blob: 6da14c44f3f2516d1691b0d802d10560604af4f4 (
plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
|
<!--
title: "Export metrics to Google Cloud Pub/Sub Service"
description: "Export Netdata metrics to the Google Cloud Pub/Sub Service for long-term archiving or analytical processing."
custom_edit_url: https://github.com/netdata/netdata/edit/master/exporting/pubsub/README.md
sidebar_label: Google Cloud Pub/Sub Service
-->
# Export metrics to Google Cloud Pub/Sub Service
## Prerequisites
To use the Pub/Sub service for metric collecting and processing, you should first
[install](https://github.com/googleapis/cpp-cmakefiles) Google Cloud Platform C++ Proto Libraries.
Pub/Sub support is also dependent on the dependencies of those libraries, like `protobuf`, `protoc`, and `grpc`. Next,
Netdata should be re-installed from the source. The installer will detect that the required libraries are now available.
> You [cannot compile Netdata](https://github.com/netdata/netdata/issues/10193) with Pub/Sub support enabled using
> `grpc` 1.32 or higher.
>
> Some distributions don't have `.cmake` files in packages. To build the C++ Proto Libraries on such distributions we
> advise you to delete `protobuf`, `protoc`, and `grpc` related packages and
> [install](https://github.com/grpc/grpc/blob/master/BUILDING.md) `grpc` with its dependencies from source.
## Configuration
To enable data sending to the Pub/Sub service, run `./edit-config exporting.conf` in the Netdata configuration directory
and set the following options:
```conf
[pubsub:my_instance]
enabled = yes
destination = pubsub.googleapis.com
credentials file = /etc/netdata/google_cloud_credentials.json
project id = my_project
topic id = my_topic
```
Set the `destination` option to a Pub/Sub service endpoint. `pubsub.googleapis.com` is the default one.
Next, create the credentials JSON file by following Google Cloud's [authentication guide](https://cloud.google.com/docs/authentication/getting-started#creating_a_service_account). The user running the Agent
(typically `netdata`) needs read access to `google_cloud_credentials.json`, which you can set with
`chmod 400 google_cloud_credentials.json; chown netdata google_cloud_credentials.json`. Set the `credentials file`
option to the full path of the file.
[](<>)
|
