summaryrefslogtreecommitdiffstats
path: root/iredis/data/commands/cluster-nodes.md
blob: 435ce2b2c0148904d8442452506d502de5e55842 (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
Each node in a Redis Cluster has its view of the current cluster configuration,
given by the set of known nodes, the state of the connection we have with such
nodes, their flags, properties and assigned slots, and so forth.

`CLUSTER NODES` provides all this information, that is, the current cluster
configuration of the node we are contacting, in a serialization format which
happens to be exactly the same as the one used by Redis Cluster itself in order
to store on disk the cluster state (however the on disk cluster state has a few
additional info appended at the end).

Note that normally clients willing to fetch the map between Cluster hash slots
and node addresses should use `CLUSTER SLOTS` instead. `CLUSTER NODES`, that
provides more information, should be used for administrative tasks, debugging,
and configuration inspections. It is also used by `redis-trib` in order to
manage a cluster.

## Serialization format

The output of the command is just a space-separated CSV string, where each line
represents a node in the cluster. The following is an example of output:

```
07c37dfeb235213a872192d90877d0cd55635b91 127.0.0.1:30004@31004 slave e7d1eecce10fd6bb5eb35b9f99a514335d9ba9ca 0 1426238317239 4 connected
67ed2db8d677e59ec4a4cefb06858cf2a1a89fa1 127.0.0.1:30002@31002 master - 0 1426238316232 2 connected 5461-10922
292f8b365bb7edb5e285caf0b7e6ddc7265d2f4f 127.0.0.1:30003@31003 master - 0 1426238318243 3 connected 10923-16383
6ec23923021cf3ffec47632106199cb7f496ce01 127.0.0.1:30005@31005 slave 67ed2db8d677e59ec4a4cefb06858cf2a1a89fa1 0 1426238316232 5 connected
824fe116063bc5fcf9f4ffd895bc17aee7731ac3 127.0.0.1:30006@31006 slave 292f8b365bb7edb5e285caf0b7e6ddc7265d2f4f 0 1426238317741 6 connected
e7d1eecce10fd6bb5eb35b9f99a514335d9ba9ca 127.0.0.1:30001@31001 myself,master - 0 0 1 connected 0-5460
```

Each line is composed of the following fields:

```
<id> <ip:port@cport> <flags> <master> <ping-sent> <pong-recv> <config-epoch> <link-state> <slot> <slot> ... <slot>
```

The meaning of each filed is the following:

1. `id`: The node ID, a 40 characters random string generated when a node is
   created and never changed again (unless `CLUSTER RESET HARD` is used).
2. `ip:port@cport`: The node address where clients should contact the node to
   run queries.
3. `flags`: A list of comma separated flags: `myself`, `master`, `slave`,
   `fail?`, `fail`, `handshake`, `noaddr`, `noflags`. Flags are explained in
   detail in the next section.
4. `master`: If the node is a replica, and the master is known, the master node
   ID, otherwise the "-" character.
5. `ping-sent`: Milliseconds unix time at which the currently active ping was
   sent, or zero if there are no pending pings.
6. `pong-recv`: Milliseconds unix time the last pong was received.
7. `config-epoch`: The configuration epoch (or version) of the current node (or
   of the current master if the node is a replica). Each time there is a
   failover, a new, unique, monotonically increasing configuration epoch is
   created. If multiple nodes claim to serve the same hash slots, the one with
   higher configuration epoch wins.
8. `link-state`: The state of the link used for the node-to-node cluster bus. We
   use this link to communicate with the node. Can be `connected` or
   `disconnected`.
9. `slot`: A hash slot number or range. Starting from argument number 9, but
   there may be up to 16384 entries in total (limit never reached). This is the
   list of hash slots served by this node. If the entry is just a number, is
   parsed as such. If it is a range, it is in the form `start-end`, and means
   that the node is responsible for all the hash slots from `start` to `end`
   including the start and end values.

Meaning of the flags (field number 3):

- `myself`: The node you are contacting.
- `master`: Node is a master.
- `slave`: Node is a replica.
- `fail?`: Node is in `PFAIL` state. Not reachable for the node you are
  contacting, but still logically reachable (not in `FAIL` state).
- `fail`: Node is in `FAIL` state. It was not reachable for multiple nodes that
  promoted the `PFAIL` state to `FAIL`.
- `handshake`: Untrusted node, we are handshaking.
- `noaddr`: No address known for this node.
- `noflags`: No flags at all.

## Notes on published config epochs

Replicas broadcast their master's config epochs (in order to get an `UPDATE`
message if they are found to be stale), so the real config epoch of the replica
(which is meaningless more or less, since they don't serve hash slots) can be
only obtained checking the node flagged as `myself`, which is the entry of the
node we are asking to generate `CLUSTER NODES` output. The other replicas epochs
reflect what they publish in heartbeat packets, which is, the configuration
epoch of the masters they are currently replicating.

## Special slot entries

Normally hash slots associated to a given node are in one of the following
formats, as already explained above:

1. Single number: 3894
2. Range: 3900-4000

However node hash slots can be in a special state, used in order to communicate
errors after a node restart (mismatch between the keys in the AOF/RDB file, and
the node hash slots configuration), or when there is a resharding operation in
progress. This two states are **importing** and **migrating**.

The meaning of the two states is explained in the Redis Specification, however
the gist of the two states is the following:

- **Importing** slots are yet not part of the nodes hash slot, there is a
  migration in progress. The node will accept queries about these slots only if
  the `ASK` command is used.
- **Migrating** slots are assigned to the node, but are being migrated to some
  other node. The node will accept queries if all the keys in the command exist
  already, otherwise it will emit what is called an **ASK redirection**, to
  force new keys creation directly in the importing node.

Importing and migrating slots are emitted in the `CLUSTER NODES` output as
follows:

- **Importing slot:** `[slot_number-<-importing_from_node_id]`
- **Migrating slot:** `[slot_number->-migrating_to_node_id]`

The following are a few examples of importing and migrating slots:

- `[93-<-292f8b365bb7edb5e285caf0b7e6ddc7265d2f4f]`
- `[1002-<-67ed2db8d677e59ec4a4cefb06858cf2a1a89fa1]`
- `[77->-e7d1eecce10fd6bb5eb35b9f99a514335d9ba9ca]`
- `[16311->-292f8b365bb7edb5e285caf0b7e6ddc7265d2f4f]`

Note that the format does not have any space, so `CLUSTER NODES` output format
is plain CSV with space as separator even when this special slots are emitted.
However a complete parser for the format should be able to handle them.

Note that:

1. Migration and importing slots are only added to the node flagged as `myself`.
   This information is local to a node, for its own slots.
2. Importing and migrating slots are provided as **additional info**. If the
   node has a given hash slot assigned, it will be also a plain number in the
   list of hash slots, so clients that don't have a clue about hash slots
   migrations can just skip this special fields.

@return

@bulk-string-reply: The serialized cluster configuration.

**A note about the word slave used in this man page and command name**: Starting
with Redis 5, if not for backward compatibility, the Redis project no longer
uses the word slave. Unfortunately in this command the word slave is part of the
protocol, so we'll be able to remove such occurrences only when this API will be
naturally deprecated.