Differences between revisions 26 and 50 (spanning 24 versions)

Redis

Redis is an in memory data structure storage. It will be used to share PHP-sessions between the apache servers. To guarantee a robust deployment three redis servers will be configured.

192.168.1.58 redis (virtual IP-address)
192.168.1.59 redis01 (master)
192.168.1.60 redis02 (replica)
192.168.1.61 redis03 (replica)

Software

apt-get install redis-server redis-sentinel

Configuration

Redis Server

Change the contents of the redis configuration file in /etc/redis/redis.conf.

Add the IP-address for each of the servers. Each of the redis servers needs to listen on its own IP-address. Make sure to add its IP-address in the beginning on the line. (running as a cluster currently requires this due to a bug, so we will do this although we are not setting up a cluster).

bind 192.168.1.59 127.0.0.1

Enable redis to listen on the network, instead of only listening on the loopback device.

protected-mode no

For better dataintegrity enable this.

appendonly yes

Now restart the redis master

service redis-server restart

And stop the replicas

service redis-server stop

On each of the replicas, set them up af a replica of the master

slaveof 192.168.1.59 6379

Start the replicas again

services redis-server start

You should now be able to see the replicas from the master redis-cli -h 192.168.1.59.

192.168.1.59:6379> info replication
# Replication
role:master
connected_slaves:2
slave0:ip=192.168.1.60,port=6379,state=online,offset=2615,lag=0
slave1:ip=192.168.1.61,port=6379,state=online,offset=2615,lag=1
master_replid:79a21f08669303e71990ea8819830f30c94384c6
master_replid2:0000000000000000000000000000000000000000
master_repl_offset:2615
second_repl_offset:-1
repl_backlog_active:1
repl_backlog_size:1048576
repl_backlog_first_byte_offset:1
repl_backlog_histlen:2615

Redis Sentinel

Change the contents of the redis configuration file in /etc/redis/sentinel.conf.

Add the IP-address for each of the servers. Each of the redis servers needs to listen on its own IP-address.

bind 192.168.1.59 127.0.0.1 ::1

Configure each of the hosts to monitor the master redis server, and at least 2 sentinels should agree to change the master

sentinel monitor redis01 192.168.1.59 6379 2

Set the time the redis master can be down

sentinel down-after-milliseconds redis01 5000

Finally set the timeout before the failover happens

sentinel failover-timeout redis01 30000

And finally

sentinel parallel-syncs redis01 1

-  ⇤ ← Revision 26 as of 2021-01-02 01:50:18 → 
  Size: 2611
  Editor: Kristian Kallenberg
  Comment:
+   ← Revision 50 as of 2021-01-08 21:36:51 → ⇥
  Size: 3710
  Editor: Kristian Kallenberg
  Comment:
-Deletions are marked like this.
+Additions are marked like this.
 Line 1:
-DISCLAIMER
THIS ONLY WORKS IN BUSTER
INCOMPLETE DO NOT USE
-Line 9:
+Line 5:
- * 192.168.1.59 redis01
 * 192.168.1.60 redis02
 * 192.168.1.61 redis03
+ * 192.168.1.58 redis (virtual IP-address)
 * 192.168.1.59 redis01 (master)
 * 192.168.1.60 redis02 (replica)
 * 192.168.1.61 redis03 (replica)
-Line 16:
+Line 13:
-apt-get install redis-server
+apt-get install redis-server redis-sentinel
-Line 25:
+Line 22:
-Add the IP-address for each of the servers. Each of the redis servers needs to listen on its own IP-address. Due to a bug in redis, the added IP-address will have to be in the beginning of the line, right next to `bind`. If the IP-address is added in the end of the line, then the cluster will not initialize itself, and a `Waiting for the cluster to join...` message will continuously write dots.
+Add the IP-address for each of the servers. Each of the redis servers needs to listen on its own IP-address. Make sure to add its IP-address in the beginning on the line. (running as a cluster currently requires this due to a bug, so we will do this although we are not setting up a cluster).
-Line 27:
+Line 24:
-bind 192.168.1.58 127.0.0.1 ::1
+bind 192.168.1.59 127.0.0.1
-Line 29:
+Line 26:
-Line 36:
+Line 32:
-Redis stores its data in memory only, hence its speed. To make sure redis does not loose its state, in case of a hardware failure, this will enable it to store the state as it changes in a file on disk.
+For better dataintegrity enable this.
-Line 41:
+Line 37:
-Activate redis cluster features
{{{
cluster-enabled yes
cluster-config-file nodes-6379.conf
cluster-node-timeout 15000
}}}

Restart redis on all hosts.
+Now restart the redis master
-Line 53:
+Line 42:
-Next we will need to configure the servers to run as a cluster
+And stop the replicas
-Line 55:
+Line 44:
-redis-cli --cluster create 192.168.1.59:6379 192.168.1.60:6379 192.168.1.61:6379
+service redis-server stop
}}}

On each of the replicas, set them up af a replica of the master
{{{
slaveof 192.168.1.59 6379
}}}

Start the replicas again
{{{
services redis-server start
}}}

You should now be able to see the replicas from the master `redis-cli -h 192.168.1.59`.
{{{
192.168.1.59:6379> info replication
# Replication
role:master
connected_slaves:2
slave0:ip=192.168.1.60,port=6379,state=online,offset=2615,lag=0
slave1:ip=192.168.1.61,port=6379,state=online,offset=2615,lag=1
master_replid:79a21f08669303e71990ea8819830f30c94384c6
master_replid2:0000000000000000000000000000000000000000
master_repl_offset:2615
second_repl_offset:-1
repl_backlog_active:1
repl_backlog_size:1048576
repl_backlog_first_byte_offset:1
repl_backlog_histlen:2615
}}}

=== Redis Sentinel ===

Change the contents of the redis configuration file in `/etc/redis/sentinel.conf`.

Add the IP-address for each of the servers. Each of the redis servers needs to listen on its own IP-address.
{{{
bind 192.168.1.59 127.0.0.1 ::1
}}}

Configure each of the hosts to monitor the master redis server, and at least 2 sentinels should agree to change the master
{{{
sentinel monitor redis01 192.168.1.59 6379 2
}}}

Set the time the redis master can be down
{{{
sentinel down-after-milliseconds redis01 5000
}}}

Finally set the timeout before the failover happens
{{{
sentinel failover-timeout redis01 30000
}}}

And finally
{{{
sentinel parallel-syncs redis01 1
-Line 71:
+Line 117:
+ * https://www.willandskill.se/en/setup-a-highly-available-redis-cluster-with-sentinel-and-haproxy/

Redis

Software

Configuration

Redis Server

Redis Sentinel

References