Step 2: Configure Shared Local Storage

Install GlusterFS

On each Enterprise ColumnStore node, install GlusterFS.

Install on CentOS / RHEL 8 (YUM):

$ sudo yum install --enablerepo=PowerTools glusterfs-server

Install on CentOS / RHEL 7 (YUM):

$ sudo yum install centos-release-gluster

$ sudo yum install glusterfs-server

Install on Debian (APT):

$ wget -O - https://download.gluster.org/pub/gluster/glusterfs/LATEST/rsa.pub | apt-key add -

$ DEBID=$(grep 'VERSION_ID=' /etc/os-release | cut -d '=' -f 2 | tr -d '"')
$ DEBVER=$(grep 'VERSION=' /etc/os-release | grep -Eo '[a-z]+')
$ DEBARCH=$(dpkg --print-architecture)
$ echo deb https://download.gluster.org/pub/gluster/glusterfs/LATEST/Debian/${DEBID}/${DEBARCH}/apt ${DEBVER} main > /etc/apt/sources.list.d/gluster.list

$ sudo apt update

$ sudo apt install glusterfs-server

Install on Ubuntu (APT):

$ sudo apt update

$ sudo apt install glusterfs-server

Start the GlusterFS Daemon

Start the GlusterFS daemon:

$ sudo systemctl start glusterd

$ sudo systemctl enable glusterd

Probe the GlusterFS Peers

Before you can create a volume with GlusterFS, you must probe each node from a peer node.

1. On the primary node, probe all of the other cluster nodes:

   $ sudo gluster peer probe mcs2
   

   $ sudo gluster peer probe mcs3
   

2. On one of the replica nodes, probe the primary node to confirm that it is connected:

   $ sudo gluster peer probe mcs1
   

   peer probe: Host mcs1 port 24007 already in peer list
   

3. On the primary node, check the peer status:

   $ sudo gluster peer status
   

   Number of Peers: 2
   
   Hostname: mcs2
   Uuid: 3c8a5c79-22de-45df-9034-8ae624b7b23e
   State: Peer in Cluster (Connected)
   
   Hostname: mcs3
   Uuid: 862af7b2-bb5e-4b1c-8311-630fa32ed451
   State: Peer in Cluster (Connected)
   

Configure and Mount GlusterFS Volumes

Create the GlusterFS volumes for MariaDB Enterprise ColumnStore. Each volume must have the same number of replicas as the number of Enterprise ColumnStore nodes.

1. On each Enterprise ColumnStore node, create the directories for each brick in the /brick directory:

   $ sudo mkdir -p /brick/data1
   

   $ sudo mkdir -p /brick/data2
   

   $ sudo mkdir -p /brick/data3
   

2. On the primary node, create the GlusterFS volumes:

   $ sudo gluster volume create data1 \
         replica 3 \
         mcs1:/brick/data1 \
         mcs2:/brick/data1 \
         mcs3:/brick/data1 \
         force
   

   $ sudo gluster volume create data2 \
         replica 3 \
         mcs1:/brick/data2 \
         mcs2:/brick/data2 \
         mcs3:/brick/data2 \
         force
   

   $ sudo gluster volume create data3 \
         replica 3 \
         mcs1:/brick/data3 \
         mcs2:/brick/data3 \
         mcs3:/brick/data3 \
         force
   

3. On the primary node, start the volumes:

   $ sudo gluster volume start data1
   

   $ sudo gluster volume start data2
   

   $ sudo gluster volume start data3
   

4. On each Enterprise ColumnStore node, create mount points for the volumes:

   $ sudo mkdir -p /var/lib/columnstore/data1
   

   $ sudo mkdir -p /var/lib/columnstore/data2
   

   $ sudo mkdir -p /var/lib/columnstore/data3
   

5. On each Enterprise ColumnStore node, add the mount points to /etc/fstab:

   127.0.0.1:data1 /var/lib/columnstore/data1 glusterfs defaults,_netdev 0 0
   127.0.0.1:data2 /var/lib/columnstore/data2 glusterfs defaults,_netdev 0 0
   127.0.0.1:data3 /var/lib/columnstore/data3 glusterfs defaults,_netdev 0 0
   

6. On each Enterprise ColumnStore node, mount the volumes:

   $ sudo mount -a