Multi-node deployment

A multi-node deployment allows you to run CLP across a distributed set of hosts.

Warning

CLP now uses Docker Compose for orchestration and support for multi-node deployments has been removed temporarily. Please contact us if you need immediate support for multi-node deployments, or stay tuned for future updates on Kubernetes Helm support.

Setting up SeaweedFS

The instructions below are for running a simple SeaweedFS cluster on a set of hosts. For other use cases, see the SeaweedFS docs.

1. Install SeaweedFS.

2. Start the master and a filer on one of the hosts:

   weed master -port 9333
   weed filer -port 8888 -master "localhost:9333"
   

3. Start one or more volume servers on one or more hosts.

   1. Create a directory where you want SeaweedFS to store data.

   2. Start the volume server:

      weed volume -mserver "<master-host>:9333" -dir <storage-dir> -max 0
      

      • <master-host> is the hostname/IP of the master host.

      • <storage-dir> is the directory where you want SeaweedFS to store data.

4. Start a FUSE mount on every host that you want to run a CLP worker:

   weed mount -filer "<master-host>:8888" -dir <mount-path>
   

   • <master-host> is the hostname/IP of the master host.

   • <mount-path> is the path where you want the mount to be.