How do I set up a self-managed Compute Server Cluster? (Step-by-Step Instructions)

This article will guide you through the installation, configuration, activation, and testing of your self-managed Compute Server cluster. Please note that this is not the recommended deployment option, as it lacks key features such as security and user management accounts, advanced monitoring capabilities, and asynchronous (batch) optimization. However, we provide these step-by-step Instructions as this type of deployment might be more convenient in some situations. The recommended deployment is to use a Cluster Manager, see How do I set up a Compute Server Cluster with a Cluster Manager? (Step-by-Step Instructions) for step-by-step instructions. For an overview on Gurobi Compute Server Clusters please refer to  How do I set up a Gurobi Compute Server Cluster? (Overview)

The figure below depicts the architecture of a self-managed Compute Server cluster. The cluster nodes are Gurobi Compute Server(s). 

These instructions are valid for Compute Server nodes running on a physical or a Virtual Machine. If you want to set up a Compute Server node using Docker or Kubernetes please see https://hub.docker.com/r/gurobi/compute. 

The instructions below assume that you want to set up k(>=1) Compute Server nodes, and use the notation cs_t for t=1,...,k, and IP_t for t=1,...,k to represent the Compute Server node t, and its IP address, respectively. 

Installation of a self-managed Compute Server Cluster

On every cluster node:

1. Install Gurobi Remote Services,
2. Install Gurobi Optimizer (full installation) or upgrade Gurobi Optimizer,
3. Retrieve and set up a Gurobi license for each node.

Set the environment variables GUROBI_HOME and GUROBI_SERVER_HOME to point to the installation directories of the Gurobi Optimizer and the Gurobi Remote Services package, respectively. This step is optional but recommended. The precise paths depend on your OS:

Configuration of a self-managed Compute Server cluster

For each Compute Server node t=1,...,k

1. Locate and open the $GUROBI_SERVER_HOME/bin/grb_rs.cnf file.
2. Change the HOSTNAME property to IP_t. Alternatively, you can set HOSTNAME to the DNS name of the node that can be resolved from the other nodes or clients in your network (see $GUROBI_SERVER_HOME/bin/grb_rs.cnf file for more details).
3. Set the PORT property. For example, you can set the port of each node to the value 60100.

Activation of a self-managed Compute Server cluster

1. Start the Compute Server cluster with the first node (cs_1) by opening a terminal and running

   grb_rs start

2. For t=2,...,k add node cs_t to the cluster by opening a terminal and running the command

   grb_rs --join=IP_1:60100

Testing your self-managed Compute Server Cluster

On a client machine with Gurobi Optimizer installed:

1. Create a Compute Server Cluster Client License (gurobi.lic) file containing a single line: COMPUTESERVER=IP_1:60100,...,IP_k:60100
2. Save the client license file to the user's home directory (e.g., ~/). If you want to place the client license file in a different location, follow the instructions in Where do I place the Gurobi license file (gurobi.lic)?

3. Open a terminal, and solve a sample model by running
    

   gurobi_cl $GUROBI_HOME/examples/data/coins.lp

   A successful test will show an output similar to 

Set parameter ComputeServer to value "IP_1:60100,IP_2:60100,...,IP_k:60100"
Set parameter LogFile to value "gurobi.log"
Using license file <PATH/TO/CLIENT/LICENSE/FILE>
Compute Server job ID: 70572e6e-b798-4b2c-b852-cfb33d3e252c
Capacity available on 'IP_2:60100' - connecting...
Established HTTP unencrypted connection
[...]

Advanced Configuration Options

This article provided a simple setup of a working Gurobi Compute Server cluster. Starting with a working Gurobi Compute Server cluster, we encourage users to explore and test various configurations for their specific needs, ranging from starting a Compute Server as a service to configuring an enterprise-grade Compute Server cluster with LDAP integration, high availability, failover, and more. The Gurobi Optimizer Reference Manual and Gurobi Remote Services document the configuration options and details.

Further Information

• How do I set up a Gurobi Compute Server Cluster? (Overview)
• Gurobi Installation Navigator
• Gurobi Remote Services
• How do I set up a Compute Server Cluster with a Cluster Manager? (Step-by-Step Instructions)
• Compute Server on Docker and Kubernetes