Infra setup to run reinforcement learning baselines in a cloud deployment.

1. Create GCP instances to run the experiments

bash ./scripts/gcp-create-instances.sh

2. Set up ansible inventory file. Example for GCP below

plugin: gcp_compute
projects:
  - projectname
auth_kind: serviceaccount
groups:
  rl: true
filters:
  - 'labels.algo = ppo'
  - any filters you may want
service_account_file: /home/yourdir/gcp/serviceaccount.json

3. Install ansible galaxy roles

ansible-galaxy install geerlingguy.docker geerlingguy.pip

4. Change ansible vault file to contain proper MongoDB login information for your database

5. Set up experiment environment on all machines

bash ./scripts/ansible-full-setup.sh

6. Start running the experiments

bash ./scripts/ansible-run-experiments.sh