You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This repository contains a sample project using CML with DVC to push/pull data from cloud storage and track model metrics. When a pull request is made in this repository, the following will occur:
GitHub will deploy a runner machine with a specified CML Docker environment
DVC will pull data from cloud storage
The runner will execute a workflow to train a ML model (python train.py)
A visual CML report about the model performance with DVC metrics will be returned as a comment in the pull request
The key file enabling these actions is .github/workflows/cml.yaml.
Secrets and environmental variables
In this example, .github/workflows/cml.yaml contains three environmental variables that are stored as repository secrets.
Secret
Description
GITHUB_TOKEN
This is set by default in every GitHub repository. It does not need to be manually added.
AWS_ACCESS_KEY_ID
AWS credential for accessing S3 storage
AWS_SECRET_ACCESS_KEY
AWS credential for accessing S3 storage
AWS_SESSION_TOKEN
Optional AWS credential for accessing S3 storage (if MFA is enabled)
DVC works with many kinds of remote storage. To configure this example for a different cloud storage provider, see our documentation on the CML repository.
Cloning this project
Note that if you clone this project, you will have to configure your own DVC storage and credentials for the example. We suggest the following procedure:
Fork the repository and clone to your local workstation.
Run python get_data.py to generate your own copy of the dataset. After initializing DVC in the project directory and configuring your remote storage, run dvc add data and dvc push to push your dataset to remote storage.
git add, commit and push to push your DVC configuration to GitHub.
Add your storage credentials as repository secrets.
Copy the workflow file .github/workflows/cml.yaml from this repository to your fork. By default, workflow files are not copied in forks. When you commit this file to your repository, the first workflow should be initiated.