An easy-to-use MLflow platform to track experiments, flexible more users.
Blogged (Japanese): https://cyberagent.ai/blog/research/15272/
Software | Install (Mac) |
---|---|
Python 3.8.10 | pyenv install 3.8.10 |
Poetry 1.1.* | curl -sSL https://raw.githubusercontent.com/python-poetry/poetry/master/get-poetry.py | python |
direnv | brew install direnv |
jq | brew install jq |
Docker | brew cask install docker |
Google Cloud SDK | https://cloud.google.com/sdk/docs/quickstart-macos/ |
Terraform | brew tap hashicorp/tap && brew install hashicorp/tap/terraform |
- Declare the environment variables
cp .env.example .env
vi .env
=====================
GCP_PROJECT=YOUR_GCP_PROJECT
GOOGLE_APPLICATION_CREDENTIALS=/path/to/gcp-terraform-credentials.json
TF_GCS_BUCKET=YOUR_PREFIX-tfstate
MLFLOW_GCS_BUCKET=YOUR_PREFIX-mlflow-k8s
MLFLOW_DOMAIN=YOUR_MLFLOW_DOMAIN
MLFLOW_TRACKING_URI=https://${MLFLOW_DOMAIN}/user1/
SERVICE_ACCOUNT_EMAIL=mlflow-k8s@${GCP_PROJECT}.iam.gserviceaccount.com
direnv allow .
- Replace the variables in .tf file for you
make tf
- Initialize the bucket for terraform
make bucket
- Run terraform
cd infra
terraform init
terraform apply
- Check your launched server accessible via Cloud IAP
cd ..
make access