Tutorial

Running your project

Deploying your project is as simple as copying your metadata folder to a cloud storage bucket and run any of the load / transform command from the starlake docker container running on any cloud provider.

note

Make sure you use environment variables to abstract your project from the target environment as described here

In your starlake docker container make the SL_ENV and SL_ROOT env variables are set to the correct values.

Orchestrating the ETL pipeline

To run on your orchestrator, just copy the contents of the metadta/dags/generated folder to your orchestrator's DAGs folder.