Example Meltano Projects

If you have a production project that you’d like to add please open a Pull Request.

We group example projects into three categories:

1. Running in production
2. Simpler examples usually solving one problem
3. Complete sandbox projects to play around with

1. Running in production #

The following Meltano projects are real-world examples of Meltano in production use. If you’re about to launch your pipelines into your own production environment or want to take a look at how others organize their projects, these projects are a great place to start.

• Meltano Squared - This is the project the Meltano team uses to manage their Meltano instance. Meltano Squared is quite comprehensive running on kubernetes, leveraging multiple yaml files, environments, plugin inheritance, Great Expectations, SQLFluff, dbt, Airflow and Superset.
• GitLab Data Meltano - This is the project GitLab uses to manage Meltano.

2. Simple Meltano example projects #

The following Meltano projects are designed to illustrate a solution to one problem, like how to add SQLFluff as dbt linter. If you’re looking for hints on a specific problem, go through this list.

• Meltano & SQLFluff for dbt - A simple project setting up SQLFluff via meltano as a linter for dbt (also via Meltano).
• Data Stack 4 Fun & Nonprofits - A larger setup accompanied by a tutorial series setting up Meltano, Gitpod, dbt and superset.
• Meltano Getting Started Project - If you follow the getting started doc part, this will be the resulting Meltano project.
• Advanced dbt orchestration with Meltano + Airflow - A self-contained Meltano project using Airflow to orchestrate a variation of the dbt jaffle shop project using tap-csv along with an experimental Airflow DAG generator that translates each dbt model into a Airflow task in your DAG, for finer grain control. There also is a video demonstrating this dbt & Airflow project in action.

3. Sandbox projects #

The following projects are beginner projects with mocks, local CSVs, local databases to make them self-contained. A great place to peek into if you want to see Meltano projects in action for the first time and play around with basic functionality like extracting a CSV and loading it into a database.

• Meltano Dbt Jaffle shop - The dbt jaffle shop project placed in a meltano context, with local postgres, completely self-contained.
• Meltano Extract Load Example - A simple AWS S3 CSV extract and load into a PostgreSQL database. All mocked and completely self-contained.
• Meltano DB -> DB Example - A simple extract from a Postgres database and load into a second Postgres database. All mocked and completely self-contained.