MMDSolutionsPython ETL Starter Kit

Validate. Load. Run again.

A repeatable pipeline.
A visible audit trail.

A real CSV-to-SQLite Python starter with validation, quarantine and idempotent upserts. No third-party Python packages.

Example report viewer

This page displays a saved result from running the supplied sample. It does not execute Python or process your files. Download the starter and follow the guide to run it locally with Python 3.11+.


        

Run the actual project

python -m unittest discover -s tests -v
python -m etl --source examples/orders.csv --database data/orders.sqlite3 --output output

The fictional sample has two valid orders and two intentionally invalid records. Exit code 2 flags quarantine; a repeat run leaves existing orders unchanged.

Includes source, sample data, tests, a guide, Docker and CI templates. Adapt the schema and add your own deployment, monitoring and backup controls before production use.