Daily data quality gate

Load a product usage extract, profile it, and stop the pipeline when the data is wrong — blanks, duplicates, out-of-range values, and a total that drifts from history.

BeginnerAbout 10 minutesSchedule: Every day at 07:00Sample files: usage_events.csv

What it teaches

Quality check rules
Anomaly detection
Failure alerts
Results tab warnings

Try it

In Datronome, open Learn and choose Examples.
Install Daily data quality gate.
Press Run now and open the Results tab.

Learn more

3. Catch the 10,000-instead-of-1,000 mistake in the Analytics guide
3. Gates, alerts and what to do at 3 a.m. in the Data engineering guide

The steps

Load usage events Move a file
Brings usage_events.csv into the run.

Gate: is the extract sane? Quality check

rows >= 100
not_null: event_id, account_id, feature
unique: event_id
numeric: users
range: users 1 500
allowed: feature reports, dashboards, exports, api
anomaly: users

Publish clean extract Move a file
Saves usage_events.csv to Files, date-stamped.

Watch it

Daily data quality gate · 1:08 · narrated, with captions · open the video file

More data engineering examples

Morning data guardrail: Check the overnight payments extract every morning and get the numbers by email: row count against the usual, which regions or plans moved, blanks that appeared — even when every rule passes.
Fix it before you schedule it: A pipeline whose SQL has a mistake in it. Use Try it on the query step to see the error, fix it, try again, and only then run the whole pipeline. Nothing is scheduled until you say so.
Turn a billing inbox into a table: Works offline: sample messages in exactly the shape the Read-a-mailbox task produces. Filter the payment processor's daily payout reports, count what arrived, and check none are missing. Swap the first step for a real mailbox connection when you are ready.
Warehouse query to Excel report: Query your warehouse on a schedule, check the result, and drop an Excel file on a shared drive every morning. Uses a connection you set up in Settings.
See what a pipeline costs: A deliberately heavier calculation so Usage & cost has something to show: machine time, peak memory and rows produced for each step. Run it a few times, then open Settings → Usage & cost.

Run it on your own computer

Every example installs with its sample data in one click. Already have Datronome? Open Learn, then Examples.

Download for Windows