▸▸Data Pipeline Automation
OPERATIONAL · LAST RUN 08:00 UTC

Dashboard

Pipeline health at a glance — run history, throughput, durations and quality over the last 30 days, plus what needs attention right now.

Connected feeds
14
across 7 source systems
Runs per day
4
every 6 hours, UTC
Success rate
99.2%
last 30 days
Avg run time
12m 40s
▾ 9% vs April
01

Monitoring

Every run is recorded. These charts cover the last 30 days — May 12 to June 10, 2026.

Run status history

30 DAYS · 4 RUNS/DAY

Outcome of each scheduled run, stacked per day.

Success Warning Failed

Rows processed per day

30 DAYS

Total rows ingested across all 14 feeds. Weekend dips are expected.

Rows ingested

Run duration by stage

30 DAYS · MINUTES

Average time per stage per day. Ingest dominates; the May 30 spike was a backfill.

Fetch Ingest Refresh Submit

Data quality checks

LAST RUN

Validation gates applied during ingest. Rows failing a gate are quarantined for review.

Schema validation99.8%
Row completeness98.6%
Uniqueness (no duplicates)99.9%
Referential integrity100%
Source freshness < 24h96.7%
02

Status & reports

What to check day-to-day: the latest runs, the health of each source, open alerts, and whether we hit our service-level targets.

Recent runs

ALL TIMES UTC
RunTriggerStartedDurationRowsStatus
#2026.06.10-08ScheduledJun 10 · 08:0012m 18s561,204SUCCESS
#2026.06.10-02ScheduledJun 10 · 02:0013m 02s548,917SUCCESS
#2026.06.09-20ScheduledJun 09 · 20:0012m 44s552,338SUCCESS
#2026.06.09-14ScheduledJun 09 · 14:0014m 51s560,112WARNING
#2026.06.09-08ScheduledJun 09 · 08:0012m 09s555,876SUCCESS
#2026.06.09-02ScheduledJun 09 · 02:0012m 31s549,452SUCCESS
#2026.06.08-20ManualJun 08 · 21:1211m 58s12,408SUCCESS
#2026.06.08-20ScheduledJun 08 · 20:0006m 12sFAILED

Source health

LIVE
ERP · PostgreSQLsynced 22 min ago
Finance · SQL Serversynced 22 min ago
CRM · MySQLsynced 23 min ago
Budget workbooks · Excel1 file pending
Partner exports · SFTPsynced 24 min ago
Market prices · Scrapersynced 25 min ago
FX rates · APIsynced 25 min ago

Alerts

1 OPEN
Budget workbook missing tab “FY26-Q3”
File skipped; previous version used. Owner notified.
TODAY 08:14
FX rates API timeout — resolved
Run #2026.06.08-20 failed at fetch; manual retry succeeded.
JUN 08
Schema drift on CRM — auto-mapped
New column lead_source_v2 detected and mapped.
JUN 03

SLA · last 30 days

Warehouse refreshedby 07:00 UTC29 / 30
Reports liveby 08:00 UTC30 / 30
Submission filedby 17:00 UTC30 / 30
Source freshness< 24 hours28 / 30