Skip to content
Free public beta until December 4, 2026: every course is open, no card needed. After that, the first chapter of each course stays free and full access is a one-time $39 ($19 for up to 100 founding members chosen for helpful feedback). Your progress is kept. How the beta works

ingestion

Taking messages off the broker, checking them and writing them into storage.

Ingestion is the pipeline stage that consumes incoming messages, validates and normalises them, de-duplicates and batches them, and writes them to a store.

Examples

  • The greenhouse ingest consumer subscribes to gh1/+/telemetry/climate at QoS 1, rejects a reading like "temp_c": "warm", and stores good ones with INSERT OR IGNORE keyed on (device_id, msg_id).

See also

batching message contract idempotent at-least-once delivery
Read the full section →