Reference
Glossary
Plain-English definitions of the terms we use. Type to filter.
- API
- Application programming interface: a defined way for one system to request data or actions from another.
- Backfill
- Running a workflow over historical data, for example after adding a new field.
- Batch
- Processing data in groups on a schedule, such as nightly.
- Data contract
- A written agreement on the structure and meaning of data exchanged between parties.
- Data dictionary
- A document describing each field: name, type, meaning and source.
- De-duplication
- Identifying and merging records that represent the same thing.
- ETL
- Extract, transform, load: collecting data, reshaping it, and delivering it.
- Event-driven
- Processing triggered by something happening, rather than on a schedule.
- Idempotency
- A property of an operation that gives the same result however many times it runs.
- Ingestion
- The step where data first enters a workflow.
- Pseudonymisation
- Replacing identifying details with codes so data cannot be linked to a person without extra information.
- Quarantine
- Holding invalid records aside with a reason, for review and reprocessing.
- Rate limit
- A cap on how many requests a service accepts in a period.
- Schema drift
- Unannounced changes to the structure of incoming data.
- Upsert
- Insert a record if it is new, or update it if it already exists.
- Webhook
- A message one system sends to another automatically when an event occurs.
No matching terms. Try a shorter word, or ask us.