ARVENOR

Web services and data workflows

Send a signal

Reference

Glossary

Plain-English definitions of the terms we use. Type to filter.

API
Application programming interface: a defined way for one system to request data or actions from another.
Backfill
Running a workflow over historical data, for example after adding a new field.
Batch
Processing data in groups on a schedule, such as nightly.
Data contract
A written agreement on the structure and meaning of data exchanged between parties.
Data dictionary
A document describing each field: name, type, meaning and source.
De-duplication
Identifying and merging records that represent the same thing.
ETL
Extract, transform, load: collecting data, reshaping it, and delivering it.
Event-driven
Processing triggered by something happening, rather than on a schedule.
Idempotency
A property of an operation that gives the same result however many times it runs.
Ingestion
The step where data first enters a workflow.
Pseudonymisation
Replacing identifying details with codes so data cannot be linked to a person without extra information.
Quarantine
Holding invalid records aside with a reason, for review and reprocessing.
Rate limit
A cap on how many requests a service accepts in a period.
Schema drift
Unannounced changes to the structure of incoming data.
Upsert
Insert a record if it is new, or update it if it already exists.
Webhook
A message one system sends to another automatically when an event occurs.