Process Data

Utility functions for processing data sets

Component key: process-data

Description#

The Process Data component provides functions for processing data sets.

Actions#

Deduplicate#

Takes a sorted descending list of objects and a list of field names to use as identifiers and returns the list of objects that have not been previously processed | key: deDuplicate

InputKeyNotesExample

Data

data
/ Required
dataInputThis is the dataset that will be operated on
[
{
"id": "123",
"firstname": "John",
"lastname": "Smith"
},
{
"id": "122",
"firstname": "Jimmy",
"lastname": "Popadopoulos"
},
{
"id": "121",
"firstname": "Sally",
"lastname": "Smith"
}
]

Key Field Names

string
/ Required
keyFieldNamesInputThe names of the fields in each item of the collection to use as a unique identifier
[
"id",
"lastname"
]

Output Example Payload#

{
"data": [
{
"id": "123",
"lastname": "Smith",
"firstname": "John"
},
{
"id": "122",
"lastname": "Popadopoulos",
"firstname": "Jimmy"
}
]
}