Process Data Component
Process data sets
Component key: process-data
Description
The process data component allows your integrations to "remember" what data they have processed, so they don't process the same data over and over. The deduplicate action tracks the data that is processed each execution, and returns only items that it didn't previously process.
Actions
Deduplicate
Takes a sorted descending list of objects and a list of field names to use as identifiers and returns the list of objects that have not been previously processed | key: deDuplicate
Input | Notes | Example |
---|---|---|
Data code / Required dataInput | This is the dataset that will be operated on | |
Key Field Names string / Required Value List keyFieldNamesInput | The names of the fields in each item of the collection to use as a unique identifier | lastname |
Example Payload for Deduplicate
Example Payload for Deduplicate
{
"data": [
{
"id": "123",
"firstname": "John",
"lastname": "Smith"
},
{
"id": "122",
"firstname": "Jimmy",
"lastname": "Popadopoulos"
}
],
"instanceState": {}
}