Writing Custom Components

Prismatic is extensible and allows for developer users to develop their own custom components. Components that Prismatic users develop are proprietary to their organization, and are private.

Sample component code is referenced throughout this page.

For a sample component that wraps an HTTP-based API, see our quickstart on Wrapping an API in a Component.

Custom component library#

Prismatic provides a NodeJS package, @prismatic-io/spectral, which provides TypeScript typing and some utility functions. Source code for Spectral is available on github.

For information on Spectral's utility functions and types, see our custom component library docs.

NodeJS Version Support: While many versions of NodeJS may work for component development, we recommend using the latest LTS (long-term support) version of NodeJS. You can find the latest LTS version on the NodeJS download page.

Initializing a new component#

To initialize a new project, run prism components:init {{ COMPONENT NAME }}. If you do not have Prismatic's CLI tool, prism, installed, please take a moment to look through the Prism overview page.

prism components:init format-name

Your component name must be comprised of alphanumeric characters, hyphens, and underscores, and start and end with alphanumeric characters. You will be prompted with a couple of questions - to give a description for your component and to determine what connection authorization type should be templated (you can edit those later).

This will create a directory structure that looks like this:

format-name├── assets│   └── icon.png├── jest.config.js├── package.json├── src│   ├── actions.ts│   ├── client.ts│   ├── connections.ts│   ├── index.test.ts│   ├── index.ts│   └── triggers.ts├── tsconfig.json└── webpack.config.js

assets/icon.png is the icon that will be displayed next to your component. Square transparent PNGs at least 128 x 128 pixels in size look best, and will be scaled by the web app appropriately.
jest.config.js contains configuration for the Jest testing framework.
package.json is a standard node package definition file.
src/actions.ts contains your component's actions. This can be broken out in to distinct files as your code grows.
src/client.ts contains a shared "client". This is handy for actions that share a mechanism for connecting to an API. The "client" will probably be an authenticated HTTP client that's configured to make requests of a particular endpoint.
src/connections.ts contains the connections that your component uses to authenticate with third-party APIs.
src/index.test.ts contains tests for component's actions. See Unit Testing Custom Components.
src/index.ts contains your component definition.
src/triggers.ts contains custom triggers.
tsconfig.json contains configuration for TypeScript.
webpack.config.js contains configuration for Webpack.

Custom components from WSDLs or OpenAPI specs#

Third-party apps and services often provide APIs with hundreds of RESTful endpoints. It would be tedious to manually write actions for each individual endpoint. Luckily, many companies also provide an API specification - commonly a Web Service Definition Language (WSDL) file, or an OpenAPI (Swagger) specification.

You can generate a custom component from a WSDL file with prism by passing the --wsdl-path flag to the components:init subcommand:

prism components:init myThirdPartyComponent --wsdl-path ./thirdPartySpec.wsdl

You can generate a custom component from an OpenAPI definition (you can use a YAML or JSON file - both work fine) with prism by passing the --open-api-path flag to the components:init subcommand:

prism components:init myThirdPartyComponent --open-api-path ./third-party-openapi-spec.json

The custom component code that is generated may require some tweaking - some APIs have undocumented required headers, or irregular authentication schemes (so you may need to touch up src/client.ts or src/connection.ts). But, this does give you a great jumping-off point when building a custom component for a third-party app.

Writing actions#

A component is comprised of zero, one or many actions. For example, the HTTP component contains actions to GET (httpGet), POST (httpPost), etc.

An action has three required properties and one optional one:

Information on how the web app display the action
A function to perform
A series of input fields

const myAction = action({  display: {    label: "Brief Description",    description: "Longer description to display in web app UI",  },  perform: async (context, params) => {},  inputs: { inputFieldOne, inputFieldTwo },});

Adding inputs#

Components can take inputs. Each input is comprised of a required label, and type and optional placeholder, default, comments, required and model.

Consider this example input:

const middleName = input({  label: "Middle Name",  placeholder: "Middle name of a person",  type: "string",  required: false,  default: "",  comments: "Leave blank if the user has no middle name",});

This contributes to an input prompt that looks like this:

Step Config - Properly Format Name in Prismatic app

Note where the label and placeholder text appeared in the web app, and note that First Name and Last Name are required - indicated with a *, but Middle Name is not.

Cleaning inputs#

An input of an action can be anything - a number, string, boolean, JavaScript Buffer, a complex object with lots of properties, etc. If you reuse an input for multiple actions, it's handy to do some preprocessing and type conversion on the input. That's where a clean function on an input comes in.

For example, suppose you expect an input to be a number. But, inputs by default are presented to perform functions as strings. You can leverage the util.types.toNumber() utility function and clean property to ensure that the input is presented to the perform function as a number:

Ensure input is a number

const serverPortInput = input({  label: "Server Port",  placeholder: "The port of the API server",  comments: "Look for the number after the colon (my-server.com:3000)"  type: "string",  default: "3000",  required: true,  clean: (value) => util.types.toNumber(value),});

You can also add validation to the input. For example, if you want to validate that the input is an IPv4 IP address, you can build a more complex clean function:

Validate that an input is an IP address

const validateIpAddress = (value: unknown) => {  const ipAddressRegex = /^(?:(?:2(?:[0-4][0-9]|5[0-5])|[0-1]?[0-9]?[0-9])\.){3}(?:(?:2([0-4][0-9]|5[0-5])|[0-1]?[0-9]?[0-9]))$/;  const inputValue = util.types.toString(value);  if (!ipAddressRegex.test(inputValue)) {    throw new Error(`The value "${inputValue}" is not a valid IP address`);  }  return inputValue;};
const ipAddressInput = input({  label: "IP Address",  placeholder: "Server IP Address",  type: "string",  default: "192.168.1.1",  required: true,  clean: validateIpAddress,});

Action input types#

An input can take a number of types, which affects how the input renders in the Prismatic web app:

string will allow users to input or reference a string of characters.
password will allow users to input or reference a string of characters, and the string will be obfuscated in the UI.
text is similar to string, but allows for multi-line input.
boolean allows users to enter one of two values: true or false.
code opens a code editor so users can enter XML, HTML, JSON, etc. Syntax highlighting can be added to a code input's definition and can reference any language supported by PrismJS. (e.g. input({ label: "My Code", type: "code", language: "json" }))
conditional allows users to enter a series of logical conditionals. This is most notably used in the branch component.

You can also create connection inputs for actions. Read more about connections below.

Dropdown menu inputs#

Rather than allowing integration builders to enter values for an input, you might want to have users choose a value from a list of possible values. You can do that by making your input into a dropdown menu.

To create an input with a dropdown menu, add a model property to your input:

export const acmeEnvironment = input({  label: "Acme Inc Environment to Use",  placeholder: "ACME Environment",  type: "string",  required: true,  model: [    {      label: "Production",      value: "https://api.acme.com/",    },    {      label: "Staging",      value: "https://staging.acme.com/api",    },    {      label: "Sandbox",      value: "https://sandbox.acme.com/api",    },  ],});

The model property should be an array of objects, with each object containing a label and a value. The label is shown in the dropdown menu. The value is passed in as the input's value to the custom component.

Collection inputs#

Most inputs represent single strings. A collection input, on the other hand, represents an array of values or key-value pairs. Collections are handy when you don't know how many items a component user might need.

Value list collection#

For example, your component might require an array of record to query, but you might not know how many record IDs a component user will enter. You can create a valuelist collection in code like this:

Value List Collection Example

const recordIdsInputField = input({  label: "Record ID",  type: "string",  collection: "valuelist",  required: true,});

The corresponding UI in the integration designer would then prompt a user for any number of record IDs that they would like to enter:

When the input is received by an action's perform function, the input is a string[].

Key value list collection#

If you would like users to enter a number of key-value pairs as an input, you can use a keyvaluelist collection. The Header input on the HTTP component actions is an example of a keyvaluelist collection, and is defined in code like this:

Key Value List Input

export const headersInputField = input({  label: "Header",  type: "string",  collection: "keyvaluelist",  required: false,  comments: "A list of headers to send with the request.",  example: "User-Agent: curl/7.64.1",});

The "Header" input, then, appears like this in the integration designer:

Key Value List Collection in Prismatic app

When the input is received by an action's perform function, the input is an array of objects of the form:

[  {    key: "foo",    value: "bar",  },  {    key: "baz",    value: 5,  },];

If you would like to convert the input to a key-value pair object, you can use the built-in Spectral function, keyValPairListToObject:

import { util } from "@prismatic-io/spectral";const myObject = util.types.keyValPairListToObject(myInput);// { foo: "bar", baz: 5 }

Writing `perform` functions#

Each action contains one perform function, which is an async function with two parameters that may or may not have a return value. In this example firstName, middleName, and lastName, are input parameters for this perform function:

export const properFormatName = action({  display: {    label: "Properly Format Name",    description: "Properly format a person's name (Last, First M.)",  },  perform: async (context, params) => {    if (params.middleName) {      return {        data: `${params.lastName}, ${params.firstName} ${params.middleName[0]}.`,      };    } else {      return { data: `${params.lastName}, ${params.firstName}` };    }  },  inputs: { firstName, middleName, lastName },});

`perform` Function Parameters#

The perform function takes two parameters, context and params, that can be destructured into their respective properties:

perform: async (context, params) => {},// orperform: async (  { logger },  { paramName1, paramName2, ... }) => {},

The `context` Parameter#

The context parameter is an object that contains the following attributes:

logger allows you to write out log lines.
instanceState, crossFlowState, integrationState and executionState gives you access to persisted state.
stepId is the ID of the current step being executed.
executionId is the ID of the current execution.
webhookUrls contains the URLs of the running instance's sibling flows.
webhookApiKeys contains the API keys of the running instance's sibling flows.
invokeUrl was the URL used to invoke the integration.
customer is an object containing an id, name, and externalId of the customer the instance is assigned to.
instance is an object containing an id and name of the running instance.

Step ID#

context.stepId contains the unique identifier (UUID) of the step. It is used by the Process Data - DeDuplicate action to track what items in a array have or have not been previously seen. You can use it similarly in a custom component to persist step-specific data.

Webhook URLs#

You can reference an instance's webhook URLs through the context.webhookUrls object. This is useful when writing actions to configure and delete webhooks in a third-party app.

perform: async (context, params) => {  const inventoryUrl = context.webhookUrls["My Inventory Flow"];};

Logger object#

context.logger is a logging object and can be helpful to debug components.

perform: async ({ logger }, params) => {  logger.info("Things are going great");  logger.warn("Now less great...");};

Available log functions in increasing order of severity include logger.debug, logger.info, logger.warn and logger.error.

You can also execute logger.metric on an object, which helps when streaming logs and metrics to an external logging service.

Note: Log lines are truncated after 4096 characters. If you need longer log lines, consider streaming logs to an external log service.

Execution, instance, and cross-flow state#

context.executionState, context.instanceState, context.integrationState and context.crossFlowState are key/value stores that may be used to store small amounts of data for future use:

context.executionState stores state for the duration of the execution, and is often used as an accumulator for loops.
context.instanceState stores state that is persisted between executions. This state is scoped to a specific flow. The flow may persist data, and reference it in a subsequent execution.
Shouldn't instanceState be called flowState or something?
Great question! We developed state storage prior to multi-flow, and the name instanceState was retained for historical reasons.
context.crossFlowState also stores state that is persisted between executions. This state is scoped to the instance, and flows may reference one another's stored state.
context.integrationState stores state between flows in instances of the same integration. Customer A's flow 1 can share data with Customer B's flow 2.

State is most notably used by the Persist Data and Process Data components, but you can use it in your custom components, too.

If, for example, a previous flow's run saved a state key of sampleKey, you can reference context.instanceState['sampleKey'] to access that key's value.

To do the reverse, and save data to a flow's state storage for subsequent runs, add an instanceState property to your perform function's return value:

return {  data: "Some Data",  instanceState: { exampleKey: "example value", anotherKey: [1, 2, 3] },};

Note: To remove a key from persisted state, set it to null:

Remove a key from crossFlowState

return {  data: "Some Data",  crossFlowState: { exampleKey: null },};

Input parameters#

The params parameter is an object that has attributes for each input field the action supports. For example, for the perform action defined above, params has params.firstName, params.middleName, and params.lastName.

firstName, middleName, and lastName are based off of the input objects that are provided to the action as inputs.

Shorthand property names

You can use shorthand property names for inputs. If your input object variables have different names - say you have a const myFirstNameInput = input ({...}), you can structure your action's input property like this:

inputs: {  firstName: myFirstNameInput,  middleName: myMiddleNameInput,  lastName: myLastNameInput,}

and the params object passed into perform will have keys firstName, middleName, and lastName.

Using non-shorthand property names is preferable to some developers to avoid variable shadowing.

The function is written with a destructured params parameter. It could be rewritten without being destructured.

perform: async (context, params) => {  if (params.middleName == "") {    return { data: `${params.lastName}, ${params.firstName}` };  } else {    return {      data: `${params.lastName}, ${params.firstName} ${params.middleName[0]}.`,    };  }},

Coercing input types#

TypeScript-based Node libraries often have strict rules about the type of variables that are passed into their functions, but inputs to perform functions are of type unknown since it's not known ahead of time what types of values users of components are going to pass in. For example, you might expect one of your inputs to be a number, but a user might pass in a string instead. That's obviously a problem since "2" + 3 is "23", while 2 + 3 is 5 in JavaScript.

The Spectral package includes several utility functions for coercing input to be the type of variable that you need. Looking at the number/string example, suppose you have some input - quantity - that you need turned into a number (even if someone passes in "123.45" as a string), and you have another input - itemName - that you'd like to be a string. You can use util.types.toNumber() and util.types.toString() to ensure that the input has been converted to a number and string respectively:

import { action, util } from "@prismatic-io/spectral";import { someThirdPartyApiCall } from "some-example-third-party-library";
action({  /*...*/  perform: async (context, { quantity, itemName }) => {    const response = await someThirdPartyApiCall({      orderQuantity: util.types.toNumber(quantity), // Guaranteed to be a number      orderItemName: util.types.toString(itemName), // Guaranteed to be a string    });    return { data: response };  },});

If an input cannot be coerced into the type you've chosen - for example, suppose you pass "Hello World" into util.toNumber() - an error will be thrown indicating that "Hello World" cannot be coerced into a number.

Writing your own type checking functions#

Prismatic provides a variety of type check and type coercion functions for common types (number, integer, string, boolean, etc). If you require a uniquely shaped object, you can create your own type check and coercion functions to ensure that inputs your custom component receives have the proper shape that the libraries you rely on expect.

You can import an interface or type (or write one yourself) and write a function that converts inputs into an expected shape. For example, the SendGrid SDK expects an object that has this form:

{  "to": [string],  "from": string,  "subject": string,  "text": string,  "html": string}

We can pull in that defined type, MailDataRequired, from the SendGrid SDK, and write a function that takes inputs and converts them to an object containing a series of strings:

import { MailDataRequired } from "@sendgrid/mail";import { util } from "@prismatic-io/spectral";
export const createEmailPayload = ({  to,  from,  subject,  text,  html,}): MailDataRequired => ({  to: util.types    .toString(to)    .split(",")    .map((recipient: string) => recipient.trim()),  from: util.types.toString(from),  subject: util.types.toString(from),  text: util.types.toString(text),  html: util.types.toString(html),});

Action Results#

An action can return a variety of data types. To return a simple string, number, boolean, array, or object your return block can read:

// return a string:return {  data: "some string",};// return a number:return {  data: 123.45,};// return a boolean:return {  data: true,};// return an array:return {  data: [1, 2, 3, 4, "a", "b"],};// return an object:return {  data: {    key1: "value1",    key2: ["value2", 123],  },};

Those values can be used as inputs in subsequent steps by referencing this step's results:

Step results from an action in Prismatic app

Returning binary data from an action#

Some custom components will not output a number, string, boolean, array, or object, but will instead output an entire file (like an image, PDF, video, etc). For those custom components, the return value will contain a file Buffer as the data return, and a contentType key to indicate kind of file is being returned. See Mozilla's documentation for a list of common file MIME types.

For example, if your custom component returns a rendered PDF file, and the PDF contents are saved in a Buffer variable named pdfContents, the return block might look like this:

return {  data: pdfContents,  contentType: "application/pdf",};

If the binary file is nested in an object, it can have similar structure:

return {  myKey: "myValue",  myFile: {    data: pdfContents,    contentType: "application/pdf",  },};

Setting synchronous HTTP status codes#

If you invoke your instances synchronously and would like to return an HTTP status code other than 200 - OK, you can configure the final step of your integration to be a custom component that returns any HTTP status code you want.

To return an HTTP status code other than 200, return a statusCode attribute in the object you return from your custom component instead of a data attribute:

return {  statusCode: 415,};

If this custom component is the last step of an integration, then the integration will return an HTTP status code of 415 if invoked synchronously.

Note: When an integration is invoked synchronously, the integration redirects the caller to a URL containing the output results of the final step of the integration. If the final step of the integration is a Stop Execution action, or any custom component action that returns a statusCode, the redirect does not occur and the caller receives a null response body instead. You should not return both data and statusCode attributes in a custom component.

Example action payloads#

As noted above, actions return results for subsequent steps to consume. It's often handy for an integration builder to have access to the shape of the results prior to a test being run. Your action can provide an examplePayload that can be referenced before test data is available:

{  /* ... */  examplePayload: {    data: {      username: "john.doe",      name: {        first: "John",        last: "Doe",      },      age: 20,    },  },}

In the integration designer, this example payload can be referenced as an input.

Note: your examplePayload must match the exact TypeScript type of the return value of your perform function. If your perform function's return value does not match the type of the example payload, TypeScript will generate a helpful error message:

Example Result Data Type Mismatch in Typescript

SOAP utility functions#

If you are integrating with a SOAP-based API, you can use Spectral's SOAP client utility functions to accomplish common SOAP-related tasks. For example, you can fetch a WSDL, produce a JavaScript object containing the authentication or methods that the WSDL defines, generate SOAP headers (for things like authentication) or make requests to a SOAP-based API using its defined methods.

Please see our examples repo for an example component that wraps the SOAP-based Salesforce API.

Adding connections#

A connection is a special type of input for an action that contains information on how to connect to an external app or service. A connection can consist of one or many inputs that can represent things like API endpoints, keys, passwords, OAuth 2.0 fields, etc. The inputs contained within a connection use the same structure as other inputs, described above.

For example, suppose you're writing a component for an API that can take a username and password combination or an API key. You would write two connections - one for username/password authentication, and one for api key authentication.

You also want your customers to be able to point to a sandbox or production environment - each connection should also include an input to represent the endpoint. Your connections could look like this:

import { connection } from "@prismatic-io/spectral";
// Declare this once, so we don't repeat ourselves for the two connectionsconst acmeEnvironment = input({  label: "Acme Inc Environment to Use",  placeholder: "ACME Environment",  type: "string",  required: true,  model: [    {      label: "Production",      value: "https://api.acme.com/",    },    {      label: "Sandbox",      value: "https://sandbox.acme.com/api",    },  ],});
const basicAuth = connection({  key: "basicAuth",  label: "Acme username and password",  inputs: {    username: {      label: "Acme Username",      placeholder: "Username",      type: "string",      required: true,    },    password: {      label: "Acme Password",      placeholder: "Password",      type: "string",      required: true,    },    acmeEnvironment,  },});
const apiKey = connection({  key: "apiKey",  label: "Acme API Key",  inputs: {    username: {      label: "Acme API Key",      placeholder: "API Key",      type: "string",      required: true,    },    acmeEnvironment,  },});

Once connections have been defined, be sure to include them in your component definition. That will allow users to fill in connection information once, and that information can be fed into actions that require that connection. This also makes connections available to all inputs of type "connection" in your component:

import { component } from "@prismatic-io/spectral";
// ...
export default component({  key: "acme",  public: false,  display: {    label: "Acme Inc",    description: "Interact with Acme Inc's API",    iconPath: "icon.png",  },  actions: { myAction1, myAction2 },  triggers: { myTrigger1 },  connections: [basicAuth, apiKey],});

Connection ordering

The first connection listed in the connections: array will be the default connection. In the above example, basicAuth would be the default connection for this component. The default connection is the one that is recommended to users when they add an action from your component to their integration, but the other connection types can be selected as well.

Referencing connections as inputs in actions#

Actions can reference connections like they do any other input.

To give users the ability to assign a connection to an action, create an input of type connection and add it as an input to your action:

Reference a connection input from an action

import { action, input } from "@prismatic-io/spectral";
const connectionInput = input({ label: "Connection", type: "connection" });
export const getAcmeData = action({  display: {    label: "Get Item",    description: "Get an Item from Acme",  },  inputs: { itemId: itemIdInput, myConnection: connectionInput },  perform: async (context, { itemId, myConnection }) => {    const response = axios({      method: "get",      url: `${myConnection.fields.acmeEnvironment}/item/${itemId}`,      headers: {        Authorization: `Bearer ${myConnection.fields.apiKey}`,      },    });    return { data: response.data };  },});

Throwing connection errors#

It's valuable to know if a connection is valid or not, and to track errors if and when a connection fails to connect. Within your custom component you can throw a ConnectionError in order to signal to Prismatic that there is something wrong with the connection (unable to connect to endpoint, invalid credentials, etc).

For example, if you know the API you integrate with returns a 401 "Unauthorized" when credentials are invalid, you could throw a ConnectionError if your HTTP client returns a status code 401:

Throw a connection error

import { action, ConnectionError, util } from "@prismatic-io/spectral";
const getItem = action({  display: {    label: "Get Item",    description: "Get an item from Acme",  },  perform: async (context, { myConnection, itemId }) => {    const apiKey = util.types.toString(myConnection.fields.apiKey);    const response = await axios.get(`https://api.acme.com/items/${itemId}`, {      headers: { Authorization: apiKey },    });    if (response.status === 401) {      throw new ConnectionError(        myConnection,        "Invalid Acme credentials have been configured."      );    }    return {      data: response.data,    };  },  inputs: {    myConnection: input({ label: "Connection", type: "connection" }),    itemId: itemIdInput,  },});

The thrown error, then, will be indicated by a red mark to the right of customers' connections on an instance and messages will appear in logs.

Writing OAuth 2.0 connections#

An OAuth 2.0 authorization code connection follows the OAuth 2.0 protocol and consists of five required inputs:

authorizeUrl - The URL a user visits to authorize an OAuth 2.0 connection.
tokenUrl - The URL where an authorization code can be exchanged for an API key and optional refresh key, and where a refresh key can be used to refresh an API key.
scopes - A space-delimited list of scopes (permissions) that your application needs.
clientId - Your OAuth 2.0 application's client ID.
clientSecret - Your OAuth 2.0 application's client secret.

The first three fields can generally be found in the documentation of the API that you're integrating with. Client ID and secret are created when you create an application in the third-party application.

You can elect to give integration builders the ability to edit any of these fields. Or, you can mark the fields as shown: false, in which case the default value will always be used and integration developers will never see the value.

For example, if you're writing a OAuth 2.0 connection to google drive, the authorizeUrl and tokenUrl never change. So, those can be given default values and can be marked as shown: false. Integration developers will want to be able to adjust scopes, client ID and client secret (though, you may already know what scopes you need), so we can write a connection like this:

Example OAuth 2.0 Connection with Google Drive

import { oauth2Connection, OAuth2Type } from "@prismatic-io/spectral";
export const oauth2 = oauth2Connection({  key: "googleDriveOauth",  label: "OAuth2",  comments: "OAuth2 Connection",  required: true,  oauth2Type: OAuth2Type.AuthorizationCode,  iconPath: "oauth-icon.png",  inputs: {    authorizeUrl: {      label: "Authorize URL",      placeholder: "Authorization URL",      type: "string",      required: true,      shown: false,      comments: "The Authorization URL for Google Drive.",      default: "https://accounts.google.com/o/oauth2/v2/auth",    },    tokenUrl: {      label: "Token URL",      placeholder: "Token URL",      type: "string",      required: true,      shown: false,      comments: "The Token URL for Google Drive.",      default: "https://oauth2.googleapis.com/token",    },    scopes: {      label: "Scopes",      placeholder: "Scopes",      type: "string",      required: true,      comments:        "Space delimited listing of scopes. https://developers.google.com/identity/protocols/oauth2/scopes#drive",      default: "https://www.googleapis.com/auth/drive",    },    clientId: {      label: "Client ID",      placeholder: "Client Identifier",      type: "password",      required: true,      comments: "The Google Drive app's Client Identifier.",    },    clientSecret: {      label: "Client Secret",      placeholder: "Client Secret",      type: "password",      required: true,      comments: "The Google Drive app's Client Secret.",    },  },});

Use `oauth2Connection` for OAuth Connections

Note that we used oauth2Connection() rather than connection() to define this OAuth connection. That's because the oauth2Connection helper function gives us additional TypeScript hinting about what fields are required.

An oauth2Connection can be assigned to a component and referenced as an input just like a connection. The input that is received by a perform function will have the form:

{  "token": {    "access_token": "EXAMPLE-TOKEN",    "token_type": "bearer",    "expires_in": 14400,    "refresh_token": "EXAMPLE-REFRESH-TOKEN",    "scope": "account_info.read account_info.write file_requests.read file_requests.write files.content.read files.content.write files.metadata.read files.metadata.write",    "uid": "123456789",    "account_id": "dbid:EXAMPLEIRNhsZ3wECJZ3aXK3Gm47Di74",    "expires_at": "2021-12-07T01:54:38.096Z"  },  "context": {    "code": "EXAMPLEqMEAAAAAAAAON5iBXhk_yOxjkfDeWy_vSE0",    "state": "EXAMPLE2VDb25maWdWYXJpYWJsZTpmMDZlMDVkNy1kMjY0LTQ0YTgtYWI0Ni01MDhiOTNmZjU5ZjI="  },  "instanceConfigVarId": "EXAMPLE2VDb25maWdWYXJpYWJsZTpmMDZlMDVkNy1kMjY0LTQ0YTgtYWI0Ni01MDhiOTNmZjU5ZjI=",  "key": "oauth",  "fields": {    "scopes": "",    "clientId": "example-client-id",    "tokenUrl": "https://api.dropboxapi.com/oauth2/token",    "authorizeUrl": "https://www.dropbox.com/oauth2/authorize?token_access_type=offline",    "clientSecret": "example-client-secret"  }}

You will likely want to reference myConnection.token.access_token.

Add a custom button to your OAuth 2.0 Connection

You can specify what the OAuth 2.0 button looks like in the instance configuration page by specifying an optional iconPath (see the above example). An icon must be a PNG file, and we recommend that it be wider than it is tall with text indicating what it does:

OAuth buttons including Dropbox, Facebook, GitHub, Google, Tumblr, and Twitter

Without an iconPath, a simple button that says CONNECT will be placed in the configuration page.

Global error handlers#

The actions in your component might all wrap API endpoints using an HTTP client, and that client might throw certain errors. You could handle those errors within each action, but you'd end up writing the same error handlers over and over.

You can now specify an error handler function to run whenever any of your actions throws an error. To specify an error handler, add a handlers block to your component({}) function definition:

components({  // ...  handlers: {    error: (error) => doSomething(error),  },});

For example, the popular HTTP client axios throws an error whenever it receives a status code that's not between 200-299. If your HTTP client receives a status code in the 4xx or 5xx range, an error is thrown with a minimal message. If you would like additional information, like the status code or full response to the HTTP request, you can inspect the error being thrown and return a more detailed error message, as illustrated in Spectral here.

Exporting a component#

Component code contains a default export of component type. A component contains a key that uniquely identifies it, whether or not it's public, some information about how the web app should display it, an object containing the actions that the component is comprised of, and if your custom component has its own triggers, an object containing the triggers that the component contains. For the "proper and improper" names example component, the export can look like this:

export default component({  key: "format-name",  public: false,  display: {    label: "Format Name",    description: "Format a person's name given a first, middle, and last name",    iconPath: "icon.png",  },  actions: {    improperFormatName,    properFormatName,  },  connections: [basicAuth, apiKey],});

Unit tests for custom components#

It's important to have good unit tests for software - custom components are no exception. You want to catch errors or breaking changes before they wreak havoc on your customers' integrations. Prismatic's Spectral library provides some utility functions to make writing unit tests easier.

In the examples below, we assume that you use the Jest testing framework which is installed by default when you run prism components:init. You can swap Jest out for another testing framework if you like.

Test file naming conventions#

To create a unit test file, create a new file alongside your code that has the extension test.ts (rather than .ts). For example, if your code lives in index.ts, create a file named index.test.ts. If you separate out your component actions into actions.ts, create a corresponding actions.test.ts.

Testing component actions#

As described above a component action's perform function takes two arguments:

context is an object that contains a logger, executionId, instanceState, and stepId.
params is an object that contains input parameters as key-value pairs.

Test context parameters are described below. Let's ignore them for now and look at the params object. Consider the example "Format Proper Name" action described previously:

export const properFormatName = action({  display: {    label: "Properly Format Name",    description: "Properly format a person's name (Last, First M.)",  },  perform: async (context, params) => {    if (params.middleName) {      return {        data: `${params.lastName}, ${params.firstName} ${params.middleName[0]}.`,      };    } else {      return { data: `${params.lastName}, ${params.firstName}` };    }  },  inputs: { firstName, middleName, lastName },});

You can use the ComponentTestHarness class and createHarness helper function to test your actions.

The test harness's action function takes two required and one optional parameters:

The action's key (i.e. properFormatName)
An object containing input parameters
An optional context object containing logger, executionId, instanceState, and stepId

A Jest test file, then, could look like this:

import component from ".";import { createHarness } from "@prismatic-io/spectral/dist/testing";
const harness = createHarness(component);
describe("Test the Proper Name formatter", () => {  test("Verify first, middle, and last name", async () => {    const result = await harness.action("properFormatName", {      firstName: "John",      middleName: "James",      lastName: "Doe",    });    expect(result.data).toStrictEqual("Doe, John J.");  });  test("Verify first and last name without middle", async () => {    const result = await harness.action("properFormatName", {      firstName: "John",      middleName: null,      lastName: "Doe",    });    expect(result.data).toStrictEqual("Doe, John");  });});

You can then run yarn run jest, and Jest will run each test, returning an error code if a test failed.

Verifying correct logging in action tests#

You may want to verify that your action generates some logs of particular severities in certain situations. In addition to step results, the test utility's invoke function returns an object, loggerMock, with information on what was logged during the action invocation.

You can use Jest to verify that certain lines were logged like this:

import { myExampleAction } from "./actions";import { invoke } from "@prismatic-io/spectral/dist/testing";
test("Ensure that an error is logged", async () => {  const level = "error";  const message = "Error code 42 occurred.";  const { loggerMock } = await invoke(myExampleAction, {    exampleInput1: "exampleValue1",    exampleInput2: "exampleValue2",  });  expect(loggerMock[level]).toHaveBeenCalledWith(message);});

In the above example, the test would pass if an error log line of Error code 42 occurred. were generated, and would fail otherwise.

Providing test connection inputs to an action test#

Many actions require a connection to interact with third-party services. You can create a connection object the createConnection function from @prismatic-io/spectral/dist/testing:

import {  createConnection,  createHarness,} from "@prismatic-io/spectral/dist/testing";import component from ".";import { myConnection } from "./connections";
const harness = createHarness(component);
const myBasicAuthTestConnection = createConnection(myConnection, {  username: "myUsername",  password: "myPassword",});
describe("test my action", () => {  test("verify the return value of my action", async () => {    const result = await harness.action("myAction", {      someInput: "abc-123",      connection: myBasicAuthTestConnection,      someOtherInput: "def-456",    });  });});

It's not good practice to hard-code authorization secrets. Please use best practices, like setting environment variables to store secrets in your CI/CD environment:

import { createConnection } from "@prismatic-io/spectral/dist/testing";import { myConnection } from "./connections";
const myBasicAuthTestConnection = createConnection(myConnection, {  username: process.env.ACME_ERP_USERNAME,  password: process.env.ACME_ERP_PASSWORD,});

Use an Existing Integration's Connections for Testing

If you would like to fetch an access key from an existing OAuth 2.0 connection in an integration (or username / password, API key, etc.), leverage the prism components:dev:run command to fetch the connection's fields and tokens. You can then reference the PRISMATIC_CONNECTION_VALUE environment variable in your Jest tests.

More info is in our prism docs.

Testing components from the CLI#

The prism CLI tool provides two commands for testing custom components:

prism components:dev:run fetches an integration's active connection and saves the fields as an environment variable so you can run unit tests and other commands locally. This is helpful, since many unit tests require an access token from a validated OAuth 2.0 connection - this provides a way of fetching the token from a connection you've already authenticated in the Prismatic integration designer.
prism components:dev:test publishes your component under a temporary name, and runs a single-action test integration for you that tests the action. This is helpful for quickly testing an action in the real Prismatic integration runner environment.

Access connections for local testing#

The prism components:dev:run command fetches an active connection from the Prismatic integration designer, so you can use the connection's fields for unit testing. The connection's values are set to an environment variable named PRISMATIC_CONNECTION_VALUE, which can be used by a subsequent command.

In this example, we use printenv to print the environment variable, and pipe the result into jq for pretty printing:

prism components:dev:run \  --integrationId SW50ZEXAMPLE \  --connectionKey "Dropbox Connection" -- printenv PRISMATIC_CONNECTION_VALUE | jq
{  "token": {    "access_token": "sl.EXAMPLE",    "token_type": "bearer",    "expires_in": 14400,    "expires_at": "2022-10-13T20:09:53.739Z",    "refresh_token": "EXAMPLE"  },  "context": {    "code": "sU4pEXAMPLE",    "state": "SW5zdEXAMPLE"  },  "fields": {    "clientId": "EXAMPLE",    "clientSecret": "EXAMPLE"  }}

Note that the command you want to run with the environment variable should follow a --.

Within your unit test code, you can use harness.connectionValue(), which pulls in the PRISMATIC_CONNECTION_VALUE environment variable into a connection that you can use for tests:

Use PRISMATIC_CONNECTION_VALUE for a Jest test

import { createHarness } from "@prismatic-io/spectral/dist/testing";import { oauthConnection } from "./connections";import component from ".";
// Initialize a testing harnessconst harness = createHarness(component);
// Parse the OAuth 2.0 connection from the PRISMATIC_CONNECTION_VALUE environment variableconst parsedConnection = harness.connectionValue(oauthConnection);
describe("listFolder", () => {  test("listRootFolder", async () => {    const result = await harness.action("listFolder", {      dropboxConnection: parsedConnection, // Pass in our connection      path: "/",    });    const files = result["data"]["result"]["entries"];    // Verify a folder named "Public" exists in the response    expect(files).toEqual(      expect.arrayContaining([expect.objectContaining({ name: "Public" })])    );  });});

From your component, you can then run:

prism components:dev:run \  --integrationId SW50ZEXAMPLE \  --connectionKey "Dropbox Connection" -- npm run jest

Run a test of an action from the command line#

The prism components:dev:test command allows you to test an action quickly from the command line in the real integration runner environment.

Run prism components:dev:test from your component's root directory.
You will be prompted to select an action to test. Select one.
For each input of the action, supply a value
If your action requires a connection, you will be prompted for values for that connection (username, password, client_id, etc).
- If your action requires an OAuth 2.0 connection, a web browser will open to handle the OAuth flow.

Once all inputs are entered, your action will run in the integration runner, and you will see logs from your action.

Test run environment files#

You do not need to enter the same inputs each time you want to run a test of your action. To set some values for your test inputs, create a new file called .env in the same directory where you're invoking prism and enter your inputs and values as key/value pairs. For example, if you plan to leave cursor and limit inputs blank, set path to /, and you have an OAuth client ID and secret that you want to use each time, your .env file can look like this:

CURSOR=LIMIT=PATH=/CLIENT_ID=xlexampleCLIENT_SECRET=4yexample

Writing triggers#

Integrations are usually triggered on a schedule (meaning instances of the integration run every X minutes, or at a particular time of day) or via webhook (meaning some outside system sends JSON data to a unique URL and an instance processes the data that was sent). The vast majority of integrations built in Prismatic start with a schedule trigger or webhook trigger. There are situations, though, where neither the schedule nor the standard webhook trigger are suitable for one reason or another. That's where writing your own triggers come in handy.

Triggers are custom bits of code that are similar to actions. They give you fine-grained control over how a webhook's payload is presented to the rest of the steps of an integration and what HTTP response is returned to whatever invoked the trigger's webhook URL.

Similar to an action, a trigger is comprised of display information, a perform function and inputs. Additionally, you specify if your trigger can be invoked synchronously (synchronousResponseSupport) and if your trigger supports scheduling (scheduleSupport).

Suppose, for example, a third-party app can be configured to send CSV data via webhook and requires that the webhook echo a header, x-confirmation-code, back in plaintext to confirm it got the payload. The default webhook trigger accepts JSON, and responds with an execution ID, so it's not suitable for integrating with this third-party app.

This trigger will return an HTTP 200 and echo a particular header back to the system invoking the webhook, and then it'll parse the CSV payload into an object so that subsequent steps can reference through the trigger's results.body.data:

import {  input,  trigger,  TriggerPayload,  HttpResponse,  util,} from "@prismatic-io/spectral";import papaparse from "papaparse"; // CSV Library
export const csvTrigger = trigger({  display: {    label: "CSV Webhook",    description:      "Accepts and parses CSV data into a referenceable object and returns a plaintext ACK to the webhook caller.",  },  perform: async (context, payload, { hasHeader }) => {    // Create a custom HTTP response that echos a header,    // x-confirmation-code, that was received as part of    // the webhook invocation    const response: HttpResponse = {      statusCode: 200,      contentType: "text/plain; charset=utf-8",      body: payload.headers["x-confirmation-code"],    };
    // Create a copy of the webhook payload, deserialize    // the CSV raw body, and add the deserialized object    // to the object to the trigger's outputs    const finalPayload: TriggerPayload = { ...payload };
    const parseResult = papaparse.parse(      util.types.toString(payload.rawBody.data),      {        header: util.types.toBool(hasHeader),      }    );
    finalPayload.body.data = parseResult.data;
    // Return the modified trigger payload and custom HTTP response    return Promise.resolve({      payload: finalPayload,      response,    });  },  inputs: {    // Declare if the incoming CSV has header information    hasHeader: input({      label: "CSV Has Header",      type: "boolean",      default: "false",    }),  },  synchronousResponseSupport: "invalid", // Do not allow synchronous invocations  scheduleSupport: "invalid", // Do not allow scheduled invocations});
export default { csvTrigger };

Notice a few things about this example:

The trigger's form is very similar to that of an action definition.
The response contains an HTTP statusCode, body, and contentType to be returned to the webhook caller.
The second argument to the perform function - payload - contains the same information that a standard webhook trigger returns. The rawBody.data presumably contains some CSV text - the body.data key of the payload is replaced by the deserialized version of the CSV data.
inputs work the same way that they work for actions - you define a series of inputs, and they're passed in as the third parameter of the perform function.

For another real-world example of writing a trigger, check out our tutorial on how we wrote the Salesforce trigger.

Add a trigger to your component#

Once you've written a trigger, you can add it to an existing component the same way you add an action to your component, but using the triggers key:

import { csvTrigger } from "./csvTrigger";
export default component({  key: "format-name",  public: false,  display: {    label: "Format Name",    description: "Format a person's name given a first, middle, and last name",    iconPath: "icon.png",  },  actions: {    improperFormatName,    properFormatName,  },  triggers: { csvTrigger },});

Testing a trigger#

Testing a trigger is similar to testing an action, except you use the harness.trigger function instead. For example, if you want to use Jest to test the csvTrigger outlined above, your test could look like this:

import component from ".";import {  createHarness,  defaultTriggerPayload,} from "@prismatic-io/spectral/dist/testing";
const harness = createHarness(component);
describe("test csv webhook trigger", () => {  test("verify the return value of the csv webhook trigger", async () => {    const payload = defaultTriggerPayload(); // The payload you can expect a generic trigger to receive
    payload.rawBody.data = "first,last,age\nJohn,Doe,30\nJane,Doe,31";    payload.headers.contentType = "text/csv";    payload.headers["x-confirmation-code"] = "some-confirmation-code-123";
    const expectedData = [      { first: "John", last: "Doe", age: "30" },      { first: "Jane", last: "Doe", age: "31" },    ];
    const expectedResponse = {      statusCode: 200,      contentType: "text/plain; charset=utf-8",      body: payload.headers["x-confirmation-code"],    };
    const {      payload: {        body: { data },      },      response,    } = await harness.trigger("csvTrigger", null, payload, {      hasHeader: true,    });
    expect(data).toStrictEqual(expectedData);    expect(response).toStrictEqual(expectedResponse);  });});

Writing data sources#

A Data Source fetches data from a third-party API that will be used to dynamically generate a config variable. When your customer deploys an instance, they use a connection to authenticate with a third-party API.

A data source can generate a variety of types of data including a string, date, picklist (which is a string[]), complex objectSelection objects, and more.

Here's a simple data source that fetches an array of customers, each with a name and id. It maps them to a label/key object so the customer's names show in a picklist, and the customer's id is :

Fetch a string from an external API

import { dataSource, Element } from "@prismatic-io/spectral";
const companyName = dataSource({  display: {    label: "Fetch Customers",    description: "Fetch an array of customers' names",  },  inputs: {    connection: input({      label: "Connection",      type: "connection",      required: true,    }),  },  perform: async (context, params) => {    const client = createAcmeClient(params.connection);    const response = await client.get("/customers");    const customers = response.data.customers?.map<Element>((customer) => ({      label: customer.name,      value: customer.id,    }));    return { result: customers };  },  dataSourceType: "picklist",  examplePayload: {    result: [      { label: "Smith Rocket Company", key: "abc-123" },      { label: "Mars Rocket Corp", key: "def-456" },    ],  },});

In this example, we fetch several items from an API, including metadata about each item, so that a user can select one or more of the items and get that metadata of each:

Fetch a string from an external API

const companyName = dataSource({  display: {    label: "Fetch Items",    description: "Fetch all available items",  },  inputs: {    connection: input({      label: "Connection",      type: "connection",      required: true,    }),  },  perform: async (context, params) => {    const client = createAcmeClient(params.connection);    const response = await client.get("/items");    const objects: ObjectSelection = response.data.items.map((item) => ({      object: { key: object.id, label: object.name },      fields: [        { key: object.quantity, label: "Quantity" },        { key: object.sku, label: "SKU" },      ],    }));    return { result: response.data.name };  },  dataSourceType: "objectSelection",  examplePayload: {    result: [      {        object: { key: "abc-123", label: "widgets" },        fields: [          { key: "5", label: "Quantity" },          { key: "0000000000", label: "SKU" },        ],      },    ],  },});

An example of a data source that generates a picklist is available in the Slack component.

Branching in custom actions and triggers#

Similar to the branch component, your custom actions and triggers can make use of logical branches. To support branches, give your action() or trigger() two additional properties, allowsBranching: true and staticBranchNames: ["List", "Of", "Branches"], and ensure that the object that your perform function returns includes a branch property:

Example action with branching

export const branchExample = action({  display: {    label: "Branch Example",    description: "An example action that branches",  },  inputs: {    myValue: input({ label: "My Value", type: "string", required: true }),  },  allowsBranching: true,  staticBranchNames: ["First", "Second", "Other"],  perform: async (context, params) => {    let branchName = "Other";    if (params.myValue === "One") {      branchName = "First";    } else if (params.myValue === "Two") {      branchName = "Second";    }    return await Promise.resolve({ branch: branchName, data: null });  },});

Similar code can be used in a custom trigger. allowsBranching: true indicates to the integration designer that it should render branches beneath your action or trigger. staticBranchNames is an array of strings representing names of possible branches that can be followed. The branch name that matches the branch return value will be followed.

Logs showing which branch was followed in a custom branch step — Execution logs will always indicate which branch of a branching step was followed.

Publishing a component#

Package a component with webpack by running npm run build or yarn build:

$ yarn buildyarn run v1.22.10$ webpackasset icon.png 94.2 KiB [compared for emit] [from: assets/icon.png] [copied]asset index.js 92.2 KiB [emitted] (name: main)runtime modules 1.04 KiB 5 modulesmodules by path ./node_modules/@prismatic-io/spectral/ 49.6 KiB  modules by path ./node_modules/@prismatic-io/spectral/dist/types/*.js 3.92 KiB 12 modules  modules by path ./node_modules/@prismatic-io/spectral/dist/*.js 21.4 KiB    ./node_modules/@prismatic-io/spectral/dist/index.js 4.21 KiB [built] [code generated]    ./node_modules/@prismatic-io/spectral/dist/util.js 11.9 KiB [built] [code generated]    ./node_modules/@prismatic-io/spectral/dist/testing.js 5.29 KiB [built] [code generated]  ./node_modules/@prismatic-io/spectral/node_modules/jest-mock/build/index.js 24.2 KiB [built] [code generated]modules by path ./node_modules/date-fns/ 16 KiB  modules by path ./node_modules/date-fns/_lib/ 780 bytes    ./node_modules/date-fns/_lib/toInteger/index.js 426 bytes [built] [code generated]    ./node_modules/date-fns/_lib/requiredArgs/index.js 354 bytes [built] [code generated]  4 modules./src/index.ts 2.46 KiB [built] [code generated]./node_modules/valid-url/index.js 3.99 KiB [built] [code generated]webpack 5.41.1 compiled successfully in 1698 ms✨  Done in 2.86s.

This will create a dist/ directory containing your compiled JavaScript and icon image. Now use prism to publish your component. If you do not have Prismatic's CLI tool, prism, installed, please take a moment to look through the Prism overview page.

$ prism components:publish
Format Name - Format a person's name given a first, middle, and last nameWould you like to publish Format Name? (y/N): ySuccessfully submitted Format Name (v6)! The publish should finish processing shortly.

Upgrading spectral versions#

We release minor, non-breaking changes to Spectral often, and major changes periodically. Major changes come with major version bumps (1.x.x, 2.x.x, 3.x.x, etc).

To upgrade a component from an older major version of spectral to a new one, see our upgrade guides:

If you are building a new component, we strongly encourage you to start with the latest version of Spectral.

Custom component library#

Initializing a new component#

Custom components from WSDLs or OpenAPI specs#

Writing actions#

Adding inputs#

Cleaning inputs#

Action input types#

Dropdown menu inputs#

Collection inputs#

Value list collection#

Key value list collection#

Writing perform functions#

perform Function Parameters#

The context Parameter#

Step ID#

Webhook URLs#

Logger object#

Execution, instance, and cross-flow state#

Shouldn't instanceState be called flowState or something?

Input parameters#

Shorthand property names

Coercing input types#

Writing your own type checking functions#

Action Results#

Returning binary data from an action#

Setting synchronous HTTP status codes#

Example action payloads#

SOAP utility functions#

Adding connections#

Connection ordering

Referencing connections as inputs in actions#

Throwing connection errors#

Writing OAuth 2.0 connections#

Use oauth2Connection for OAuth Connections

Add a custom button to your OAuth 2.0 Connection

Global error handlers#

Exporting a component#

Unit tests for custom components#

Test file naming conventions#

Testing component actions#

Verifying correct logging in action tests#

Providing test connection inputs to an action test#

Use an Existing Integration's Connections for Testing

Testing components from the CLI#

Access connections for local testing#

Run a test of an action from the command line#

Test run environment files#

Writing triggers#

Add a trigger to your component#

Testing a trigger#

Writing data sources#

Branching in custom actions and triggers#

Publishing a component#

Upgrading spectral versions#

Writing `perform` functions#

`perform` Function Parameters#

The `context` Parameter#

Shouldn't `instanceState` be called `flowState` or something?

Use `oauth2Connection` for OAuth Connections