AWS Glue Connector

Source API Docs API Changelog Connector Changelog

Description

AWS Glue is a serverless data integration service from Amazon Web Services. The AWS Glue component allows listing, starting, and stopping jobs, triggers, and crawlers in an AWS Glue account.

API Documentation

This component was built using the AWS Glue Developer Guide.

Connections

Access Key and Secret

key: apiKeySecret

An AWS IAM access key pair is required to interact with AWS Glue. Ensure the key pair generated in AWS has proper permissions to the AWS Glue resources to access. Read more about Glue IAM actions in the AWS documentation.

Prerequisites

An AWS account with IAM access
Appropriate permissions to create IAM access keys

Setup Steps

To create an IAM access key pair:

Sign in to the AWS Console and navigate to Identity and Access Management (IAM)
Select the IAM user that will be used for the integration
Navigate to the Security credentials tab
Under the Access keys section, select Create access key
Choose the appropriate use case (e.g., Third-party service or Application running outside AWS)
Copy both the Access key ID and Secret access key when displayed

Secret Key Visibility

The Secret access key is only shown once during creation. If it is not copied at this time, a new access key pair must be created.

Configure the Connection

Enter the Access Key ID into the connection configuration
Enter the Secret Access Key into the connection configuration

Input	Notes	Example
Access Key ID	The AWS IAM Access Key ID used to authenticate requests.	AKIAIOSFODNN7EXAMPLE
Secret Access Key	The AWS IAM Secret Access Key used to authenticate requests.	wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY

AWS Role ARN

key: awsAssumeRole

AWS Assume Role authentication allows assuming an IAM role using temporary security credentials. This method is useful for cross account access or when implementing principle of least privilege.

Refer to the AWS documentation on assuming roles for detailed information.

Prerequisites

Completed Access Key and Secret connection setup (access key pair required)
Appropriate permissions to create IAM roles

Setup Steps

An IAM user with access keys is required to assume a role. If access keys have not been created, follow the Access Key and Secret setup steps first, then return here to create the IAM role.

Create an IAM Role with Trust Policy

From the IAM Console, navigate to Roles and select Create Role
Select Custom trust policy as the trusted entity type
Enter the trust policy below, replacing USER_ARN with the IAM user ARN:

View trust policy template

{
  "Version": "2012-10-17",
  "Statement": [
    {
      "Effect": "Allow",
      "Principal": {
        "AWS": "USER_ARN"
      },
      "Action": "sts:AssumeRole"
    }
  ]
}

Click Next and attach the appropriate Glue permissions policy (e.g., AWSGlueConsoleFullAccess)
Complete the remaining steps and select Create Role
Copy the Role ARN from the role summary (format: arn:aws:iam::123456789012:role/role-name)

Configure the Connection

Role ARN: The ARN of the IAM role to assume
Access Key ID: From the IAM user (see Access Key and Secret)
Secret Access Key: From the IAM user
External ID (optional): Shared secret for enhanced security

External ID

The External ID provides additional security for cross-account access. Refer to the AWS documentation for more information.

Verify Connection

The IAM user credentials assume the role, which provides temporary credentials with the role's attached permissions. Ensure the trust policy correctly references the IAM user ARN.

Input	Notes	Example
Access Key ID	An AWS IAM Access Key ID	AKIAIOSFODNN7EXAMPLE
External ID	Provides enhanced security measures to the connection. Optional, but recommended. Please check AWS docs for more information.	shared-common-secret
Role ARN	An AWS IAM Role ARN	arn:aws:iam::OtherAccount-ID:role/assumed-role-name
Secret Access Key	An AWS IAM Secret Access Key	wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY

Data Sources

Select AWS Region

Select an AWS region | key: selectRegion | type: picklist

Select Crawler

A picklist of crawlers available in the AWS Glue account. | key: selectCrawler | type: picklist

Input	Notes	Example
Connection	The AWS Glue connection to use.
AWS Region	AWS provides services in multiple regions, like us-west-2 or eu-west-1.	us-east-1

Example Payload for Select Crawler⤓

Loading…

Select Job

A picklist of jobs available in the AWS Glue account. | key: selectJob | type: picklist

Input	Notes	Example
Connection	The AWS Glue connection to use.
AWS Region	AWS provides services in multiple regions, like us-west-2 or eu-west-1.	us-east-1

Example Payload for Select Job⤓

Loading…

Select Trigger

A picklist of triggers available in the AWS Glue account. | key: selectTrigger | type: picklist

Input	Notes	Example
Connection	The AWS Glue connection to use.
AWS Region	AWS provides services in multiple regions, like us-west-2 or eu-west-1.	us-east-1

Example Payload for Select Trigger⤓

Loading…

Actions

Get Job Run

Retrieves the metadata for a given job run. | key: getJobRun

Input	Notes	Example
Connection	The AWS Glue connection to use.
AWS Region	AWS provides services in multiple regions, like us-west-2 or eu-west-1.	us-east-1
Name	The name of the resource (job, crawler, or trigger) to act on. Provide the name, not the ARN.
Run ID	The unique identifier for the job run.

Example Payload for Get Job Run⤓

Loading…

List Crawlers

Lists crawlers available in AWS Glue. | key: listCrawlers

Input	Notes	Example
Connection	The AWS Glue connection to use.
AWS Region	AWS provides services in multiple regions, like us-west-2 or eu-west-1.	us-east-1
Marker	The pagination token returned by a previous request, used to retrieve the next page of results.	lslTXFcbLQKkb0vP9Kgh5hy0Y0OnC7Z9ZPHPwPmMnxSk3eiDRMkct7D8E
Max Items	The maximum number of results to return. Provide a value from 1 to 50.	20

Example Payload for List Crawlers⤓

Loading…

List Jobs

Lists jobs available in AWS Glue. | key: listJobs

Input	Notes	Example
Connection	The AWS Glue connection to use.
AWS Region	AWS provides services in multiple regions, like us-west-2 or eu-west-1.	us-east-1
Marker	The pagination token returned by a previous request, used to retrieve the next page of results.	lslTXFcbLQKkb0vP9Kgh5hy0Y0OnC7Z9ZPHPwPmMnxSk3eiDRMkct7D8E
Max Items	The maximum number of results to return. Provide a value from 1 to 50.	20

Example Payload for List Jobs⤓

Loading…

List Triggers

Lists the names of all triggers in the account. | key: listTriggers

Input	Notes	Example
Connection	The AWS Glue connection to use.
AWS Region	AWS provides services in multiple regions, like us-west-2 or eu-west-1.	us-east-1
Marker	The pagination token returned by a previous request, used to retrieve the next page of results.	lslTXFcbLQKkb0vP9Kgh5hy0Y0OnC7Z9ZPHPwPmMnxSk3eiDRMkct7D8E
Max Items	The maximum number of results to return. Provide a value from 1 to 50.	20

Example Payload for List Triggers⤓

Loading…

Start Crawler

Starts an existing crawler in AWS Glue. | key: startCrawler

Input	Notes	Example
Connection	The AWS Glue connection to use.
AWS Region	AWS provides services in multiple regions, like us-west-2 or eu-west-1.	us-east-1
Name	The name of the resource (job, crawler, or trigger) to act on. Provide the name, not the ARN.

Example Payload for Start Crawler⤓

Loading…

Start Job Run

Starts a job run using an AWS Glue job definition. | key: startJobRun

Input	Notes	Example
Arguments	Optional key value parameters to pass into a job.
Connection	The AWS Glue connection to use.
AWS Region	AWS provides services in multiple regions, like us-west-2 or eu-west-1.	us-east-1
Allocated Capacity	The number of AWS Glue data processing units (DPUs) that can be allocated when this job runs. If this is omitted, Glue will use the default number of DPUs configured for the job.	10
Name	The name of the resource (job, crawler, or trigger) to act on. Provide the name, not the ARN.
Security Configuration	The name of the SecurityConfiguration structure to be used with this job. This can be left blank if there is no security configuration.

Example Payload for Start Job Run⤓

Loading…

Start Trigger

Starts an existing trigger in AWS Glue. | key: startTrigger

Input	Notes	Example
Connection	The AWS Glue connection to use.
AWS Region	AWS provides services in multiple regions, like us-west-2 or eu-west-1.	us-east-1
Name	The name of the resource (job, crawler, or trigger) to act on. Provide the name, not the ARN.

Example Payload for Start Trigger⤓

Loading…

Stop Crawler

Stops the specified crawler if it is currently running. | key: stopCrawler

Input	Notes	Example
Connection	The AWS Glue connection to use.
AWS Region	AWS provides services in multiple regions, like us-west-2 or eu-west-1.	us-east-1
Name	The name of the resource (job, crawler, or trigger) to act on. Provide the name, not the ARN.

Example Payload for Stop Crawler⤓

Loading…

Stop Job Run

Stops one or more job runs for a specified job definition. | key: stopJobRun

Input	Notes	Example
Connection	The AWS Glue connection to use.
AWS Region	AWS provides services in multiple regions, like us-west-2 or eu-west-1.	us-east-1
Job Run IDs	The job run identifiers to stop for the specified job.
Name	The name of the resource (job, crawler, or trigger) to act on. Provide the name, not the ARN.

Example Payload for Stop Job Run⤓

Loading…

Stop Trigger

Stops a specified trigger. | key: stopTrigger

Input	Notes	Example
Connection	The AWS Glue connection to use.
AWS Region	AWS provides services in multiple regions, like us-west-2 or eu-west-1.	us-east-1
Name	The name of the resource (job, crawler, or trigger) to act on. Provide the name, not the ARN.

Example Payload for Stop Trigger⤓

Loading…

Changelog

2026-06-09

Resolved an issue with the Start Job Run action so the Security Configuration input is applied properly

2026-05-28

Various modernizations and documentation updates

2026-04-30

Updated spectral version

2026-02-26

Added inline data sources for jobs, crawlers, and triggers to enable dynamic dropdown selection

AWS Glue Connector

Description​

API Documentation​

Connections​

Access Key and Secret​

Prerequisites​

Setup Steps​

Configure the Connection​

AWS Role ARN​

Prerequisites​

Setup Steps​

Create an IAM Role with Trust Policy​

Configure the Connection​

Verify Connection​

Data Sources​

Select AWS Region​

Select Crawler​

Select Job​

Select Trigger​

Actions​

Get Job Run​

List Crawlers​

List Jobs​

List Triggers​

Start Crawler​

Start Job Run​

Start Trigger​

Stop Crawler​

Stop Job Run​

Stop Trigger​

Changelog​

2026-06-09​

2026-05-28​

2026-04-30​

2026-02-26​

Description

API Documentation

Connections

Access Key and Secret

Prerequisites

Setup Steps

Configure the Connection

AWS Role ARN

Prerequisites

Setup Steps

Create an IAM Role with Trust Policy

Configure the Connection

Verify Connection

Data Sources

Select AWS Region

Select Crawler

Select Job

Select Trigger

Actions

Get Job Run

List Crawlers

List Jobs

List Triggers

Start Crawler

Start Job Run

Start Trigger

Stop Crawler

Stop Job Run

Stop Trigger

Changelog

2026-06-09

2026-05-28

2026-04-30

2026-02-26