Skip to main content

AWS Glue Component

AWS Glue

Manage AWS Glue crawlers, jobs and triggers

Component key: aws-glue

Description​

AWS Glue is a serverless data integration service from Amazon Web Services. The AWS Glue component allows you to interact with jobs, triggers, and crawlers in your AWS Glue account.

Connections​

AWS Glue Access Key and Secret​

An AWS IAM access key pair is required to interact with AWS Glue. Make sure that the key pair you generate in AWS has proper permissions to the AWS Glue resources you want to access. Read more about Glue IAM actions in the AWS docs.

Actions​

Get Job Run​

Retrieves the metadata for a given job run. | key: getJobRun

Output Example Payload​

{
  "data": {
    "JobRun": ""
  }
}

List Crawlers​

List Crawlers available in AWS Glue | key: listCrawlers

Output Example Payload​

{
  "data": {
    "NextToken": "",
    "CrawlerNames": [
      "crawler-1",
      "crawler-2"
    ]
  }
}

List Jobs​

List job schemas available in AWS Glue | key: listJobs

Output Example Payload​

{
  "data": {
    "JobNames": [
      "job1",
      "job2"
    ],
    "NextToken": ""
  }
}

List Triggers​

List the names of all triggers in the account. | key: listTriggers

Output Example Payload​

{
  "data": {
    "NextToken": "",
    "TriggerNames": [
      "trigger-1",
      "trigger-2"
    ]
  }
}

Start Crawler​

Starts an existing crawler in AWS Glue. | key: startCrawler

Output Example Payload​

{
  "data": {
    "Name": "exampleCrawlerName"
  }
}

Start Job Run​

Starts a job run using a AWS Glue job definition. | key: startJobRun

Output Example Payload​

{
  "data": {
    "Name": "exampleJobRunName"
  }
}

Start Trigger​

Starts an existing trigger in AWS Glue. | key: startTrigger

Output Example Payload​

{
  "data": {
    "Name": "exampleTriggerName"
  }
}

Stop Crawler​

If the specified crawler is running, stops the crawl | key: stopCrawler

Output Example Payload​

{
  "data": {
    "Name": "exampleCrawlerName"
  }
}

Stop Job Run​

Stops one or more job runs for a specified job definition | key: stopJobRun

Output Example Payload​

{
  "data": {
    "SuccessfulSubmissions": [
      ""
    ],
    "Errors": [
      ""
    ]
  }
}

Stop trigger​

Stops a specified trigger | key: stopTrigger

Output Example Payload​

{
  "data": {
    "Name": "exampleTriggerName"
  }
}