Amazon S3AWS Glue can extract, transform, and load (ETL) data to and from Amazon S3 buckets.
Amazon RDSAWS Glue can connect to and perform ETL operations on data stored in Amazon RDS databases.
Amazon RedshiftAWS Glue can load data into and extract data from Amazon Redshift data warehouses.
Amazon AthenaAWS Glue can catalog data that can be queried directly with Amazon Athena.
AWS Lake FormationAWS Glue Data Catalog is used by AWS Lake Formation to manage and secure data lakes.
Amazon DynamoDBAWS Glue can connect to and perform ETL operations on data from Amazon DynamoDB tables.
Amazon KinesisAWS Glue can read from and write to Amazon Kinesis Data Streams and Amazon Data Firehose.
Amazon AppFlowAWS Glue Data Catalog can register the schema and location of data that AppFlow transfers into Amazon S3. This makes application exports discoverable as catalog tables for downstream analytics.
Amazon AuroraAWS Glue connects to Aurora databases through JDBC connections to discover schemas and read or write data. An ETL job can extract transactional records from Aurora and transform them for a data lake.
Amazon Aurora ServerlessAWS Glue can access Aurora Serverless databases through JDBC connections when the database endpoint is reachable from the job's network. Crawlers can discover database tables, and ETL jobs can read and write their data.
Amazon Bedrock
AWS Glue Data Catalog can supply table metadata for structured-data knowledge bases in Amazon Bedrock that use Amazon Redshift as their query engine. This lets a knowledge base answer natural-language questions over supported cataloged lake data.
Amazon CloudWatchAWS Glue publishes job logs and operational metrics to CloudWatch. You can inspect Spark execution logs, monitor resource utilization, and configure alarms for processing problems.
Amazon ConnectAWS Glue Data Catalog exposes tables for data shared through the Amazon Connect analytics data lake. These tables describe contact-center datasets that authorized analytics tools can query.
Amazon Data FirehoseAWS Glue Data Catalog supplies the table schema that Data Firehose uses when converting JSON records to Parquet or ORC before delivery to Amazon S3. Schema versions in the catalog control how incoming records are interpreted.
Amazon DataZone
AWS Glue databases and tables can be ingested into DataZone through an AWS Glue data source. DataZone adds business metadata and publishing workflows to those technical assets so users can discover and request access to them.
Amazon DocumentDB (with MongoDB compatibility)AWS Glue provides connections for reading and writing Amazon DocumentDB collections. ETL jobs can transform document data into tabular datasets or load processed records back into DocumentDB.
Amazon EC2AWS Glue development endpoints support notebook servers hosted on EC2 for interactive ETL development. The notebook server connects to the development endpoint to execute and test Glue code.
Amazon EMRAWS Glue Data Catalog can serve as the external Hive metastore for supported applications on EMR. Spark and Hive workloads can use shared table definitions instead of maintaining a separate metastore.
Amazon EventBridgeAWS Glue emits job, crawler, and Data Catalog events to EventBridge. EventBridge can also deliver events to a Glue workflow trigger, allowing workflows to start when matching events arrive.
Amazon HealthLakeAWS Glue Data Catalog holds table metadata used by HealthLake's analytics integration. Together with Lake Formation permissions, this makes supported HealthLake datasets available for SQL analysis.
Amazon Keyspaces (for Apache Cassandra)AWS Glue Spark jobs can use the Amazon Keyspaces connector to read and write Cassandra-compatible tables. This supports tasks such as loading transformed S3 data into Keyspaces.
Amazon Kinesis Data StreamsAWS Glue streaming ETL jobs can consume records from Kinesis Data Streams and continuously transform them into destination datasets. Glue can also use its Schema Registry to serialize and validate records produced to or consumed from streams.
Amazon Managed Service for Apache FlinkAWS Glue Schema Registry integrates with Flink applications through serialization and deserialization libraries. Applications can validate streaming records against registered schemas and manage schema evolution.
Amazon Managed Streaming for Apache KafkaAWS Glue streaming ETL jobs can consume Kafka topics hosted on Amazon MSK. AWS Glue Schema Registry also provides schema management and compatible serializers for Kafka producers and consumers.
Amazon Managed Workflows for Apache Airflow (Amazon MWAA)AWS Glue jobs and crawlers can be orchestrated from MWAA using Airflow's AWS Glue operators and sensors. A DAG can start a job, wait for completion, and then run dependent processing tasks.
Amazon NeptuneAWS Glue jobs can use the Neptune connector to read and write graph data. This allows ETL pipelines to transform source records into vertices and edges or process data extracted from a graph.
Amazon OpenSearch ServiceAWS Glue for Spark provides an OpenSearch Service connection for reading and writing indexed data. Jobs can clean and enrich records before indexing them or extract indexed documents for further processing.
Amazon Q
AWS Glue Studio integrates Amazon Q Developer to help author and troubleshoot data integration jobs. You can describe a transformation in natural language to generate code or request explanations of Glue functionality and job errors.
Amazon QuickSightAWS Glue Data Catalog tables can be used in QuickSight datasets through an Athena data source. Glue supplies the schemas and partition metadata for the underlying lake data that QuickSight queries.
Amazon SageMakerAWS Glue interactive sessions can be used from SageMaker Studio notebooks to develop and run serverless data preparation code. SageMaker's lakehouse capabilities also use the Glue Data Catalog to organize and access lakehouse tables.
Amazon SageMaker Data Wrangler
AWS Glue Data Catalog databases and tables can be selected when importing data into Data Wrangler through Athena. This lets users prepare cataloged lake datasets for machine learning.
Amazon Security Lake
AWS Glue Data Catalog stores the database and table definitions for Security Lake datasets. Security Lake maintains this metadata so authorized subscribers can discover and query normalized security logs.
Amazon Simple Queue Service (Amazon SQS)AWS Glue crawlers can consume S3 event notifications from an SQS queue to identify changed objects. Event-driven crawling reduces the need to list and inspect an entire S3 dataset on every crawl.
Amazon TimestreamAWS Glue jobs can use the Amazon Timestream connector to read time-series data and write transformed records. This supports ETL pipelines that load historical measurements into Timestream or process query results.
Amazon VPCAWS Glue connections can specify VPC subnets and security groups for accessing private data sources. Glue creates network interfaces in the selected subnet so jobs and crawlers can reach resources such as private databases.
AWS Application Discovery ServiceAWS Glue crawlers and Data Catalog tables support exploration of Application Discovery Service data exported to Amazon S3. The discovery service's data exploration workflow uses these resources to make collected server data queryable.
AWS Clean Rooms
AWS Glue Data Catalog tables can be referenced when creating S3-backed configured tables in Clean Rooms. The catalog supplies the schema and data location used to associate a dataset with a collaboration.
AWS CloudFormationAWS Glue resources can be provisioned through CloudFormation, including databases, tables, jobs, crawlers, connections, triggers, and workflows. Templates can deploy a pipeline's catalog definitions and processing configuration together.
AWS CloudTrailAWS Glue API activity is recorded by CloudTrail for auditing. These records help identify who changed catalog metadata, modified a job, or initiated a processing operation.
AWS CodeCommitAWS Glue Studio supports synchronizing job scripts and associated job definitions with CodeCommit repositories. This provides version control for visual and script-based ETL development.
AWS ConfigAWS Config can record supported AWS Glue resource configurations and track changes over time. Configuration history and rules can help audit resources such as Glue jobs and security configurations.
AWS Cost and Usage ReportAWS Glue crawlers and Data Catalog tables support the Athena integration for Cost and Usage Reports delivered to S3. Cataloging the report files makes billing line items available for SQL analysis.
AWS Data ExchangeAWS Glue Data Catalog tables can be shared through AWS Data Exchange data products that use Lake Formation permissions. Subscribers receive governed access to the published tables without the provider distributing separate copies of the underlying data.
AWS Database Migration Service (AWS DMS)AWS Glue Data Catalog generation can be enabled for supported DMS S3 targets. DMS creates catalog metadata describing the migrated data so analytics tools can discover and query it.
AWS Entity Resolution
AWS Glue Data Catalog tables define S3-backed input datasets for Entity Resolution workflows. The table schemas provide the columns that are mapped to matching attributes.
AWS Glue DataBrew
AWS Glue Data Catalog tables can be used as DataBrew datasets for supported data sources. DataBrew recipe jobs can also publish supported output datasets into the catalog for subsequent ETL and analytics.
AWS Identity and Access Management (IAM)AWS Glue uses IAM roles to access data sources, write outputs, and perform processing operations. IAM policies also control who can manage Glue jobs, crawlers, connections, and Data Catalog resources.
AWS Key Management Service (AWS KMS)AWS Glue uses KMS keys to protect supported stored data, including Data Catalog metadata and connection passwords. Glue security configurations also specify encryption settings for job outputs, CloudWatch logs, and job bookmarks.
AWS MarketplaceAWS Glue can use data connectors distributed through AWS Marketplace. Subscribed connectors can be configured as Glue connections to access additional data sources and destinations.
AWS PrivateLinkAWS Glue supports interface VPC endpoints powered by PrivateLink. Clients in a VPC can call supported Glue APIs without sending traffic over the public internet.
AWS Resource Access Manager (AWS RAM)AWS Glue Data Catalog resources can be shared across accounts through Lake Formation integrations that use AWS RAM resource shares. Recipient accounts can access authorized databases and tables without duplicating their metadata.
AWS Secrets ManagerAWS Glue connections can reference Secrets Manager secrets for database and connector credentials. Jobs and crawlers retrieve the credentials using their execution roles rather than embedding passwords in scripts.
AWS Security Token Service (AWS STS)AWS Glue assumes its configured IAM execution roles through STS to obtain temporary credentials. Those credentials authorize jobs and crawlers to access their permitted data sources and destinations.
AWS Step FunctionsAWS Glue jobs can be started through the Step Functions service integration, including a synchronous mode that waits for a job run to finish. State machines can coordinate ETL stages and handle job failures with retries or recovery branches.