AWS Glue Spark jobs should run on supported versions of AWS Glue¶

This control checks whether an AWS Glue for Spark job is configured to run on a supported version of AWS Glue. The control fails if the Spark job is configured to run on a version of AWS Glue that's earlier than the minimum supported version.

How to fix¶

Attribute glue_version of aws_glue_job must be non-empty.

Implementation options¶

Choose the option that matches how you manage Terraform. All options satisfy this control.

Option 1: Terraform AWS provider resources¶

If you manage resources directly, configure the relevant Terraform AWS provider resources to meet this control. See docs for the resources involved: aws_glue_job.

resource "aws_glue_job" "this" {
  command {
    script_location = "s3://pofix-example/script.py"
  }
  glue_version = "4.0"
  name         = "pofix-example-job"
  role_arn     = "arn:aws:iam::123456789012:role/example-role"
}

Which option should I choose?

Compliance.tf module (recommended): controls enforced by default and mapped to frameworks.
Open source module (terraform-aws-modules): compatible by design with compliance.tf. Same variable names for an easy, low-change migration path when you are ready.
Terraform AWS provider resources: manage Terraform resources directly.

Tool mappings¶

Use these identifiers to cross-reference this control across tools, reports, and evidence.

Compliance.tf (CTF) Control: glue_spark_job_runs_on_version_3_or_higher
AWS Config Managed Rule: GLUE_SPARK_JOB_SUPPORTED_VERSION
Powerpipe Control: aws_compliance.control.glue_spark_job_runs_on_version_3_or_higher