All checks
Medium
AWS Glue Spark jobs should run on supported versions of AWS Glue
Checks that a Glue Spark ETL job sets a Glue version at or above the minimum AWS's control accepts; a job with no Glue version set fails too. A version past end of support gets no security patches, and at end of life AWS stops starting its runs.
- service
- Glue
- severity
- Medium
- scope
- evaluated in every region
How to fix it
- Can break clients: Each Glue version brings newer Spark and Python, so run the job on test data first: a script or library that relied on the old versions can fail.
In the console
AWS Glue → ETL jobs → the job → Job details
- Glue version
- The newest version offered, rather than the oldest that passes today
With Terraform
resource "aws_glue_job" "this" {
name = var.job_name
role_arn = var.role_arn
glue_version = var.glue_version
command {
name = "glueetl"
script_location = var.script_location
}
}See which of your accounts this check is failing on.
Book a live scan