Medium Glue Regional

AWS Glue Spark jobs should run on supported versions of AWS Glue

NIST 800-53

Description

This control checks whether an AWS Glue for Spark job is configured to run on a supported version of AWS Glue. The control fails if the Spark job is configured to run on a version of AWS Glue that's earlier than the minimum supported version.


Remediation

To update your AWS Glue Spark job to use a supported version, you need to modify the job configuration.

Steps

  1. Navigate to the AWS Glue console
  2. Go to 'ETL' > 'Jobs' in the left navigation
  3. Select your Spark job
  4. Choose 'Edit' to modify the job
  5. In the 'Job details' section, update the 'Glue version'
  6. Select a supported version (3.0 or higher)
  7. Save the job configuration
  8. Test the job to ensure it works with the new version

Compliance

NIST 800-53