Upload compressed JSON in S3 to JSON #733

Job	Run time
Run pre-commit hooks against all files	18s
Runs unit tests that are not dependent on aws-glue package resources	1m 2s
Build and push testing docker images to the pytest ECR repository. (aws_glue_3, tests/Dockerfile....	2m 9s
Upload files to S3 bucket in development	1m 25s
Build and push testing docker images to the pytest ECR repository. (aws_glue_4, tests/Dockerfile....	2m 31s
Deploy Snowflake resources	3m 43s
Run Pytest unit tests for AWS glue (aws_glue_3)	2m 32s
Run Pytest unit tests for AWS glue (aws_glue_4)	5m 50s
Deploys branch using sceptre	1m 52s
Cleanup non-main branch data before integration tests	48s
Triggers ETL workflow with S3 test files	50s
Deploys to staging of prod using sceptre	0s
Cleanup main branch staging data before integration tests	0s
Triggers staging workflow with production data	0s
	23m 0s

Provide feedback