Upload compressed JSON in S3 to JSON #731

Job	Run time
Run pre-commit hooks against all files	17s
Runs unit tests that are not dependent on aws-glue package resources	17m 48s
Upload files to S3 bucket in development	1m 22s
Deploy Snowflake resources	3m 30s
Build and push testing docker images to the pytest ECR repository. (aws_glue_3, tests/Dockerfile....	2m 13s
Build and push testing docker images to the pytest ECR repository. (aws_glue_4, tests/Dockerfile....	2m 26s
Run Pytest unit tests for AWS glue (aws_glue_3)	1m 56s
Run Pytest unit tests for AWS glue (aws_glue_4)	5m 39s
Deploys branch using sceptre	1m 53s
Cleanup non-main branch data before integration tests	44s
Triggers ETL workflow with S3 test files	52s
Deploys to staging of prod using sceptre	0s
Cleanup main branch staging data before integration tests	0s
Triggers staging workflow with production data	0s
	38m 40s

Provide feedback