Serverless Data Lake Framework 2.0.0-rc.0

[cnfait]

Work is ongoing on a new major version of the Serverless Data Lake Framework. This is a pre-release, not ready for production workloads.

We welcome your feedback!

What's Changed

Read Serverless Data Lake Framework 2.0.0-beta.0 to know more about what's new in SDLF 2.0.0!

• automatically create codepipeline infrastructure for new stages by @cnfait in automatically create codepipeline infrastructure for new stages #190
• StageA state machine update by @cnfait in StageA state machine update #191
• Python 3.11 as default for CodeBuild runtimes. Also update Codebuild image to latest AmazonLinux2 by @Mreddy19 in Python 3.11 as default for CodeBuild runtimes. Also update Codebuild image to latest AmazonLinux2 #192
• Python 3.11 as default for Lambda functions by @Mreddy19 in Python 3.11 as default for Lambda functions #193
• StageB state machine update by @cnfait in StageB state machine update #194
• Enforce the use of aws-cli >= 2.13.0 by @Mreddy19 in Enforce the use of aws-cli >= 2.13.0 #196
• fix sdlf-stageB glue arguments from dynamodb by @cnfait in fix sdlf-stageB glue arguments from dynamodb #198
• Configurable lambda stageA is now configurable through dynamodb by @cnfait in Configurable lambda stageA is now configurable through dynamodb #199
• StageB: configurable glue job name through dynamodb by @cnfait in StageB: configurable glue job name through dynamodb #200
• deploy datalakelibrary using cloudformation by @cnfait in deploy datalakelibrary using cloudformation #201
• use 'main' as the default branch name instead of 'master' by @cnfait in use 'main' as the default branch name instead of 'master' #202
• Use KMS for base encryption of S3 buckets by @cnfait in Use KMS for base encryption of S3 buckets #203
• Build CloudFormation modules as part of sdlf-main/sdlf-main-* repository pipelines by @cnfait in Build CloudFormation modules as part of sdlf-main/sdlf-main-* repository pipelines #204
• update GlueVersion from 2.0 to 4.0 by @cnfait in update GlueVersion from 2.0 to 4.0 #205

Full Changelog: 2.0.0-beta.4...2.0.0-rc.0

Thanks

We thank all the contributors/users for their work on this release, in particular @Mreddy19.

---

This discussion was created from the release Serverless Data Lake Framework 2.0.0-rc.0.