Skip to content

Serverless Data Lake Framework 2.7.0-alpha.0

Pre-release
Pre-release
Compare
Choose a tag to compare
@cnfait cnfait released this 22 Oct 14:55
· 145 commits to main since this release

Work is ongoing on version 2.7.0 of the Serverless Data Lake Framework.

This is a pre-release, not ready for production workloads. New features may not work properly, may be rewritten significantly or even removed before 2.7.0 is officially available.

This alpha release is for SDLF 2.x. See the release notes for SDLF 2.0.0 to learn about all the changes in this major version.

For users of SDLF 1.x, version 1 is still available on the master branch. Development of newer versions of SDLF (2.x) happens on branch main. The workshop still contains sections for version 1 as well.

What's Changed

  • fix datalakeLibrary case in workshop files by @cnfait in #403
  • update version to 2.7.0-alpha.0 by @cnfait in #404
  • redesign sdlf-team and sdlf-dataset by @cnfait in #405
  • add glue database for raw bucket by @gwenika in #406
  • add glue database for analytics bucket by @cnfait in #407
  • add glue crawler for raw bucket by @cnfait in #408
  • add glue crawler for analytics bucket by @cnfait in #409
  • sdlf-dataset can be deployed without a team by @cnfait in #410
  • workshop examples: add stage- prefix to stages by @cnfait in #411
  • remove replicate lambda by @cnfait in #412
  • [sdlf-foundations][cdk] remove legacy resources by @cnfait in #413
  • [sdlf-dataset][cdk] add peh, manifests tables by @cnfait in #414
  • cdk: sdlf-dataset/sdlf-team design changes by @cnfait in #415
  • [sdlf-team][sdlf-dataset][cdk] fix imports by @cnfait in #416
  • [cdk] Enable key rotation for all KMS keys by @cnfait in #417
  • [sdlf-dataset] deployment fixes by @cnfait in #418
  • [sdlf-foundations][cdk] remove CentralBucket reference by @cnfait in #419
  • [sdlf-foundations][cdk] CfnDataLakeSettings by @cnfait in #420
  • [sdlf-foundations][cdk] data_bucket method to handle raw/stage/analytics buckets creation by @cnfait in #421
  • rework sdlf-foundations (cdk) deployment with seedfarmer by @cnfait in #422
  • rework sdlf-dataset (cdk) deployment with seedfarmer by @cnfait in #423

Full Changelog: 2.6.0...2.7.0-alpha.0