Serverless Data Lake Framework 2.7.0-alpha.1

Work is ongoing on version 2.7.0 of the Serverless Data Lake Framework.

This is a pre-release, not ready for production workloads. New features may not work properly, may be rewritten significantly or even removed before 2.7.0 is officially available.

This alpha release is for SDLF 2.x. See the release notes for SDLF 2.0.0 to learn about all the changes in this major version.

For users of SDLF 1.x, version 1 is still available on the master branch. Development of newer versions of SDLF (2.x) happens on branch main. The workshop still contains sections for version 1 as well.

What's Changed

• [sdlf-dataset][cdk] data_catalog method to handle raw/stage/analytics catalogs creation by @cnfait in #424
• [sdlf-foundations][cdk] avoid using a hardcoded stack name by @cnfait in #425
• [sdlf-dataset][cdk] avoid using a hardcoded stack name by @cnfait in #426
• [sdlf-dataset][cdk] update dynamo table names by @cnfait in #427
• [cdk] remove pEnvironment parameter by @cnfait in #428
• [sdlf-dataset][cdk] remove pPipelineDetails parameter by @cnfait in #429
• [sdlf-foundations][cdk] replace octagon with sdlf in dynamo table name by @cnfait in #430
• [cdk] ssm parameters naming change by @cnfait in #431
• [sdlf-dataset][cdk] add sdlf:dataset lf-tag association for raw and analytics databases by @cnfait in #432
• [sdlf-dataset][cdk] add EMR Security Configuration SSM parameter by @cnfait in #433
• [sdlf-dataset][cdk] ruff linting by @cnfait in #434
• [sdlf-foundations][cdk] dynamo table: let cloudformation do the naming by @cnfait in #435
• [sdlf-foundations][cdk] ruff linting by @cnfait in #436
• [sdlf-team][cdk] ruff linting by @cnfait in #437
• [sdlf-pipeline][sdlf-stage-*][cdk] remove sdlf-team dependency by @cnfait in #438
• Ruff linting for all CDK constructs by @cnfait in #439
• [sdlf-foundations][cdk] ruff formatting by @cnfait in #440
• [sdlf-foundations][cdk] metadata for seedfarmer by @cnfait in #441
• [sdlf-dataset][cdk] metadata for seedfarmer by @cnfait in #442
• add seedfarmer.gitmodules to gitignore by @cnfait in #443
• [sdlf-foundations][cdk] ability to provide parameter values without --parameters by @cnfait in #444
• [sdlf-dataset][cdk] ability to provide parameter values without CfnParameter by @cnfait in #445

Full Changelog: 2.7.0-alpha.0...2.7.0-alpha.1