Code

feat: Add Batch Processing Utility#337

Code

Merged

hjgraca merged 50 commits intoaws-powertools:developaws-powertools/powertools-lambda-dotnet:developfrom

lachriz-aws:feature/batch-processinglachriz-aws/aws-lambda-powertools-dotnet:feature/batch-processingCopy head branch name to clipboard

Sep 19, 2023

Commits

Commits on Nov 13, 2022

• Initial commit.

  lachriz-aws

  committed
  f24f96a

  Copy full SHA for f24f96a

• Initial commit.

  lachriz-aws

  committed
  0549eb1

  Copy full SHA for 0549eb1

• Merge branch 'awslabs:develop' into feature/batch-processing

  lachriz-aws

  authored
  f97e15e

  Copy full SHA for f97e15e

Commits on May 1, 2023

• Merge branch 'develop' of github.com:lachriz-aws/aws-lambda-powertools-dotnet into develop

  lachriz-aws

  committed
  f508aa8

  Copy full SHA for f508aa8

• Merge remote-tracking branch 'upstream/develop' into develop

  lachriz-aws

  committed
  4d6dae6

  Copy full SHA for 4d6dae6

• Merge branch 'feature/batch-processing' into develop

  lachriz-aws

  committed
  cfe3304

  Copy full SHA for cfe3304

• Preparing for unit tests.

  lachriz-aws

  committed
  b436261

  Copy full SHA for b436261

• Added support for record handler providers.

  lachriz-aws

  committed
  3e67cdb

  Copy full SHA for 3e67cdb

• Added 'TODO' and an example related to logging of failures during record processing.

  lachriz-aws

  committed
  38d71df

  Copy full SHA for 38d71df

• Minor comments update.

  lachriz-aws

  committed
  d8c992c

  Copy full SHA for d8c992c

• Added unit tests for SQS batch processing logic (standard vs fifo queues).

  lachriz-aws

  committed
  b1c8a99

  Copy full SHA for b1c8a99

Commits on May 4, 2023

• Updated the 'partial failure mechanics' to match those of the Python Powertools.

  lachriz-aws

  committed
  3d9bf81

  Copy full SHA for 3d9bf81

Commits on Jun 30, 2023

• Merge remote-tracking branch 'upstream/develop' into develop

  lachriz-aws

  committed
  7b4fa10

  Copy full SHA for 7b4fa10

• Post-merge clean-up in solution file.

  lachriz-aws

  committed
  2f7caef

  Copy full SHA for 2f7caef

• Merge branch 'develop' into feature/batch-processing

  lachriz-aws

  committed
  66b7ae4

  Copy full SHA for 66b7ae4

Commits on Jul 1, 2023

• The 'BatchProcesserAttribute' now derives from the 'UniversalWrapperAttribute' enabling async execution of the batch processing logic.

  lachriz-aws

  committed
  1908794

  Copy full SHA for 1908794

• Added support for parallel processing of batch items (POWERTOOLS_BATCH_PROCESSING_MAX_PARALLELISM).

  lachriz-aws

  committed
  4d3ced9

  Copy full SHA for 4d3ced9

Commits on Jul 2, 2023

• Added support for configuring processing options via environment variables, via the batch processing attribute and via dynamic configuration passed at runtime.

  lachriz-aws

  committed
  b153943

  Copy full SHA for b153943

• Added missing copyright statements.

  lachriz-aws

  committed
  a93da4c

  Copy full SHA for a93da4c

• Updated nuget package references in BatchProcessing projects.

  lachriz-aws

  committed
  13e2f82

  Copy full SHA for 13e2f82

• Started work on BatchProcessing docs.

  lachriz-aws

  committed
  199101b

  Copy full SHA for 199101b

• Added remaining comments and improved the support for reading processing results. We are now down to zero warnings.

  lachriz-aws

  committed
  d7a2d59

  Copy full SHA for d7a2d59

Commits on Jul 3, 2023

• Minor updates to titles, links and descriptions in the BatchProcessing docs, .csproj file and the SAM template.

  lachriz-aws

  committed
  1ec18a0

  Copy full SHA for 1ec18a0

Commits on Jul 20, 2023

• Trying to fix sonarcloud security Omitting "KmsMasterKeyId" disables SQS queues encryption. Make sure it is safe here.

  hjgraca

  committed
  749c482

  Copy full SHA for 749c482

Commits on Aug 19, 2023

• Merge branch 'develop' of https://github.com/hjgraca/powertools-lambda-dotnet into feature/batch-processing

  hjgraca

  committed
  210be16

  Copy full SHA for 210be16

• Replace Moq

  Show description for 8ea523d
  hjgraca

  committed
  8ea523d

  Copy full SHA for 8ea523d

Commits on Aug 29, 2023

• Merge remote-tracking branch 'upstream/develop' into feature/batch-processing

  hjgraca

  committed
  34afc7e

  Copy full SHA for 34afc7e

Commits on Sep 1, 2023

• Parallel behind config. Add SetExecutionEnvironment. Refactor

  hjgraca

  committed
  a3923cb

  Copy full SHA for a3923cb

• Merge branch 'develop' of https://github.com/hjgraca/powertools-lambda-dotnet into feature/batch-processing

  hjgraca

  committed
  ece1daa

  Copy full SHA for ece1daa

• fix result duplication. fix warnings, more tests

  Show description for aa08c47
  hjgraca

  committed
  aa08c47

  Copy full SHA for aa08c47

Commits on Sep 6, 2023

• Refactor SQSBatchProcessor. Add tests for all SQS handler scenarios

  Show description for d468c50
  hjgraca

  committed
  d468c50

  Copy full SHA for d468c50

Commits on Sep 11, 2023

• finishing sqs tests

  Show description for 059612b
  hjgraca

  committed
  059612b

  Copy full SHA for 059612b

• Merge branch 'develop' of https://github.com/hjgraca/powertools-lambda-dotnet into feature/batch-processing

  hjgraca

  committed
  a8fffd3

  Copy full SHA for a8fffd3

Commits on Sep 12, 2023

• refactoring, kinesis tests, readme and initial docs

  hjgraca

  committed
  974c93d

  Copy full SHA for 974c93d

• fix sonar sam template without kms

  hjgraca

  committed
  2927354

  Copy full SHA for 2927354

• fix sonar kms key, doc line updates due to added kms

  hjgraca

  committed
  146d343

  Copy full SHA for 146d343

• dynamodb tests

  hjgraca

  committed
  53c6b0f

  Copy full SHA for 53c6b0f

• name refactorings

  hjgraca

  committed
  127bf40

  Copy full SHA for 127bf40

• fix examples

  hjgraca

  committed
  6e6ea41

  Copy full SHA for 6e6ea41

Commits on Sep 13, 2023

• Merge branch 'develop' of https://github.com/hjgraca/powertools-lambda-dotnet into feature/batch-processing

  hjgraca

  committed
  4abb4e5

  Copy full SHA for 4abb4e5

• Batch support for central package management

  Show description for 2b042a8
  hjgraca

  committed
  2b042a8

  Copy full SHA for 2b042a8

• fix examples (will remove project reference once released and add nuget package)

  hjgraca

  committed
  cec087f

  Copy full SHA for cec087f

• docs: add kinesis and dynamodb

  hjgraca

  committed
  cb8db81

  Copy full SHA for cb8db81

• docs update and conclusion. Testing fail all messages.

  hjgraca

  committed
  96e2d08

  Copy full SHA for 96e2d08

• docs updates

  hjgraca

  committed
  562b162

  Copy full SHA for 562b162

Commits on Sep 15, 2023

• refactor to interfaces

  amirkaws

  committed
  b0491c2

  Copy full SHA for b0491c2

• rename KenisisDataStream to KenisisEvent

  amirkaws

  committed
  68b488c

  Copy full SHA for 68b488c

• implement processors as interface

  amirkaws

  committed
  e632af6

  Copy full SHA for e632af6

• implement processors as interface in example

  amirkaws

  committed
  f567b65

  Copy full SHA for f567b65

Commits on Sep 19, 2023

• Merge branch 'develop' of https://github.com/hjgraca/powertools-lambda-dotnet into feature/batch-processing

  hjgraca

  committed
  3736f2d

  Copy full SHA for 3736f2d