-
Notifications
You must be signed in to change notification settings - Fork 107
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
* Addressing lodash vulnerability CVE-2021-23337 (#2730) * updating lodash vulnerability * Updated changelog Authored-by: Katherine Kelly <[email protected]> * Update changelog with recent maintenance branch releases (#2732) * Release v10.1.0 (#2731) merge back to master (#2734) * Release v10.1.0 (#2731) * Release v10.1.0 * Update Cumulus package API documentation * v10.1.0 Cumulus Documentation * update orca version to v4.0.1 * add the missing fix note to release * Adds logs surrounding the preparation and launch of asynchronous operations (#2726) * Adds logging surrounding the preparation and launch of asynchronous operations. * sets new docker image as default * Put proper grammar into your logs. * Also spell your logs correctly. * Update the actual async_operation_image_version I was confusing that with teh async_operation_image. * more fixing of changelog * really fix all grammar. * CUMULUS-2846: Fix rules PUT logic (#2733) * fix unit tests * update rule PUT endpoint logic to ensure consistent record in PG/Dynamo/ES & add unit tests for updating SNS rule * fix unit test * add unit test for SQS rule * add unit test for PUT for SQS rules * add unit tests * fix unit test * fix revert logic for PUT endpoint and add unit tests * add unit test for rules PG model * update rule.upsert() to accept fieldsToDelete parameter * CUMULUS-2703:Implement ORCA Reconciliation Reports (#2683) * use createAt for reconciliation report time range * update stack selection * compare cumulus granule with orca * add createBackupReconciliationReport * update initial report format * add ORCASearchCatalogQueue * add unit test for backup-reconciliation-report * update unit test * rearrange unit test * add unit test * add more test granules to unit test * add ORCA Backup report type * add orca reconciliation report integration test to spec * add and fix unit tests * fix unit test with regex * change report structure * refactor * revert back to updatedAt range for report * v4.0.0 is not available * update from PR feedback * fix integration test * remove startTimestamp for GNF report spec * fix changelog for rds2 branch * remove duplicate entries from changelog * add translateApiRuleToPostgresRuleRaw helper and unit test * fix PUT endpoint logic and update unit test * export new helper * update data-migration1 lambda to allow overriding rules in PG * modify rule update logic & update unit tests * remove unused code * clean up code * remove unnecessary code * add unit test * update unit tests * update CHANGELOG * remove deletion from rules model * add unit test for updateRuleTrigger(0 * update unit tests * refactoring test * delete mocking code * update localstack to 0.14.0 * fix unit test for SNS triggers * update unit tests * add unit tests for deleting SNS triggers * fixing unit tests * refactor unit tests * fix unit tests * fix unit tests * fix unit tests * update changelog * update detection of unit test bootstrapping * add dummy lambda zip * fix unit tests * fix unit tests * update logic for rule SNS permission ID * fix int test * revert ORCA changes * revert changes * revert changes * revert changes * fix unresolved merge conflicts * fix CHANGELOG * updates * update base model * fix unit tests * update unit tests * fix unit tests * revert schema change * fix unit test * fix unit test * fix unit test * fix unit tests * update tests * fix tests * fix test for local mocking * fix tests * fix unit tests * update test to use API * fix integration test helper * downgrade localstack to 0.11.5 * update unit tests * fix rules migration to overwrite and delete values * remove duplicate lines * remove unnecessary code * fix integration test * address feedback * address feedback * update test names * cleanup SNS topics * cleanup SNS topics * update CHANGELOG * fix integration test cleanup * fix unit tests Co-authored-by: jennyhliu <[email protected]> * Port CUMULUS-2845 to master (#2736) * Add environment variables to unit test * Update changelog, add createRuleTrigger before rulesModel.create calls * Add missing createRuleTrigger calls * update unit tests * update CHANGLEOG * fix unit tests * fix unit tests * fix unit tests * fix unit tests * fix unit tests * fix CHANGELOG * revert rules model change * update unit test * fix unit test * fix unit tests * add unit tests Co-authored-by: Jennifer Tran <[email protected]> * CUMULUS-2854: Update queue-granules to correctly set granule createdAt stamp (#2863) Co-authored-by: Matt Savoie <[email protected]> Co-authored-by: Jonathan Kovarik <[email protected]> * Update Cumulus version and package API documentation * Cut new version of Cumulus documentation * Update unreleased compare link in CHANGELOG.md * Release-10.1.1 - Address PR review comments * Add personal CI stack to Bamboo config * Update config.yml for personal CI stack * Update example/config.yml for personal sandbox stack Co-authored-by: kkelly51 <[email protected]> Co-authored-by: Jonathan Kovarik <[email protected]> Co-authored-by: jennyhliu <[email protected]> Co-authored-by: Matt Savoie <[email protected]> Co-authored-by: Mark Boyd <[email protected]> Co-authored-by: Jennifer Tran <[email protected]>
- Loading branch information
7 people
authored
Mar 8, 2022
1 parent
765ba47
commit b34bda5
Showing
139 changed files
with
2,832 additions
and
896 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,9 @@ | ||
| { | ||
| "Comment": "State machine that creates a step function success event", | ||
| "StartAt": "SuccessState", | ||
| "States": { | ||
| "SuccessState": { | ||
| "Type": "Succeed" | ||
| } | ||
| } | ||
| } |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,16 @@ | ||
| module "passthrough_workflow" { | ||
| source = "../../tf-modules/workflow" | ||
|
|
||
| prefix = var.prefix | ||
| name = "Passthrough" | ||
| workflow_config = module.cumulus.workflow_config | ||
| system_bucket = var.system_bucket | ||
| tags = local.tags | ||
|
|
||
| state_machine_definition = templatefile( | ||
| "${path.module}/passthrough_workflow.asl.json", | ||
| { | ||
| hello_world_task_arn: module.cumulus.hello_world_task.task_arn | ||
| } | ||
| ) | ||
| } |
65 changes: 65 additions & 0 deletions
65
example/cumulus-tf/queue_granules_passthrough_workflow.asl.json
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,65 @@ | ||
| { | ||
| "Comment": "Queue Granules", | ||
| "StartAt": "QueueGranules", | ||
| "States": { | ||
| "QueueGranules": { | ||
| "Parameters": { | ||
| "cma": { | ||
| "event.$": "$", | ||
| "task_config": { | ||
| "queueUrl": "${start_sf_queue_url}", | ||
| "provider": "{$.meta.provider}", | ||
| "internalBucket": "{$.meta.buckets.internal.name}", | ||
| "stackName": "{$.meta.stack}", | ||
| "granuleIngestWorkflow": "${ingest_granule_workflow_name}", | ||
| "cumulus_message": { | ||
| "input": "{$.payload}", | ||
| "outputs": [ | ||
| { | ||
| "source": "{$.granules}", | ||
| "destination": "{$.meta.input_granules}" | ||
| }, | ||
| { | ||
| "source": "{$}", | ||
| "destination": "{$.payload}" | ||
| }, | ||
| { | ||
| "source": "{$.process}", | ||
| "destination": "{$.meta.process}" | ||
| } | ||
| ] | ||
| } | ||
| } | ||
| } | ||
| }, | ||
| "Type": "Task", | ||
| "Resource": "${queue_granules_task_arn}", | ||
| "Retry": [ | ||
| { | ||
| "ErrorEquals": [ | ||
| "Lambda.ServiceException", | ||
| "Lambda.AWSLambdaException", | ||
| "Lambda.SdkClientException" | ||
| ], | ||
| "IntervalSeconds": 2, | ||
| "MaxAttempts": 6, | ||
| "BackoffRate": 2 | ||
| } | ||
| ], | ||
| "Catch": [ | ||
| { | ||
| "ErrorEquals": [ | ||
| "States.ALL" | ||
| ], | ||
| "ResultPath": "$.exception", | ||
| "Next": "WorkflowFailed" | ||
| } | ||
| ], | ||
| "End": true | ||
| }, | ||
| "WorkflowFailed": { | ||
| "Type": "Fail", | ||
| "Cause": "Workflow failed" | ||
| } | ||
| } | ||
| } |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,18 @@ | ||
| module "queue_granules_passthrough_workflow" { | ||
| source = "../../tf-modules/workflow" | ||
|
|
||
| prefix = var.prefix | ||
| name = "QueueGranulesPassthrough" | ||
| workflow_config = module.cumulus.workflow_config | ||
| system_bucket = var.system_bucket | ||
| tags = local.tags | ||
|
|
||
| state_machine_definition = templatefile( | ||
| "${path.module}/queue_granules_passthrough_workflow.asl.json", | ||
| { | ||
| ingest_granule_workflow_name: module.passthrough_workflow.name, | ||
| queue_granules_task_arn: module.cumulus.queue_granules_task.task_arn, | ||
| start_sf_queue_url: module.cumulus.start_sf_queue_url | ||
| } | ||
| ) | ||
| } |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.