v0.0.0

What's Changed

• Create folder with external storage location and STS by @philerooski in #2
• [ETL-33/55] Ready BridgeDownstream for infra development by @tthyer in #3
• Changes in response to comments on ETL-34 by @philerooski in #4
• Update flow diagram to reflect ETL-34 changes by @philerooski in #5
• bootstrap json dataset by submitting existing archives by @philerooski in #6
• fix end of files by @philerooski in #7
• [ETL-33] CFN stacks: revise bucket, add role, database, classifier by @tthyer in #8
• Etl-55 scripts workflow by @tthyer in #10
• Create ECR repository for use with lambda by @philerooski in #9
• Etl-55 scripts workflow part. 2 by @tthyer in #11
• Etl-66 Glue Jobs by @tthyer in #12
• Etl-68/buckets by @tthyer in #13
• ETL-68 Add workflows stack by @tthyer in #14
• Etl-69 Triggers by @tthyer in #15
• Add glue tables stack by @tthyer in #16
• Etl-70 Glue crawler by @tthyer in #17
• Small revision to README by @tthyer in #19
• Make job names dependent upon stack name by @tthyer in #20
• Etl-76/pipeline fixes by @tthyer in #21
• Add schema change documents describing how to respond to a proposed upstream schema change by @philerooski in #18
• Etl-73 refactor by @tthyer in #22
• [ETL-71] Nested template for individual studies by @tthyer in #23
• Etl-65/synapsify by @tthyer in #24
• Etl-65/lambda by @tthyer in #25
• Etl-84/s3tojson tweaks by @tthyer in #26
• Add dataset mapping and reference it in s3_to_json_s3 script by @philerooski in #27
• Extend backfill json datasets script to accept entity view by @philerooski in #28
• ETL-85: unique job names / stack decoupling by @tthyer in #29
• Add script to build query string for representative appVersion sample by @philerooski in #30
• Initial commit flip_job script by @philerooski in #31
• Initial commit archive_dataset script by @philerooski in #33
• Etl-83 Schema update changes by @tthyer in #35
• fixing storage location handling in setup_test_data by @tthyer in #36
• Remove explicit SerdeInfo config from Glue tables by @tthyer in #37
• Use uploadedOn rather than createdOn for derived year/month/day partition fields by @philerooski in #38
• Improve schema change docs, remove flip_job script by @philerooski in #34
• ETL-99/spark UI by @tthyer in #39
• Config-driven refactor & jinja2 conversions by @tthyer in #40
• Fix info version in config files by @tthyer in #41
• Correct branch in example study sceptre config by @tthyer in #42
• Update sns_to_glue lambda to use Bridge SNS message format and SQS trigger by @philerooski in #43
• Create CODE_OF_CONDUCT.md by @tthyer in #44
• Convert s3 to json s3 job from python shell to spark job by @philerooski in #45
• Make database per study rather than global by @tthyer in #46
• Use exporter 3.0 data and metadata by @philerooski in #48
• Etl-121 by @tthyer in #49
• Fix lambda issue with namespaces by @tthyer in #50
• ETL-121: fixing cleanup workflow by @tthyer in #51
• Test commit by @tthyer in #52
• Another empty test commit by @tthyer in #53
• Fix syntax issue preventing variable from being expanded by @tthyer in #54
• Use github action expression instead of bash environment variable by @tthyer in #55
• Use the correct ref name from the delete event when cleaning up by @tthyer in #56
• [ETL-144] Return None if osName not found in dataset mapping by @philerooski in #57

Full Changelog: https://github.com/Sage-Bionetworks/BridgeDownstream/commits/v0