Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(DC): Discover Storage as a Config #3480

Merged
merged 1 commit into from
Dec 9, 2022

Conversation

rahul-kumar-saini
Copy link
Contributor

Overview

Changes

  • Any call to get_storage() with a discover storage key will return the storage built from config instead of the hardcoded version

Testing Notes

  • How config was generated:
    • python3 scripts/pystorage_2_yaml.py discover discover.yaml
    • Removed quotes around columns in schema, format yaml file with Prettier
  • How config was tested:
    • python3 scripts/check_yaml_against_code.py discover discover.yaml
    • Updated tests/datasets/configuration/test_storage_loader.py

@codecov-commenter
Copy link

codecov-commenter commented Dec 7, 2022

Codecov Report

Base: 91.67% // Head: 91.67% // Increases project coverage by +0.00% 🎉

Coverage data is based on head (3cb2708) compared to base (b408d54).
Patch coverage: 100.00% of modified lines in pull request are covered.

Additional details and impacted files
@@           Coverage Diff           @@
##           master    #3480   +/-   ##
=======================================
  Coverage   91.67%   91.67%           
=======================================
  Files         715      715           
  Lines       33466    33467    +1     
=======================================
+ Hits        30679    30680    +1     
  Misses       2787     2787           
Impacted Files Coverage Δ
...ests/datasets/configuration/test_storage_loader.py 100.00% <100.00%> (ø)

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report at Codecov.
📢 Do you have feedback about the report comment? Let us know in this issue.

column_name: tags
- processor: UUIDColumnProcessor
args:
columns: !!set
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What does this mean?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's the yaml syntax for a set. I was confused at first too but that's just how you define a set in yaml 😅

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Lol that is bizarre but good to know it's supported. I think we had type issues with that before.

column_name: tags
- processor: UUIDColumnProcessor
args:
columns: !!set
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Lol that is bizarre but good to know it's supported. I think we had type issues with that before.

@rahul-kumar-saini rahul-kumar-saini merged commit 31079db into master Dec 9, 2022
@rahul-kumar-saini rahul-kumar-saini deleted the rahul/feat/discover-storage-as-a-config branch December 9, 2022 21:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants