v0.0.4

Released on 7/7/2022

Key Features

• Workflows can now have custom parameters! A workflow can have any numbers of parameters which can be used in Python operators or SQL queries. See here for more details.

Enhancements

• Add SDK support for fetching and pretty-printing workflow and workflow run metadata.
• Hide success notifications by default to avoid repetitive notifications.
• Allow for custom port selection for the Postgres integration.
• Allow requirements.txt to be set on an operator-by-operator basis.
• Add ability to copy SDK initialization snippet from account page.
• Allows metrics to be integers in addition to floats.
• Adds syntax candy for head on TableArtifacts.

Bugfixes

• Fix bug that showed undefined in search bar when data search returned empty results.
• Fix bug where integration passwords were shown in plaintext on request headers.
• Fix bug where schema metadata was improperly persisted.
• Fix bug that disallowed non-CSV file uploads.
• Fix bug that caused unnecessary repetitive calls to the DAG render API.
• Fix a number of minor UI bugs -- margins, button placement, etc.
• Deprecates use of ipynbname in the SDK, which prevented the SDK from running in some notebook environments.

All Changes

v0.0.3...v0.0.4

All commits

• Fixes error handling in get_apikey by @vsreekanti in #130
• [SDK] Builds ability to fetch and inspect an existing flow in the system by @kenxu95 in #115
• Fix the automated notebook tests by @kenxu95 in #131
• Add list method for sys metrics by @HarisChoudhary in #137
• Add example for preset/system metrics in notebook by @HarisChoudhary in #134
• UI-finished implementation to hide success notification by @Boyuan-Deng in #94
• Eng 1256 refresh table list in integration by @eunice-chan in #133
• [UI] Fix data page search bar bug showing 'undefined' and not cancel properly by @likawind in #139
• Eng-1267-append-dag-result-id-to-workflow-id-page0-url by @Boyuan-Deng in #135
• Eng 1239 create pull request template by @cw75 in #138
• Move pull request template file location by @cw75 in #142
• Remove the unneeded header section in the PR template by @cw75 in #143
• Eng 1185 UI build by @agiron123 in #132
• Show parameters correctly on the UI by @kenxu95 in #125
• Update README for ui development. by @agiron123 in #146
• Obfuscate password in header for integration config by @HarisChoudhary in #118
• Eng 943 update getartifactversionsroute to include checks by @eunice-chan in #95
• ENG-1271 Show user a message saying that we do not support previewing base data for an S3 integration by @eunice-chan in #151
• Add executor files to integration tests server logs by @HarisChoudhary in #150
• [Backend] Adds Parameterization to SQL Queries by @kenxu95 in #152
• Implement a script to run all linters by @cw75 in #149
• Adds UI input to capture custom port for Postgres integration by @eunice-chan in #156
• Update pull_request_template.md by @eunice-chan in #163
• Creates pre-merge integration test check by @hsubbaraj-spiral in #155
• Fix bug where the schema metadata was written improperly by @kenxu95 in #166
• Eng 1104 Allow users to specify function-specific requirements by @Fanjia-Yan in #128
• Changes branch of reused workflow to main by @hsubbaraj-spiral in #164
• [SDK] Adds consistent parameter validation by @kenxu95 in #158
• Use absolute file path to serve UI files by @cw75 in #165
• Adds integration test step to dev workflow in contribution guide by @hsubbaraj-spiral in #170
• ENG-1281 Fix IntegrationFileUploadField to be usable for csv & other filetypes by @eunice-chan in #145
• Remove unnecessary triggers and reporting from integration tests by @kenxu95 in #169
• Changes the concurrency of integration tests to n=1 by @hsubbaraj-spiral in #173
• Follow up to Eng 1305 by @hsubbaraj-spiral in #174
• cleans logic to avoid unnecessary api call to dagPosition route by @Boyuan-Deng in #92
• Simplifies README and moves example to top level by @vsreekanti in #172
• Eng 1181, Eng 1281, Eng 1209 move download of binaries to setup.py by @eunice-chan in #167
• adds copy button to sdk initialization … by @Boyuan-Deng in #136
• fixed "report issue" button weird margin by @Boyuan-Deng in #179
• Eng 1181 move download of binaries to pip install (followup) by @eunice-chan in #180
• make-archive-all-button-visible-at-all-time by @Boyuan-Deng in #178
• Skips ci on non-code changes by @hsubbaraj-spiral in #175
• Follows up 1306 to change workflow branch to main by @hsubbaraj-spiral in #183
• Fixes bug in the pre-merge-ci config by @hsubbaraj-spiral in #185
• Allow the update script to update components separately by @cw75 in #171
• [UI] Add ability to trigger a flow with custom parameters by @kenxu95 in #181
• Adds periodic integration tests by @hsubbaraj-spiral in #182
• Write demo notebook for workflow parameterization by @kenxu95 in #186
• Updates periodic integration test by @hsubbaraj-spiral in #189
• Improves usage of ci tests by not relying on github paths by @hsubbaraj-spiral in #190
• Fix restrictive metric typing by @eunice-chan in #192
• adding live demo example by @jegonzal in #162
• ENG 1297: Set up build to package UI for sagemaker by @vsreekanti in #176
• Deprecate the use of ipynbname package in our SDK by @cw75 in #184
• Add a head function to Table artifacts by @Fanjia-Yan in #191
• Fix link in parameterization demo notebook by @kenxu95 in #196
• Move setup back to aqueduct start by @eunice-chan in #197
• Fix bugs in README script from set up call by @vsreekanti in #199
• Update install script to properly install for SageMaker instances and bump release numbers by @cw75 in #203
• Updates changelog for v0.0.4 release by @vsreekanti in #204