Skip to content

Releases: RunLLM/aqueduct

v0.0.7

01 Aug 20:52
a4b42dd
Compare
Choose a tag to compare

Released on 8/1/2022

Enhancements

  • Upgrades to go-chi v5.
  • Removes need to provide API key and server address when running client and server on same machine.
  • Adds support for operators with no input data.

Bugfixes

  • Fixes bug where imported functions were not executed correctly.
  • Improves CSV upload UI to make data preview accurate and more legible.
  • Fixes bug where requirements.txt was not consistently used.
  • Fixes bug where bottom sidesheet and DAG viewer were misaligned and improperly sized.

All Changes

v0.0.6...v0.0.7

All commits
  • Allows user to specify S3 credentials for Airflow integration by @saurav-c in #250
  • Adds workflow_dag engine_config column by @saurav-c in #209
  • Update SDK's S3 integration api documentation by @cw75 in #252
  • Fix a bug where we couldn't execute imported functions by @likawind in #259
  • Add docs and Slack links to top of README by @vsreekanti in #261
  • [backend] Upgrade go chi to v5 by @likawind in #260
  • [UI] Show workflows associated with an integration in integration details page by @likawind in #254
  • Add exec state to get_artifact_result by @kenxu95 in #253
  • Add warning color to DAG in UI by @kenxu95 in #245
  • [ENG-1412, 1413, 1414] Fixes CSV upload modal bugs by @vsreekanti in #262
  • ENG- 1418 export spiraldemocard and sqlservercard by @agiron123 in #256
  • [Bugfix] Fix bug where requirements.txt was not installing by @kenxu95 in #264
  • [ENG-1354, 1415] Fixes bottom sidesheet and ReactFlow alignment issues by @vsreekanti in #267
  • Update Integration Test Timeout by @agiron123 in #269
  • Returns ObjDoesNotExist error for S3 storage implementation by @saurav-c in #271
  • [ENG-1459] Removes need to provide API key, server address when running locally by @vsreekanti in #272
  • Support operator with no input by @cw75 in #265
  • Rename GetWorkflowTables -> GetWorkflowObjects by @eunice-chan in #239
  • Bump version number and changelog for release 0.0.7 by @cw75 in #279

v0.0.6

25 Jul 19:25
dd96998
Compare
Choose a tag to compare

Released on 7/25/2022

Enhancements

  • Prints error message as part of preview execution stack trace, not above it.

Bugfixes

  • Fixes bug where parameters argument to head function was unused.
  • Fixes bug where menu sidebar didn't link to home page.
  • Fixes bug where operator zipfiles weren't cleaned up after workflow creation.
  • Fixes bug where S3 connection listed all objects in bucket, causing connection to be extremely slow.
  • Fixes bug where error and warning checks aren't properly distinguished.

All Changes

v0.0.5...v0.0.6

All commits
  • Performs Code Structure/Naming changes for Orchestration Refactor by @kenxu95 in #207
  • Adds UI for connecting Airflow integration by @saurav-c in #140
  • Adds backend support for connecting Airflow integration by @saurav-c in #141
  • Fixing embarrassing bug by @jegonzal in #220
  • Rmeove unnecessary files from parcel bundle by @Boyuan-Deng in #219
  • Refactors the orchestration engine to use new dag, operator, artifact, and orchestration interfaces. by @kenxu95 in #213
  • Reenable gci in golangci linter by @kenxu95 in #224
  • Eng 1345 create api endpoint to get tables associated for workflow_id by @eunice-chan in #216
  • Fix bug where parameters argument to head() was unused. by @kenxu95 in #225
  • ENG-1401: Fixes menu sidebar link to homepage by @vsreekanti in #230
  • Updates example notebooks based on user feedback by @vsreekanti in #229
  • [Server] Create server API endpoint to fetch operators associated with integration by @likawind in #208
  • [Quality of life] Print the error context in the preview execution exception by @kenxu95 in #232
  • Refactors python operator entrypoints by @saurav-c in #226
  • Cleanup unzipped function directories properly on OSX by @kenxu95 in #233
  • Fix logging for workflow name / type in executor code. by @likawind in #234
  • Add ability to distinguish between warnings and error level checks on backend by @kenxu95 in #227
  • Eng 1427 fix database integration tests by @saurav-c in #235
  • Switch to a low-overhead way of authenticating S3 integration by @cw75 in #236
  • Revert "Rmeove unnecessary files from parcel bundle" by @Boyuan-Deng in #243
  • Disables connecting to Airflow from UI by @saurav-c in #244
  • ENG-1430 Fix UI Build in install_local.py by @agiron123 in #237
  • ENG-1407 Allow UI page sidebars to be passed in as prop. by @agiron123 in #242
  • Fix error message for error severity check not passing by @kenxu95 in #246
  • modify install_local scripts to only select necessary UI files by @Boyuan-Deng in #247
  • Bump version number and update changelog for release v0.0.6 by @cw75 in #249

v0.0.5

14 Jul 19:56
856ecad
Compare
Choose a tag to compare

Released on 7/14/2022

Enhancements

  • Makes password optional when creating a Postgres connection.
  • Adds describe method to every relational integration.
  • Improves log capture when executing user functions.
  • Enables configuration of S3 storage backend for version snapshots and operator metadata.
  • Displays workflow ID on workflow settings modal.
  • Adds ability to fetch an individual artifact from a workflow run using the SDK.
  • Supports reading multiple S3 files into a single Pandas DataFrame.
  • Deprecates showing pyplot image in notebook on workflow creation; instead, provides link to UI.

Bugfixes

None! 🎉

All Changes

v0.0.4...v0.0.5

All commits
  • Updates churn example to use correct port for UI by @hsubbaraj-spiral in #200
  • Make password optional for the Postgres integration by @eunice-chan in #202
  • ENG-868-Add describe() method to each of the relational integrations. by @Fanjia-Yan in #201
  • Improve the linter script to auth-sort Python imports by @cw75 in #205
  • Fixes run linter scripts when running commands by @likawind in #206
  • [Python executor] Improve logging for user function execution by @likawind in #144
  • Adds aqueduct storage command to CLI by @saurav-c in #193
  • add workflow id to workflow setting by @Boyuan-Deng in #188
  • Direct user UI instead of pyplot dag image by @Boyuan-Deng in #187
  • Eng 1241 Add ability to fetch an artifact from an existing flow version by @Fanjia-Yan in #157
  • Adds default values for Python connectors for Postgres.port and Extract.query_is_usable by @saurav-c in #210
  • Support multi file inputs from S3 integration by @cw75 in #211
  • Update README with latest tagline by @vsreekanti in #217
  • Bump release version to 0.0.5 by @cw75 in #215
  • Fix release 0.0.5 changelog typo by @cw75 in #218

v0.0.4

08 Jul 03:25
0e6040a
Compare
Choose a tag to compare

Released on 7/7/2022

Key Features

  • Workflows can now have custom parameters! A workflow can have any numbers of parameters which can be used in Python operators or SQL queries. See here for more details.

Enhancements

  • Add SDK support for fetching and pretty-printing workflow and workflow run metadata.
  • Hide success notifications by default to avoid repetitive notifications.
  • Allow for custom port selection for the Postgres integration.
  • Allow requirements.txt to be set on an operator-by-operator basis.
  • Add ability to copy SDK initialization snippet from account page.
  • Allows metrics to be integers in addition to floats.
  • Adds syntax candy for head on TableArtifacts.

Bugfixes

  • Fix bug that showed undefined in search bar when data search returned empty results.
  • Fix bug where integration passwords were shown in plaintext on request headers.
  • Fix bug where schema metadata was improperly persisted.
  • Fix bug that disallowed non-CSV file uploads.
  • Fix bug that caused unnecessary repetitive calls to the DAG render API.
  • Fix a number of minor UI bugs -- margins, button placement, etc.
  • Deprecates use of ipynbname in the SDK, which prevented the SDK from running in some notebook environments.

All Changes

v0.0.3...v0.0.4

All commits

v0.0.3

22 Jun 00:37
3386f2b
Compare
Choose a tag to compare

Released on 6/21/2022

Key Features

  • View what tables are present in an integration by clicking on the integration in the UI.
  • View all data artifacts created by Aqueduct on the /data page on the UI.
  • Add support for pre-defined metrics and checks, including lower & upper bounds and equality checks.
  • Implement support for capturing low-level metrics, such as compute time, CPU usage, and memory usage, on a per-operator basis.

Enhancements

  • API keys can now be retrieved from the SDK if running on the same machine as the Aqueduct server with aqueduct.get_apikey().
  • Add feature to automatically search for next available port when port 8080 is occupied.
  • Users can upload custom data to the Aqueduct demo DB — navigate to the integrations page, click on the Aqueduct Demo database, and hit “Add CSV”.
  • Allow users to optionally specify HTTP/S prefix when creating Aqueduct API client.
  • Implements support for creating checks via Great Expectations.
  • Simplifies notifications interface by reducing redundant text.

Bugfixes

  • Fix bug where logs directory didn’t exist on upgraded installations.
  • Fix bug where account page wasn’t previously being displayed.

All Changes

v0.0.2...v0.0.3

All commits

v0.0.2

09 Jun 20:46
5415030
Compare
Choose a tag to compare

Released on 6/9/2022

Enhancements

  • Allows users to start both the backend server and UI with aqueduct start
  • Removes NextJS from UI project, reverting to a vanilla React app packaged with Parcel
  • Removes need for users to have npm installed by serving the UI from the same server as the backend
  • Automatically ships common library as a transpiled module, removing need for explicit transpilation
  • Allows users to retrieve package version by running aqueduct version
  • Only binds server to localhost by default, removing requirement for firewall permissions
  • Improves the thread safety of the job manager
  • Allow users to execute annotated functions by calling fn.local(args)

Bugfixes

  • Fixes incorrect use of typing library for Python3.7
  • Fixes inconsistency in DAG rendering which would previously cause page load jitter
  • Fixes bug where bounds on metrics were mislabeled

Contributors

v0.0.1

09 Jun 20:10
Compare
Choose a tag to compare

Initial release of the Aqueduct Prediction Infrastructure.