Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Feature/fs 5753 sync with remote take 3 (conductor-oss#75)
* Feature - use environment variable to set ES6 support mode for Nashorn script evaluator (conductor-oss#88) Use environment variable CONDUCTOR_NASHORN_ES6_ENABLED=true to set ES6 support mode for Nashorn script evaluator. * Fix an issue with the postgres indices as they weren't being used properly (conductor-oss#92) * Upgrade the postgres lib to prevent CVE-2024-1597 (conductor-oss#94) * Enable finer-grained control over the postgres indexing and searching (conductor-oss#93) * Enable the searching of the JSON field in Postgres to be configured * Enable the indexing of tasks to be enabled / disabled * Implement removeWorkflow for postgres index * Enable the migration to run without always recreating an index (conductor-oss#98) * Feature: Use TaskStatusListener.onTaskInProgress() (conductor-oss#58) * apply task-task-status-listener * fix test error * prevent NPE * Fix SpringBoot imports file location error (conductor-oss#89) * Implementation of Postgres PollDataDAO with read and write caching (conductor-oss#82) * Initial implementation of an experimental queue optimisation using Postgres LISTEN/NOTIFY (conductor-oss#87) * Initial implementation of an experimental queue optimisation using Postgres LISTEN/NOTIFY * Use Optional instead of returning null for getSize() * Update connection method for queue listener to make it more thread safe * Only apply the queue notify migrations if configured * Update the postgres docs with all configurable properties (conductor-oss#99) * Fix ElasticSearch health check failure when ES sets password (conductor-oss#59) * Add option to only index workflows on Postgres when their status changes (conductor-oss#83) * Adding redis username support for clusters (conductor-oss#105) Co-authored-by: Anup Chatterjee <[email protected]> * Update README.md * Fix PostgresIndexQueryBuilder null pointer exception (conductor-oss#116) * Throw IllegalArgumentException when query string does not match regex * Unit test for exception * Update README.md (conductor-oss#113) * Add a migration to relax the size constraint on task_index columns (conductor-oss#114) * Fix of exception handler trying to write response to a disconnected client (conductor-oss#109) Why: On Conductor server side, an exception gets raised `Failure in @ExceptionHandler com.netflix.conductor.rest.controllers.ApplicationExceptionMapper#handleAll(HttpServletRequest, Throwable)`. Cause is attempting to write while the client aborted the connection `org.apache.catalina.connector.ClientAbortException: java.io.IOException: Broken pipe` What: Added a ClientAbortException handler. Testing done: Local run. Not trivial to emulate the issue in a test. Such a test may rely on timing out the client before server responded. Signed-off-by: Iva Avramova <[email protected]> * Workflow bulk deletion API and action module options (conductor-oss#110) * Initial commit to add bulk workflow deletion * Added an API endpoint for bulk deletion * Add archiveworkflow param * Added bulk delete action to BulkActionModule * Added archive option to bulk delete * Addition of terminateRemove() Functions (conductor-oss#9) * Added an API endpoint for bulk deletion * Fixed WorkflowBulkServiceTest, added test cases for deleteWorkflow an… (conductor-oss#10) * Fixed WorkflowBulkServiceTest, added test cases for deleteWorkflow and terminateRemove, and added WorkflowResourceTest test for single terminateRemove * pass spotlessjava --------- Co-authored-by: JeffP <[email protected]> --------- Co-authored-by: jeffp1 <[email protected]> Co-authored-by: Ayush Thengne <[email protected]> Co-authored-by: Jeff P <[email protected]> Co-authored-by: Doe1111 <[email protected]> * Join task fixes (conductor-oss#117) * fix join completing with errors when a task has failed or some tasks are not terminal yet * add more tests * add more comments to join routine * mark join task synchronous * Implement postgres lock DAO * add postgres locking mention in docs * rename locking db migration * refactor query - the pg now() function is already UTC * fix test * fix pg query * simplify query * fix tests * timeunit ms * fix tests * fix formatting * Workflow and task status notifier Co-authored-by: ToastedTaco <[email protected]> Co-authored-by: BabyBlue0214 <[email protected]> Co-authored-by: Elijah Spicer <[email protected]> * revert WorkflowDef changes * Revert unrelated changes * Status Notifier Properties Cleanup * update the tests for the JOIN task fix * Fix the name of the task index migration * Update README.md * Update README.md * Wrap PGExecutionDAO createTasks in a single transaction * publish roadmap * add link to the roadmap * Create codacy.yml * if status-listener error, task not executed * change the point of cancellation * Delete .github/workflows/codacy.yml * Fix of exception handler trying to write response to a disconnected client Why: On Conductor server side, an exception gets raised `Failure in @ExceptionHandler com.netflix.conductor.rest.controllers.ApplicationExceptionMapper#handleAll(HttpServletRequest, Throwable)`. Cause is attempting to write while the client aborted the connection `org.apache.catalina.connector.ClientAbortException: java.io.IOException: Broken pipe`, while the exception was wrapped in `ClosedChannelException`. What: Added a ClosedChannelException handler for such exceptions root caused by ClientAbortException. Testing done: Local run. Not trivial to emulate the issue in a test. Such a test may rely on timing out the client before server responded. Signed-off-by: Iva Avramova <[email protected]> * Fix of exception handler trying to write response to a disconnected client Why: On Conductor server side, an exception gets raised `Failure in @ExceptionHandler com.netflix.conductor.rest.controllers.ApplicationExceptionMapper#handleAll(HttpServletRequest, Throwable)`. Cause is attempting to write while the client aborted the connection `org.apache.catalina.connector.ClientAbortException: java.io.IOException: Broken pipe`, while the exception was nested in `ClosedChannelException`. What: Added a ClosedChannelException handler for exception chain containing ClientAbortException. Testing done: Local run. Not trivial to emulate the issue in a test. Such a test may rely on timing out the client before server responded. Signed-off-by: Iva Avramova <[email protected]> * added tests; generalized the exception Signed-off-by: Iva Avramova <[email protected]> * added tests; generalized the exception Signed-off-by: Iva Avramova <[email protected]> * Why: Ignoring a particular exception based on its stack trace should be rather an alerting concern. What: Reverted ClientAbortedException specific handler. Added test coverage for the existing exception handler. Testing done: local run Signed-off-by: Iva Avramova <[email protected]> * Fix for concurrentExecLimit * Bump io.micrometer:micrometer-registry-datadog from 1.12.1 to 1.13.0 Bumps [io.micrometer:micrometer-registry-datadog](https://github.com/micrometer-metrics/micrometer) from 1.12.1 to 1.13.0. - [Release notes](https://github.com/micrometer-metrics/micrometer/releases) - [Commits](micrometer-metrics/micrometer@v1.12.1...v1.13.0) --- updated-dependencies: - dependency-name: io.micrometer:micrometer-registry-datadog dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> * Added logic to remove stale iteration outputs based on keepLastN parameter * Remove unused code block * Remove unused code block * Fixed formatting issues * Updating DoWhileTask keepLastN iteration endIndex * fix: Fix error with headers in webhook * style: Fix style * Bump com.diffplug.spotless from 5.0.0 to 6.25.0 Bumps com.diffplug.spotless from 5.0.0 to 6.25.0. --- updated-dependencies: - dependency-name: com.diffplug.spotless dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <[email protected]> * Make sub workflow task sync * assertion * fix sub workflow tests * remove not required pop * rerun test fix. * more fixes. * fixes * fixes * Sub workflow sync test fix. Since the ordering of the task can be different. The integration_task_2 will be polled and completed. * added in other tests * Update directed-acyclic-graph.md * clean up * added additional configuration properties, error listener, proper handling of queue groups * fix: spotless apply * fix webhook property validation - parameterizing log with placeholder * fix: logging of connection failures due to bad evaluation of a string comparison * update from Orkes * clean up * update tests * updates to the classes * updates * back to async * update tests * add AfterburnerModule * formatting * fix tests * Added test for decider completion logic: a workflow with all optional tasks in terminal state should be COMPLETED * Adding back AfterburnerModule to ObjectMapperConfiguration. This instance is the one that Spring Boot is going to inject to its beans. * update README * FS-5753 Updated application.properties per feedback in last PR that was declined https://github.com/euc-data/mirror.conductor/pull/69/files#diff-0d50f15e65cc4f2001605e2f6f29edb9c2d73e1d5864cc3b7fe6d3dc385839a0 --------- Signed-off-by: Iva Avramova <[email protected]> Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: Vasiliy Pankov <[email protected]> Co-authored-by: Ben Pirt <[email protected]> Co-authored-by: Hoony <[email protected]> Co-authored-by: Young-Zen <[email protected]> Co-authored-by: Anup Chatterjee <[email protected]> Co-authored-by: Anup Chatterjee <[email protected]> Co-authored-by: Viren Baraiya <[email protected]> Co-authored-by: omadaan <[email protected]> Co-authored-by: Riza Farheen <[email protected]> Co-authored-by: ivakoleva <[email protected]> Co-authored-by: Olivia Bailey <[email protected]> Co-authored-by: jeffp1 <[email protected]> Co-authored-by: Ayush Thengne <[email protected]> Co-authored-by: Jeff P <[email protected]> Co-authored-by: Doe1111 <[email protected]> Co-authored-by: Bert Verstraete <[email protected]> Co-authored-by: CollinDewey <[email protected]> Co-authored-by: ToastedTaco <[email protected]> Co-authored-by: BabyBlue0214 <[email protected]> Co-authored-by: Elijah Spicer <[email protected]> Co-authored-by: Martini <[email protected]> Co-authored-by: manan164 <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Srihari Malagi <[email protected]> Co-authored-by: Srihari K. Malagi <[email protected]> Co-authored-by: Juan Cruz <[email protected]> Co-authored-by: RizaFarheen <[email protected]> Co-authored-by: astelmashenko <[email protected]> Co-authored-by: Marcellus <[email protected]> Co-authored-by: Fabio Scippacercola <[email protected]> Co-authored-by: Miguel Prieto <[email protected]>
- Loading branch information