Merge in recent changes

README.md

@@ -1,6 +1,6 @@
 ![Conductor](docs/img/logo.svg)
 
-[![Github release](https://img.shields.io/github/v/release/Netflix/conductor.svg)](https://GitHub.com/Netflix/conductor/releases)
+[![Github release](https://img.shields.io/github/v/release/conductor-oss/conductor.svg)](https://GitHub.com/Netflix/conductor-oss/releases)
 [![License](https://img.shields.io/github/license/conductor-oss/conductor.svg)](http://www.apache.org/licenses/LICENSE-2.0)
 
 
@@ -28,21 +28,22 @@ Please update your forks to point to this repo.  This will ensure your commits a
 git remote set-url origin https://github.com/conductor-oss/conductor
 ```
 > [!IMPORTANT]  
-> **Follow the steps below if you have an active PR againt the Netflix/Conductor repository**
+> **Follow the steps below if you have an active PR against the Netflix/Conductor repository**
 > 1. Fork **this** repository
 > 2. Update your local repository to change the remote to this repository
 > 3. Send a PR against the `main` branch
 
-## Releases
-The latest version is [![Github release](https://img.shields.io/github/v/release/Netflix/conductor.svg)](https://GitHub.com/Netflix/conductor/releases)
+## Conductor OSS Roadmap
+[See the roadmap for the Conductor](ROADMAP.md)
 
-The next scheduled release is in Dec 2023.
+## Releases
+The latest version is [![Github release](https://img.shields.io/github/v/release/conductor-oss/conductor.svg)](https://GitHub.com/conductor-oss/conductor/releases)
 
 ## Resources
-#### [Slack Community](https://join.slack.com/t/orkes-conductor/shared_invite/zt-xyxqyseb-YZ3hwwAgHJH97bsrYRnSZg)
-We have an active [community](https://join.slack.com/t/orkes-conductor/shared_invite/zt-xyxqyseb-YZ3hwwAgHJH97bsrYRnSZg) of Conductor users and contributors on the channel.
-#### [Documentation Site](https://orkes.io/content)
-[Documentation](https://orkes.io/content) and tutorial on how to use Conductor
+#### [Slack Community](https://join.slack.com/t/orkes-conductor/shared_invite/zt-2hmxn0i3n-_W~a9rWMbvMoYmlJo3Y15g)
+We have an active [community](https://join.slack.com/t/orkes-conductor/shared_invite/zt-2hmxn0i3n-_W~a9rWMbvMoYmlJo3Y15g) of Conductor users and contributors on the channel.
+#### [Documentation Site](https://docs.conductor-oss.org/)
+[Documentation](https://docs.conductor-oss.org/) and tutorial on how to use Conductor
 
 [Discussion Forum](https://github.com/conductor-oss/conductor/discussions): Please use the forum for questions and discussing ideas and join the community.
 
@@ -61,28 +62,17 @@ The runnable server is in server/ module.
 Follow the steps below to launch the docker container:
 
 ```shell
-
-# Create volumes for persistent stores
-# Used to create a persistent volume that will preserve the 
-docker volume create postgres
-docker volume create redis
-
-docker run --init -p 8080:8080 -p 1234:5000 --mount source=redis,target=/redis \
---mount source=postgres,target=/pgdata conductoross/conductor-standalone:3.15.0
-```
-
-Navigate to http://localhost:1234 once the container starts to launch UI.
-
-## Docker Containers for production usage
-```shell
-docker pull conductoross/conductor:3.15.0
+docker compose -f docker/docker-compose.yaml up
 ```
+* Navigate to http://localhost:5000 once the container starts to launch UI.
+* APIs are accessible at http://localhost:8080
+* Swagger Docs:http://localhost:8080/swagger-ui/index.html?configUrl=/api-docs/swagger-config#/
 
 
 ## Database Requirements
 
 * The default persistence used is Redis
-* The indexing backend is [Elasticsearch](https://www.elastic.co/) (6.x)
+* The indexing backend is [Elasticsearch](https://www.elastic.co/) (7.x)
 
 ## Other Requirements
 * JDK 17+

ROADMAP.md

@@ -0,0 +1,75 @@
+# Conductor OSS Roadmap
+
+
+## New Features
+### Type safety for workflow inputs and task input/output through JSON Schema
+
+* Allow type safe workflows and workers with support for JSON schema and protobuf
+* Enable scaffolding code generation for workers through schema for workers using CLI tool
+
+### New System Tasks
+
+* Database task to work with relational & no-sql databases
+* Polling support for HTTP task
+* Operators
+ * * For..Each with parallel and sequential execution
+ * * Improved While loop
+ * *  Try..Catch for improved error handling at the task level
+
+### LLM Integrations
+Conductor is a perfect platform to build your next LLM powered application or incorporating genAI into your applications.
+Enable system tasks for LLM integrations that lets you work with various language models for:
+1. Text completion
+2. Chat completion with memory
+3. Embedding generation
+
+### CLI for Conductor
+Allow developers to manage their conductor instance via CLI.
+
+* Manage metadata
+* Query and manage workflow executions (terminate, pause, resume, retry)
+* Start | Stop manage conductor server
+
+### Support Python as a scripting language for INLINE task
+Extend usability of Conductor by allowing lightweight python code as INLINE tasks.
+
+### New APIs for workflow state management
+
+* Synchronous execution of workflows
+* update workflow variables
+* Update tasks synchronously
+
+## SDKs
+
+* Rust
+* Kotlin
+* C++
+* Ruby
+* Swift
+* Flutter / Dart 
+* PHP
+
+### Worker metrics on server
+Expose an endpoint on the server that can be used by workers to publish worker specific metrics.
+This will allow monitoring metrics for all the workers in a distributed system across the entire system. 
+
+## Testing
+Infrastructure to make workflows easier to test and debug right from the UI and IDE.
+
+### Workflow Debugger
+
+* Ability to debug your workflows during development just like you would do when you write code
+* All functionality of a debugger
+* Breakpoints add/remove
+* Step to next
+* Drop to a certain task that was already executed. (going back in time)
+* Ability to inspect, modify, add input / output parameters
+* Watch Windows to see values of interesting  parameters during execution
+* Attaching to a certain WF execution
+* Remote Task debugging (with SDK Support).. Enable step by step execution in a task worker from the server
+
+## Maintenance
+
+1. Deprecate support for Elasticsearch 6
+2. Update support for newer versions of Elasticsearch
+2. Improve/Fix JOIN task performance (less about making it performant and more about just fixing the usability)  - Done