feat: change default graph to contain deepgram & fish only (#440)

* feat: change default graph to contain deepgram & fish only

* Update docker-compose.yml

* feat: initial change

* feat: add module setting dialog

* add addon property

* feat: initial module picker

* feat: first draft done for property editing

* fix: fix frontend build failures

* feat: small bug fixes

* feat: details

* feat: make module picker dynamic, fix 11labs pandatic issue

* feat: request optimization

* feat: improvements

* feat: add default property.json for replacable modules

* playground image update

* update playground image

* feat: update readme to take out graph designer

* feat: support environment variable check before starting

* feat: support azure for openai & fix extension property editor bug

* update playground image

* feat: upgrade azure tts version

* feat: playground cfg dialog ui reorg

* feat: support tool binding

* upgrade 11labs version

* fix: fix playground build failure

* feat: whitelist vision_analyze_tool_python

* support v2v

* feat: add v2v graph

.env.example

@@ -102,6 +102,11 @@ OPENAI_API_BASE=https://api.openai.com/v1
 OPENAI_API_KEY=
 OPENAI_MODEL=gpt-4o-mini
 
+# set this to azure if you are using azure openai
+OPENAI_VENDOR=
+OPENAI_AZURE_ENDPOINT=
+OPENAI_AZURE_API_VERSION=
+
 # OpenAI API key for realtime API
 OPENAI_REALTIME_API_KEY=
 # Azure OPENAI API key & Base URI for realtime API

README.md

@@ -151,8 +151,7 @@ docker compose up -d
 Open up a separate terminal window, enter the container and build the agent:
 ```bash
 docker exec -it ten_agent_dev bash
-
-task use AGENT=agents/examples/demo
+task use
 ```
 
 #### 5. Start the server
@@ -166,14 +165,6 @@ task run
 #### TEN Agent
 Open up [localhost:3000]( http://localhost:3000 ) in browser to play the TEN Agent.
 
-#### TEN Graph Designer
-
-Open up another tab go to [localhost:3001]( http://localhost:3001 ), and use Graph Designer to create, connect and edit extensions on canvas.
-
-Once you save the graph, you can return to [localhost:3000]( http://localhost:3000 ) and select the corresponding graph to view the changes.
-
-![TEN Graph Designer](https://github.com/TEN-framework/docs/blob/main/assets/gif/hello_world_python.gif?raw=true)
-
 <br>
 <h2>How components work together</h2>
 

Taskfile.yml

@@ -16,7 +16,7 @@ tasks:
   use:
     desc: use agent, default 'agents/examples/demo'
     vars:
-      AGENT: '{{.AGENT| default "agents/examples/demo"}}'
+      AGENT: '{{.AGENT| default "agents/examples/default"}}'
     cmds:
       - ln -sf {{.USER_WORKING_DIR}}/{{.AGENT}}/manifest.json ./agents/
       - ln -sf {{.USER_WORKING_DIR}}/{{.AGENT}}/property.json ./agents/
@@ -49,7 +49,6 @@ tasks:
   build-server:
     desc: build server
     dir: ./server
-    internal: true
     cmds:
       - go mod tidy && go mod download && go build -o bin/api main.go
 

agents/examples/default/manifest.json

@@ -0,0 +1,42 @@
+{
+  "type": "app",
+  "name": "agent_demo",
+  "version": "0.4.0",
+  "dependencies": [
+    {
+      "type": "system",
+      "name": "ten_runtime_go",
+      "version": "0.4"
+    },
+    {
+      "type": "extension",
+      "name": "py_init_extension_cpp",
+      "version": "0.4"
+    },
+    {
+      "type": "extension",
+      "name": "agora_rtc",
+      "version": "=0.9.0-rc1"
+    },
+    {
+      "type": "extension",
+      "name": "agora_sess_ctrl",
+      "version": "0.3.0-rc1"
+    },
+    {
+      "type": "system",
+      "name": "azure_speech_sdk",
+      "version": "1.38.0"
+    },
+    {
+      "type": "extension",
+      "name": "azure_tts",
+      "version": "=0.6.2"
+    },
+    {
+      "type": "extension",
+      "name": "agora_rtm",
+      "version": "=0.3.0"
+    }
+  ]
+}