diff --git a/README.md b/README.md index d2cbfc4d..36927896 100644 --- a/README.md +++ b/README.md @@ -1,8 +1,4 @@ -
- ASTRA -
- -
+![ASTRA Banner Image](https://github.com/rte-design/ASTRA.ai/raw/main/images/banner-image-without-tagline.png)
@@ -22,36 +18,24 @@ README in English 简体中文 - -Real-time Multi-model Interactions - +[Lightning Fast](astra-service.md)   •   - -Low Latency - +[Multimodal Interactive](astra-service.md)   •   - -Supporting Multiple languages - +[Highly Customizeable](astra-service.md)
-
- -ASTRA is an open-source platform designed for developing applications utilizing large language models. It merges the ideas of Backend-as-a-Service and LLM operations, allowing developers to swiftly create production-ready generative AI applications. Additionally, it empowers non-technical users to engage in defining and managing data operations for AI applications. - -With ASTRA, you can easily create real-time, multi-modal AI applications with low latency, even without any coding knowledge. 🎉 +ASTRA is an open-source platform designed for developing agents utilizing large language models. With ASTRA, you can easily create lightning fast, multimodal AI agents, even without any coding knowledge.
-

Voice Agent

+

Voice Agent Showcase

-ASTRA is a versatile platform that can be used to build a wide range of applications. Here, we present a fantastic example of [an intuitive Voice Agent ](https://astra-agents.agora.io/) built on ASTRA. +[ASTRA Voice Agent](https://theastra.ai) -
-ASTRA Voice Agent -
+ASTRA is a versatile platform capable of building a wide range of agents. Here, we showcase an impressive Voice Agent powered by ASTRA, demonstrating its ability to create intuitive and seamless interactions. -As you can see, the real-time multimodal interactions, low latency, and responsive feedback all showcase the power of ASTRA. +![Showcase ASTRA Voice Agent](https://github.com/rte-design/ASTRA.ai/raw/main/images/astra-voice-agent.gif)

Run Voice Agent Locally

@@ -85,7 +69,7 @@ You will need to uncheck "Use Rosetta for x86_64/amd64 emulation on apple silico
-![ASTRA Docker Setting](./images/docker-setting.gif) +![ASTRA Docker Setting](https://github.com/rte-design/ASTRA.ai/raw/main/images/docker-setting.gif)
@@ -166,57 +150,17 @@ make run-server 🎉 Congratulations! You have created your first personalized voice agent. -
-

ASTRA Service

- -Now let's discuss what's under the hood. The ASTRA Service is composed of various ASTRA extensions, developed in different programming languages. These extensions are interconnected using Graph, which describes their relationships and illustrates the flow of data. Furthermore, sharing and downloading extensions are simplified through the ASTRA Extension Store and the ASTRA Package Manager. - -
- -ASTRA - -
+To understand how the ASTRA service works under the hood, please refer to the [ ASTRA service documentation ](astra-service.md).
-

ASTRA Extension

- -An extension is the fundamental unit of composition within the ASTRA framework. Developers can create extensions in various programming languages and combine them to build diverse scenarios and applications. ASTRA emphasizes cross-language collaboration, allowing extensions written in different languages to work together seamlessly within the same application or service. - -For example, if an application requires real-time communication (RTC) features and advanced AI capabilities, a developer might choose to write RTC-related extensions in C++ for its performance advantages in processing audio and video data. Meanwhile, they could develop AI extensions in Python to leverage its extensive libraries and frameworks for data analysis and machine learning tasks. - -#### Supported Languages - -As of July 2024, we support extensions written in **C++**, **Golang** and **Python**. +

Stay Tuned

+Star our repository and get instant notifications for all new releases!
-

Graph

- -A Graph in ASTRA describes the data flow between extensions, orchestrating their interactions. For example, the text output from a speech-to-text (STT) extension might be directed to a large language model (LLM) extension. Essentially, a Graph defines which extensions are involved and the direction of data flow between them. Developers can customize this flow, directing outputs from one extension, such as an STT, into another, like an LLM. -In ASTRA, there are four main types of data flow between extensions, they are **Command**, **Data**, **Image Frame** and **PCM Frame**. - -By specifying the direction of these data types in the Graph, developers can enable mutual invocation and unidirectional data flow between plugins. This is especially useful for PCM and image data types, simplifying audio and video processing. +![ASTRA star us gif](https://github.com/rte-design/ASTRA.ai/raw/main/images/star-the-repo-confetti-higher-quality.gif)
-

ASTRA Agent App

- -An ASTRA Agent App is a runnable server-side application that combines multiple Extensions following Graph rules to accomplish more sophisticated operations.An ASTRA Agent App is a robust, server-side application that executes complex operations by integrating multiple Extensions within a flexible framework defined by Graph rules. These Graph rules orchestrate the interplay between various Extensions, enabling the app to perform sophisticated tasks that go beyond the capabilities of individual components. - -By leveraging this architecture, an ASTRA Agent App can seamlessly manage and coordinate different functionalities, ensuring that each Extension interacts harmoniously with others. This design allows developers to create powerful and scalable applications capable of handling intricate workflows and data processing requirements. - -
-

ASTRA Extension Store

- -The ASTRA Store is a centralized platform designed to foster collaboration and innovation among developers by providing a space where they can share their extensions. This allows developers to contribute to the community, showcase their work, and receive feedback from peers, enhancing the overall quality and functionality of the ASTRA ecosystem. - -In addition to sharing their own extensions, developers can also access a wide array of extensions created by others. This extensive library of extensions makes it easier to find tools and functionalities that can be integrated into their own projects, accelerating development and promoting best practices within the community. The ASTRA Store thus serves as a valuable resource for both novice and experienced developers looking to expand their capabilities and leverage the collective expertise of the community. - -
-

ASTRA Package Manager

- -The ASTRA Package Manager streamlines the entire process of handling ASTRA extensions, making it easy to upload, share, download, and install them. It significantly simplifies the workflow by allowing extensions to specify their dependencies on other extensions and the environment. This ensures that all necessary components are automatically managed and installed, reducing the potential for errors and conflicts. - -By automatically managing these dependencies, the ASTRA Package Manager makes the installation and release of extensions extremely convenient and intuitive. This tool not only saves time but also enhances the user experience by ensuring that every extension works seamlessly within the larger ecosystem. This level of automation and ease of use encourages the development and distribution of more robust and complex extensions, further enriching the ASTRA framework.

Join Community

diff --git a/astra-service.md b/astra-service.md new file mode 100644 index 00000000..1a3ff8c6 --- /dev/null +++ b/astra-service.md @@ -0,0 +1,50 @@ +

ASTRA Service

+ +Now let's discuss what's under the hood. The ASTRA Service is composed of various ASTRA extensions, developed in different programming languages. These extensions are interconnected using Graph, which describes their relationships and illustrates the flow of data. Furthermore, sharing and downloading extensions are simplified through the ASTRA Extension Store and the ASTRA Package Manager. + +
+ +ASTRA + +
+ +
+

ASTRA Extension

+ +An extension is the fundamental unit of composition within the ASTRA framework. Developers can create extensions in various programming languages and combine them to build diverse scenarios and applications. ASTRA emphasizes cross-language collaboration, allowing extensions written in different languages to work together seamlessly within the same application or service. + +For example, if an application requires real-time communication (RTC) features and advanced AI capabilities, a developer might choose to write RTC-related extensions in C++ for its performance advantages in processing audio and video data. Meanwhile, they could develop AI extensions in Python to leverage its extensive libraries and frameworks for data analysis and machine learning tasks. + +#### Supported Languages + +As of July 2024, we support extensions written in **C++**, **Golang** and **Python**. + +
+

Graph

+ +A Graph in ASTRA describes the data flow between extensions, orchestrating their interactions. For example, the text output from a speech-to-text (STT) extension might be directed to a large language model (LLM) extension. Essentially, a Graph defines which extensions are involved and the direction of data flow between them. Developers can customize this flow, directing outputs from one extension, such as an STT, into another, like an LLM. + +In ASTRA, there are four main types of data flow between extensions, they are **Command**, **Data**, **Image Frame** and **PCM Frame**. + +By specifying the direction of these data types in the Graph, developers can enable mutual invocation and unidirectional data flow between plugins. This is especially useful for PCM and image data types, simplifying audio and video processing. + +
+

ASTRA Agent App

+ +An ASTRA Agent App is a runnable server-side application that combines multiple Extensions following Graph rules to accomplish more sophisticated operations.An ASTRA Agent App is a robust, server-side application that executes complex operations by integrating multiple Extensions within a flexible framework defined by Graph rules. These Graph rules orchestrate the interplay between various Extensions, enabling the app to perform sophisticated tasks that go beyond the capabilities of individual components. + +By leveraging this architecture, an ASTRA Agent App can seamlessly manage and coordinate different functionalities, ensuring that each Extension interacts harmoniously with others. This design allows developers to create powerful and scalable applications capable of handling intricate workflows and data processing requirements. + +
+

ASTRA Extension Store

+ +The ASTRA Store is a centralized platform designed to foster collaboration and innovation among developers by providing a space where they can share their extensions. This allows developers to contribute to the community, showcase their work, and receive feedback from peers, enhancing the overall quality and functionality of the ASTRA ecosystem. + +In addition to sharing their own extensions, developers can also access a wide array of extensions created by others. This extensive library of extensions makes it easier to find tools and functionalities that can be integrated into their own projects, accelerating development and promoting best practices within the community. The ASTRA Store thus serves as a valuable resource for both novice and experienced developers looking to expand their capabilities and leverage the collective expertise of the community. + +
+

ASTRA Package Manager

+ +The ASTRA Package Manager streamlines the entire process of handling ASTRA extensions, making it easy to upload, share, download, and install them. It significantly simplifies the workflow by allowing extensions to specify their dependencies on other extensions and the environment. This ensures that all necessary components are automatically managed and installed, reducing the potential for errors and conflicts. + +By automatically managing these dependencies, the ASTRA Package Manager makes the installation and release of extensions extremely convenient and intuitive. This tool not only saves time but also enhances the user experience by ensuring that every extension works seamlessly within the larger ecosystem. This level of automation and ease of use encourages the development and distribution of more robust and complex extensions, further enriching the ASTRA framework. \ No newline at end of file diff --git a/images/banner-image-without-tagline.png b/images/banner-image-without-tagline.png new file mode 100644 index 00000000..e571a29b Binary files /dev/null and b/images/banner-image-without-tagline.png differ diff --git a/images/new-banner-without-tagline.png b/images/new-banner-without-tagline.png deleted file mode 100644 index 03b273ea..00000000 Binary files a/images/new-banner-without-tagline.png and /dev/null differ diff --git a/images/star-the-repo-confetti-higher-quality.gif b/images/star-the-repo-confetti-higher-quality.gif new file mode 100644 index 00000000..1055515f Binary files /dev/null and b/images/star-the-repo-confetti-higher-quality.gif differ diff --git a/images/star-the-repo-confetti.gif b/images/star-the-repo-confetti.gif new file mode 100644 index 00000000..d41e7d4d Binary files /dev/null and b/images/star-the-repo-confetti.gif differ