RAGFlow-0.10.0

Release Summary

• Supports text to SQL by RAG
• Provides Agent API
• Provide the health check on task_executor process.
• Add more Agent operator: Github, DeepL, BaiduFanyi, QWeather, ExecSQL, GoogleScholar
• Supports file type: eml
• Supports embedding model: Cohere
• Supports more LLMs or model services : GPT-4o-mini, PerfXCloud, TogetherAI, Upstage, Novita.AI, 01.AI, SiliconFlow, XunFei Spark, Baidu Yiyan, Tencent Hunyuan

What's Changed

• refine loginfo about graprag progress by @KevinHuSh in #1823
• feat: Add GoogleScholar #918 by @cike8899 in #1818
• fix: align limitation with env by @Chunshan-Theta in #1819
• add supprot for OpenAI-API-Compatible llm by @hangters in #1787
• add support for eml file parser by @hangters in #1768
• fix #1816 by @KevinHuSh in #1829
• Fixed a broken link by @writinwaters in #1831
• feat: Move files in file manager #1826 by @cike8899 in #1837
• fix: Unable to create a new chat assistant after closing the edit modal #1833 by @cike8899 in #1838
• fix: Embedding error in file parsing #1835 by @cike8899 in #1839
• fix: Entity types are only displayed when the knowledge graph is selected #1594 by @cike8899 in #1841
• add callback to entity extraction by @KevinHuSh in #1843
• refine mindmap by @KevinHuSh in #1844
• fix LocalAI add bug by @hangters in #1851
• add support for cohere by @hangters in #1849
• fix add slef base url openai error by @KevinHuSh in #1854
• feat: Do not display arrow icons on leaf node of folders #1826 by @cike8899 in #1862
• fix: The size of operators created from agent templates is displayed incorrectly #1863 by @cike8899 in #1864
• Fix a "TypeError: expected string or buffer bug" in docx files extracted using Knowledge Graph.#1859 by @jiyegege in #1865
• add support for lepton by @hangters in #1866
• remove jina pack in requirement file to fix package conflict by @hangters in #1867
• fix: Reference markers in the context may be carried over into the next answer by @leecj in #1855
• add support for gpt-4o-mini by @AAlexDing in #1827
• Add GitHub, deepl, baidu-fanyi by @guoyuhao2330 in #1857
• fix code injection by @Lyutoon in #1868
• less text, better extraction by @KevinHuSh in #1869
• feat: Add component DeepL #1739 by @cike8899 in #1870
• feat: Add component GitHub #1739 by @cike8899 in #1871
• feat: Add component BaiduFanyi #1739 by @cike8899 in #1874
• Add component qweather by @guoyuhao2330 in #1873
• Update version and format by @JinHai-CN in #1878
• feat: Replace the LocalAi icon #762 by @cike8899 in #1875
• Enhance the robustness of the code by @hangters in #1879
• feat: Add component QWeather #1739 by @cike8899 in #1881
• add using jina deploy local llm in deploy_local_llm.mdx by @hangters in #1872
• fix: model type only support single value by @hangters in #1884
• add function: upload and parse by @KevinHuSh in #1889
• Add agent api by @guoyuhao2330 in #1888
• fix no modual error by @KevinHuSh in #1892
• rm qwen-v1-max by @KevinHuSh in #1894
• remove qwen-v1-max by @KevinHuSh in #1895
• feat: Expose the agent's chat window to third parties #1842 by @cike8899 in #1897
• Fix token list , stats in api app.py by @guoyuhao2330 in #1896
• add support for PerfXCloud by @hangters in #1883
• add support for TogetherAI by @hangters in #1890
• add support for Upstage by @hangters in #1902
• Fix agent non stream by @guoyuhao2330 in #1904
• add sql to naive parser by @KevinHuSh in #1908
• fix: When the component id is very long, the delete button of generate will be hidden #1906 by @cike8899 in #1907
• feat: Add delimiter field to naive parsing method #1909 by @cike8899 in #1911
• add support for novita.ai by @hangters in #1910
• fix: Chunks cannot be deleted #1912 by @cike8899 in #1913
• feat: Added explanation on the parsing method of knowledge graph #1594 by @cike8899 in #1916
• fix api argument error by @KevinHuSh in #1920
• fix: Error on chat api，<BadRequestKeyError '400: Bad Request'> #1918 by @cike8899 in #1923
• boost paralal of graphrag by @KevinHuSh in #1924
• fix parameter error by @KevinHuSh in #1925
• feat: After selecting the parsing method as knowledge graph, the delimiter and chunk token number are displayed. #1594 by @cike8899 in #1929
• Fix retrieval API error and add multi-kb search by @wingjson in #1928
• add support for SILICONFLOW by @hangters in #1926
• fix prefXCloud logo bug by @hangters in #1933
• feat: Modify PerfXCloud name #1853 by @cike8899 in #1931
• fix mind map bug by @KevinHuSh in #1934
• refine error log while chunking by @KevinHuSh in #1937
• refine llm init by @KevinHuSh in #1938
• fix empty graph issue by @KevinHuSh in #1939
• add doc ids to chat by @KevinHuSh in #1944
• feat: Supports chatting with files/images #1880 by @cike8899 in #1943
• requirements_dev.txt is useless by @KevinHuSh in #1945
• Format file format from Windows/dos to Unix by @JinHai-CN in #1949
• feat: Delete the file from the upload control of the message input box #1880 by @cike8899 in #1946
• add interface to get doc infos by doc ids by @KevinHuSh in #1950
• Refactor switch component by @guoyuhao2330 in #1940
• add support for 01.AI by @hangters in #1951
• Correct the incorrect description of the pre-installed models on the SILICONFLOW platform. by @morler in #1956
• feat: Add FileIcon #1880 by @cike8899 in #1960
• Update api.md by @guoyuhao2330 in #1961
• fix add Bedrock llm error by @hangters in #1952
• feat: Add MessageInput to the external chat page #1880 by @cike8899 in #1963
• feat: Delete the files uploaded in the external dialog box #1880 by @cike8899 in #1967
• Refactor user register by @JinHai-CN in #1962
• refine upload & parse by @KevinHuSh in #1969
• Refactor user registration by @JinHai-CN in #1970
• Refactor user register & login by @JinHai-CN in #1971
• fix OpenAI Embedding length error by @hangters in #1972
• Add component ExeSQL by @guoyuhao2330 in #1966
• fix: Opening file whose type is Knowledge Graph appear error with tsx #1975 by @cike8899 in #1978
• fix 01.ai url error by @hangters in #1977
• feat: Add component ExecSQL #1739 by @cike8899 in #1982
• feat: Add tip to loop of ExeSQL #1739 by @cike8899 in #1983
• feat: Hide the upload button in the external agent's chat box #1880 by @cike8899 in #1984
• Update README.md by @andrewkwok-shanghaitech in #1979
• fix empty mind map issue by @KevinHuSh in #1991
• Add API to get doc info by doc ids by @wingjson in #1986
• Add template text2sql by @guoyuhao2330 in #1985
• add support for Replicate by @hangters in #1980
• feat: Add SwitchForm #1739 by @cike8899 in #1994
• fix mutiple retrieval component content by @guoyuhao2330 in #1997
• Refactor display Text by @JinHai-CN in #1999
• feat: Add complex dynamic form to SwitchForm #1739 by @cike8899 in #2001
• feat: Extract the code for building categorize operator coordinates to hooks.ts #1739 by @cike8899 in #2005
• Fix mutiple retrieval component content by @guoyuhao2330 in #2006
• Fix generate param empty_response by @guoyuhao2330 in #2010
• Updated Model Information for Tongyi-Qianwen and ZHIPU-AI by @morler in #2003
• turn down es bulk size by @KevinHuSh in #2013
• add support for Tencent Hunyuan by @hangters in #2015
• feat: Build the positions of the Switch handle #1739 by @cike8899 in #2018
• add support for XunFei Spark by @hangters in #2017
• doc: fix zh and ja document type by @aboutmydreams in #2012
• feat: Build the edges of Switch by form data #1739 by @cike8899 in #2022
• feat: Update Switch form data #1739 by @cike8899 in #2029
• Fix generate component reset_index and update text2sql template prompt by @guoyuhao2330 in #2031
• feat: Add SwitchOperatorOptions to Select of Switch #1739 by @cike8899 in #2033
• feat: Test the database connection of the ExeSQL operator #1739 by @cike8899 in #2036
• feat: Build options for the component id field of the Switch operator #1739 by @cike8899 in #2037
• add taskexecutor status check by @KevinHuSh in #2038
• How to make your changes to vm.max_map_count persistent on macOS by @writinwaters in #2041
• feat: Delete Answer and Relevant from RestrictedUpstreamMap of Switch #1739 by @cike8899 in #2039
• show error log of KG extraction by @KevinHuSh in #2045
• fix: Fix return type annotation in truncate function by @huangbaichao in #2044
• filter out + in es query by @KevinHuSh in #2046
• Fix component exesql bug by @guoyuhao2330 in #2042
• Refactor component exesql by @guoyuhao2330 in #2048
• [Doc] Add Korean translation for README.md by @RektPunk in #2040
• add support for markdown file in one parse way by @hangters in #2052
• feat: Fixed the issue where the test database connection was successful but the prompt message showed that there was no error status #1739 by @cike8899 in #2051
• Add template DB Assistant and exesql sql column description by @guoyuhao2330 in #2054
• add support for Baidu yiyan by @hangters in #2049
• Add Explanation for entering the API key when adding an LLM by @hangters in #2055
• feat: Create a conversation before uploading files in it #1880 by @cike8899 in #2057
• feat: Remove Typography from SwitchForm #1739 by @cike8899 in #2059
• fix uploading docx for mind map by @KevinHuSh in #2064
• Fix Bedrock system prompt by @rantav in #2062
• support monitoring task executor by @KevinHuSh in #2069
• fix: Add Task Executor to system panel #2061 by @cike8899 in #2070
• update doc for release by @KevinHuSh in #2071

New Contributors

• @AAlexDing made their first contribution in #1827
• @Lyutoon made their first contribution in #1868
• @wingjson made their first contribution in #1928
• @morler made their first contribution in #1956
• @andrewkwok-shanghaitech made their first contribution in #1979
• @aboutmydreams made their first contribution in #2012
• @RektPunk made their first contribution in #2040
• @rantav made their first contribution in #2062

Full Changelog: v0.9.0...v0.10.0