Add a web surfer agent that can search and browse the web. #1093
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…s. WebSurfer will be added in a subsequent commit.
afourney
changed the title
3 tasks
Codecov ReportAttention:
Additional details and impacted files@@ Coverage Diff @@
## main #1093 +/- ##
===========================================
+ Coverage 34.57% 45.18% +10.61%
===========================================
Files 38 40 +2
Lines 4587 4904 +317
Branches 1060 1185 +125
===========================================
+ Hits 1586 2216 +630
+ Misses 2875 2504 -371
- Partials 126 184 +58
Flags with carried forward coverage won't be shown. Click here to find out more. ☔ View full report in Codecov by Sentry. |
quantum-ciphers
pushed a commit
to quantum-ciphers/autogen
that referenced
this pull request
Jan 26, 2024
…#1093) * Initial commit of WebSurfer. Adds the browser_utils, and related tests. WebSurfer will be added in a subsequent commit. * Added the web surfer agent, and related tests. * Added a notebook to show how WebSurferAgent works. * Fixed a typo. * Updated test_web_surfer for compatibility with microsoft#1110. * Updated skip_oai logic. * Fixed code formatting. * More pre-commit fixes. * Added block to contrib-openai.yml * Added block to contrib-openai.yml * Added hook for BING_API_KEY * Temporarily commented out other tests, per request. * Fixed indentation (maybe?) * Restoring contrib-openai.yml
corleroux
pushed a commit
to corleroux/autogen
that referenced
this pull request
Jan 30, 2024
…#1093) * Initial commit of WebSurfer. Adds the browser_utils, and related tests. WebSurfer will be added in a subsequent commit. * Added the web surfer agent, and related tests. * Added a notebook to show how WebSurferAgent works. * Fixed a typo. * Updated test_web_surfer for compatibility with microsoft#1110. * Updated skip_oai logic. * Fixed code formatting. * More pre-commit fixes. * Added block to contrib-openai.yml * Added block to contrib-openai.yml * Added hook for BING_API_KEY * Temporarily commented out other tests, per request. * Fixed indentation (maybe?) * Restoring contrib-openai.yml
whiskyboy
pushed a commit
to whiskyboy/autogen
that referenced
this pull request
Apr 17, 2024
* support string alg in tune * add test, enforce string feasible, support lexico in set_search_priorities in CFO * fix bug * fix bug * fix bug * fix bug * fix bugs * fix yiran --------- Co-authored-by: “skzhang1” <“[email protected]”>
whiskyboy
pushed a commit
to whiskyboy/autogen
that referenced
this pull request
Apr 17, 2024
…#1093) * Initial commit of WebSurfer. Adds the browser_utils, and related tests. WebSurfer will be added in a subsequent commit. * Added the web surfer agent, and related tests. * Added a notebook to show how WebSurferAgent works. * Fixed a typo. * Updated test_web_surfer for compatibility with microsoft#1110. * Updated skip_oai logic. * Fixed code formatting. * More pre-commit fixes. * Added block to contrib-openai.yml * Added block to contrib-openai.yml * Added hook for BING_API_KEY * Temporarily commented out other tests, per request. * Fixed indentation (maybe?) * Restoring contrib-openai.yml
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Why are these changes needed?
At present, AutoGen agents need to write code, or be set up with specific function-calling routines to gather information from the web. Inspired by OpenAI's WebGPT work, this PR adds a stateful agent that can command a (simulated) web browser. Add a WebSurferAgent to any conversation to instantly and seamlessly add web content and browsing abilities to your workflows.
This simulated web browser uses Bing web search and renders all webpages as Markdown. It supports a stateful scrollable viewport (to save you context tokens), as well as actions on that viewport (e.g., page up, page down, find on page). Given that this is largely driven by the python requests library and BeautifulSoup, JavaScript and other modern web content are not supported directly. In the future, this simulated browser can be replaced with a real headless browser (e.g., powered by Selenium).
Related issue number
Supersedes #888
Addresses: #287, #132 etc.
Checks