Let's have a fun with LLM agent using selenium as a tool to scrape web content.
Selenium Agent is a research assistant that can search the web and extract information from various sources, including Google and Reddit. It utilizes web scraping techniques to gather data and present it in a user-friendly markdown format.
- Clone the repository:
git clone https://github.com/ahmadrosid/selenium-agent.git cd selenium-agent
- Install dependencies:
npm install
Please set the OPENAI_API_KEY
environment variable with your OpenAI API key.
export OPENAI_API_KEY="YOUR_OPENAI_API_KEY"
To run the Selenium Agent, execute:
node src/index.js
You can then interact with the assistant by providing tasks or questions.
- selenium-webdriver
- turndown
- @mozilla/readability
- jsdom
Contributions are welcome! Please submit a pull request or open an issue for discussion.
This project is licensed under the MIT License.