Config-driven scraping/testing with rod (towards AI/LLM-assisted automation)

[iljya]

Hi everyone,

I'm wondering if there have been any attempts to create a config-language to drive scraping/testing automations. That is, rather than writing golang code to drive the browser, actions (click, input text, etc.) are configured in a config file. I am interested in this from the perspective of one-day having an LLM create these config files based on a high-level description of the task (and a webpage side-input).

I found this project which is exactly what I am looking for, but it appears to be abandoned:
https://github.com/go-rod/wayang

Many thanks for your attention!

[ysmood]

I think it's a valuable direction, but I don't have enough resource to work on it.

[iljya]

Thanks for the encouragement :)