x/oscar feedback #68490
Replies: 5 comments 7 replies
-
The examples that show similar issues are not very impressive. Similar tools existed years before the AI hype. The root problem here is more that the GitHub search is not very good and often returns way to many issues by seemingly matching the entire thread. This can be worked around by adding in:title to the search if you know what you are looking for. But my main concern with this, that we probably soon need to fight AIs in addition to stale bot in issues and in the process create lots of irrelevant comments. |
Beta Was this translation helpful? Give feedback.
-
This is so cool! I'm excited to see another language ecosystem start looking into this. At a high level, I think most of what I see in the oscar readme, and what I expect oscar to be in practice, is more effective project management:
There are other things that come to mind (e.g. making it easier for a newcomer to learn about the existing communication structures and ticketing/org processes of a given OSS org, or even just updating onboarding docs to reflect the new practices of an org) but none of those are super concrete. Two additional points I'll throw out as food for thought:
|
Beta Was this translation helpful? Give feedback.
-
Also, taking quick skim through golang's issue tracker specifically, it looks like y'all have a lot of issues being filed by automation. I definitely remember a lot of those being very noisy when I was at Google (over in databases world), and the constant frustration of "ok, here I go again, triaging automated issues...". There's definitely room here to reduce the noise - in particular, when a potentially useful signal gets so noisy that people disregard the signal entirely, there's not much utility in the signal itself, and I think that's also an area where LLMs can help out. The tricky part, though, is that a lot of what we're imagining along these lines, is that it requires a lot of dedicated engineering work to build the integrations for every action we're envisioning that gabyhelp might be able to do, and, well, if it hasn't been done already, why would adding an LLM to the mix make it more likely that someone will prioritize that work? |
Beta Was this translation helpful? Give feedback.
-
Last year I created an LLM agent framework and an example system that added source code comments to code. This used the AST facilities in golang along with some other small deterministic tools to extract code for review, ChatGPT to write comments and improve them using a multi-agent conversation, and then more utilities to insert them back into the code. This worked quite well, producing decent comments that would be helpful to both new developers coming in to a project as well as maintainers learning new parts of one. The next step would have been to add a vector store to enable good package-level structural comments, unfortunately the project was cut short. I suggest that good source comments are a huge help to maintainers, and where not existing, the best addition to aid maintainability. Not all developers like writing comments and many OSS projects do not have them -- indeed golang is unusually lucky in the quality of its comments. So I suggest adding "producing good in-source comments where not already available" as a future goal for Oscar :) |
Beta Was this translation helpful? Give feedback.
-
My initial reaction to this is that it could be a massive help. I help maintain https://github.com/a-h/templ and even on that smaller scale issue management can become overwhelming at times, particularly because it is not my full time job and most of my motivation comes from bug fixes and new features, not chasing down issues that I know have already been raised or gathering documentation links (we have a docs site https://templ.guide which once oscar becomes generally useable I can imagine us scraping that site). Am I right in assuming that there will be someway to feedback to oscar in cases where a comment is not useful, or the opposite where a comment from oscar results in a productive outcome? For example |
Beta Was this translation helpful? Give feedback.
-
Gabyhelp is a first prototype experiment for a larger effort to explore creating automated help for open-source maintenance. We have posted an overview of the vision in x/oscar/README.md. This discussion is for collecting feedback about the overall vision, not for specifics about gabyhelp (use the gabyhelp discussion for that).
Please read the README. After that, we would be happy to hear any feedback about concerns we are missing and also ways to reduce maintainer toil that we should be considering beyond what's listed there.
Thanks very much!
Beta Was this translation helpful? Give feedback.
All reactions