Asana Toolkit

[byrro]

Sorry this first version of the toolkit ended up getting too big. Task is the most relevant object, but it's 'entangled' with everything else in Asana. I realized the toolkit wouldn't be of much value if we didn't have some basic tools related to projects, workspaces, teams, users, and tags as well.

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

📢 Thoughts on this report? Let us know!

[EricGustin]

This is awesome & great coverage of the API.

One thing to think about: From what the evals are telling me, language models don't seem to fully grasp that they can provide multiple workspace_ids, or multiple tags in a single request. How can the annotations be improved to clear up this confusion?

[byrro]

This is an area for improvement. I tried to make some tools more ergonomic. Like the tags arg in create_task or search_tasks. Instead of having to look for tag IDs, the tool takes a tag name and does the job of finding the IDs.

Even 4o is a bit flaky when taking advantage of this ergonomy. Sometimes, it'll invoke search_tags_by_name before creating a task instead of passing the tag names directly to create_task.

So far, I haven't found a way to make them consistent through the argument annotation or the function docstring.

Did any ideas pop to your mind that we could try?

[byrro]

The search_tags_by_name and search_projects_by_name were confusing the LLMs. I moved them to simple utility functions. The toolkit already has list_projects and list_tags.

[EricGustin]

LGTM