Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Autolabel config cli #463

Merged
merged 13 commits into from
Jul 27, 2023
Merged

Autolabel config cli #463

merged 13 commits into from
Jul 27, 2023

Conversation

Tyrest
Copy link
Contributor

@Tyrest Tyrest commented Jul 17, 2023

Adds an Autolabel CLI to reduce friction for new users! #456

Here's what a sample use case might look like for the company dataset

First execute the create-config command...

Screenshot 2023-07-17 at 2 58 48 PM

Then, execute plan to make sure everything looks good...

Screenshot 2023-07-17 at 3 03 06 PM

Finally, execute run to start the labeling task!

Screenshot 2023-07-17 at 3 06 44 PM

Help pages

General

Screenshot 2023-07-17 at 2 59 55 PM

plan

Screenshot 2023-07-17 at 3 00 17 PM

run

Screenshot 2023-07-17 at 3 00 30 PM

create-config

Screenshot 2023-07-17 at 3 00 44 PM

@Tyrest
Copy link
Contributor Author

Tyrest commented Jul 24, 2023

New Automatic Config Creation

The goal for this is to have the user do as little as possible to get to a working config.
Screenshot 2023-07-24 at 11 50 46 AM

New Help Page for Config Command

Screenshot 2023-07-24 at 11 52 44 AM

@Tyrest Tyrest requested review from nihit and rajasbansal July 25, 2023 20:45
@nihit
Copy link
Contributor

nihit commented Jul 25, 2023

Changes from the meeting w/ @Tyrest @rajasbansal :

Autolabel config:

  1. "wizard" mode is the default -- it is an interactive multi-step workflow to arrive at a final config
  2. "non wizard" mode will be invoked with "autolabel config init". It outputs a template/starter config with all the valid keys, and values being descriptions of what value should the user put there. E.g.:
{
    "task_name": "[TODO] Enter task name",
    "task_type": "...",
    "dataset": {
        "label_column": "...",
        "delimiter": "..."
    },
    "model": {...},
    "prompt": {...}
}

@Tyrest
Copy link
Contributor Author

Tyrest commented Jul 26, 2023

Added placeholder values for values that we cannot infer as shown below.

Screenshot 2023-07-25 at 4 57 49 PM

The new default for autolabel config is the wizard:
Screenshot 2023-07-25 at 4 59 24 PM

Updated the help page
Screenshot 2023-07-25 at 5 05 16 PM

Copy link
Contributor

@nihit nihit left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm!
do we need to add any dependencies for the CLI app ?

@Tyrest Tyrest merged commit 1f40687 into main Jul 27, 2023
1 of 2 checks passed
@Tyrest Tyrest deleted the autolabel-config-cli branch July 27, 2023 17:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants