Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Massive PR on many parts #54

Merged
merged 31 commits into from
Oct 21, 2023
Merged

Massive PR on many parts #54

merged 31 commits into from
Oct 21, 2023

Conversation

shuyanzhou
Copy link
Contributor

  • Further fix inaccurate or wrong locators and required_contents in the test data
  • Update evaluation code to deal with corner cases
  • Add support to huggingface models and support generation retry when facing invalid actions
  • Fix bounding box errors for more accurate in-viewport display

@shuyanzhou
Merge remote-tracking branch 'origin/bug-in-current-viewport-gitlab' …
7630e04 
…into new_eval
@shuyanzhou
add huggingface model support
1fef526
@shuyanzhou
better rendering of typing action
507659a
@shuyanzhou
multi threading auto login; auto login per example
2b15f20
@shuyanzhou
better error message for env config
e84910d
@shuyanzhou
fix statictext bounding box bug
493294b
@shuyanzhou
add support to evaluate by trace
57d2067
@shuyanzhou
support generation retry when the parsing of the action failed
16f2592
@shuyanzhou
ignore cache
9f3e4ac
@shuyanzhou
add prompts
0e7bcda
@shuyanzhou
fix force_prefix missing bug
741292e
@shuyanzhou
fix typo
1ee1ea4
@shuyanzhou
add script to check inference failures
c1ae73c
@shuyanzhou
add parallel running script
6fdbd92
@shuyanzhou
fix annotation errors based on human trajectories
cd7d593
@shuyanzhou
change reddit vote related posts to absolute urls
b6e0b22
@shuyanzhou
update URL matching, fix typos
f8d636a
@shuyanzhou
update must_include tokenization condition; upate url match
b4c917d
@shuyanzhou
remove unused evaluators
a7c475b
@shuyanzhou
remove exact from evalutor names
50e2c43
@shuyanzhou
update test example due to html escape
db063c7
@shuyanzhou
update fuzzy match prompt
6ab7fd2
@shuyanzhou
reduce coordinate precision; fix template 67 annotations
58061ee
@shuyanzhou
fix locator for product; add prep action; fix url for promo rules
4b86d43
@shuyanzhou
add options to renew cookie for selected sites
df87757
@shuyanzhou
print unfinished examples
3d3d837
@shuyanzhou
reduce openai max retry
7730a85
@shuyanzhou
minor
f91eb5b
@shuyanzhou
minor
4cec5ac
@shuyanzhou
Merge remote-tracking branch 'origin/main' into new_eval
7a1f8d6
@shuyanzhou shuyanzhou changed the title Massive PR on many aspects Massive PR on many parts Oct 21, 2023
@shuyanzhou shuyanzhou merged commit a68aa1a into main Oct 21, 2023
2 checks passed
@shuyanzhou shuyanzhou deleted the new_eval branch October 21, 2023 04:28
This was referenced Oct 21, 2023
Closed
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@shuyanzhou