Skip to content

Conversation

@JanekEbb
Copy link
Contributor

No description provided.

@JanekEbb JanekEbb requested a review from boeddeker December 21, 2023 11:39
@codecov-commenter
Copy link

codecov-commenter commented Dec 21, 2023

Codecov Report

All modified and coverable lines are covered by tests ✅

Comparison is base (545ae34) 76.49% compared to head (84b1b8b) 76.49%.

❗ Your organization needs to install the Codecov GitHub app to enable full functionality.

Additional details and impacted files
@@           Coverage Diff           @@
##           master      #64   +/-   ##
=======================================
  Coverage   76.49%   76.49%           
=======================================
  Files           5        5           
  Lines        1736     1736           
=======================================
  Hits         1328     1328           
  Misses        408      408           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@boeddeker
Copy link
Member

Can you explain, when and why the code failed? The maybe_append has an assert, that is_completed is False, before calling assess.

Could you add a small test, that ensures, that the code now works as intended?

@JanekEbb
Copy link
Contributor Author

so far a padded batch could exceed max_total_size when a newly accepted example has the maximum length in the batch. I now added a test case for this. Without the update in assess, the output would be [[6, 7, 9], [5, 6, 3], [7, 4]], where the first batch would exceed max_total_size=21 after padding as 3*9=27.

Copy link
Member

@boeddeker boeddeker left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I overlooked that assess has max(self.max_len, seq_len), while is_completed has only seq_len.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants