Skip to content

Conversation

@fabianlim
Copy link
Collaborator

  • support parquet data files
  • support additional model args

@garrett361
Copy link
Owner

LGTM. Additional args are for NoPE/z_loss?

@garrett361
Copy link
Owner

I assume the ArgumentParserPlus is taking care of turning the extra arg string into a list, also? For my own information, should the args be space or comma separated? Does it matter?

--additional_model_arguments "k0:v0, k1:v1"

# or 
--additional_model_arguments "k0:v0 k1:v1"

@fabianlim
Copy link
Collaborator Author

good point, i think it should be space delimited, but I need to check

@fabianlim
Copy link
Collaborator Author

@garrett361 i tested it takes a space delimited sequence of args

Copy link
Collaborator

@dangxuanhong dangxuanhong left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks @fabianlim

@fabianlim fabianlim merged commit 74c155a into padding-free Jun 11, 2025
@fabianlim fabianlim deleted the padding-free-updates branch June 11, 2025 15:15
@fabianlim fabianlim mentioned this pull request Jun 25, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants