Uploading large files to the DataHUB

[Brilator]

In order to properly upload large(r) files to the DataHUB via ARC Commander or ARCitect, Git-LFS needs to be initiated on every computer (and user account) before using these tools.

Checking whether LFS (large file storage) works properly for your ARCs

• In ARCitect, you can see large files (defined by the threshold in the commit menu) flagged as LFS in the file tree
• In the DataHUB LFS files are also flagged as LFS. In addition, you can click in the right sidebar of your ARC in the DataHUB on "Project Storage". Here, the major amount of your data should be stored in "LFS", while only a minor part is stored in "Repository".

Initiating git-lfs

Via command line

• If you have git-lfs installed and know how to use there command line, simply run git lfs install.
• You can check for the proper configuration via git config --list --show-origin --show-scope. Amongst others, the config should contain the following lines

filter.lfs.process=git-lfs filter-process
filter.lfs.required=true
filter.lfs.clean=git-lfs clean -- %f
filter.lfs.smudge=git-lfs smudge -- %f

Manually

In your home folder (Windows: C:/Users/<UserName>, macOS: Users/<UserName>), create or edit the file called .gitconfig to include the following lines.

[filter "lfs"]
	process = git-lfs filter-process
	required = true
	clean = git-lfs clean -- %f
	smudge = git-lfs smudge -- %f

Ask for help

Feel free to contact a data steward, since this is not trivial.