Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

It starts, but the console displays some errors #134

Closed
Phrixus2023 opened this issue Jan 21, 2024 · 9 comments
Closed

It starts, but the console displays some errors #134

Phrixus2023 opened this issue Jan 21, 2024 · 9 comments

Comments

@Phrixus2023
Copy link

D:\BaiduNetdiskDownload\OneTrainer\venv\lib\site-packages\transformers\utils\hub.py:123: FutureWarning: Using TRANSFORMERS_CACHE is deprecated and will be removed in v5 of Transformers. Use HF_HOME instead.
warnings.warn(
A matching Triton is not available, some optimizations will not be enabled.
Error caught was: No module named 'triton'

@Nerogar
Copy link
Owner

Nerogar commented Jan 24, 2024

This is a warning you can ignore. triton is only available on Linux.

@Nerogar Nerogar closed this as completed Jan 24, 2024
@FurkanGozukara
Copy link

This is a warning you can ignore. triton is only available on Linux.

they can use pre compiled trion

triton-lang/triton#2738

@Nerogar
Copy link
Owner

Nerogar commented Jan 24, 2024

@FurkanGozukara Have you tested that already? I haven't, but I've heard from other people that it didn't improve performance at all.

@SirTrippsalot
Copy link
Contributor

Indeed, I can say on using it I didn't see any major improvement, though I didn't do an actual full compare to see if any stages improved

@Latentnaut
Copy link

@FurkanGozukara Is Triton recommended?

@FurkanGozukara
Copy link

@Nerogar @Latentnaut i also didn't find much improvement but if there are dependency libraries of Triton i think it fixes those

@Latentnaut
Copy link

@FurkanGozukara Would you mind to provide easy instructions on how to install it? (I have no clue what folder for example)

@FurkanGozukara
Copy link

@FurkanGozukara Would you mind to provide easy instructions on how to install it? (I have no clue what folder for example)

I plan to record windows tutorial very soon. i should show there

the logic is easy

you activate venv and install the precompiled wheel

@Kallamamran
Copy link

I installed this precompiled wheel and it broke my installation completely. OneTrainer didn't even start after this
"pip install --use-pep517 https://huggingface.co/r4ziel/xformers_pre_built/resolve/main/triton-2.0.0-cp310-cp310-win_amd64.whl"

"pip uninstall triton" made it run again, but with the pesky error messages

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

6 participants