Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Utilize new quantize_onto qtensor api #492

Merged
merged 5 commits into from
Jun 29, 2024
Merged

Utilize new quantize_onto qtensor api #492

merged 5 commits into from
Jun 29, 2024

Conversation

EricLBuehler
Copy link
Owner

This will remove the necessity for the "ISQ_LOW_MEMORY" environment variable because it will enable quantization on the CPU.

Copy link

Code Metrics Report
  ===============================================================================
 Language            Files        Lines         Code     Comments       Blanks
===============================================================================
 Dockerfile              1           34           25            0            9
 Happy                   1          442          369            0           73
 JSON                    9           21           21            0            0
 Python                 32         1256         1075           37          144
 TOML                   16          444          403            1           40
-------------------------------------------------------------------------------
 Jupyter Notebooks       1            0            0            0            0
 |- Markdown             1           60           30           22            8
 |- Python               1           96           87            1            8
 (Total)                            156          117           23           16
-------------------------------------------------------------------------------
 Markdown               19         1373            0         1027          346
 |- BASH                 5          100           97            0            3
 |- Python               5           98           88            0           10
 |- Rust                 3          151          135            6           10
 (Total)                           1722          320         1033          369
-------------------------------------------------------------------------------
 Rust                  121        37335        33732          683         2920
 |- Markdown            59          667           13          616           38
 (Total)                          38002        33745         1299         2958
===============================================================================
 Total                 201        40905        35625         1748         3532
===============================================================================
  

@EricLBuehler EricLBuehler merged commit 7f9b6bd into master Jun 29, 2024
10 checks passed
@EricLBuehler EricLBuehler deleted the quantize_onto branch June 29, 2024 22:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant