Remove numpy as bitpack dependency

[msaroufim]

main builds are broken because we are now accidentally dependending on numpy https://github.com/pytorch/ao/commits/main/

AO as of now has no dependencies

Tests seem fine

(ao) [[email protected] ~/test/ebs-torchtune (debug)]$ pip list | grep numpy
(ao) [[email protected] ~/test/ebs-torchtune (debug)]$ 

test_uintx.py ....................................................................................               [100%]

=================================================== warnings summary ===================================================
../../../.conda/envs/ao/lib/python3.10/site-packages/torch/_subclasses/functional_tensor.py:271
  /home/marksaroufim/.conda/envs/ao/lib/python3.10/site-packages/torch/_subclasses/functional_tensor.py:271: UserWarning: Failed to initialize NumPy: No module named 'numpy' (Triggered internally at ../torch/csrc/utils/tensor_numpy.cpp:84.)
    cpu = _conversion_method_template(device=torch.device("cpu"))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
====================================== 84 passed, 1 warning in 291.43s (0:04:51) =======================================
(ao) [[email protected] ~/ao/test/dtypes (main)]$ 

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/ao/677

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit b2e86b1 with merge base 009f55f ():
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.