[Spyre-Next] [Bug] Fixed dtype for embedding

[bohnstingl]

Description

This PR ensures that the correct dtypes are used for spyre for the embedding layer.

cc @coderfornow

Related Issues

#753

Test Plan

I ran E2E test and confirmed they are working. Furthermore, we will use the current upstream tests that we have to check.

Checklist

• I have read the contributing guidelines
• My code follows the project's code style (run bash format.sh)
• I have added tests for my changes (if applicable)
• I have updated the documentation (if applicable)
• My commits include a Signed-off-by: line (DCO compliance)

[github-actions]

👋 Hi! Thank you for contributing to vLLM support on Spyre.
Just a reminder: Make sure that your code passes all the linting checks, otherwise your PR won't be able to be merged. To do so, run ./format.sh.
Now you are good to go 🚀.

We also recommend installing prek and configuring it to check your code before every local commit.

[bohnstingl]

bot:next-test

[yannicks1]

lgtm, did #836 never run on spyre or how come this went unnoticed?

[coderfornow]

lgtm!

[bohnstingl]

lgtm, did #836 never run on spyre or how come this went unnoticed?

@yannicks1 this is a good point.
@coderfornow can you confirm that this #836 (comment) was actually running on spyre?

@tjohnson31415 could you maybe confirm that the CI tests for this PR are failing because of a non-related issue?

[tjohnson31415]

@tjohnson31415 could you maybe confirm that the CI tests for this PR are failing because of a non-related issue?

Yes, that is correct. The spyre-ci tests are still in a broken state, so we don't need to have that block this PR

[bohnstingl]

I tested this PR locally and it worked. The CI tests are currently broken, but a solution is in the making.