feat: Allow serializing and deserializing with Tensorizer without passing --model-loader-extra-config

[sangstar]

Serializing and deserializing with Tensorizer just with AWS config/credential files or env vars

This PR streamlines Tensorizer usage patterns with vLLM by allowing Tensorizer to handle model loading (and saving) from vLLM just by passing load_format=tensorizer.

As a basic demonstrating of what this looks like, the targets being run in this Makefile demonstrate the ways Tensorizer can be used to now save and load models without passing things like --model-loader-extra-config JSON strings.

SHELL := /bin/bash
PYTHON := $(shell python3 -c 'import sys; print(sys.executable)')
SERIALIZATION_FP := /vllm-workspace/examples/others/tensorize_vllm_model.py
WITH_PDB := -m pdb
AWS_ENDPOINT_URL := https://cwobject.com/
ENV := AWS_ACCESS_KEY_ID=$(AWS_ACCESS_KEY_ID) AWS_SECRET_ACCESS_KEY=$(AWS_SECRET_ACCESS_KEY) AWS_ENDPOINT_URL=$(AWS_ENDPOINT_URL)

.PHONY: test_serialize_env_vars test_serialize_aws_cfg test_vllm_serve_with_aws_cfg test_vllm_serve_with_aws_env_vars

test_serialize_env_vars:
	@$(ENV) $(PYTHON) $(SERIALIZATION_FP) \
		--model facebook/opt-125m \
		serialize \
		--serialized-directory s3://ml-dev-sandbox-bucket \
		--suffix v1

# Assumes aws config and creds files are in ~/.aws/* as they are conventionally
test_serialize_aws_cfg:
	$(PYTHON) $(SERIALIZATION_FP) \
			--model facebook/opt-125m \
			serialize \
			--serialized-directory s3://ml-dev-sandbox-bucket \
			--suffix v1

test_vllm_serve_with_aws_cfg:
	@$(ENV) AWS_S3_ADDRESSING_STYLE=virtual $(PYTHON) -m vllm.entrypoints.cli.main serve s3://ml-dev-sandbox-bucket/vllm/facebook/opt-125m/v1 \
		--load-format=tensorizer

test_vllm_serve_with_aws_env_vars:
	@$(ENV) AWS_S3_ADDRESSING_STYLE=virtual $(PYTHON) -m vllm.entrypoints.cli.main serve s3://ml-dev-sandbox-bucket/vllm/facebook/opt-125m/v1 \
		--load-format=tensorizer

Please hold off on any requests for changes relating to formatting. This will all be done in a later stage with vLLM's formatter.

[Eta0]

Requested a few changes when reviewing this in a Zoom call, will approve when those are fixed.