4 commits

Author	SHA1	Message	Date
remsky	4a24be1605	Refactor model loading and configuration: update, adjust model loading device,. add async streaming examples and remove unused warmup service.	2025-01-22 02:33:29 -07:00
remsky	21bf810f97	Enhance model inference: update documentation, add model download scripts for PyTorch and ONNX, and refactor configuration handling	2025-01-21 21:44:21 -07:00
remsky	22752900e5	Ruff checks, ci fix	2025-01-13 20:15:46 -07:00
remsky	3d0ca2a8c2	Update Dockerfiles for baked in models, adjustments to cpu/gpu environment splits	2025-01-12 05:23:02 -07:00