Model Serving

https://aws.amazon.com/blogs/machine-learning/feed/

https://github.com/vllm-project/vllm

https://www.anyscale.com/blog

https://modal.com/blog

https://blog.vespa.ai

https://github.com/huggingface/text-generation-inference/releases.atom

https://github.com/sgl-project/sglang/releases.atom

https://fireworks.ai/blog

https://www.baseten.co/blog

https://octoai.cloud/blog

https://github.com/kserve/kserve

https://blog.vllm.ai/

https://blog.openrouter.ai/

https://github.com/ollama/ollama

https://github.com/BerriAI/litellm