Small & Efficient Models

https://llm.mlc.ai/blog

https://github.com/ggml-org/llama.cpp/releases.atom

https://github.com/mlc-ai/mlc-llm/releases.atom

https://www.edgeimpulse.com/blog

https://www.tinyml.org/blog/

https://github.com/ml-explore/mlx/releases.atom

https://ollama.com/blog

https://lmstudio.ai/blog

https://www.reddit.com/r/LocalLLaMA

https://github.com/unslothai/unsloth

https://github.com/casper-hansen/AutoAWQ

https://github.com/turboderp/exllamav2

https://github.com/LostRuins/koboldcpp