Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
最近更新:
4天前
Minimalist ML framework for Rust
最近更新:
4天前
Sccache is a ccache-like tool. It is used as a compiler wrapper and avoids compilation when possible. Sccache has the capability to utilize caching...
最近更新:
4天前