Tags: EmbeddedLLM/LMCache
Tags
vllm 0.6.0 integration and support for pip install (LMCache#101) * Fix unused torchac dependency * Separate torchac to a standalone pip package * Fix buildkite configuration error * [refactor] merge the lmcache-server * Prepare to release lmcache 0.1.2 with pip * Update README.md with new quick start example
[Add] support for redis.Sentinel (LMCache#93) * [Add] support for redis.Sentinel * remove useless codes --------- Co-authored-by: ApostaC <jc4xvyp@outlook.com>
Add coverage report for CI pipeline (LMCache#89) * Add coverage report for CI pipeline * Fix the branch of lmcache-server --------- Co-authored-by: ApostaC <jc4xvyp@outlook.com>