CPP

Llama.cpp flags auto-tuning tool
3 points | 0 comments

As; HN: I was curious why MTP affects PP TPS in llama.cpp. My PoC recovers it?
2 points | 1 comments

Show HN: Loqi, a "local-first" translation tool using Ollama/llama.cpp
2 points | 0 comments

Show HN: Sipp – Run small local LLMs in browser 3x faster
5 points | 1 comments

A C++ AirPlay 2 sender: the encrypted RAOP/RTSP recipe, written down
3 points | 0 comments

A Value_lock Type for C++
2 points | 0 comments

Anthropic says Alibaba illicitly extracted Claude AI model capabilities
779 points | 1274 comments