CPP

TokiRecur – llama.cpp LLM launcher with KV-cache recycling
3 points | 0 comments

Inside Llama.cpp: How Local LLMs Run on Your Hardware [video]
2 points | 0 comments

Show HN: clap.cpp – Audio embedding inference in C++ (GGML)
2 points | 0 comments

Swapping LLMs in Under Two Seconds: A Sleep Mode for Llama.cpp
1 points | 0 comments

Show HN: Yogurt – Free, private, open-source alternative to Granola
290 points | 111 comments

Show HN: Usul – Express neural networks as raw math in C++23
2 points | 1 comments

For the first time, a C++ standard failed to pass the national bodies
5 points | 1 comments