• HN Mail
  • Subscribe

CPP

TokiRecur – llama.cpp LLM launcher with KV-cache recycling
3 points | 0 comments

Inside Llama.cpp: How Local LLMs Run on Your Hardware [video]
2 points | 0 comments

Show HN: clap.cpp – Audio embedding inference in C++ (GGML)
2 points | 0 comments

Swapping LLMs in Under Two Seconds: A Sleep Mode for Llama.cpp
1 points | 0 comments

Show HN: Yogurt – Free, private, open-source alternative to Granola
240 points | 95 comments

Show HN: Usul – Express neural networks as raw math in C++23
2 points | 1 comments

Show HN: A C++ Compiler That Is Faster Than GCC and Clang
8 points | 3 comments