CPP

cpp-tui – A lightweight, single-header C++ TUI (Text User Interface) library
5 points | 0 comments

6.4x faster than llama.cpp, 3.9x faster than MLX
4 points | 2 comments

TurboPrefill: 3.27× Prefill Speedup in Llama.cpp
2 points | 1 comments

Show HN: Cactus Hybrid: We taught Gemma 4 to know when it's wrong
185 points | 44 comments

Ask HN: HotPin – lossless 120B MoE inference on 24GB RAM (CPU, 50 loc)
10 points | 0 comments

Show HN: Llamatop - see what the various cores on your macbook are doing!
1 points | 1 comments

Show HN: Diktafon – Voice memos on cassette tapes, transcribed on-device
1 points | 0 comments