CPP

Show HN: Minute – Offline meeting notes on macOS with Whisper and llama.cpp
12 points | 6 comments

cpp-tui – A lightweight, single-header C++ TUI (Text User Interface) library
5 points | 0 comments

Show HN: I run 30B 22tok/s, 109tok/s not novel,6GB/16GB RAM overcoming llama.cpp
4 points | 0 comments

TurboPrefill: 3.27× Prefill Speedup in Llama.cpp
2 points | 1 comments

Self Hosting LLMs with Llama.cpp
2 points | 0 comments

Ask HN: HotPin – lossless 120B MoE inference on 24GB RAM (CPU, 50 loc)
13 points | 0 comments

Show HN: Lexicon a free Grammarly alternative, local writing assistant
1 points | 2 comments