CPP

Llama.cpp performance breakthrough for multi-GPU setups
6 points | 0 comments

The unofficial whisper.cpp snap now supports Vulkan-based audio transcription
2 points | 2 comments

What are Cpp2 and cppfront? How do I get and build cppfront?
2 points | 0 comments

Real Time Speech to Text Running Whisper.cpp with CUDA on Jetson Orin Nano Super
1 points | 1 comments

VLLM or llama.cpp: Choosing the right LLM inference engine for your use case
1 points | 0 comments

Ask HN: Who's running local AI workstations in 2026?
8 points | 8 comments

Show HN: Revibing nanochat's inference model in C++ with ggml
4 points | 0 comments