Friday, 31 March 2023

New best story on Hacker News: Llama.cpp 30B runs with only 6GB of RAM now

Llama.cpp 30B runs with only 6GB of RAM now
552 by msoad | 156 comments on Hacker News.