Question: for software development, how much of an AI do you need for local deve...

mrkeen · 2026-05-10T21:08:02.000000Z

This is a good snapshot of things:

A specialist handrolls a cut-down framework to power a 1 or 2 bit quantised version of a cut-down sort-of-frontier model.

It can be yours if you have 128GB or 256GB of RAM.

dd8601fn · 2026-05-10T21:04:08.000000Z

The ones that are good for more than elaborate auto-complete are pretty hefty, but it can be done. They’re still not Opus behind claude code.