Do you have a write up available on your build? A friend is looking for a simila... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		toomuchtodo 5 days ago \| parent \| context \| favorite \| on: Three of our worst VC stories Do you have a write up available on your build? A friend is looking for a similar solution where they can offer an API/service for internal use.
		help

lrvick 3 days ago [–]

Not really much to write up.

Insert 2-4 $1200 r9700 GPUs in a Linux 7.0.0+ machine with 64GB+ of DDR4-5 memory, fire up llama.cpp, and connect with any OpenAI compatible tools.

A free public anonymous LLM like BigPickle can easily set up the software for you if in doubt.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact