The big difference will be measuring seconds per token instead of tokens per sec... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

reverius42 3 months ago | parent | context | favorite | on: Local AI needs to be the norm

The big difference will be measuring seconds per token instead of tokens per second.

martijnvds 3 months ago [–]

Seconds per token is just fractional tokens per second ;)

degamad 3 months ago | [–]

> fractional

Reciprocal?

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact