The sycophancy is also a concern, it’s not really an impartial teacher, all its ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

andy99 28 days ago | parent | context | favorite | on: How I use LLMs to learn complex topics

The sycophancy is also a concern, it’s not really an impartial teacher, all its training is to suck up and maximize engagement rather than learning. The incentives are wrong.

cromka 28 days ago [–]

> all its training is to suck up and maximize engagement rather than learning

That's speculative, isn't it

adastra22 28 days ago | [–]

No, that's a direct consequence (intended or not) of how RLHF works.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact