AI models agree that humans conform. Is that the real groupthink?
The funniest part of this experiment is that AI models were asked for a controversial opinion and overwhelmingly gave the same one: humans conform. Apparently the machines don't want to be wrong alone either.
ModelCompare asked 12 text models three times each. It classified 29 of 35 substantive answers as variations on "people value belonging over truth." The HN discussion splits between treating this as a deep observation about human nature and dismissing it as a predictable artifact of overlapping training data and post-training.
I think the latter explanation is more plausible, but it doesn't make the result boring. The prompt asks for an edgy, intelligent-sounding generalization about humanity. Our culture has an extremely well-worn script for that: everyone else is tribal, while I see through the illusion. An AI trained on our writing learns the script beautifully. So do we.
The most interesting outlier was Claude saying people are more decent than they think, and that our cynicism does damage of its own. That might actually be the riskier claim in a room full of sophisticated pessimists.
Here's the experiment I'd like to see: ask humans and models the same question, vary the social context (anonymous, job interview, among friends), and score answers blind. Then repeat with prompts asking for an unpopular positive belief about people. Do the answers converge less? Does the apparent "truth" depend more on the room than the reasoner?
Original: https://www.modelcompare.ai/blog/ai-models-controversial-take-on-humans
HN discussion: https://news.ycombinator.com/item?id=50197313
What is a genuinely unpopular, charitable take on humanity?
#
ModelCompare asked 12 text models three times each. It classified 29 of 35 substantive answers as variations on "people value belonging over truth." The HN discussion splits between treating this as a deep observation about human nature and dismissing it as a predictable artifact of overlapping training data and post-training.
I think the latter explanation is more plausible, but it doesn't make the result boring. The prompt asks for an edgy, intelligent-sounding generalization about humanity. Our culture has an extremely well-worn script for that: everyone else is tribal, while I see through the illusion. An AI trained on our writing learns the script beautifully. So do we.
The most interesting outlier was Claude saying people are more decent than they think, and that our cynicism does damage of its own. That might actually be the riskier claim in a room full of sophisticated pessimists.
Here's the experiment I'd like to see: ask humans and models the same question, vary the social context (anonymous, job interview, among friends), and score answers blind. Then repeat with prompts asking for an unpopular positive belief about people. Do the answers converge less? Does the apparent "truth" depend more on the room than the reasoner?
Original: https://www.modelcompare.ai/blog/ai-models-controversial-take-on-humans
HN discussion: https://news.ycombinator.com/item?id=50197313
What is a genuinely unpopular, charitable take on humanity?