Here are some related and powerful insights from Robin Hanson over the past few years where he identifies a bias that motivates much more of our thinking that we’d care to admit. The general theme is that our we are biased in our beliefs because they are more than just beliefs to us:
In my experience “I believe X” suggests that the speaker has chosen to affiliate with X, feeling loyal to it and making it part of his or her identity. The speaker is unlikely to offer much evidence for X, or to respond to criticism of X, and such criticism will likely be seen as a personal attack.
Feel the warm comfort inside you when you say “I believe” – recognize it and be ready to identify it in the future, even without those woods. And then – flag that feeling as a dangerous bias. The “I believe” state of mind is quite far from being neutrally ready to adjust its opinions in the light of further evidence. Far better to instead say “I feel,” which directly warns listeners of the speaker’s attachment to an opinion.
We feel a deep pleasure from realizing that we believe something in common with our friends, and different from most people. We feel an even deeper pleasure letting everyone know of this fact. This feeling is EVIL. Learn to see it in yourself, and then learn to be horrified by how thoroughly it can poison your mind. Yes evidence may at times force you to disagree with a majority, and your friends may have correlated exposure to that evidence, but take no pleasure when you and your associates disagree with others; that is the road to rationality ruin.
There is another old post of Robin’s I think about often but cannot seem to find that offers a way to check yourself against biases like these. Since I can’t find it, I’ll try to summarize it.
Think about beliefs that you hold and imagine yourself changing your mind. Literally imagine waking up tomorrow with a changed mind and imagine how you would or wouldn’t discuss changing your mind with people you know. Feelings will be strong for beliefs that are important to our identities or that we value for some signaling purpose, like signaling affiliation with some group. Can you actually imagine yourself with these changed beliefs, or is it unthinkable?
In his post Robin argued that people often convince themselves that they truly reconsider their strongly held beliefs, but what they do is false reconsideration with the real purpose of reassuring themselves and strengthening the belief. Before it was just a strong belief, but after false reconsideration it’s a strong belief that they’ve really, definitely, seriously reconsidered. But if you can’t imagine yourself going through the day holding another set of competing beliefs than you never actually reconsidered it.
To provide a concrete example, I think many religious people tell themselves that they truly reconsider some of their deeply held religious beliefs. But can they imagine waking up tomorrow a non-believer and telling their significant others, parents, friends, children, and people in their church that they are now non-believers? If not, can you at the very least picture lying to these people about your beliefs for the rest of your life? If you can’t seriously tell yourself you could do one of these, you should be skeptical that you’ve ever really reconsidered your beliefs.
Conservatives, could you imagine becoming someone believes that higher taxes and unemployment insurance don’t hurt economic growth or employment? Liberals can you imagine becoming someone who believes that that minimum wages decrease employment and fiscal stimulus doesn’t work? If the answer is no, you should think about whether it’s because holding such a belief would conflict with your identity or affiliations.

11 comments
Comments feed for this article
Monday ~ May 23rd, 2011 at 10:03 am
Lord
This is more problematic for conservatives than liberals because conservatives argue from principle and hold to them despite contrary evidence whereas liberals argue from evidence and are more open to revision even if in their theories and arguments more than their beliefs.
Monday ~ May 23rd, 2011 at 10:48 am
Apex
First rule of bias: I’m not biased, they are.
Monday ~ May 23rd, 2011 at 10:53 am
Ben
And are you supposed to do if you discovery you’re biased?
Monday ~ May 23rd, 2011 at 10:54 am
Ben
*what* are you supposed to do…
Monday ~ May 23rd, 2011 at 1:40 pm
Andy Harless
This sounds a bit too much like intellectual pacifism.
Here’s the problem. People who are smart enough to understand and be convinced by Robin’s argument are also smart enough to be more likely than the average person to have beliefs that correspond to the true reality. Robin is telling the good guys (smart people) to have a lower threshold for intellectual surrender than the bad guys (non-smart people) do. (He’s also saying it to the bad guys, but they won’t listen.) I would expect the result to be a greater prevalence of bad ideas over good ones.
That wouldn’t be the case if ones own bias could be observed at zero cost without any noise, or even if all the noise were necessarily in the form of false negatives. But in practice, any attempt (such as what Hanson urges) to reduce false negatives (instances where one fails to recognize ones own bias) is going to result in an increase in the number of false positives (instances where one rejects a valid idea because it falsely appears to be the result of ones own bias). “The best lack all conviction, and the worst / are full of passionate intensity,” and if we encourage the best to be constantly second-guessing their own beliefs, the situation only gets worse.
I think my point is related to Lord’s point above. Liberals are at a disadvantage intellectually because the fragility of belief is inherent in their philosophy, and one isn’t inclined to fight as hard for beliefs that are inherently fragile. In some respects, liberalism is an inherently ineffectual philosophy. In order to have a backbone, liberals need to borrow some dogmatism from other philosophies (but this results in their not being truly liberal).
Monday ~ May 23rd, 2011 at 1:50 pm
anti_supernaturalist
If we cannot see clearly, let us at least see clearly what is unclear. — Freud
A belief statement requires no evidence at all
• Does that imply that there are no facts?! Of course there are facts…but “beliefs” are not facts. Facts require evidence. A belief statement requires no evidence at all.
False beliefs abound. Yet no linguistic object is a ‘false fact’. When a statement turns out to be false on the evidence — then, a (legally) reasonable person backs out by saying, “I thought that it was a fact, but it was not. I withdraw my statement. I wrongly believed that it was true.”
Statements are the linguistic objects which are true or false. But, to arrive at statements which are true, which are facts, requires methods for determining truth by using evidence and rational methods.
Conspiracy fanatics — like xians who insist that Easter marks a historical event — have an easy time of it. Believing that a statement is true (or false) has nothing whatsoever to do with that statement being a fact.
While believing is not more blessèd than knowing, it’s much easier to believe than to know. All ideology (including religious ideology) provides an illegitimate path to “knowledge” through “faith” (‘trust’ in xian Greek).
• No matter of fact is ever certain — since no statement about reality is necessarily true, or logically true, or mathematically true, or statistically certain — as if any statistical fact could be certain! Any statement about nature or human action must be open to “criticism” (the possibility of being false); otherwise users refuse to acknowledge what the concept of evidence based criticism is. And, in so doing they become unreasonable.
No empirical statement (a statement about nature, or about evidence in a trial) is certain. Otherwise, there would be no need for experimentation in science or evidence in jurisprudence — just as there is no need for information about the world in mathematics. Axioms and sound reasoning are enough.
• Conspiracy “theories” — and xianity is a massive, successful conspiracy theory — turn on a rabid strategy — What people want to disregard, they will; what people want to deny, they will — no matter how “unreasonable” (non-rational or irrational) they become.
A need for evidence and sound methods always leaves theory (good or bad) open to claims of fraud — thus the fact that the US government routinely lies to the people and that religious institutions always lie in matters of “faith” — leaves plenty of room for deniers, both illegitimate and legitimate.
After all, without standards for being “a reasonable person” there could be no lying or cheating — there could be no order without rule governed behavior. Even pre-linguistic smarties, like bonobo chimps, know how to game the hierarchical system of instinctual and learned “rules” by theft, cheating, and guile.
If “ordinary” individuals were talented at altering their beliefs based on evidence; then, rule governed cultural institutions — science, technology, law — would be less necessary to create widely shared human well-being.
• Only religion and mores easily survive in cultures without well-grounded methods for establishing knowledge claims. Mores and religion are cultural atavisms given over to indoctrination, paternalist norms, and the principle of ‘wish fulfillment’.
Without formal systems of rule-governed method and rule-governed review, science, technology, secular law would disappear. Xianity destroyed the high culture of the west for a thousand years (500-1500 CE). Xians in their hatred for the body closed baths, destroyed public sanitation, and let fall the aqueducts.
Anti-science fundie theocrats in US school boards, state houses, congress work overtime to destroy our open culture. They stink, but stinking is godly.
the anti_supernaturalist
Monday ~ May 23rd, 2011 at 5:54 pm
Mich
Tangentially, I’m reminded of the “backfire effect” identified by political scientist Brendan Nyhan. Individuals given corrective information may actually dig their heels in and believe incorrect information more strongly.
Monday ~ May 23rd, 2011 at 5:55 pm
Mich
Sorry. I lopped of the link to the Nyhan and Reifler paper. Here it is.
http://www-personal.umich.edu/~bnyhan/nyhan-reifler.pdf
Tuesday ~ May 24th, 2011 at 3:03 am
Locked In | Just Above Sunset
[...] And this is pretty universal. Consider Adam Ozimek on our unwillingness to truly reconsider beliefs that are integral to our self identity: [...]
Tuesday ~ May 24th, 2011 at 9:34 am
Barry
Adam: “Think about beliefs that you hold and imagine yourself changing your mind. Literally imagine waking up tomorrow with a changed mind and imagine how you would or wouldn’t discuss changing your mind with people you know. Feelings will be strong for beliefs that are important to our identities or that we value for some signaling purpose, like signaling affiliation with some group. Can you actually imagine yourself with these changed beliefs, or is it unthinkable?”
Well, we have a recent example – economics and the Great Financial Crash. Which happened after a quarter century of neoliberal reforms in the US, which didn’t seem to bear much fruit (except for a larger share of economic growth going to the top 1%).
Adam, do you have many examples of right-wing economists changing their minds?
Tuesday ~ May 24th, 2011 at 11:38 am
Belief | ReadWatchShare
[...] we believe, we can run into some of this and that. Money quotes: In my experience “I believe X” suggests that the speaker has chosen to affiliate [...]