{"id":40,"date":"2021-08-06T19:55:10","date_gmt":"2021-08-06T19:55:10","guid":{"rendered":"https:\/\/pressbooks.usnh.edu\/wickedproblem\/chapter\/our-mental-shortcuts\/"},"modified":"2026-07-06T15:45:49","modified_gmt":"2026-07-06T15:45:49","slug":"our-mental-shortcuts","status":"publish","type":"chapter","link":"https:\/\/pressbooks.usnh.edu\/wickedproblem\/chapter\/our-mental-shortcuts\/","title":{"raw":"Our Mental Shortcuts","rendered":"Our Mental Shortcuts"},"content":{"raw":"<div class=\"textbox textbox--learning-objectives\"><header class=\"textbox__header\">\r\n<p class=\"textbox__title\">In This Chapter<\/p>\r\n\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n\r\nLearning Objectives\r\n<ul>\r\n \t<li>Understand how our existing knowledge and mental shortcuts are likely to affect our research process<\/li>\r\n \t<li>Identify strategies for overcoming our cognitive biases<\/li>\r\n<\/ul>\r\nSummary\r\n\r\nCognitive biases are shortcuts that help us deal with the huge amount of information in our environments, but they can hurt our research processes. Confirmation bias means we are more likely to search for and notice information that confirms our existing beliefs. Motivated reasoning means we think more critically about information that challenges our beliefs than we do about information that confirms our beliefs. A mindset based on curiosity and openness will help us mitigate our cognitive biases and see that changing our minds based on new information isn't the end of the world.\r\n\r\n<\/div>\r\n<\/div>\r\n<h1>\"The brain is a machine for jumping to conclusions.\" ~Daniel Kahneman[footnote]Content and quotes in this section are from Daniel Kahneman's 2011 book, Thinking Fast and Slow.[\/footnote]<\/h1>\r\nEvery human is inundated with information every moment of their life. Not just the research information we talk about in this book, but all sorts of information. All the light that hits our eyes and tells us where things are in the room, every noise we hear, every clue from our environment. It is not possible to think critically about every piece of information that comes our way, and we don't need or want to.\r\n\r\nWe have all developed mental shortcuts to deal with this information overload. Researcher Daniel Kahneman describes the situation this way: we have two systems for processing information, the first, System 1, that runs effortlessly and involuntarily and a second one, System 2, that takes more effort to use.\r\n\r\nLet's see if we can catch these systems at work. Try out this problem:\r\n<blockquote>A bat and ball together cost $1.10 and the bat costs $1 more than the ball. How much does each one cost on its own?<\/blockquote>\r\nMany people get this answer wrong because they use a mental shortcut without even realizing it. (The correct answer and an explanation is available <a href=\"https:\/\/www.businessinsider.com\/question-that-harvard-students-get-wrong-2012-12\">here<\/a>.) To get to the right answer we have to resist the tempting, easy answer offered by System 1, and engage the careful thinking of System 2.\r\n\r\nThe System 1 runs automatically; it is in charge most of the time and it is the system that helps us make quick judgements about the vast majority of input coming into our brains. System 2 takes effort to use, is only activated occasionally, but it can do much more complicated things. The fact that we use System 1 most of the time isn't a problem, it's our brains working as they should. They help us not expend energy needlessly on things that are unlikely to be important. We're not bad people because we jump to conclusions much of the time. But the effects of System 1 extend into our research activities in ways that can lead us to make mistakes.\r\n<h1>Cognitive Biases<\/h1>\r\nThere are many different mental shortcuts our brains take when System 1 is activated; we call these cognitive biases. <strong>Cognition<\/strong> refers to a variety of thinking processes such as attention, perception, memory, and reasoning that we use to gain knowledge and understanding.\u00a0 \"Cognitive biases\" does not refer to biases related to a particular opinion, rather it refers to biases that all of our brains have to behave in a certain way as we try to make sense of the world. There are <a href=\"https:\/\/ritholtz.com\/wp-content\/uploads\/2016\/09\/1-71TzKnr7bzXU_l_pU6DCNA.jpeg\"><strong>a lot<\/strong><\/a> of different <a href=\"https:\/\/en.wikipedia.org\/wiki\/Cognitive_bias\">cognitive biases<\/a>, but here we will just mention two that are quite likely to impact our research activities.\r\n<h3>Confirmation Bias<\/h3>\r\nConfirmation bias relates to the information we look for, notice and remember. Confirmation bias makes us more likely to notice information that confirms our existing opinions and beliefs. If we're scanning a list of search results, the sources that support our existing beliefs are more likely to jump out at us; they are familiar and require less energy to process. Similarly, we are likely to not notice results that run counter to our existing ideas.\r\n<div class=\"textbox textbox--sidebar shaded\">Sometimes people use this property of search terms to steer you toward a particular conclusion. If someone online is telling you to \"do your own research\" while at the same time repeating words and phrases that are only used by proponents of one side of an issue, they don't really want you to find a variety of perspectives, just the one associated with those terms.<\/div>\r\nBut the part of confirmation bias that is most likely to affect our research is how it affects our choice of search terms. We can't help but choose search terms based on what we are already thinking. And it's not surprising that if you search for <span style=\"color: #339966\"><em>why Marvel is better than DC<\/em><\/span> you will find info that supports this claim. Google (or your search engine of choice) tries its hardest to match the words in the search box with words on websites. The sources that most closely match your search terms are also very likely to share the opinion that was embedded in your search terms.\r\n\r\nSimilarly, if you search <em><span style=\"color: #339966\">is lab testing on animals wrong<\/span><\/em>, you get very different search results than you would if you search <em><span style=\"color: #339966\">benefits of animal testing<\/span><\/em>.\r\n\r\nBut even when we don't type value words like <em><span style=\"color: #339966\">better<\/span><\/em>, <em><span style=\"color: #339966\">wrong<\/span><\/em>, or <em><span style=\"color: #339966\">benefits<\/span><\/em> into the search box, some words are more associated with one position than another and are likely to return results associated with only one position. For example, compare the results you get for the search <em><span style=\"color: #339966\">illegal aliens voter fraud<\/span><\/em> with those for <em><span style=\"color: #339966\">immigrant voting rights<\/span><\/em>. Both searches involve the concept of people born outside a country participating in elections, but the pictures you get from the results are very different.\r\n<h3>Motivated Reasoning<\/h3>\r\nMotivated reasoning relates to how we think about a piece of information. Motivated reasoning happens when we readily accept pieces of information that support our existing beliefs without much thought, and we expend more effort to think critically about pieces of information that challenge our existing beliefs or behaviors. Examples of this are everywhere, but my favorite is <a href=\"https:\/\/journals.sagepub.com\/doi\/abs\/10.1177\/0146167292186002\">a study<\/a> that asked people to read and evaluate a research paper that suggested that drinking coffee had negative health effects. Coffee drinkers were much more likely to question the validity of the research than non-coffee drinkers.\r\n\r\nThis is a mental shortcut that saves a lot of time and mental energy. Many things we believe don't need to be reexamined on a regular basis, and it would be a big energy drain if we did. Generally, we all believe that brushing our teeth is a good idea. There's not much to be gained by critically examining another piece of evidence that brushing your teeth is good. So we skip over thinking about information that matches up with what we already believe.\r\n\r\nOn the other hand, when those coffee drinkers were given information that suggested their habit might be bad for their health, their only choices were to accept the information (and either deal with an uncomfortable idea or try to break the habit), or find a reason to reject the information. The easier choice in that situation was to work a little harder to find a reason to discredit the information.\r\n\r\nThese coffee drinkers aren't bad people, and they weren't consciously deciding to think critically about the research in front of them. These shortcuts are just part of being human, and there's no need to attempt the impossible task of avoiding them entirely. It is very hard to notice motivated reasoning in ourselves because this is an automatic process. But motivated reasoning does have big implications for research because it tends to reinforce what we already believe.\r\n<h1>What Can We Do About Cognitive Biases?<\/h1>\r\nIn the <a href=\"https:\/\/www.ted.com\/talks\/julia_galef_why_you_think_you_re_right_even_if_you_re_wrong#t-684450\">video below<\/a>, Julia Galef mentions several things that can help us overcome our cognitive biases and improve our judgement.\r\n\r\n&nbsp;\r\n<div style=\"max-width: 854px\">\r\n<div style=\"height: 0;padding-bottom: 56.25%\">\r\n\r\n[embed]https:\/\/embed.ted.com\/talks\/julia_galef_why_you_think_you_re_right_even_if_you_re_wrong?cc_load_policy=1[\/embed]\r\n\r\n<\/div>\r\n<\/div>\r\nThe first step is one you've already done: become aware that these cognitive biases exist. Just knowing that motivated reasoning is a thing won't magically prevent your brain from taking this shortcut, but you can't compensate for it until you know it exists. This is part of increasing your metacognitive awareness.\r\n\r\nBe kind to yourself and others during the research process. Galef mentions the strong tendency in our society to criticize people who change their minds. We seem to have adopted the strange idea that revising your positions is a sign of weakness, that there is nothing worse than being wrong. We can change this perception by giving each other space to grow and revise our ideas and by expressing approval when people demonstrate a willingness to revise their opinions after careful consideration of new information. We don't need to tie our self-worth or the worth of others to how right or wrong we or they are on a particular issue.\r\n\r\nGalef also mentions that feelings play a big part in how we deal with new information. Notice your feelings as they come up during your research. In the chapter, <a href=\"http:\/\/researching-wicked-problems.press.plymouth.edu\/chapter\/sifting-information\/\">SIFTing Information<\/a>, we talk about how having a strong positive or negative emotional reaction to a piece of information is an important cue to stop and check that piece of information. The Oatmeal comic strip creator, Matthew Inman has an entertaining assessment of our emotional reactions to new information (10 minute read):\r\n\r\n&nbsp;\r\n\r\n[caption id=\"attachment_147\" align=\"aligncenter\" width=\"427\"]<a href=\"https:\/\/theoatmeal.com\/comics\/believe_clean\"><img class=\"wp-image-39 \" src=\"http:\/\/pressbooks.usnh.edu\/wickedproblem\/wp-content\/blogs.dir\/78\/files\/2021\/08\/Screen-Shot-2021-06-08-at-12.12.26-PM-300x186.png\" alt=\"A cartoon of two birds on a branch. One says to the other, &quot;You're not going to beliefe these things I tell you.&quot;\" width=\"427\" height=\"265\" \/><\/a> George Washington's Teeth, The Oatmeal, https:\/\/theoatmeal.com\/comics\/believe_clean[\/caption]\r\n\r\nBe aware of your feelings as they come up, but don't let them have the final say. As Galef suggests, try to cultivate feelings of curiosity, openness, and groundedness.\r\n\r\nAnother practice that can help us overcome our cognitive biases is actively seeking out disconfirming ideas. Researcher Sonke Ahrens[footnote]I highly recommend Sonke Ahrens' 2017 book How to Take Smart Notes[\/footnote] suggests that instead of asking whether a source will reinforce the position we hold, we try asking whether it is relevant to the topic. If you are someone who struggles to find something to write about, this shift in perspective can have an added benefit: working through the tension between the ideas you started with and the sources that challenge those ideas will give you things to write about.\r\n<blockquote>\"Do you yearn to defend your own beliefs?\u00a0 Or do you yearn to see the world as clearly as you possibly can?\" ~Julia Galef<\/blockquote>\r\n&nbsp;\r\n<div class=\"textbox textbox--exercises\"><header class=\"textbox__header\">\r\n<p class=\"textbox__title\">Reflection &amp; Discussion Question 1: Taking Stock of What You Already Know<\/p>\r\n\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<blockquote class=\"tc-quote\">Let's consider what you already know about your wicked problem. You may be surprised at how little or how much you already know, but either way you will become more aware of your own background on the topic, and therefore more aware of what direction your cognitive biases might nudge you in.\r\n\r\nConstruct a chart using the following directions:\r\n<ul>\r\n \t<li>In the first column, list what you know about your topic.<\/li>\r\n \t<li>In the second column, briefly explain how you know this. (Heard it from a friend or family member, read it in a book, saw it on a blog, etc.)<\/li>\r\n \t<li>In the last column, rate your confidence in that knowledge on a scale of 1 (least confident) to 10 (most confident).<\/li>\r\n \t<li>Look over your chart and compare columns 2 and 3. Select three rows and for each one, write a reflection on whether the source of information justifies your confidence level.<\/li>\r\n \t<li>Underline any information that you think might need to be checked or that you would like to find additional sources on.<\/li>\r\n<\/ul>\r\n<\/blockquote>\r\n<\/div>\r\n<\/div>\r\n<div class=\"textbox textbox--exercises\"><header class=\"textbox__header\">\r\n<p class=\"textbox__title\">Reflection &amp; Discussion Question 2: Mindmapping<\/p>\r\n\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n\r\nConfirmation bias can be hard to overcome because by definition it makes us less likely to even notice certain kinds of information. In this exercise we'll try to find some our blind spots by creating and sharing mindmaps.\r\n<ol>\r\n \t<li>Create a <a href=\"https:\/\/www.google.com\/search?q=mindmap&amp;tbm=isch&amp;sxsrf=ALeKk02VFIkv7gRgWRBGeJ6RqIIbAzfNvQ%3A1627638185223&amp;source=hp&amp;biw=1103&amp;bih=571&amp;ei=qckDYbTNCo6j5NoPg8yEyAM&amp;oq=mindmap&amp;gs_lcp=CgNpbWcQAzIICAAQgAQQsQMyBQgAEIAEMgUIABCABDIFCAAQgAQyBQgAEIAEMgUIABCABDIFCAAQgAQyBQgAEIAEMgUIABCABDIFCAAQgAQ6BAgjECc6CAgAELEDEIMBOgsIABCABBCxAxCDAVDBBFj_EmDJGWgAcAB4AIABhQGIAd4FkgEDMy40mAEAoAEBqgELZ3dzLXdpei1pbWc&amp;sclient=img&amp;ved=0ahUKEwj0xebewIryAhWOEVkFHQMmATkQ4dUDCAY&amp;uact=5\">mindmap<\/a> of your wicked problem. Include as many different aspects of the problem as you can: different issues, possible solutions, challenges, anything that comes to mind.<\/li>\r\n \t<li>Trade papers with a partner. Review their mindmap for aspects of your wicked problem you may have overlooked and add any aspects that you thought of that aren't there.<\/li>\r\n \t<li>Trade papers with another pair, and repeat the process.<\/li>\r\n \t<li>Get back your original paper and consider the additions made by your classmates. What was added that you hadn't thought of?\u00a0 Did anything about the additions surprise you?<\/li>\r\n<\/ol>\r\n<\/div>\r\n<\/div>\r\n<div class=\"textbox textbox--exercises\"><header class=\"textbox__header\">\r\n<p class=\"textbox__title\">Reflection &amp; Discussion Question 3: Loaded Search Terms<\/p>\r\n\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n\r\nIn the confirmation bias section above we saw examples of search terms that return a limited range of viewpoints. For most topics it is possible to find \"loaded\" search terms that have this effect.\r\n<ul>\r\n \t<li>What search terms related to your wicked problem are likely to return one particular viewpoint?<\/li>\r\n \t<li>What neutral search terms can you think of related to your wicked problem? Are any search terms really neutral?<\/li>\r\n \t<li>Should we always avoid loaded search terms, or are there times when they're ok to use?<\/li>\r\n<\/ul>\r\n<\/div>\r\n<\/div>\r\n<div class=\"textbox textbox--exercises\"><header class=\"textbox__header\">\r\n<p class=\"textbox__title\">Reflection &amp; Discussion Question 4: Thesis Statements<\/p>\r\n\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n\r\nHave you ever had an assignment that required you to come up with a thesis statement before proceeding with your research?\u00a0 It's a common approach. Often what gets lost in these assignments is that the goal is to test the thesis, not justify it. But many of our mental shortcuts nudge us towards maintaining our existing positions.\r\n<ul>\r\n \t<li>Think about how you usually approach assignments. Are you more likely to start with a thesis statement or more likely to start with a question? What do you like about your approach?\u00a0 What do you not like about it?<\/li>\r\n \t<li>In the past how have you handled it when you encountered information that argued against your thesis statement?\u00a0 Do you think you will handle it differently based on the ideas in this chapter?\u00a0 Why or why not?<\/li>\r\n \t<li>What kinds of assignments or instructions would make you more likely to be open to revising your original position or thesis statement?<\/li>\r\n<\/ul>\r\n<\/div>\r\n<\/div>\r\n<div class=\"textbox textbox--exercises\"><header class=\"textbox__header\">\r\n<p class=\"textbox__title\">Reflection &amp; Discussion Question 5: Algorithms &amp; Cognitive Biases<\/p>\r\n\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n\r\nIn the <a href=\"http:\/\/researching-wicked-problems.press.plymouth.edu\/chapter\/introduction\/\">Introduction<\/a> chapter we mentioned some ways that algorithms determine what information we see online.\r\n<ul>\r\n \t<li>What connections do you see between our cognitive biases and an information environment driven by algorithms?\u00a0 In what ways do they work together?<\/li>\r\n \t<li>What actions do you take or can you think of to break out of the \"<a href=\"https:\/\/www.ted.com\/talks\/eli_pariser_beware_online_filter_bubbles\/transcript?language=en\">filter bubbles<\/a>\" and \"<a href=\"https:\/\/en.wikipedia.org\/wiki\/Echo_chamber_(media)\">echo chambers<\/a>\" we find ourselves in?<\/li>\r\n<\/ul>\r\n<\/div>\r\n<\/div>\r\n&nbsp;","rendered":"<div class=\"textbox textbox--learning-objectives\">\n<header class=\"textbox__header\">\n<p class=\"textbox__title\">In This Chapter<\/p>\n<\/header>\n<div class=\"textbox__content\">\n<p>Learning Objectives<\/p>\n<ul>\n<li>Understand how our existing knowledge and mental shortcuts are likely to affect our research process<\/li>\n<li>Identify strategies for overcoming our cognitive biases<\/li>\n<\/ul>\n<p>Summary<\/p>\n<p>Cognitive biases are shortcuts that help us deal with the huge amount of information in our environments, but they can hurt our research processes. Confirmation bias means we are more likely to search for and notice information that confirms our existing beliefs. Motivated reasoning means we think more critically about information that challenges our beliefs than we do about information that confirms our beliefs. A mindset based on curiosity and openness will help us mitigate our cognitive biases and see that changing our minds based on new information isn&#8217;t the end of the world.<\/p>\n<\/div>\n<\/div>\n<h1>&#8220;The brain is a machine for jumping to conclusions.&#8221; ~Daniel Kahneman<a class=\"footnote\" title=\"Content and quotes in this section are from Daniel Kahneman's 2011 book, Thinking Fast and Slow.\" id=\"return-footnote-40-1\" href=\"#footnote-40-1\" aria-label=\"Footnote 1\"><sup class=\"footnote\">[1]<\/sup><\/a><\/h1>\n<p>Every human is inundated with information every moment of their life. Not just the research information we talk about in this book, but all sorts of information. All the light that hits our eyes and tells us where things are in the room, every noise we hear, every clue from our environment. It is not possible to think critically about every piece of information that comes our way, and we don&#8217;t need or want to.<\/p>\n<p>We have all developed mental shortcuts to deal with this information overload. Researcher Daniel Kahneman describes the situation this way: we have two systems for processing information, the first, System 1, that runs effortlessly and involuntarily and a second one, System 2, that takes more effort to use.<\/p>\n<p>Let&#8217;s see if we can catch these systems at work. Try out this problem:<\/p>\n<blockquote><p>A bat and ball together cost $1.10 and the bat costs $1 more than the ball. How much does each one cost on its own?<\/p><\/blockquote>\n<p>Many people get this answer wrong because they use a mental shortcut without even realizing it. (The correct answer and an explanation is available <a href=\"https:\/\/www.businessinsider.com\/question-that-harvard-students-get-wrong-2012-12\">here<\/a>.) To get to the right answer we have to resist the tempting, easy answer offered by System 1, and engage the careful thinking of System 2.<\/p>\n<p>The System 1 runs automatically; it is in charge most of the time and it is the system that helps us make quick judgements about the vast majority of input coming into our brains. System 2 takes effort to use, is only activated occasionally, but it can do much more complicated things. The fact that we use System 1 most of the time isn&#8217;t a problem, it&#8217;s our brains working as they should. They help us not expend energy needlessly on things that are unlikely to be important. We&#8217;re not bad people because we jump to conclusions much of the time. But the effects of System 1 extend into our research activities in ways that can lead us to make mistakes.<\/p>\n<h1>Cognitive Biases<\/h1>\n<p>There are many different mental shortcuts our brains take when System 1 is activated; we call these cognitive biases. <strong>Cognition<\/strong> refers to a variety of thinking processes such as attention, perception, memory, and reasoning that we use to gain knowledge and understanding.\u00a0 &#8220;Cognitive biases&#8221; does not refer to biases related to a particular opinion, rather it refers to biases that all of our brains have to behave in a certain way as we try to make sense of the world. There are <a href=\"https:\/\/ritholtz.com\/wp-content\/uploads\/2016\/09\/1-71TzKnr7bzXU_l_pU6DCNA.jpeg\"><strong>a lot<\/strong><\/a> of different <a href=\"https:\/\/en.wikipedia.org\/wiki\/Cognitive_bias\">cognitive biases<\/a>, but here we will just mention two that are quite likely to impact our research activities.<\/p>\n<h3>Confirmation Bias<\/h3>\n<p>Confirmation bias relates to the information we look for, notice and remember. Confirmation bias makes us more likely to notice information that confirms our existing opinions and beliefs. If we&#8217;re scanning a list of search results, the sources that support our existing beliefs are more likely to jump out at us; they are familiar and require less energy to process. Similarly, we are likely to not notice results that run counter to our existing ideas.<\/p>\n<div class=\"textbox textbox--sidebar shaded\">Sometimes people use this property of search terms to steer you toward a particular conclusion. If someone online is telling you to &#8220;do your own research&#8221; while at the same time repeating words and phrases that are only used by proponents of one side of an issue, they don&#8217;t really want you to find a variety of perspectives, just the one associated with those terms.<\/div>\n<p>But the part of confirmation bias that is most likely to affect our research is how it affects our choice of search terms. We can&#8217;t help but choose search terms based on what we are already thinking. And it&#8217;s not surprising that if you search for <span style=\"color: #339966\"><em>why Marvel is better than DC<\/em><\/span> you will find info that supports this claim. Google (or your search engine of choice) tries its hardest to match the words in the search box with words on websites. The sources that most closely match your search terms are also very likely to share the opinion that was embedded in your search terms.<\/p>\n<p>Similarly, if you search <em><span style=\"color: #339966\">is lab testing on animals wrong<\/span><\/em>, you get very different search results than you would if you search <em><span style=\"color: #339966\">benefits of animal testing<\/span><\/em>.<\/p>\n<p>But even when we don&#8217;t type value words like <em><span style=\"color: #339966\">better<\/span><\/em>, <em><span style=\"color: #339966\">wrong<\/span><\/em>, or <em><span style=\"color: #339966\">benefits<\/span><\/em> into the search box, some words are more associated with one position than another and are likely to return results associated with only one position. For example, compare the results you get for the search <em><span style=\"color: #339966\">illegal aliens voter fraud<\/span><\/em> with those for <em><span style=\"color: #339966\">immigrant voting rights<\/span><\/em>. Both searches involve the concept of people born outside a country participating in elections, but the pictures you get from the results are very different.<\/p>\n<h3>Motivated Reasoning<\/h3>\n<p>Motivated reasoning relates to how we think about a piece of information. Motivated reasoning happens when we readily accept pieces of information that support our existing beliefs without much thought, and we expend more effort to think critically about pieces of information that challenge our existing beliefs or behaviors. Examples of this are everywhere, but my favorite is <a href=\"https:\/\/journals.sagepub.com\/doi\/abs\/10.1177\/0146167292186002\">a study<\/a> that asked people to read and evaluate a research paper that suggested that drinking coffee had negative health effects. Coffee drinkers were much more likely to question the validity of the research than non-coffee drinkers.<\/p>\n<p>This is a mental shortcut that saves a lot of time and mental energy. Many things we believe don&#8217;t need to be reexamined on a regular basis, and it would be a big energy drain if we did. Generally, we all believe that brushing our teeth is a good idea. There&#8217;s not much to be gained by critically examining another piece of evidence that brushing your teeth is good. So we skip over thinking about information that matches up with what we already believe.<\/p>\n<p>On the other hand, when those coffee drinkers were given information that suggested their habit might be bad for their health, their only choices were to accept the information (and either deal with an uncomfortable idea or try to break the habit), or find a reason to reject the information. The easier choice in that situation was to work a little harder to find a reason to discredit the information.<\/p>\n<p>These coffee drinkers aren&#8217;t bad people, and they weren&#8217;t consciously deciding to think critically about the research in front of them. These shortcuts are just part of being human, and there&#8217;s no need to attempt the impossible task of avoiding them entirely. It is very hard to notice motivated reasoning in ourselves because this is an automatic process. But motivated reasoning does have big implications for research because it tends to reinforce what we already believe.<\/p>\n<h1>What Can We Do About Cognitive Biases?<\/h1>\n<p>In the <a href=\"https:\/\/www.ted.com\/talks\/julia_galef_why_you_think_you_re_right_even_if_you_re_wrong#t-684450\">video below<\/a>, Julia Galef mentions several things that can help us overcome our cognitive biases and improve our judgement.<\/p>\n<p>&nbsp;<\/p>\n<div style=\"max-width: 854px\">\n<div style=\"height: 0;padding-bottom: 56.25%\">\n<p><iframe loading=\"lazy\" id=\"oembed-1\" title=\"Julia Galef: Why you think you&#39;re right -- even if you&#39;re wrong\" src=\"https:\/\/embed.ted.com\/talks\/julia_galef_why_you_think_you_re_right_even_if_you_re_wrong\" width=\"500\" height=\"282\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/p>\n<\/div>\n<\/div>\n<p>The first step is one you&#8217;ve already done: become aware that these cognitive biases exist. Just knowing that motivated reasoning is a thing won&#8217;t magically prevent your brain from taking this shortcut, but you can&#8217;t compensate for it until you know it exists. This is part of increasing your metacognitive awareness.<\/p>\n<p>Be kind to yourself and others during the research process. Galef mentions the strong tendency in our society to criticize people who change their minds. We seem to have adopted the strange idea that revising your positions is a sign of weakness, that there is nothing worse than being wrong. We can change this perception by giving each other space to grow and revise our ideas and by expressing approval when people demonstrate a willingness to revise their opinions after careful consideration of new information. We don&#8217;t need to tie our self-worth or the worth of others to how right or wrong we or they are on a particular issue.<\/p>\n<p>Galef also mentions that feelings play a big part in how we deal with new information. Notice your feelings as they come up during your research. In the chapter, <a href=\"http:\/\/researching-wicked-problems.press.plymouth.edu\/chapter\/sifting-information\/\">SIFTing Information<\/a>, we talk about how having a strong positive or negative emotional reaction to a piece of information is an important cue to stop and check that piece of information. The Oatmeal comic strip creator, Matthew Inman has an entertaining assessment of our emotional reactions to new information (10 minute read):<\/p>\n<p>&nbsp;<\/p>\n<figure id=\"attachment_147\" aria-describedby=\"caption-attachment-147\" style=\"width: 427px\" class=\"wp-caption aligncenter\"><a href=\"https:\/\/theoatmeal.com\/comics\/believe_clean\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-39\" src=\"http:\/\/pressbooks.usnh.edu\/wickedproblem\/wp-content\/blogs.dir\/78\/files\/2021\/08\/Screen-Shot-2021-06-08-at-12.12.26-PM-300x186.png\" alt=\"A cartoon of two birds on a branch. One says to the other, &quot;You're not going to beliefe these things I tell you.&quot;\" width=\"427\" height=\"265\" srcset=\"https:\/\/pressbooks.usnh.edu\/wickedproblem\/files\/2021\/08\/Screen-Shot-2021-06-08-at-12.12.26-PM-300x186.png 300w, https:\/\/pressbooks.usnh.edu\/wickedproblem\/files\/2021\/08\/Screen-Shot-2021-06-08-at-12.12.26-PM-1024x635.png 1024w, https:\/\/pressbooks.usnh.edu\/wickedproblem\/files\/2021\/08\/Screen-Shot-2021-06-08-at-12.12.26-PM-768x476.png 768w, https:\/\/pressbooks.usnh.edu\/wickedproblem\/files\/2021\/08\/Screen-Shot-2021-06-08-at-12.12.26-PM-65x40.png 65w, https:\/\/pressbooks.usnh.edu\/wickedproblem\/files\/2021\/08\/Screen-Shot-2021-06-08-at-12.12.26-PM-225x140.png 225w, https:\/\/pressbooks.usnh.edu\/wickedproblem\/files\/2021\/08\/Screen-Shot-2021-06-08-at-12.12.26-PM-350x217.png 350w, https:\/\/pressbooks.usnh.edu\/wickedproblem\/files\/2021\/08\/Screen-Shot-2021-06-08-at-12.12.26-PM.png 1380w\" sizes=\"auto, (max-width: 427px) 100vw, 427px\" \/><\/a><figcaption id=\"caption-attachment-147\" class=\"wp-caption-text\">George Washington&#8217;s Teeth, The Oatmeal, https:\/\/theoatmeal.com\/comics\/believe_clean<\/figcaption><\/figure>\n<p>Be aware of your feelings as they come up, but don&#8217;t let them have the final say. As Galef suggests, try to cultivate feelings of curiosity, openness, and groundedness.<\/p>\n<p>Another practice that can help us overcome our cognitive biases is actively seeking out disconfirming ideas. Researcher Sonke Ahrens<a class=\"footnote\" title=\"I highly recommend Sonke Ahrens' 2017 book How to Take Smart Notes\" id=\"return-footnote-40-2\" href=\"#footnote-40-2\" aria-label=\"Footnote 2\"><sup class=\"footnote\">[2]<\/sup><\/a> suggests that instead of asking whether a source will reinforce the position we hold, we try asking whether it is relevant to the topic. If you are someone who struggles to find something to write about, this shift in perspective can have an added benefit: working through the tension between the ideas you started with and the sources that challenge those ideas will give you things to write about.<\/p>\n<blockquote><p>&#8220;Do you yearn to defend your own beliefs?\u00a0 Or do you yearn to see the world as clearly as you possibly can?&#8221; ~Julia Galef<\/p><\/blockquote>\n<p>&nbsp;<\/p>\n<div class=\"textbox textbox--exercises\">\n<header class=\"textbox__header\">\n<p class=\"textbox__title\">Reflection &amp; Discussion Question 1: Taking Stock of What You Already Know<\/p>\n<\/header>\n<div class=\"textbox__content\">\n<blockquote class=\"tc-quote\"><p>Let&#8217;s consider what you already know about your wicked problem. You may be surprised at how little or how much you already know, but either way you will become more aware of your own background on the topic, and therefore more aware of what direction your cognitive biases might nudge you in.<\/p>\n<p>Construct a chart using the following directions:<\/p>\n<ul>\n<li>In the first column, list what you know about your topic.<\/li>\n<li>In the second column, briefly explain how you know this. (Heard it from a friend or family member, read it in a book, saw it on a blog, etc.)<\/li>\n<li>In the last column, rate your confidence in that knowledge on a scale of 1 (least confident) to 10 (most confident).<\/li>\n<li>Look over your chart and compare columns 2 and 3. Select three rows and for each one, write a reflection on whether the source of information justifies your confidence level.<\/li>\n<li>Underline any information that you think might need to be checked or that you would like to find additional sources on.<\/li>\n<\/ul>\n<\/blockquote>\n<\/div>\n<\/div>\n<div class=\"textbox textbox--exercises\">\n<header class=\"textbox__header\">\n<p class=\"textbox__title\">Reflection &amp; Discussion Question 2: Mindmapping<\/p>\n<\/header>\n<div class=\"textbox__content\">\n<p>Confirmation bias can be hard to overcome because by definition it makes us less likely to even notice certain kinds of information. In this exercise we&#8217;ll try to find some our blind spots by creating and sharing mindmaps.<\/p>\n<ol>\n<li>Create a <a href=\"https:\/\/www.google.com\/search?q=mindmap&amp;tbm=isch&amp;sxsrf=ALeKk02VFIkv7gRgWRBGeJ6RqIIbAzfNvQ%3A1627638185223&amp;source=hp&amp;biw=1103&amp;bih=571&amp;ei=qckDYbTNCo6j5NoPg8yEyAM&amp;oq=mindmap&amp;gs_lcp=CgNpbWcQAzIICAAQgAQQsQMyBQgAEIAEMgUIABCABDIFCAAQgAQyBQgAEIAEMgUIABCABDIFCAAQgAQyBQgAEIAEMgUIABCABDIFCAAQgAQ6BAgjECc6CAgAELEDEIMBOgsIABCABBCxAxCDAVDBBFj_EmDJGWgAcAB4AIABhQGIAd4FkgEDMy40mAEAoAEBqgELZ3dzLXdpei1pbWc&amp;sclient=img&amp;ved=0ahUKEwj0xebewIryAhWOEVkFHQMmATkQ4dUDCAY&amp;uact=5\">mindmap<\/a> of your wicked problem. Include as many different aspects of the problem as you can: different issues, possible solutions, challenges, anything that comes to mind.<\/li>\n<li>Trade papers with a partner. Review their mindmap for aspects of your wicked problem you may have overlooked and add any aspects that you thought of that aren&#8217;t there.<\/li>\n<li>Trade papers with another pair, and repeat the process.<\/li>\n<li>Get back your original paper and consider the additions made by your classmates. What was added that you hadn&#8217;t thought of?\u00a0 Did anything about the additions surprise you?<\/li>\n<\/ol>\n<\/div>\n<\/div>\n<div class=\"textbox textbox--exercises\">\n<header class=\"textbox__header\">\n<p class=\"textbox__title\">Reflection &amp; Discussion Question 3: Loaded Search Terms<\/p>\n<\/header>\n<div class=\"textbox__content\">\n<p>In the confirmation bias section above we saw examples of search terms that return a limited range of viewpoints. For most topics it is possible to find &#8220;loaded&#8221; search terms that have this effect.<\/p>\n<ul>\n<li>What search terms related to your wicked problem are likely to return one particular viewpoint?<\/li>\n<li>What neutral search terms can you think of related to your wicked problem? Are any search terms really neutral?<\/li>\n<li>Should we always avoid loaded search terms, or are there times when they&#8217;re ok to use?<\/li>\n<\/ul>\n<\/div>\n<\/div>\n<div class=\"textbox textbox--exercises\">\n<header class=\"textbox__header\">\n<p class=\"textbox__title\">Reflection &amp; Discussion Question 4: Thesis Statements<\/p>\n<\/header>\n<div class=\"textbox__content\">\n<p>Have you ever had an assignment that required you to come up with a thesis statement before proceeding with your research?\u00a0 It&#8217;s a common approach. Often what gets lost in these assignments is that the goal is to test the thesis, not justify it. But many of our mental shortcuts nudge us towards maintaining our existing positions.<\/p>\n<ul>\n<li>Think about how you usually approach assignments. Are you more likely to start with a thesis statement or more likely to start with a question? What do you like about your approach?\u00a0 What do you not like about it?<\/li>\n<li>In the past how have you handled it when you encountered information that argued against your thesis statement?\u00a0 Do you think you will handle it differently based on the ideas in this chapter?\u00a0 Why or why not?<\/li>\n<li>What kinds of assignments or instructions would make you more likely to be open to revising your original position or thesis statement?<\/li>\n<\/ul>\n<\/div>\n<\/div>\n<div class=\"textbox textbox--exercises\">\n<header class=\"textbox__header\">\n<p class=\"textbox__title\">Reflection &amp; Discussion Question 5: Algorithms &amp; Cognitive Biases<\/p>\n<\/header>\n<div class=\"textbox__content\">\n<p>In the <a href=\"http:\/\/researching-wicked-problems.press.plymouth.edu\/chapter\/introduction\/\">Introduction<\/a> chapter we mentioned some ways that algorithms determine what information we see online.<\/p>\n<ul>\n<li>What connections do you see between our cognitive biases and an information environment driven by algorithms?\u00a0 In what ways do they work together?<\/li>\n<li>What actions do you take or can you think of to break out of the &#8220;<a href=\"https:\/\/www.ted.com\/talks\/eli_pariser_beware_online_filter_bubbles\/transcript?language=en\">filter bubbles<\/a>&#8221; and &#8220;<a href=\"https:\/\/en.wikipedia.org\/wiki\/Echo_chamber_(media)\">echo chambers<\/a>&#8221; we find ourselves in?<\/li>\n<\/ul>\n<\/div>\n<\/div>\n<p>&nbsp;<\/p>\n<hr class=\"before-footnotes clear\" \/><div class=\"footnotes\"><ol><li id=\"footnote-40-1\">Content and quotes in this section are from Daniel Kahneman's 2011 book, Thinking Fast and Slow. <a href=\"#return-footnote-40-1\" class=\"return-footnote\" aria-label=\"Return to footnote 1\">&crarr;<\/a><\/li><li id=\"footnote-40-2\">I highly recommend Sonke Ahrens' 2017 book How to Take Smart Notes <a href=\"#return-footnote-40-2\" class=\"return-footnote\" aria-label=\"Return to footnote 2\">&crarr;<\/a><\/li><\/ol><\/div>","protected":false},"author":11,"menu_order":13,"template":"","meta":{"pb_show_title":"on","pb_short_title":"","pb_subtitle":"","pb_authors":[],"pb_section_license":""},"chapter-type":[],"contributor":[],"license":[],"class_list":["post-40","chapter","type-chapter","status-publish","hentry"],"part":36,"_links":{"self":[{"href":"https:\/\/pressbooks.usnh.edu\/wickedproblem\/wp-json\/pressbooks\/v2\/chapters\/40","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/pressbooks.usnh.edu\/wickedproblem\/wp-json\/pressbooks\/v2\/chapters"}],"about":[{"href":"https:\/\/pressbooks.usnh.edu\/wickedproblem\/wp-json\/wp\/v2\/types\/chapter"}],"author":[{"embeddable":true,"href":"https:\/\/pressbooks.usnh.edu\/wickedproblem\/wp-json\/wp\/v2\/users\/11"}],"version-history":[{"count":2,"href":"https:\/\/pressbooks.usnh.edu\/wickedproblem\/wp-json\/pressbooks\/v2\/chapters\/40\/revisions"}],"predecessor-version":[{"id":73,"href":"https:\/\/pressbooks.usnh.edu\/wickedproblem\/wp-json\/pressbooks\/v2\/chapters\/40\/revisions\/73"}],"part":[{"href":"https:\/\/pressbooks.usnh.edu\/wickedproblem\/wp-json\/pressbooks\/v2\/parts\/36"}],"metadata":[{"href":"https:\/\/pressbooks.usnh.edu\/wickedproblem\/wp-json\/pressbooks\/v2\/chapters\/40\/metadata\/"}],"wp:attachment":[{"href":"https:\/\/pressbooks.usnh.edu\/wickedproblem\/wp-json\/wp\/v2\/media?parent=40"}],"wp:term":[{"taxonomy":"chapter-type","embeddable":true,"href":"https:\/\/pressbooks.usnh.edu\/wickedproblem\/wp-json\/pressbooks\/v2\/chapter-type?post=40"},{"taxonomy":"contributor","embeddable":true,"href":"https:\/\/pressbooks.usnh.edu\/wickedproblem\/wp-json\/wp\/v2\/contributor?post=40"},{"taxonomy":"license","embeddable":true,"href":"https:\/\/pressbooks.usnh.edu\/wickedproblem\/wp-json\/wp\/v2\/license?post=40"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}