regular people, mental models, and Google?

    August 22nd, 2023

    Pposts are possible posts, potential posts, plausible posts, planned posts, partial posts, or perfect posts?

    What does academic research say about the quality of “mental models” that “regular people” have for how Google works and how to use it effectively?

    @parismarx via Twitter on Aug 21, 2023

    some tech people really have no idea how regular people use the web and access information online. it’s part of the reason their “solutions” to the web’s problems so often privilege their technical skill and aren’t very accessible to others.

    [ . . . ]

    @paniterka_ch via Twitter on Aug 21, 2023

    See eg. here https://blog.google/products/search/search-language-understanding-bert/ Interestingly, it’s not so easy to find accessible material on how Search actually works in 2023. Which probably proves @parismarx point - nobody has a good mental model for how it works and how to use it effectively, unless you work at Google


    Recall:

    @danielsgriffin via Twitter on Jun 22, 2022

    “In fact, I met a librarian a year ago who said, “I thought Google was a non-profit”. I know, it is shocking."[1]


    1. @safiyanoble at UK House of Lords’ Select Committee on Democracy and Digital Technologies on 26 February 2020 https://committees.parliament.uk/oralevidence/360/html/

    A classroom assignment

    Identify and critique (1) claims and their missing sources, (2) missing claims and why they may be missing, (3) implicit assumptions that should be made explicit and (4) missing research and why it might not have been done or been published.


    Perplexity AI [ What does academic research say about the quality of “mental models” that “regular people” have for how Google works and how to use it effectively? ]

    Academic research on mental models and effective use of Google search by regular users is limited. However, studies on user behavior and search strategies can provide insights into how people interact with Google and form mental models.

    A study by Backlinko found that 85% of Google users find an answer to their query with their initial search term. This suggests that either Google is effective at understanding user intent and providing relevant results or users are adept at choosing the right keywords on their first attempt. Another study by SEMRush found that almost 30% of people have to redo their Google searches, either by refining or extending queries. This indicates that users might not always have accurate mental models of how Google works and may need to adjust their search strategies to find the desired information.

    Expert tips for more effective Google searches include using quotes for exact matches, using advanced search operators, and refining search queries based on the results obtained. These strategies can help users develop better mental models of how Google works and improve their search efficiency.

    In summary, while there is limited academic research specifically on mental models and effective use of Google search by regular users, studies on user behavior and search strategies can provide insights into how people interact with Google and form mental models. Users can improve their search efficiency by adopting expert tips and refining their search strategies based on the results obtained.
    You.com’s YouChat [ What does academic research say about the quality of “mental models” that “regular people” have for how Google works and how to use it effectively? ]

    The academic research on the mental models of “regular people” in terms of how Google works and how to use it effectively is vast and varied. There is a recognition that these mental models, which represent people’s understanding and perception of how systems work, are crucial in determining the effectiveness of their interactions with these systems.

    It’s not uncommon to find that many regular users have a simplified or incorrect understanding of how complex systems like Google function. This can lead to inefficient use of the system, such as not utilizing advanced search functions and relying heavily on the first few search results.

    Research shows that regular people often view search engines like Google as a “black box”, meaning they input queries and receive results, but the process in between remains largely mysterious. This mental model does not consider the intricate algorithms and processes used by Google to retrieve and rank relevant information.

    Furthermore, studies indicate that regular people often attribute human-like thinking to Google, believing it understands their queries just as a human would. This can lead to confusion when Google’s algorithms interpret queries literally or in ways different from human interpretation.

    There are also findings suggesting that many regular users are not aware of the full range of tools and functions available on Google. For instance, they may not know about or understand how to use Boolean operators, advanced search, or personalized search settings. This lack of knowledge can limit the effectiveness of their search efforts.

    To improve these mental models, research suggests that education and training can be beneficial. This can include formal instruction but also in-workflow messages and cues to guide users in understanding the operation of the system and making the most of the tools available.

    In conclusion, while regular people can use Google effectively to a degree, their mental models of how Google works and how to use it are often limited or incorrect. Education and training can help improve these mental models and make search activities more effective.
    Google’s Bard [ What does academic research say about the quality of “mental models” that “regular people” have for how Google works and how to use it effectively? ]

    Academic research has shown that the mental models that regular people have for how Google works and how to use it effectively are often incomplete and inaccurate. This can lead to people using Google in suboptimal ways, or even making mistakes.

    For example, one study found that people often have a misconception that Google’s search results are ranked by popularity, rather than by relevance. This can lead people to click on results that are not actually relevant to their search query.

    Another study found that people often do not understand how Google’s algorithms work, which can lead them to make suboptimal choices about how to phrase their search queries. For example, people may not realize that using more specific keywords can lead to more relevant results.

    The quality of people’s mental models for Google can also vary depending on their level of experience with the search engine. People who are more experienced with Google are more likely to have accurate mental models, but even experienced users can still make mistakes.

    There are a few things that can be done to improve people’s mental models for Google. One is to provide more educational resources about how Google works. This could include providing information about how Google’s algorithms work, how to phrase search queries effectively, and how to avoid common mistakes.

    Another is to make Google’s search results more transparent. This could include providing more information about how Google ranks results, and why certain results are displayed higher than others.

    Finally, it is important to remember that mental models are constantly evolving. As Google changes its algorithms and features, people’s mental models need to change as well. It is important to be aware of these changes and to update your mental models accordingly.

    Here are some additional research papers that you may find helpful:

    • “How People Understand and Use Search Engines: A Mental Model Approach” by Carol A. O’Connor and Susan E. Herbsleb (2001)
    • “The Mental Models of Search Engine Users: A Review and Synthesis of the Literature” by Stephanie D. Grimes, et al. (2013)
    • “Improving People’s Mental Models of Search Engines” by Michael J. Rader, et al. (2016)
    OpenAI’s ChatGPT GPT-4 [ What does academic research say about the quality of “mental models” that “regular people” have for how Google works and how to use it effectively? ]

    VThe quality of regular people’s mental model for how Google (or search engines in general) works and how to use it effectively can vary widely based on a number of factors:

    1. Experience: Those who grew up using the internet or have had extensive experience using search engines tend to have a more refined mental model of how to effectively use Google.

    2. Education: Those who’ve been taught or trained in digital literacy, research methodologies, or have had exposure to search engine optimization (SEO) concepts may have a deeper understanding of how search engines work.

    3. Interest and Curiosity: Individuals who have a natural curiosity about how things work or those who’ve taken the time to read up on the mechanics of search engines will generally have a more accurate mental model.

    4. Exposure: People who regularly interact with diverse online platforms or sources of information tend to develop a better intuition for discerning between reputable and less trustworthy search results.

    For many regular users, the mental model might be as basic as: - Google indexes websites. - When a query is typed in, Google scans its index to find the most relevant results. - The more popular or authoritative a website, the higher it might appear in search results.

    However, there are more nuances to Google’s search algorithms, including understanding of: - SEO tactics. - Paid advertisements vs. organic results. - The impact of personalization on search results (based on browsing history, location, etc.). - The importance of keywords, and how to effectively use them in queries. - Understanding Google’s advanced search features and operators.

    While many people can use Google effectively for day-to-day tasks, they might not be maximizing its potential or be fully aware of the intricacies of its algorithms. Still, as long as users can find the information they’re looking for and can critically assess the reliability of that information, they’re using the tool effectively for their needs.