What when it comes to AI in software engineering are you struggling with the most?
Armin Ronacher asks; Dillon Mulroy points to the replies as the realities of agentic engineering.
Daniel Griffin ·
Questions with a history
Armin Ronacher asks; Dillon Mulroy points to the replies as the realities of agentic engineering.
Daniel Griffin ·
A partial-history retrieval led an assistant to make confident global claims about a runner's training history.
Daniel Griffin ·
An alien ethnographer comes to document intelligence on Earth and finds baskets, bodies, labels, playrooms, refrigerators, and one compartment it cannot classify.
Daniel Griffin ·
Automation bias predicts that smooth operation trains humans out of checking. manrun is a built response—a gate that forces the practitioner to re-engage before an agent's blocked command executes. The tool exists because the literature said it should.
Daniel Griffin ·
The jagged frontier of AI capability isn't random. It's predictable from the practices, artifacts, and feedback loops that constitute actual work. The frontier is smooth where work is extended. It's jagged where work has been stripped to an isolated task.
Daniel Griffin ·
Verification catches the error. Repairability determines whether you can do anything about it. They're different properties of the work, and repairability is itself an extension—one that can be designed in or absent.
Daniel Griffin ·
The AI discourse obsesses over output quality. But for most of life, the harder problem is upstream—how do you turn 'something feels wrong' into a question worth asking?
Daniel Griffin ·
Productivity and quality are one outcome among many. When AI enters a practice, skill formation, craft, pace, accountability, and repairability all shift. The handoff analytic is what makes these dimensions visible.
Daniel Griffin ·
If the extensions framework is right, it should be falsifiable. Here's the specific within-domain prediction: the same task, in the same domain, will show different AI performance depending on whether the practice's extensions are engaged. Not across domains—within one.
Daniel Griffin ·
Task-exposure models count what AI can do. Bundle theory asks whether the task can be separated from the job. The extensions framework asks a different question: does 'can do' mean the same thing with and without the practice's feedback loops?
Daniel Griffin ·
Each extension has specific capacities. The compiler grounds 'does it run?' A security review grounds 'is it safe?' Map the capacities of the extensions in a practice, and you've mapped where the frontier is smooth and where it isn't. The handoff analytic reveals what happens when those capacities s
Daniel Griffin ·
Cross-trained practitioners—doctors who code, lawyers who build tools—see the frontier differently because they carry extensions from one domain into another. Their accounts reveal the mechanism: it's not the model that differs, it's what the practice provides.
Daniel Griffin ·
I built an index of all the questions in my dissertation — research questions, interview excerpts, cited provocations.
Daniel Griffin ·
Announcing a lecture and workshop at UCLA's Information Studies department on March 1st about maintaining and improving search engines.
Daniel Griffin ·
Work log on search evaluation tooling including Searchevals, Searchjunct, and SearchRights.org, plus community engagement on AI search benchmarking.
Daniel Griffin ·
Task list for upcoming Searchevals updates, Searchwhence improvements, and preparation for a UCLA lecture on search engine evaluation.
Daniel Griffin ·
Research notes on Trieve's search-before-generate approach, ArcSearch, Perplexity AI, and testing how distractor hints affect search accuracy across multiple tools.
Daniel Griffin ·
{% include excerpt card.html id="kruschwitz2017searching search has become ubiquitous" %}
Daniel Griffin ·
{% include weblinks.html url="https://heal workshop.github.io/" center=true %}
Daniel Griffin ·
We have a big chance to really change search for the better. Will we?
Daniel Griffin ·
Social media request asking if anyone is developing a comparative benchmark between major search and AI platforms.
Daniel Griffin ·
{% include weblinks.html url="https://twitter.com/simonw/status/1751841193506550112" center=true %}
Daniel Griffin ·
{% include weblinks.html url="https://twitter.com/jiayq/status/1750242829769801793" center=true %}
Daniel Griffin ·
Link to Bruce Yu's user-driven evaluation of generative web search tools using 5 simple test questions.
Daniel Griffin ·
A brief post linking to a Twitter post discussing considerations around posting screenshots of search system results or responses.
Daniel Griffin ·
A short post linking to a Twitter post tagged as a speculative classroom exercise about thyroid nodule treatments.
Daniel Griffin ·
A short post linking to a Twitter post proposing a speculative 'plagiarism index' as a classroom exercise.
Daniel Griffin ·
{% include weblinks.html url="https://twitter.com/sergeykarayev/status/1733927606075138488" center=true %} I [quote tweeted the above](https://twitter.com/danielsgriffin/status/1733989391247479063) on Dec 10th, pasted with some edits below. The implicit social search request and responses was a g…
Daniel Griffin ·
A brief index post linking to comparisons of search results across Perplexity, You.com, Bard, Bing, Tavily, and a custom generative search baseline for the 'What is answer.ai?' query.
Daniel Griffin ·
I mention the need for something like this in several posts (which I will organize below). But I'm going to just start building it out myself.[^remotivated] Dec 10th[^1]: [On developing informed preferences for models in generative web search](/2023/12/14/on developing informed preferences for mo…
Daniel Griffin ·
Comparison of results from Perplexity AI.Copilot, YouChat.GPT-4, and Tavily when searching 'What is generative web search? site:danielsgriffin.com', noting high dependency on indexing quality.
Daniel Griffin ·
[comparing results for [What is generative web search? site:danielsgriffin.com]](/2023/12/14/comparing results for what is generative web search site/) For other systems on this theme, see: [Perplexity AI.Copilot[What is generative web search? site:danielsgriffin.com]](/2023/12/14/perplexity aico…
Daniel Griffin ·
Documents Perplexity AI.Copilot's responses to querying 'What is generative web search? site:danielsgriffin.com' in two variations, with evaluations noting distractions from off-site sources and mixed adherence to the site: operator.
Daniel Griffin ·
This is my second use of Tavily. [comparing results for [What is generative web search? site:danielsgriffin.com]](/2023/12/14/comparing results for what is generative web search site/) For other systems on this theme, see: [Perplexity AI.Copilot[What is generative web search? site:danielsgriffin.…
Daniel Griffin ·
LOOSE NOTES [comparing results for [What is answer.ai (from Howard & Ries)?]](/2023/12/14/comparing results for what is answerai from howard and ries/) For other systems on this theme, see: Perplexity, You.com, Bard, and Bing at [[What is answer.ai (from Howard & Ries)?]](/2023/12/12/what is answ…
Daniel Griffin ·
Documents testing Tavily's generative search API with the query 'What is answer.ai (from Howard & Ries)?', showing the system failed to locate the specific entity and returned unrelated 'Answer AI' products instead.
Daniel Griffin ·
{% include weblinks.html url="https://twitter.com/danielsgriffin/status/1727489830001815696" center=true %}
Daniel Griffin ·
Documentation about Tavily, a web search and generative search API integrated into LangChain's opengpts, with links to website, playground, API docs, and usage examples.
Daniel Griffin ·
{% include weblinks.html url="https://twitter.com/ryan landay/status/1734953278813724722" center=true %}
Daniel Griffin ·
Comparative evaluation of Perplexity, You.com, Bard, and Bing responses about the newly launched answer.ai R&D lab.
Daniel Griffin ·
{% include weblinks.html url="https://www.answer.ai/posts/2023 12 12 launch" center=true %}
Daniel Griffin ·
{% include weblinks.html url="https://twitter.com/omarsar0/status/1734260212310098216" center=true %}
Daniel Griffin ·
Commentary on competitive pressure for LLMs to have live web access rather than static knowledge cutoffs.
Daniel Griffin ·
Exploration of UI experimentation versus training approaches for search disambiguation and clarifying questions in AI search assistants.
Daniel Griffin ·
Weblink marking Perplexity AI's first anniversary with founder reflections in thread format.
Daniel Griffin ·
Brief weblink noting Bing's internal codename for Deep Search was 'Search Harder.'
Daniel Griffin ·
Weblink polling preference between Perplexity AI and X Grok for live accurate information.
Daniel Griffin ·
{% include weblinks.html url="https://twitter.com/naz andalibi/status/1732355077632074200" center=true %}
Daniel Griffin ·
{% include weblinks.html url="https://herbsleb.org/" center=true %} I've been thinking about these sorts of questions a lot in relation to our current disruption in web search. See some of my musings in [Towards “benchmarking” democratization of good search](/2023/12/04/towards benchmarking democ…
Daniel Griffin ·
What organizations are best situated to apply their own resources and promote developer attention and energy to this problem and opportunity?
Daniel Griffin ·
Solaiman et al. (2023)
Daniel Griffin ·
Liu et al. (2023)
Daniel Griffin ·
Parsing details in the supplemental materials.
Daniel Griffin ·
A recommendation.
Daniel Griffin ·
An excerpt from Liu et al. (2023)
Daniel Griffin ·
Mager (2023)
Daniel Griffin ·
Mager (2013)
Daniel Griffin ·
{% include weblinks.html url="https://nlnet.nl/news/2023/20231016 marginalia" center=true %} See: [search.marginalia.nu/](https://search.marginalia.nu/) HT \@FloweeTheHub via [Twitter/X](https://twitter.com/FloweeTheHub/status/1730563488081215780) on Dec 01, 2023: [“I love it when single devs can…
Daniel Griffin ·
{% include weblinks.html url="https://twitter.com/blennon /status/1658501876512587777" center=true %} Note: The URL is now [ollie.ai](https://ollie.ai/)
Daniel Griffin ·
{% include weblinks.html url="https://twitter.com/FloweeTheHub/status/1730563488081215780" center=true %} See: [search.marginalia.nu/](https://search.marginalia.nu/)
Daniel Griffin ·
{% include weblinks.html url="https://twitter.com/AravSrinivas/status/1730647482999378052" center=true %}
Daniel Griffin ·
A tweet from Ori Zilbershtein.
Daniel Griffin ·
Search again?
Daniel Griffin ·
“It’s a clean and efficient way to search, get what you need, and get on with your day.”
Daniel Griffin ·
Weblink to Data & Society's 'Trust Issues' event exploring perspectives on community, technology, and trust.
Daniel Griffin ·
Van Couvering (2007)
Daniel Griffin ·
Gururaja et al. (2023)
Daniel Griffin ·
Weblink post sharing Mitchell Hashimoto's tweet about eliminating Google products from personal life, connecting to themes of technology refusal.
Daniel Griffin ·
Re confirmation-biased queries.
Daniel Griffin ·
Kacperski et al. (2023)
Daniel Griffin ·
von Nordheim et al. (2023)
Daniel Griffin ·
Zou et al. (2023)
Daniel Griffin ·
A question.
Daniel Griffin ·
Research summary of FreshLLMs, a paper introducing search engine-augmented prompting to improve LLM factuality and reduce hallucinations on current world knowledge questions.
Daniel Griffin ·
Tweets from Perplexity.
Daniel Griffin ·
{% include weblinks.html url="https://twitter.com/danielsgriffin/status/1729563309098099092" center=true %}
Daniel Griffin ·
A speculative tweet thread on terminology choices in documentation, library and information sciences, and information retrieval.
Daniel Griffin ·
An excerpt from Waller (2009).
Daniel Griffin ·
An excerpt from Hoffmann (2016).
Daniel Griffin ·
A tweet from Aravind Srinivas.
Daniel Griffin ·
A social search request from Shawn Wang.
Daniel Griffin ·
A post from Filip Piekniewski.
Daniel Griffin ·
A post from Teknium.
Daniel Griffin ·
A robots.txt parser from Will Critchlow.
Daniel Griffin ·
Weblink post sharing Twitter announcements about November 16, 2023 updates to Google's Search Quality Rater Guidelines.
Daniel Griffin ·
A post from Aravind Srinivas
Daniel Griffin ·
Sharing a Request for Proposals from Open Philanthropy.
Daniel Griffin ·
Sharing a script and search results for some find_similar searches on Metaphor.
Daniel Griffin ·
Reflection on wanting to share recent searches, considering building a new post category and browser export system for search queries.
Daniel Griffin ·
A thread from Google's Search Liaison.
Daniel Griffin ·
A post from Anton Bacaj.
Daniel Griffin ·
A post from Geoffrey Litt.
Daniel Griffin ·
A post from Jordi Ribas.
Daniel Griffin ·
A social-search-request example.
Daniel Griffin ·
A social-search-request from Timothy B. Lee.
Daniel Griffin ·
A screenshot from Friday AI.
Daniel Griffin ·
“explore practices for discovering, maintaining, and adding to the many internets blossoming beneath app hedges and large platforms:”
Daniel Griffin ·
A post from Rob Haisfield.
Daniel Griffin ·
A post from Nick Dobos.
Daniel Griffin ·
An example setup for transcribing videos from TikTok.
Daniel Griffin ·
A post from François Chollet.
Daniel Griffin ·
Fact-checks a Reddit claim about unique Google searches by analyzing the random query 'dbw0340tokfkds;a' through Google Trends data.
Daniel Griffin ·
An excerpt from Sullivan (2017).
Daniel Griffin ·
Critiques the '15% of Google searches are new' statistic, examining how Google frames it to suggest impressive capabilities without providing meaningful context.
Daniel Griffin ·
Describing a search engine for your complaints
Daniel Griffin ·
Tweet from Clement Delangue.
Daniel Griffin ·
Weblink post sharing Stanford's Intervenr platform for sociotechnical audits.
Daniel Griffin ·
Have, could, would, should?
Daniel Griffin ·
Is this a query for which “only general search engines return links to websites with information you might be looking for”?
Daniel Griffin ·
A discussion of mismatch in the search experience (between query, presented search results, and content) and missing contextually-relevant explanations.
Daniel Griffin ·
An excerpt from Lewis's "The people who ruined the internet"
Daniel Griffin ·
Early draft exploring sources of search failures and related research on algorithms of oppression, search quality complaints, and sociotechnical imaginaries around Google Search.
Daniel Griffin ·
A search quality complaint from journalist Louise Matsakis.
Daniel Griffin ·
A social-search-request from Paula Goldman.
Daniel Griffin ·
I argue that we should use this opportunistic to rethink what search could be.
Daniel Griffin ·
A status post re trying out ripgrep.
Daniel Griffin ·
A social-search-request from Chenoe Hart.
Daniel Griffin ·
A note on non-digital searchability, search & rescue, and search engine optimization.
Daniel Griffin ·
Towards minimizing harm from “hallucinations” and other baloney.
Daniel Griffin ·
Can the Programmable Search Engine's Custom Search JSON API be said to be an official web search API?
Daniel Griffin ·
Tweet from Lily Ray.
Daniel Griffin ·
Loose notes on Google's search result warnings for unreliable or rapidly evolving topics, with Vox and Verge reporting on the feature's 2021 rollout.
Daniel Griffin ·
How might Google support users to calibrate trust within the tool itself?
Daniel Griffin ·
Early draft covering data voids and research on how search engine reliance on source popularity can surface extreme-right content for migration-related queries in Germany and Sweden.
Daniel Griffin ·
Early draft on search directives, exploring how posts suggest specific Google search terms to co-opt Google's perceived impartiality.
Daniel Griffin ·
Draft covering trending searches via Google Trends, with research by Gillespie on algorithms becoming culture and critical perspectives on using Google Trends data.
Daniel Griffin ·
Google sometimes displays a text books to
Daniel Griffin ·
Brief draft about null results (searches with no results) and their relation to data voids, with a link to how the site's search handles them.
Daniel Griffin ·
Comprehensive draft on Google autocomplete's benefits, harms (amplifying social bias, gaming), and warnings about misconceptions like autocompletions not representing most popular searches.
Daniel Griffin ·
An excerpt from Davey Alba's article, "Even Google Insiders Are Questioning Bard AI Chatbot’s Usefulness".
Daniel Griffin ·
My comments about the Bard Discord server were picked up by Davey Alba and she talked to me for an article in Bloomberg.
Daniel Griffin ·
See [flights to israel] and [why does the us support israel]
Daniel Griffin ·
An excerpt from Will Knight's article, "Chatbot Hallucinations Are Poisoning Web Search".
Daniel Griffin ·
Exploring Google Bard's non-selectable 'Search related topics' links and whether this UX limitation constitutes hostile design.
Daniel Griffin ·
Shares response from Bard and brief additional comments re running Will Knight's "hallucination test".
Daniel Griffin ·
How do you share about misinformation without spreading it? How do you link to the outputs of chatbots and generative search engines without deceiving folks?
Daniel Griffin ·
My comments about poisoning Bing were picked up by Will Knight and he talked to me for an article in Wired.
Daniel Griffin ·
Bing Chat, Perplexity AI, and Phind retrieve and summarize.
Daniel Griffin ·
How well do search engines deal with masked URLs?
Daniel Griffin ·
Exploring the challenges of differentiating LLM-generated content in search results and proposing possible actions.
Daniel Griffin ·
Testing and comparing the fact-checking capabilities of various generative search systems (Andi, Metaphor, Perplexity, Phind, You.com) on a false SEO claim.
Daniel Griffin ·
Sharing an example hallucination test.
Daniel Griffin ·
Weblinks post announcing the public beta of Collective Cognition, a project for sharing ChatGPT conversations.
Daniel Griffin ·
a tweet from Ian Arawjo
Daniel Griffin ·
"How You Can Help Fix Peer Review"
Daniel Griffin ·
/@simonw: Anyone seen any interesting examples of...
Daniel Griffin ·
Weblinks post linking to a Twitter thread discussing the meaning of the 'f' in printf format specifiers.
Daniel Griffin ·
"I’m looking for the quickest and simplest way to call a language model from Python"
Daniel Griffin ·
A simple FlexSearch implementation
Daniel Griffin ·
A weblink.
Daniel Griffin ·
Faithfulness, Context Relevancy, Context Recall, Answer Relevancy, Aspect Critiques
Daniel Griffin ·
An excerpt: "..."help users overcome the “design”, “selection”, and “use” barriers"
Daniel Griffin ·
Brief excerpt post referencing Ethan Mollick's vision for large-scale public prompt libraries or 'grimoires'.
Daniel Griffin ·
Documentation of the LangChain Hub as a searchable repository of prompts for LLM developers, with investigation into when search functionality was added.
Daniel Griffin ·
the impetus to search... spaces that reward curiosity... ways to distribute evaluation
Daniel Griffin ·
Trying to 'find the grounding' and finding flipping and waffling.
Daniel Griffin ·
Comparative Search User Integration Rx - Recipe / Reception / Research / Review
Daniel Griffin ·
Reflection on documenting persistent research questions that warrant better answers but aren't urgent enough to pursue immediately.
Daniel Griffin ·
What can and will we do to unseal knowledges?
Daniel Griffin ·
Analysis of AI hallucination behavior by testing a Plato quote completion task across multiple LLM systems (ChatGPT, Claude, Bard, Pi, Perplexity, YouChat).
Daniel Griffin ·
Technical documentation of website bugs including pagination issues with sort:date searches and incorrect back-to labels for pposts.
Daniel Griffin ·
Overview of searchsmart.org's approach to testing academic search systems using metamorphic testing from the user perspective.
Daniel Griffin ·
- Dave Guarino (Jan 16th, 2020)
Daniel Griffin ·
A doc listing feedback on complaints re search user interfaces (SUI).
Daniel Griffin ·
The briefest introduction.
Daniel Griffin ·
A provocation.
Daniel Griffin ·
What is retrieval-augmented generation (RAG)?
Daniel Griffin ·
On some struggles with chatbots and gensearch tools.
Daniel Griffin ·
What might that look like?
Daniel Griffin ·
Weblink to a Twitter thread arguing that physical automation shouldn't be dismissed as just another passing tech trend like crypto or metaverse.
Daniel Griffin ·
"...essential to realizing the promise of AI to benefit people and society while mitigating risks"
Daniel Griffin ·
A minor bug report on a search user interface.
Daniel Griffin ·
Could take a photo of a sign and be led directly to the inspection report?
Daniel Griffin ·
Reflection on viewing Google's core algorithm updates through the lens of chaos engineering and their disruptive effects on SEO organizations.
Daniel Griffin ·
Weblink to a Twitter post about questioning whether knowledge comes from AI tools or the underlying material being queried.
Daniel Griffin ·
Weblink to a Twitter post about the confusing state of AI discourse, where people claim both that AI is overhyped and that it poses existential risk.
Daniel Griffin ·
...which stereotypes are moderated and under-moderated in search engine autocompletion?
Daniel Griffin ·
Weblink to a Twitter post about Quivr, an open-source local search project.
Daniel Griffin ·
"A nanopublication is the smallest unit of publishable information."
Daniel Griffin ·
You can seemingly add a query string to force a cache reset?
Daniel Griffin ·
What do we know about how people make sense of Google to google?
Daniel Griffin ·
Curated list of LLM tools and frameworks including ChainForge, Comet, LangChain, and ragas for prompt engineering, evaluation, and RAG pipeline development.
Daniel Griffin ·
What might SEO for social good look like?
Daniel Griffin ·
To evaluate the performance of LLMs we have to extend our observations & analysis well-beyond the raw outputs.
Daniel Griffin ·
What does 'incorrect' even mean when referring to an LLM output?
Daniel Griffin ·
Excerpt from a study on programming expertise showing participants self-reported as mostly proficient programmers but only competent in ChatGPT usage, revealing a skill gap between traditional coding and AI tool proficiency.
Daniel Griffin ·
Brief post positioning heteromation concept alongside the automation versus augmentation debate, referencing Ekbia's work.
Daniel Griffin ·
To better understand and address tool use, we need to understand not 'accuracy' but interaction.
Daniel Griffin ·
Analysis of Metzler et al.'s 'Rethinking Search' paper and its framing of LLMs as dilettantes, reframing the concept to consider how human dilettantes might interact with or as domain experts in search practice.
Daniel Griffin ·
ChatGPT-4 seems able to now adequately address this specific stacking challenge?
Daniel Griffin ·
Thinking about what if general-purpose web search were more like searching for directions...
Daniel Griffin ·
{% include paper.html %}
Daniel Griffin ·
A tweet from @zacharylipton: Prompts are not Lipschitz. There are no “small” changes to prompts...
Daniel Griffin ·
Thinking about comparing and contrasting 'prompt injection' and the 'Google This Ploy' (Caulfield, 2019)
Daniel Griffin ·
Thinking about hallucination with Klosterman, Leahu, Munk et al., Rettberg, and Powles & Nissenbaum.
Daniel Griffin ·
{% include weblinks.html url="https://twitter.com/vectara/status/1669254503487401984" %}
Daniel Griffin ·
{% include excerpt card.html id="narayanan2022google however we often consult google about topics" %}
Daniel Griffin ·
{% include excerpt card.html id="duguid2012world for if a reader goes to a book" %}
Daniel Griffin ·
Here is the 'OWASP Top 10 for Large Language Model Applications'. [Overreliance](https://llmtop10.com/llm09/) is relevant to my research. (I’ve generally used the term “automation bias”, though perhaps a more direct term like overreliance is better.) You can see my discussion in the “Extending se…
Daniel Griffin ·
[Logan Kilpatrick just announced search in OpenAI's developer docs](https://twitter.com/OfficialLoganK/status/1686788266886942720) so I glanced at it and saw the hint to jump to the search bar (their DocSearch Button Keys ): ⌘ & K . I appreciate such [micro interactions in search](/search/?q=tags…
Daniel Griffin ·
Collection of tweets describing academic search workflow using Twitter, Semantic Scholar, local whoosh index, and various citation tools while exploring alternatives to Google Scholar.
Daniel Griffin ·
This is an incomplete listing of a few academic search tools. See also: my paper w/ [Jake Goldenfein](https://twitter.com/jakusg) ([Google Scholar – Platforming the scholarly economy (goldenfein2022platforming)](/shortcuts/goldenfein2022platforming)) my [scholar profiles (page)](/scholar profiles…
Daniel Griffin ·
{% include excerpt card.html id="grimmelmann2014speech a good search engine advises" %}
Daniel Griffin ·
This is partially about prompt engineering and partially about what a good essay or search does. More than answer a question, perhaps? (this is engaged with in the essay, though not to my liking). Grimm The linked essay includes a sentiment connected with a common theme that I think is unfounded:…
Daniel Griffin ·
\@aravsrinivas via Twitter on Jul 24, 2023 The ultimate question is what is the question. Asking the right question is hard. Even framing a question is hard. Hence why at perplexity, we don’t just let you have a chat UI. But actually try to minimize the level of thought needed to ask fresh or fol…
Daniel Griffin ·
\@aidangomezzz via Twitter on Jul 25, 2023 We're excited to start putting Coral in the hands of users! Coral is "retrieval first" in the sense it will reference and cite its sources when generating an answer. Coral can pull from an ecosystem of knowledge sources including Google Workspace, Office…
Daniel Griffin ·
Screenshot of [Ayhan Fuat Çelik's "The Fall of Stack Overflow" on Observable](https://observablehq.com/@ayhanfuat/the fall of stack overflow) omitted. The graph in question has since been updated. \@natfriedman via Twitter on Jul 26, 2023 Why the precipitous sudden decline in early 2022? That fir…
Daniel Griffin ·
\@jeremyphoward via Twitter on Jul 25, 2023 Be careful of concluding that "GPT 4 can't do " on the basis you tried it once and it didn't work for you. See the thread below for two recent papers showing how badly this line of thinking can go wrong, and an interesting example.
Daniel Griffin ·
{% include weblinks.html url="https://twitter.com/katypearce/status/1684286070924656640" center=true %}
Daniel Griffin ·
\@pchandrasekar via Twitter on Jul 27, 2023 Today we officially launch the next stage of community and AI here at \@StackOverflow: OverflowAI! Just shared the exciting news on the \@WeAreDevs keynote stage. If you missed it, watch highlights of our announcements and visit [https://stackoverflow.c…
Daniel Griffin ·
Good Boys (2019), via Yarn We're sorry. We just wanted to learn how to kiss. [ . . . ] Just go online and type in "how to kiss." That's what everyone does. HT: a random clip, containing the above, [on TikTok](https://www.tiktok.com/@movie4kkk/video/7250474768573435162).
Daniel Griffin ·
via answeroverflow.com on Jul 28, 2023 Bringing your Discord channels to Google Answer Overflow is an open source project designed to bring discord channels to your favorite search engine. Set it up in minutes and bring discovery to your hidden content. HT: browsing from [\@rhyssullivan's tweet o…
Daniel Griffin ·
via cs.berkeley.edu on Jul 28, 2023 🦍 Gorilla: Large Language Model Connected with Massive APIs Gorilla is a LLM that can provide appropriate API calls. It is trained on three massive machine learning hub datasets: Torch Hub, TensorFlow Hub and HuggingFace. We are rapidly adding new domains, inc…
Daniel Griffin ·
via r/NoStupidQuestions on Jul 13, 2023 What does it mean when people from Canada and US say chamungus in meetings? I am from slovenia and this week we have 5 people from US and toronto office visiting us for trainings. On monday when we were first shaking hands and getting to know each other bef…
Daniel Griffin ·
Weblink to Marie Haynes' post on Google’s Search Quality Raters
Daniel Griffin ·
@simonw sharing about finding misleading claims from Claude 2
Daniel Griffin ·
@swiftonsecurity warning about googling phone numbers.
Daniel Griffin ·
Various results for asking about the HTML character entity reference for an apostrophe.
Daniel Griffin ·
Musings on elaboration, structure, memory, expectation, redundancy, and search.
Daniel Griffin ·
TIL how to setup my terminal to open a file in VS Code with `code`.
Daniel Griffin ·
An example of searching with OpenAI's GPT models on my local Lunr.js instance.
Daniel Griffin ·
Exploring "[Question answering using embeddings based search](https://github.com/openai/openai cookbook/blob/main/examples/Question answering using a search API.ipynb)" in OpenAI's cookbook.
Daniel Griffin ·
This is a doc about generative search (and search like) tool support for sharing responses/results through a 'sharing interface'. My attention to support for sharing results of searches, or documenting that a search has been performed, is partially due to (1) lessons re sharing and repairing sear…
Daniel Griffin ·
Claude 2 fails my Claude Shannon hallucination test, producing a summary of a non-existent publication.
Daniel Griffin ·
Warnings and ClaimReview?
Daniel Griffin ·
\@nadaawg via Threads on Jul 6, 2023 But what about that feature where you tap the Search button twice and it pops open the keyboard? [\@spotify](https://www.threads.net/@spotify) way ahead of the curve Single tap. Screenshot taken manually on iOS at roughly: 2023 07 10 09:40 Double tap. Screensh…
Daniel Griffin ·
\@gergelyorosz What are good (and efficient) alternatives to ChatGPT \ for writing code\ or coding related topics? So not asking about Copilot alternatives. But GenAI "chat windows" that have been trained on enough code to be useful in e.g. scaffolding, explaining coding concepts etc. On Twitter …
Daniel Griffin ·
\@mati faure Thanks for the recommendation, it's actually great for searching! I wish I could ask it to narrow search results to a given time period though (cc [\@perplexity ai](https://twitter.com/perplexity ai)) On Twitter Jul 7, 2023 It will be very interesting to see how these newer search to…
Daniel Griffin ·
This is an incomplete doc about browser site search shortcuts. You can modify your web browser so that after jumping to your address bar / 'omnibox' ( Cmd+L ) you can type a shortcut to search via a particular search tool. To add a search tool in your browser, you need a name for the tool, a shor…
Daniel Griffin ·
[https://blog.kagi.com/](https://blog.kagi.com/): Kagi is building a novel ad free, paid search engine and a powerful web browser as a part of our mission to humanize the web. Kagi: Kagi's approach to AI in search Kagi Search is pleased to announce the introduction of three AI features into our p…
Daniel Griffin ·
This is an incomplete doc about search query length limits. From Perplexity AI's marketing email today: Longer Input Limits Did you know Perplexity can write code, essays, and summarize articles? To help, input limits have been increased to 2000 tokens (roughly 1500 words). Entirely apart from th…
Daniel Griffin ·
This is an incomplete doc about search audits, or search engine audits. This is overly self referential at this time. Search audits, as a form of "algorithm audit", are systematic approaches to evaluating the performance of a search tool through documenting interacting with the tool in various wa…
Daniel Griffin ·
Inflection AI PI feedback interface This is in Google Forms. Screenshot taken with [GoFullPage](https://gofullpage.com/) (distortions possible) at: 2023 07 01 08:18:06 Inflection AI PI sharing interface (via an example query prompt) Inflection AI Pi [ How can I share these conversations with othe…
Daniel Griffin ·
This tweet is a reply—from the same author—to the tweet in: [very few worthwhile tasks? (weblink)](/weblinks/2023/06/29/very few worthwhile tasks). [ highlighting added] \@benedictevans In other words, I think the text prompt is a poor UI , quite separate to the capability of the model itself. On…
Daniel Griffin ·
status: unread (2023 06 30 17:06:56) Why Johnny Can’t Prompt: How Non AI Experts Try (and Fail) to Design LLM Prompts bibtex @inproceedings{zamfirescu pereira2023johnny, author = {Zamfirescu Pereira, J.D. and Wong, Richmond Y. and Hartmann, Bjoern and Yang, Qian}, title = {Why Johnny Can’t Prompt…
Daniel Griffin ·
Responds to Benedict Evans' tweet about ChatGPT tasks, arguing the challenge isn't describing tasks briefly but finding the right prompts that connect searchers to their goals. Draws on dissertation research about how data engineers grow queries from code and conversation seeds.
Daniel Griffin ·
Learned how to use git status --short and create git aliases to filter out _site directory changes from Jekyll builds. Includes search tool comparisons using You.com, Perplexity AI, and Phind.
Daniel Griffin ·
Downloaded. You’re all set Once embeddings are finished being generated, you can specify Cody’s context and start asking questions in the Cody Chat. Current status: "Generating repositories embeddings" \@steve yegge [https://about.sourcegraph.com/blog/all you need is cody](https://about.sourcegra…
Daniel Griffin ·
Follow up: [very few 2 3 sentence descriptions connect (weblog)](/2023/06/30/very few 2 3 sentence descriptions). What is a "worthwhile task"? [ highlighting added] \@benedictevans The more I look at chatGPT, the more I think that the fact NLP didn’t work very well until recently blinded us to th…
Daniel Griffin ·
the definition(s) and use(s) of "prompt engineering" will continue to evolve, shapeshift, fragment and become even more multiple and context dependent. But still a useful handle? [ highlighting added] \@yoavgo i didnt look in details yet but this is roughly what i'd imagine a chaining tool api to…
Daniel Griffin ·
Comparative screenshot collection showing initial search results from seven generative search tools for the query about which SUV brand is best.
Daniel Griffin ·
\@generativist via Twitter on Jun 26, 2023 i imagine there’s no alpha left in adding the word “open” to various names anymore, right? My first thought in response to this was that someone should write a speculative design on a transformation of old Google to "OpenGoogle".
Daniel Griffin ·
Follow up: [\[I want to buy a new SUV which brand is best?\]](/2023/06/28/i want to buy a new suv which brand is best). I don't think ads[1] are necessarily wrong to have in search results (despite the misgivings in @brin1998anatomy), but people are definitely not happy with how the dominant sear…
Daniel Griffin ·
Flagging two excerpts from a recent Google Research blogpost
Daniel Griffin ·
The hard problems remain, how to use a tool to do something you or someone else wants.
Daniel Griffin ·
What does 'consumer search' mean?
Daniel Griffin ·
still searching for gorillas (or not?)
Daniel Griffin ·
Can Google Lens be more than a party trick?
Daniel Griffin ·
mastodon.social/@danielsgriffin
Daniel Griffin ·
{% assign d = page.date | date: "% d" %} {{ page.date | date: "%B" }} {% case d %}{% when '1' or '21' or '31' %}{{ d }}st{% when '2' or '22' %}{{ d }}nd{% when '3' or '23' %}{{ d }}rd{% else %}{{ d }}th{% endcase %}, {{ page.date | date: "%Y" }}: {{ page.title }} {% assign content = page.snippet …
Daniel Griffin ·
Search automation bias is one term for the production of epistemic automaticity in the Google Web Search paradigm.
Daniel Griffin ·
Here is text of my prospectus for applying to the 2021 Information Operations Fellowship with Twitter’s Trust & Safety Team.
Daniel Griffin ·
What do the communities on Mastodon think about full text search?
Daniel Griffin ·
Notes on a fear of Google abandoning Google Scholar.
Daniel Griffin ·
Here are tweets that make me think of Bailey and Leonardi's work on bridging gaps.
Daniel Griffin ·
Yet again someone is compelled to take to Twitter to issue a complaint to Google about incorrect information about them in search results and to appeal for correction.
Daniel Griffin ·
As a searcher, can you avoid featured snippets on Google? Five possible options.
Daniel Griffin ·
Looking at a recent paper from Jill Walker Rettberg[^1]—discussing a method of "algorithmic failure", which "uses the mispredictions of machine learning to identify cases that are of interest for qualitative research"—reminded me of a card in my notes: trace watery biases. The use by Rettberg is …
Daniel Griffin ·
Documents how Google's query parsing uniquely fails to return results for a hyphenated data void term from Golebiewski & boyd (2018), while other search engines handle the query successfully.
Daniel Griffin ·
Musings on seeing the below tweet: How might the experience searching (for solutions or fixes) when building with low code tools differ from the more code centric ([wc?](/glossary/wc)) tools (like Python or Bash)? Scripting languages have large (though not always welcoming) communities with exist…
Daniel Griffin ·
{% assign d = page.date | date: "% d" %} {{ page.date | date: "%B" }} {% case d %}{% when '1' or '21' or '31' %}{{ d }}st{% when '2' or '22' %}{{ d }}nd{% when '3' or '23' %}{{ d }}rd{% else %}{{ d }}th{% endcase %}, {{ page.date | date: "%Y" }}: {{ page.title }} {% assign content = page.snippet …
Daniel Griffin ·
\ My PhD dissertation looks at jokes made about searching. Shared self & group directed joking among data engineers construct an appropriate reliance on web searching at work for work. They tell the jokes to connect, test and re see rather than stigmatize the searching practices. https://web.arch…
Daniel Griffin ·
{% assign d = page.date | date: "% d" %} {{ page.date | date: "%B" }} {% case d %}{% when '1' or '21' or '31' %}{{ d }}st{% when '2' or '22' %}{{ d }}nd{% when '3' or '23' %}{{ d }}rd{% else %}{{ d }}th{% endcase %}, {{ page.date | date: "%Y" }}: {{ page.title }} {% assign content = page.snippet …
Daniel Griffin ·
Speculative design exercise imagining a beneficent Google that would point users to alternative search systems and community resources in content advisories, rather than just saying there aren't matches.
Daniel Griffin ·
A survey of search engine UX micro-interactions, documenting which sites have the search cursor ready on page load versus those that don't, including some surprising failures from academic and library search tools.
Daniel Griffin ·
I wrote some initial rambling musings on finding new running routes a few months ago: [learn how to google trail routes](/2019/05/30/learn how to google trail routes) Another way to find new running routes (or, say in the case of my PhD research, stories of searching) is to present oneself to oth…
Daniel Griffin ·
Frames a critical question about Google's cultural assumptions and localization technologies through postcolonial computing discourse, examining power, authority, and cultural encounter in search suggestions.
Daniel Griffin ·
An analysis of micro-interactions across search interfaces: how Stack Overflow, GitHub, Gmail, and Twitter differently handle the user action of pressing Enter in an empty search box.
Daniel Griffin ·
A brief inquiry into the availability and affordances of temporal search operators (date-based search constraints), noting the lack of research attention to this aspect of search behavior.
Daniel Griffin ·
Initial tentative rambling musings on this perfect intersection of my trail running & PhD obsessions: Based on messages I get to all my social media accounts y’all need to learn how to google trail routes for when you’re on vacation. Also, check out caltopo for mapping your own routes and Gaia a …
Daniel Griffin ·
Explores how search algorithms fail to account for their own influence on outcomes, connecting sociomateriality theory to the Matthew Effect in web search rankings and the production of \"epistemic automaticity.\"
Daniel Griffin ·
A reflection on an OCR error that transformed 'ad infinitum' into the beautiful nonsense phrase 'ad z'njinz'tum,' followed by a comparative analysis of how Google, DuckDuckGo, and Bing handle exact-phrase searches for the typo.
Daniel Griffin ·
An account of my Bigfoot 200. Acknowledgments At the start of this writing I must acknowledge my father who was there for me at the start of the race, there well before the start, and there at all the key points along the way. He has long supported me in my wandering adventures. My dad is a bit o…
Daniel Griffin ·
Running the [San Diego 100][1] last weekend provided me hours and hours to reflect on running and life. One particular reflection dealt with signals. The course, one hundred point two miles of trail, much of it rock strewn and technical, went on and off a number of different routes. An hour east …
Daniel Griffin ·