Category: weblinks
- What skills do you use when a decision looks straightforward—and isn’t?
Daniel Griffin
George Nurijanian asks which Claude/Codex skills help when a decision looks straightforward at first and isn't.
October 9, 2026
- “We still don’t have a single verified example” of autonomous agents building complex software
Daniel Griffin
Mark Ajzenstadt claims there is no verified example of fully autonomous agents building working complex software over an extended period.
October 8, 2026
- where is the source of truth for how your software is supposed to work?
Daniel Griffin
dax asks where the source of truth lives for how software is supposed to work.
October 8, 2026
- What if the jagged frontier is mainly math + code?
Daniel Griffin
François Chollet asks whether progress outside math and code remains bottlenecked by human-generated data.
October 8, 2026
- Can LLMs generate novel research ideas?
Daniel Griffin
Kaiyue Wen asks whether LLMs can generate novel research ideas.
October 8, 2026
- So what if the model also considered them?
Daniel Griffin
Our insight: social sycophancy happens partly because models overly focus on the user.
October 5, 2026
- Correcting the environment that shapes agent behavior
Daniel Griffin
it's easy to fall into the trap of micromanaging your agents instead of correcting the environment that shapes its behavior.
October 4, 2026
- Human-centered Evaluation and Auditing of Language Models Workshop
Daniel Griffin
{% include weblinks.html url="https://heal workshop.github.io/" center=true %}
January 31, 2024
- ssr: “Is anyone working on a google vs perplexity vs bard vs gpt search benchmark?”
Daniel Griffin
Social media request asking if anyone is developing a comparative benchmark between major search and AI platforms.
January 30, 2024
- ssr: “Anyone got any leads on good LLM prompts for RAG with citations?”
Daniel Griffin
{% include weblinks.html url="https://twitter.com/simonw/status/1751841193506550112" center=true %}
January 29, 2024
- “Over the weekend, we built a demo for conversational search”
Daniel Griffin
{% include weblinks.html url="https://twitter.com/jiayq/status/1750242829769801793" center=true %}
January 25, 2024
- Yuveganlife Tests of Generative Web Search Tools
Daniel Griffin
Link to Bruce Yu's user-driven evaluation of generative web search tools using 5 simple test questions.
January 25, 2024
- “We might be returning to the early/pre-Google era of the 1990s where there were multiple search engines”
Daniel Griffin
{% include weblinks.html url="https://twitter.com/ryan landay/status/1734953278813724722" center=true %}
December 13, 2023
- answer.ai & “A new old kind of R&D lab”
Daniel Griffin
{% include weblinks.html url="https://www.answer.ai/posts/2023 12 12 launch" center=true %}
December 12, 2023
- “responsibility to test for real world applicability”
Daniel Griffin
{% include weblinks.html url="https://twitter.com/omarsar0/status/1734260212310098216" center=true %}
December 12, 2023
- “there's pressure for every LLM to have a live web connection”
Daniel Griffin
Commentary on competitive pressure for LLMs to have live web access rather than static knowledge cutoffs.
December 8, 2023
- “Today marks the first year anniversary of the launch of perplexity.ai”
Daniel Griffin
Weblink marking Perplexity AI's first anniversary with founder reflections in thread format.
December 8, 2023
- “The internal name for Deep Search was "Search Harder"”
Daniel Griffin
Brief weblink noting Bing's internal codename for Deep Search was 'Search Harder.'
December 8, 2023
- “what do you prefer for live accurate information?”
Daniel Griffin
Weblink polling preference between Perplexity AI and X Grok for live accurate information.
December 8, 2023
- ssr: “Do folks have favorite examples of systematic literature reviews? Better if in HCI, but okay if not.”
Daniel Griffin
{% include weblinks.html url="https://twitter.com/naz andalibi/status/1732355077632074200" center=true %}
December 8, 2023
- What questions should we ask when building software?
Daniel Griffin
{% include weblinks.html url="https://herbsleb.org/" center=true %} I've been thinking about these sorts of questions a lot in relation to our current disruption in web search. See some of my musings in [Towards “benchmarking” democratization of good search](/2023/12/04/towards benchmarking democ…
December 8, 2023
- “It would be really helpful to have other people dabble in search without having to build an entire search engine from scratch.”
Daniel Griffin
{% include weblinks.html url="https://nlnet.nl/news/2023/20231016 marginalia" center=true %} See: [search.marginalia.nu/](https://search.marginalia.nu/) HT \@FloweeTheHub via [Twitter/X](https://twitter.com/FloweeTheHub/status/1730563488081215780) on Dec 01, 2023: [“I love it when single devs can…
December 1, 2023
- Ollie.ai & “your personal shopper”
Daniel Griffin
{% include weblinks.html url="https://twitter.com/blennon /status/1658501876512587777" center=true %} Note: The URL is now [ollie.ai](https://ollie.ai/)
December 1, 2023
- “I love it when single devs can build stuff like a new search engine that actually work at scale.”
Daniel Griffin
{% include weblinks.html url="https://twitter.com/FloweeTheHub/status/1730563488081215780" center=true %} See: [search.marginalia.nu/](https://search.marginalia.nu/)
December 1, 2023
- “Product human evals are what matter to us”
Daniel Griffin
{% include weblinks.html url="https://twitter.com/AravSrinivas/status/1730647482999378052" center=true %}
December 1, 2023
- “How many people who type "hi" want Adolf Hitler with a picture in autocomplete?”
Daniel Griffin
A tweet from Ori Zilbershtein.
December 1, 2023
- TRUST ISSUES
Daniel Griffin
Weblink to Data & Society's 'Trust Issues' event exploring perspectives on community, technology, and trust.
November 30, 2023
- “I finally use zero Google products for my personal life”
Daniel Griffin
Weblink post sharing Mitchell Hashimoto's tweet about eliminating Google products from personal life, connecting to themes of technology refusal.
November 29, 2023
November 29, 2023
November 29, 2023
November 27, 2023
- ssr: “is there a well known service that expands any arbitrary links for LLM consumption?”
Daniel Griffin
A social search request from Shawn Wang.
November 18, 2023
- “I don't personally know a single professional who'd be using GPT for anything seriously pertaining to their work”
Daniel Griffin
A post from Filip Piekniewski.
November 18, 2023
- “Personally I've found Bingchat with search, and GPT4 with Browse to be far more confused at all times than the no-RAG model”
Daniel Griffin
A post from Teknium.
November 18, 2023
November 18, 2023
- Nov 16, 2023 update to Google's Search Quality Rater Guidelines
Daniel Griffin
Weblink post sharing Twitter announcements about November 16, 2023 updates to Google's Search Quality Rater Guidelines.
November 18, 2023
- “Perplexity user: “Microsoft banned your domain, so can't use it on work devices”.”
Daniel Griffin
A post from Aravind Srinivas
November 18, 2023
- Open Philanthropy RFP: “studying and forecasting the real-world impacts of systems built from LLMs”
Daniel Griffin
Sharing a Request for Proposals from Open Philanthropy.
November 18, 2023
- Thread from @searchliaison: “Last week, I gave a presentation about Google Search results not being perfect, how we...
Daniel Griffin
A thread from Google's Search Liaison.
November 16, 2023
- “this is well within the model training (it has very likely seen a ton of code for pong)”
Daniel Griffin
A post from Anton Bacaj.
November 16, 2023
- “Anyone else finding the new ChatGPT-4 with browsing to be a major downgrade?”
Daniel Griffin
A post from Geoffrey Litt.
November 16, 2023
- “Bing Chat and Bing Chat Enterprise will now simply become Copilot.”
Daniel Griffin
A post from Jordi Ribas.
November 15, 2023
- “HotGirls on TikTok, why do I look stupid at the gym?”
Daniel Griffin
A social-search-request example.
November 15, 2023
- ssr: “what are the most useful LLM-powered apps?”
Daniel Griffin
A social-search-request from Timothy B. Lee.
November 15, 2023
November 14, 2023
- A syllabus for ‘Taking an Internet Walk’
Daniel Griffin
“explore practices for discovering, maintaining, and adding to the many internets blossoming beneath app hedges and large platforms:”
November 14, 2023
- “Don't make me type everything into a box, let me point at stuff.”
Daniel Griffin
A post from Rob Haisfield.
November 14, 2023
- “way more accessible to have a list of experiences to try”
Daniel Griffin
A post from Nick Dobos.
November 14, 2023
- “building a search engine by listing "every query anyone might ever make"”
Daniel Griffin
A post from François Chollet.
November 10, 2023
- “where all orgs, non-profits, academia, startups, small and big companies, from all over the world can build”
Daniel Griffin
Tweet from Clement Delangue.
November 7, 2023
- Intervenr
Daniel Griffin
Weblink post sharing Stanford's Intervenr platform for sociotechnical audits.
November 7, 2023
- [how to change the oil on a 1965 Mustang]
Daniel Griffin
Is this a query for which “only general search engines return links to websites with information you might be looking for”?
November 3, 2023
- “I'm having a much harder time finding news clips via Google search than a few months ago.”
Daniel Griffin
A search quality complaint from journalist Louise Matsakis.
November 2, 2023
- ssr: “What's the phrase to describe when an algorithm doesn't take into effect it's own influence on an outcome?”
Daniel Griffin
A social-search-request from Paula Goldman.
November 1, 2023
- ssr: “What is the equivalent of SEO, but for navigating the physical built environment?”
Daniel Griffin
A social-search-request from Chenoe Hart.
October 31, 2023
- “might be the biggest SEO development we've had in a long time”
Daniel Griffin
Tweet from Lily Ray.
October 16, 2023
- "the importance of open discussion of these new tools gave me pause"
Daniel Griffin
An excerpt from Davey Alba's article, "Even Google Insiders Are Questioning Bard AI Chatbot’s Usefulness".
October 11, 2023
- "he hopes to see AI-powered search tools shake things up"
Daniel Griffin
An excerpt from Will Knight's article, "Chatbot Hallucinations Are Poisoning Web Search".
October 9, 2023
- "a public beta of our project, Collective Cognition to share ChatGPT chats"
Daniel Griffin
Weblinks post announcing the public beta of Collective Cognition, a project for sharing ChatGPT conversations.
September 25, 2023
- Is there any paper about the increasing “arXivification” of CS/HCI?
Daniel Griffin
a tweet from Ian Arawjo
September 25, 2023
September 19, 2023
- ssr: uses in new instruct model v. chat models?
Daniel Griffin
/@simonw: Anyone seen any interesting examples of...
September 19, 2023
- [What does the f mean in printf]
Daniel Griffin
Weblinks post linking to a Twitter thread discussing the meaning of the 'f' in printf format specifiers.
September 14, 2023
- ssr: LLM libraries that can be installed cleanly on Python
Daniel Griffin
"I’m looking for the quickest and simplest way to call a language model from Python"
September 14, 2023
September 12, 2023
- ragas metrics
Daniel Griffin
Faithfulness, Context Relevancy, Context Recall, Answer Relevancy, Aspect Critiques
September 8, 2023
- searchsmart.org
Daniel Griffin
Overview of searchsmart.org's approach to testing academic search systems using metamorphic testing from the user perspective.
September 1, 2023
- "We really need to talk more about monitoring search quality for public interest topics."
Daniel Griffin
- Dave Guarino (Jan 16th, 2020)
August 31, 2023
- "The robot is not, in my opinion, a skip."
Daniel Griffin
Weblink to a Twitter thread arguing that physical automation shouldn't be dismissed as just another passing tech trend like crypto or metaverse.
August 31, 2023
- Microsoft CFP: "Accelerate Foundation Models Research"
Daniel Griffin
"...essential to realizing the promise of AI to benefit people and society while mitigating risks"
August 30, 2023
- caught myself having questions that I normally wouldn't bother
Daniel Griffin
Weblink to a Twitter post about questioning whether knowledge comes from AI tools or the underlying material being queried.
August 28, 2023
- [I am confused about this]
Daniel Griffin
Weblink to a Twitter post about the confusing state of AI discourse, where people claim both that AI is overhyped and that it poses existential risk.
August 28, 2023
- Tech Policy Press on Choosing Our Words Carefully
Daniel Griffin
...which stereotypes are moderated and under-moderated in search engine autocompletion?
August 28, 2023
- open source project named Quivr...
Daniel Griffin
Weblink to a Twitter post about Quivr, an open-source local search project.
August 28, 2023
- "And what matters is if it works."
Daniel Griffin
To evaluate the performance of LLMs we have to extend our observations & analysis well-beyond the raw outputs.
August 22, 2023
- Are prompts—& queries—not Lipschitz?
Daniel Griffin
A tweet from @zacharylipton: Prompts are not Lipschitz. There are no “small” changes to prompts...
August 4, 2023
- Keyword search is dead?
Daniel Griffin
{% include weblinks.html url="https://twitter.com/vectara/status/1669254503487401984" %}
August 3, 2023
- OWASP Top 10 for Large Language Model Applications
Daniel Griffin
Here is the 'OWASP Top 10 for Large Language Model Applications'. [Overreliance](https://llmtop10.com/llm09/) is relevant to my research. (I’ve generally used the term “automation bias”, though perhaps a more direct term like overreliance is better.) You can see my discussion in the “Extending se…
August 3, 2023
- they answered the question
Daniel Griffin
This is partially about prompt engineering and partially about what a good essay or search does. More than answer a question, perhaps? (this is engaged with in the essay, though not to my liking). Grimm The linked essay includes a sentiment connected with a common theme that I think is unfounded:…
July 31, 2023
- The ultimate question
Daniel Griffin
\@aravsrinivas via Twitter on Jul 24, 2023 The ultimate question is what is the question. Asking the right question is hard. Even framing a question is hard. Hence why at perplexity, we don’t just let you have a chat UI. But actually try to minimize the level of thought needed to ask fresh or fol…
July 28, 2023
- Cohere's Coral
Daniel Griffin
\@aidangomezzz via Twitter on Jul 25, 2023 We're excited to start putting Coral in the hands of users! Coral is "retrieval first" in the sense it will reference and cite its sources when generating an answer. Coral can pull from an ecosystem of knowledge sources including Google Workspace, Office…
July 28, 2023
- this data might be wrong
Daniel Griffin
Screenshot of [Ayhan Fuat Çelik's "The Fall of Stack Overflow" on Observable](https://observablehq.com/@ayhanfuat/the fall of stack overflow) omitted. The graph in question has since been updated. \@natfriedman via Twitter on Jul 26, 2023 Why the precipitous sudden decline in early 2022? That fir…
July 28, 2023
- Be careful of concluding
Daniel Griffin
\@jeremyphoward via Twitter on Jul 25, 2023 Be careful of concluding that "GPT 4 can't do " on the basis you tried it once and it didn't work for you. See the thread below for two recent papers showing how badly this line of thinking can go wrong, and an interesting example.
July 28, 2023
- ssr: attention span essay or keywords?
Daniel Griffin
{% include weblinks.html url="https://twitter.com/katypearce/status/1684286070924656640" center=true %}
July 28, 2023
- OverflowAI
Daniel Griffin
\@pchandrasekar via Twitter on Jul 27, 2023 Today we officially launch the next stage of community and AI here at \@StackOverflow: OverflowAI! Just shared the exciting news on the \@WeAreDevs keynote stage. If you missed it, watch highlights of our announcements and visit [https://stackoverflow.c…
July 28, 2023
- Just go online and type in "how to kiss."
Daniel Griffin
Good Boys (2019), via Yarn We're sorry. We just wanted to learn how to kiss. [ . . . ] Just go online and type in "how to kiss." That's what everyone does. HT: a random clip, containing the above, [on TikTok](https://www.tiktok.com/@movie4kkk/video/7250474768573435162).
July 28, 2023
- AnswerOverflow
Daniel Griffin
via answeroverflow.com on Jul 28, 2023 Bringing your Discord channels to Google Answer Overflow is an open source project designed to bring discord channels to your favorite search engine. Set it up in minutes and bring discovery to your hidden content. HT: browsing from [\@rhyssullivan's tweet o…
July 28, 2023
- Gorilla
Daniel Griffin
via cs.berkeley.edu on Jul 28, 2023 🦍 Gorilla: Large Language Model Connected with Massive APIs Gorilla is a LLM that can provide appropriate API calls. It is trained on three massive machine learning hub datasets: Torch Hub, TensorFlow Hub and HuggingFace. We are rapidly adding new domains, inc…
July 28, 2023
- [chamungus]
Daniel Griffin
via r/NoStupidQuestions on Jul 13, 2023 What does it mean when people from Canada and US say chamungus in meetings? I am from slovenia and this week we have 5 people from US and toronto office visiting us for trainings. On monday when we were first shaking hands and getting to know each other bef…
July 28, 2023
- Everything Marie Haynes Knows About Google’s Quality Raters
Daniel Griffin
Weblink to Marie Haynes' post on Google’s Search Quality Raters
July 17, 2023
- Simon Willison (@simonw) on misleading pretending re LLMs and reading links
Daniel Griffin
@simonw sharing about finding misleading claims from Claude 2
July 17, 2023
- Should we not "just google" phone numbers?
Daniel Griffin
@swiftonsecurity warning about googling phone numbers.
July 17, 2023
- Claude 2 on my Claude Shannon hallucination test
Daniel Griffin
Claude 2 fails my Claude Shannon hallucination test, producing a summary of a non-existent publication.
July 11, 2023
- "tap the Search button twice"
Daniel Griffin
\@nadaawg via Threads on Jul 6, 2023 But what about that feature where you tap the Search button twice and it pops open the keyboard? [\@spotify](https://www.threads.net/@spotify) way ahead of the curve Single tap. Screenshot taken manually on iOS at roughly: 2023 07 10 09:40 Double tap. Screensh…
July 10, 2023
- GenAI "chat windows"
Daniel Griffin
\@gergelyorosz What are good (and efficient) alternatives to ChatGPT \ for writing code\ or coding related topics? So not asking about Copilot alternatives. But GenAI "chat windows" that have been trained on enough code to be useful in e.g. scaffolding, explaining coding concepts etc. On Twitter …
July 7, 2023
- "I wish I could ask it to narrow search results to a given time period"
Daniel Griffin
\@mati faure Thanks for the recommendation, it's actually great for searching! I wish I could ask it to narrow search results to a given time period though (cc [\@perplexity ai](https://twitter.com/perplexity ai)) On Twitter Jul 7, 2023 It will be very interesting to see how these newer search to…
July 7, 2023
- Kagi and generative search
Daniel Griffin
[https://blog.kagi.com/](https://blog.kagi.com/): Kagi is building a novel ad free, paid search engine and a powerful web browser as a part of our mission to humanize the web. Kagi: Kagi's approach to AI in search Kagi Search is pleased to announce the introduction of three AI features into our p…
July 6, 2023
- "the text prompt is a poor UI"
Daniel Griffin
This tweet is a reply—from the same author—to the tweet in: [very few worthwhile tasks? (weblink)](/weblinks/2023/06/29/very few worthwhile tasks). [ highlighting added] \@benedictevans In other words, I think the text prompt is a poor UI , quite separate to the capability of the model itself. On…
June 30, 2023
- all you need is Sourcegraph's Cody?
Daniel Griffin
Downloaded. You’re all set Once embeddings are finished being generated, you can specify Cody’s context and start asking questions in the Cody Chat. Current status: "Generating repositories embeddings" \@steve yegge [https://about.sourcegraph.com/blog/all you need is cody](https://about.sourcegra…
June 29, 2023
- very few worthwhile tasks?
Daniel Griffin
Follow up: [very few 2 3 sentence descriptions connect (weblog)](/2023/06/30/very few 2 3 sentence descriptions). What is a "worthwhile task"? [ highlighting added] \@benedictevans The more I look at chatGPT, the more I think that the fact NLP didn’t work very well until recently blinded us to th…
June 29, 2023
- definitions of prompt engineering evolving and shapeshifting
Daniel Griffin
the definition(s) and use(s) of "prompt engineering" will continue to evolve, shapeshift, fragment and become even more multiple and context dependent. But still a useful handle? [ highlighting added] \@yoavgo i didnt look in details yet but this is roughly what i'd imagine a chaining tool api to…
June 29, 2023
- imagining OpenGoogle?
Daniel Griffin
\@generativist via Twitter on Jun 26, 2023 i imagine there’s no alpha left in adding the word “open” to various names anymore, right? My first thought in response to this was that someone should write a speculative design on a transformation of old Google to "OpenGoogle".
June 27, 2023
- Perplexity, Ads, and SUVs
Daniel Griffin
Follow up: [\[I want to buy a new SUV which brand is best?\]](/2023/06/28/i want to buy a new suv which brand is best). I don't think ads[1] are necessarily wrong to have in search results (despite the misgivings in @brin1998anatomy), but people are definitely not happy with how the dominant sear…
June 27, 2023