Category: weblinks
- Human-centered Evaluation and Auditing of Language Models Workshop
Daniel Griffin
January 31, 2024
{% include weblinks.html url="https://heal workshop.github.io/" center=true %}
- ssr: “Is anyone working on a google vs perplexity vs bard vs gpt search benchmark?”
Daniel Griffin
January 30, 2024
Social media request asking if anyone is developing a comparative benchmark between major search and AI platforms.
- ssr: “Anyone got any leads on good LLM prompts for RAG with citations?”
Daniel Griffin
January 29, 2024
{% include weblinks.html url="https://twitter.com/simonw/status/1751841193506550112" center=true %}
- “Over the weekend, we built a demo for conversational search”
Daniel Griffin
January 25, 2024
{% include weblinks.html url="https://twitter.com/jiayq/status/1750242829769801793" center=true %}
- Yuveganlife Tests of Generative Web Search Tools
Daniel Griffin
January 25, 2024
Link to Bruce Yu's user-driven evaluation of generative web search tools using 5 simple test questions.
- “We might be returning to the early/pre-Google era of the 1990s where there were multiple search engines”
Daniel Griffin
December 13, 2023
{% include weblinks.html url="https://twitter.com/ryan landay/status/1734953278813724722" center=true %}
- answer.ai & “A new old kind of R&D lab”
Daniel Griffin
December 12, 2023
{% include weblinks.html url="https://www.answer.ai/posts/2023 12 12 launch" center=true %}
- “responsibility to test for real world applicability”
Daniel Griffin
December 12, 2023
{% include weblinks.html url="https://twitter.com/omarsar0/status/1734260212310098216" center=true %}
- “there's pressure for every LLM to have a live web connection”
Daniel Griffin
December 8, 2023
Commentary on competitive pressure for LLMs to have live web access rather than static knowledge cutoffs.
- “Today marks the first year anniversary of the launch of perplexity.ai”
Daniel Griffin
December 8, 2023
Weblink marking Perplexity AI's first anniversary with founder reflections in thread format.
- “The internal name for Deep Search was "Search Harder"”
Daniel Griffin
December 8, 2023
Brief weblink noting Bing's internal codename for Deep Search was 'Search Harder.'
- “what do you prefer for live accurate information?”
Daniel Griffin
December 8, 2023
Weblink polling preference between Perplexity AI and X Grok for live accurate information.
- ssr: “Do folks have favorite examples of systematic literature reviews? Better if in HCI, but okay if not.”
Daniel Griffin
December 8, 2023
{% include weblinks.html url="https://twitter.com/naz andalibi/status/1732355077632074200" center=true %}
- What questions should we ask when building software?
Daniel Griffin
December 8, 2023
{% include weblinks.html url="https://herbsleb.org/" center=true %} I've been thinking about these sorts of questions a lot in relation to our current disruption in web search. See some of my musings in [Towards “benchmarking” democratization of good search](/2023/12/04/towards benchmarking democ…
- “It would be really helpful to have other people dabble in search without having to build an entire search engine from scratch.”
Daniel Griffin
December 1, 2023
{% include weblinks.html url="https://nlnet.nl/news/2023/20231016 marginalia" center=true %} See: [search.marginalia.nu/](https://search.marginalia.nu/) HT \@FloweeTheHub via [Twitter/X](https://twitter.com/FloweeTheHub/status/1730563488081215780) on Dec 01, 2023: [“I love it when single devs can…
- Ollie.ai & “your personal shopper”
Daniel Griffin
December 1, 2023
{% include weblinks.html url="https://twitter.com/blennon /status/1658501876512587777" center=true %} Note: The URL is now [ollie.ai](https://ollie.ai/)
- “I love it when single devs can build stuff like a new search engine that actually work at scale.”
Daniel Griffin
December 1, 2023
{% include weblinks.html url="https://twitter.com/FloweeTheHub/status/1730563488081215780" center=true %} See: [search.marginalia.nu/](https://search.marginalia.nu/)
- “Product human evals are what matter to us”
Daniel Griffin
December 1, 2023
{% include weblinks.html url="https://twitter.com/AravSrinivas/status/1730647482999378052" center=true %}
- “How many people who type "hi" want Adolf Hitler with a picture in autocomplete?”
Daniel Griffin
December 1, 2023
A tweet from Ori Zilbershtein.
- TRUST ISSUES
Daniel Griffin
November 30, 2023
Weblink to Data & Society's 'Trust Issues' event exploring perspectives on community, technology, and trust.
- “I finally use zero Google products for my personal life”
Daniel Griffin
November 29, 2023
Weblink post sharing Mitchell Hashimoto's tweet about eliminating Google products from personal life, connecting to themes of technology refusal.
- “search terms that confirm preconceptions”
Daniel Griffin
November 29, 2023
Re confirmation-biased queries.
- Perplexity AI announcing generative search APIs
Daniel Griffin
November 29, 2023
Tweets from Perplexity.
- “Q: “What is Google doing” A: Selling ads.”
Daniel Griffin
November 27, 2023
A tweet from Aravind Srinivas.
- ssr: “is there a well known service that expands any arbitrary links for LLM consumption?”
Daniel Griffin
November 18, 2023
A social search request from Shawn Wang.
- “I don't personally know a single professional who'd be using GPT for anything seriously pertaining to their work”
Daniel Griffin
November 18, 2023
A post from Filip Piekniewski.
- “Personally I've found Bingchat with search, and GPT4 with Browse to be far more confused at all times than the no-RAG model”
Daniel Griffin
November 18, 2023
A post from Teknium.
- ROBOTS.TXT PARSER
Daniel Griffin
November 18, 2023
A robots.txt parser from Will Critchlow.
- Nov 16, 2023 update to Google's Search Quality Rater Guidelines
Daniel Griffin
November 18, 2023
Weblink post sharing Twitter announcements about November 16, 2023 updates to Google's Search Quality Rater Guidelines.
- “Perplexity user: “Microsoft banned your domain, so can't use it on work devices”.”
Daniel Griffin
November 18, 2023
A post from Aravind Srinivas
- Open Philanthropy RFP: “studying and forecasting the real-world impacts of systems built from LLMs”
Daniel Griffin
November 18, 2023
Sharing a Request for Proposals from Open Philanthropy.
- Thread from @searchliaison: “Last week, I gave a presentation about Google Search results not being perfect, how we...
Daniel Griffin
November 16, 2023
A thread from Google's Search Liaison.
- “this is well within the model training (it has very likely seen a ton of code for pong)”
Daniel Griffin
November 16, 2023
A post from Anton Bacaj.
- “Anyone else finding the new ChatGPT-4 with browsing to be a major downgrade?”
Daniel Griffin
November 16, 2023
A post from Geoffrey Litt.
- “Bing Chat and Bing Chat Enterprise will now simply become Copilot.”
Daniel Griffin
November 15, 2023
A post from Jordi Ribas.
- “HotGirls on TikTok, why do I look stupid at the gym?”
Daniel Griffin
November 15, 2023
A social-search-request example.
- ssr: “what are the most useful LLM-powered apps?”
Daniel Griffin
November 15, 2023
A social-search-request from Timothy B. Lee.
- Friday AI
Daniel Griffin
November 14, 2023
A screenshot from Friday AI.
- A syllabus for ‘Taking an Internet Walk’
Daniel Griffin
November 14, 2023
“explore practices for discovering, maintaining, and adding to the many internets blossoming beneath app hedges and large platforms:”
- “Don't make me type everything into a box, let me point at stuff.”
Daniel Griffin
November 14, 2023
A post from Rob Haisfield.
- “way more accessible to have a list of experiences to try”
Daniel Griffin
November 14, 2023
A post from Nick Dobos.
- “building a search engine by listing "every query anyone might ever make"”
Daniel Griffin
November 10, 2023
A post from François Chollet.
- “where all orgs, non-profits, academia, startups, small and big companies, from all over the world can build”
Daniel Griffin
November 7, 2023
Tweet from Clement Delangue.
- Intervenr
Daniel Griffin
November 7, 2023
Weblink post sharing Stanford's Intervenr platform for sociotechnical audits.
- [how to change the oil on a 1965 Mustang]
Daniel Griffin
November 3, 2023
Is this a query for which “only general search engines return links to websites with information you might be looking for”?
- “I'm having a much harder time finding news clips via Google search than a few months ago.”
Daniel Griffin
November 2, 2023
A search quality complaint from journalist Louise Matsakis.
- ssr: “What's the phrase to describe when an algorithm doesn't take into effect it's own influence on an outcome?”
Daniel Griffin
November 1, 2023
A social-search-request from Paula Goldman.
- ssr: “What is the equivalent of SEO, but for navigating the physical built environment?”
Daniel Griffin
October 31, 2023
A social-search-request from Chenoe Hart.
- “might be the biggest SEO development we've had in a long time”
Daniel Griffin
October 16, 2023
Tweet from Lily Ray.
- "the importance of open discussion of these new tools gave me pause"
Daniel Griffin
October 11, 2023
An excerpt from Davey Alba's article, "Even Google Insiders Are Questioning Bard AI Chatbot’s Usefulness".
- "he hopes to see AI-powered search tools shake things up"
Daniel Griffin
October 9, 2023
An excerpt from Will Knight's article, "Chatbot Hallucinations Are Poisoning Web Search".
- "a public beta of our project, Collective Cognition to share ChatGPT chats"
Daniel Griffin
September 25, 2023
Weblinks post announcing the public beta of Collective Cognition, a project for sharing ChatGPT conversations.
- Is there any paper about the increasing “arXivification” of CS/HCI?
Daniel Griffin
September 25, 2023
a tweet from Ian Arawjo
- scoreless peer review
Daniel Griffin
September 19, 2023
"How You Can Help Fix Peer Review"
- ssr: uses in new instruct model v. chat models?
Daniel Griffin
September 19, 2023
/@simonw: Anyone seen any interesting examples of...
- [What does the f mean in printf]
Daniel Griffin
September 14, 2023
Weblinks post linking to a Twitter thread discussing the meaning of the 'f' in printf format specifiers.
- ssr: LLM libraries that can be installed cleanly on Python
Daniel Griffin
September 14, 2023
"I’m looking for the quickest and simplest way to call a language model from Python"
- DAIR.AI's Prompt Engineering Guide
Daniel Griffin
September 12, 2023
A weblink.
- ragas metrics
Daniel Griffin
September 8, 2023
Faithfulness, Context Relevancy, Context Recall, Answer Relevancy, Aspect Critiques
- searchsmart.org
Daniel Griffin
September 1, 2023
Overview of searchsmart.org's approach to testing academic search systems using metamorphic testing from the user perspective.
- "We really need to talk more about monitoring search quality for public interest topics."
Daniel Griffin
August 31, 2023
- Dave Guarino (Jan 16th, 2020)
- "The robot is not, in my opinion, a skip."
Daniel Griffin
August 31, 2023
Weblink to a Twitter thread arguing that physical automation shouldn't be dismissed as just another passing tech trend like crypto or metaverse.
- Microsoft CFP: "Accelerate Foundation Models Research"
Daniel Griffin
August 30, 2023
"...essential to realizing the promise of AI to benefit people and society while mitigating risks"
- caught myself having questions that I normally wouldn't bother
Daniel Griffin
August 28, 2023
Weblink to a Twitter post about questioning whether knowledge comes from AI tools or the underlying material being queried.
- [I am confused about this]
Daniel Griffin
August 28, 2023
Weblink to a Twitter post about the confusing state of AI discourse, where people claim both that AI is overhyped and that it poses existential risk.
- Tech Policy Press on Choosing Our Words Carefully
Daniel Griffin
August 28, 2023
...which stereotypes are moderated and under-moderated in search engine autocompletion?
- open source project named Quivr...
Daniel Griffin
August 28, 2023
Weblink to a Twitter post about Quivr, an open-source local search project.
- "And what matters is if it works."
Daniel Griffin
August 22, 2023
To evaluate the performance of LLMs we have to extend our observations & analysis well-beyond the raw outputs.
- Are prompts—& queries—not Lipschitz?
Daniel Griffin
August 4, 2023
A tweet from @zacharylipton: Prompts are not Lipschitz. There are no “small” changes to prompts...
- Keyword search is dead?
Daniel Griffin
August 3, 2023
{% include weblinks.html url="https://twitter.com/vectara/status/1669254503487401984" %}
- OWASP Top 10 for Large Language Model Applications
Daniel Griffin
August 3, 2023
Here is the 'OWASP Top 10 for Large Language Model Applications'. [Overreliance](https://llmtop10.com/llm09/) is relevant to my research. (I’ve generally used the term “automation bias”, though perhaps a more direct term like overreliance is better.) You can see my discussion in the “Extending se…
- they answered the question
Daniel Griffin
July 31, 2023
This is partially about prompt engineering and partially about what a good essay or search does. More than answer a question, perhaps? (this is engaged with in the essay, though not to my liking). Grimm The linked essay includes a sentiment connected with a common theme that I think is unfounded:…
- The ultimate question
Daniel Griffin
July 28, 2023
\@aravsrinivas via Twitter on Jul 24, 2023 The ultimate question is what is the question. Asking the right question is hard. Even framing a question is hard. Hence why at perplexity, we don’t just let you have a chat UI. But actually try to minimize the level of thought needed to ask fresh or fol…
- Cohere's Coral
Daniel Griffin
July 28, 2023
\@aidangomezzz via Twitter on Jul 25, 2023 We're excited to start putting Coral in the hands of users! Coral is "retrieval first" in the sense it will reference and cite its sources when generating an answer. Coral can pull from an ecosystem of knowledge sources including Google Workspace, Office…
- this data might be wrong
Daniel Griffin
July 28, 2023
Screenshot of [Ayhan Fuat Çelik's "The Fall of Stack Overflow" on Observable](https://observablehq.com/@ayhanfuat/the fall of stack overflow) omitted. The graph in question has since been updated. \@natfriedman via Twitter on Jul 26, 2023 Why the precipitous sudden decline in early 2022? That fir…
- Be careful of concluding
Daniel Griffin
July 28, 2023
\@jeremyphoward via Twitter on Jul 25, 2023 Be careful of concluding that "GPT 4 can't do " on the basis you tried it once and it didn't work for you. See the thread below for two recent papers showing how badly this line of thinking can go wrong, and an interesting example.
- ssr: attention span essay or keywords?
Daniel Griffin
July 28, 2023
{% include weblinks.html url="https://twitter.com/katypearce/status/1684286070924656640" center=true %}
- OverflowAI
Daniel Griffin
July 28, 2023
\@pchandrasekar via Twitter on Jul 27, 2023 Today we officially launch the next stage of community and AI here at \@StackOverflow: OverflowAI! Just shared the exciting news on the \@WeAreDevs keynote stage. If you missed it, watch highlights of our announcements and visit [https://stackoverflow.c…
- Just go online and type in "how to kiss."
Daniel Griffin
July 28, 2023
Good Boys (2019), via Yarn We're sorry. We just wanted to learn how to kiss. [ . . . ] Just go online and type in "how to kiss." That's what everyone does. HT: a random clip, containing the above, [on TikTok](https://www.tiktok.com/@movie4kkk/video/7250474768573435162).
- AnswerOverflow
Daniel Griffin
July 28, 2023
via answeroverflow.com on Jul 28, 2023 Bringing your Discord channels to Google Answer Overflow is an open source project designed to bring discord channels to your favorite search engine. Set it up in minutes and bring discovery to your hidden content. HT: browsing from [\@rhyssullivan's tweet o…
- Gorilla
Daniel Griffin
July 28, 2023
via cs.berkeley.edu on Jul 28, 2023 🦍 Gorilla: Large Language Model Connected with Massive APIs Gorilla is a LLM that can provide appropriate API calls. It is trained on three massive machine learning hub datasets: Torch Hub, TensorFlow Hub and HuggingFace. We are rapidly adding new domains, inc…
- [chamungus]
Daniel Griffin
July 28, 2023
via r/NoStupidQuestions on Jul 13, 2023 What does it mean when people from Canada and US say chamungus in meetings? I am from slovenia and this week we have 5 people from US and toronto office visiting us for trainings. On monday when we were first shaking hands and getting to know each other bef…
- Everything Marie Haynes Knows About Google’s Quality Raters
Daniel Griffin
July 17, 2023
Weblink to Marie Haynes' post on Google’s Search Quality Raters
- Simon Willison (@simonw) on misleading pretending re LLMs and reading links
Daniel Griffin
July 17, 2023
@simonw sharing about finding misleading claims from Claude 2
- Should we not "just google" phone numbers?
Daniel Griffin
July 17, 2023
@swiftonsecurity warning about googling phone numbers.
- Claude 2 on my Claude Shannon hallucination test
Daniel Griffin
July 11, 2023
Claude 2 fails my Claude Shannon hallucination test, producing a summary of a non-existent publication.
- "tap the Search button twice"
Daniel Griffin
July 10, 2023
\@nadaawg via Threads on Jul 6, 2023 But what about that feature where you tap the Search button twice and it pops open the keyboard? [\@spotify](https://www.threads.net/@spotify) way ahead of the curve Single tap. Screenshot taken manually on iOS at roughly: 2023 07 10 09:40 Double tap. Screensh…
- GenAI "chat windows"
Daniel Griffin
July 7, 2023
\@gergelyorosz What are good (and efficient) alternatives to ChatGPT \ for writing code\ or coding related topics? So not asking about Copilot alternatives. But GenAI "chat windows" that have been trained on enough code to be useful in e.g. scaffolding, explaining coding concepts etc. On Twitter …
- "I wish I could ask it to narrow search results to a given time period"
Daniel Griffin
July 7, 2023
\@mati faure Thanks for the recommendation, it's actually great for searching! I wish I could ask it to narrow search results to a given time period though (cc [\@perplexity ai](https://twitter.com/perplexity ai)) On Twitter Jul 7, 2023 It will be very interesting to see how these newer search to…
- Kagi and generative search
Daniel Griffin
July 6, 2023
[https://blog.kagi.com/](https://blog.kagi.com/): Kagi is building a novel ad free, paid search engine and a powerful web browser as a part of our mission to humanize the web. Kagi: Kagi's approach to AI in search Kagi Search is pleased to announce the introduction of three AI features into our p…
- "the text prompt is a poor UI"
Daniel Griffin
June 30, 2023
This tweet is a reply—from the same author—to the tweet in: [very few worthwhile tasks? (weblink)](/weblinks/2023/06/29/very few worthwhile tasks). [ highlighting added] \@benedictevans In other words, I think the text prompt is a poor UI , quite separate to the capability of the model itself. On…
- all you need is Sourcegraph's Cody?
Daniel Griffin
June 29, 2023
Downloaded. You’re all set Once embeddings are finished being generated, you can specify Cody’s context and start asking questions in the Cody Chat. Current status: "Generating repositories embeddings" \@steve yegge [https://about.sourcegraph.com/blog/all you need is cody](https://about.sourcegra…
- very few worthwhile tasks?
Daniel Griffin
June 29, 2023
Follow up: [very few 2 3 sentence descriptions connect (weblog)](/2023/06/30/very few 2 3 sentence descriptions). What is a "worthwhile task"? [ highlighting added] \@benedictevans The more I look at chatGPT, the more I think that the fact NLP didn’t work very well until recently blinded us to th…
- definitions of prompt engineering evolving and shapeshifting
Daniel Griffin
June 29, 2023
the definition(s) and use(s) of "prompt engineering" will continue to evolve, shapeshift, fragment and become even more multiple and context dependent. But still a useful handle? [ highlighting added] \@yoavgo i didnt look in details yet but this is roughly what i'd imagine a chaining tool api to…
- imagining OpenGoogle?
Daniel Griffin
June 27, 2023
\@generativist via Twitter on Jun 26, 2023 i imagine there’s no alpha left in adding the word “open” to various names anymore, right? My first thought in response to this was that someone should write a speculative design on a transformation of old Google to "OpenGoogle".
- Perplexity, Ads, and SUVs
Daniel Griffin
June 27, 2023
Follow up: [\[I want to buy a new SUV which brand is best?\]](/2023/06/28/i want to buy a new suv which brand is best). I don't think ads[1] are necessarily wrong to have in search results (despite the misgivings in @brin1998anatomy), but people are definitely not happy with how the dominant sear…