Shared Weblinks

Social media request asking if anyone is developing a comparative benchmark between major search and AI platforms.

Link to Bruce Yu's user-driven evaluation of generative web search tools using 5 simple test questions.

Commentary on competitive pressure for LLMs to have live web access rather than static knowledge cutoffs.

Weblink marking Perplexity AI's first anniversary with founder reflections in thread format.

Brief weblink noting Bing's internal codename for Deep Search was 'Search Harder.'

Weblink polling preference between Perplexity AI and X Grok for live accurate information.

I've been thinking about these sorts of questions a lot in relation to our current disruption in web search. See some of my musings in Towards “benchmarking” democratization of good search and Who is...

See: search.marginalia.nu/ HT \@FloweeTheHub via Twitter/X on Dec 01, 2023: “I love it when single devs can build stuff like a new search engine that actually work at scale.”

Note: The URL is now ollie.ai

See: search.marginalia.nu/

A tweet from Ori Zilbershtein.

Weblink to Data & Society's 'Trust Issues' event exploring perspectives on community, technology, and trust.

Weblink post sharing Mitchell Hashimoto's tweet about eliminating Google products from personal life, connecting to themes of technology refusal.

Re confirmation-biased queries.

Tweets from Perplexity.

A tweet from Aravind Srinivas.

A social search request from Shawn Wang.

A post from Filip Piekniewski.

A post from Teknium.

A robots.txt parser from Will Critchlow.

Weblink post sharing Twitter announcements about November 16, 2023 updates to Google's Search Quality Rater Guidelines.

A post from Aravind Srinivas

Sharing a Request for Proposals from Open Philanthropy.

A thread from Google's Search Liaison.

A post from Anton Bacaj.

A post from Geoffrey Litt.

A post from Jordi Ribas.

A social-search-request example.

A social-search-request from Timothy B. Lee.

A screenshot from Friday AI.

“explore practices for discovering, maintaining, and adding to the many internets blossoming beneath app hedges and large platforms:”

A post from Rob Haisfield.

A post from Nick Dobos.

A post from François Chollet.

Tweet from Clement Delangue.

Weblink post sharing Stanford's Intervenr platform for sociotechnical audits.

Is this a query for which “only general search engines return links to websites with information you might be looking for”?

A search quality complaint from journalist Louise Matsakis.

A social-search-request from Paula Goldman.

A social-search-request from Chenoe Hart.

Tweet from Lily Ray.

An excerpt from Davey Alba's article, "Even Google Insiders Are Questioning Bard AI Chatbot’s Usefulness".

An excerpt from Will Knight's article, "Chatbot Hallucinations Are Poisoning Web Search".

Weblinks post announcing the public beta of Collective Cognition, a project for sharing ChatGPT conversations.

a tweet from Ian Arawjo

"How You Can Help Fix Peer Review"

/@simonw: Anyone seen any interesting examples of...

Weblinks post linking to a Twitter thread discussing the meaning of the 'f' in printf format specifiers.

"I’m looking for the quickest and simplest way to call a language model from Python"

A weblink.

Faithfulness, Context Relevancy, Context Recall, Answer Relevancy, Aspect Critiques

Overview of searchsmart.org's approach to testing academic search systems using metamorphic testing from the user perspective.

- Dave Guarino (Jan 16th, 2020)

Weblink to a Twitter thread arguing that physical automation shouldn't be dismissed as just another passing tech trend like crypto or metaverse.

"...essential to realizing the promise of AI to benefit people and society while mitigating risks"

Weblink to a Twitter post about questioning whether knowledge comes from AI tools or the underlying material being queried.

Weblink to a Twitter post about the confusing state of AI discourse, where people claim both that AI is overhyped and that it poses existential risk.

...which stereotypes are moderated and under-moderated in search engine autocompletion?

Weblink to a Twitter post about Quivr, an open-source local search project.

To evaluate the performance of LLMs we have to extend our observations & analysis well-beyond the raw outputs.

A tweet from @zacharylipton: Prompts are not Lipschitz. There are no “small” changes to prompts...

Here is the 'OWASP Top 10 for Large Language Model Applications'. Overreliance is relevant to my research. (I’ve generally used the term “automation bias”, though perhaps a more direct term like overr...

This is partially about prompt engineering and partially about what a good essay or search does. More than answer a question, perhaps? (this is engaged with in the essay, though not to my liking). Gri...

\@aravsrinivas via Twitter on Jul 24, 2023 The ultimate question is what is the question. Asking the right question is hard. Even framing a question is hard. Hence why at perplexity, we don’t just let...

\@aidangomezzz via Twitter on Jul 25, 2023 We're excited to start putting Coral in the hands of users! Coral is "retrieval-first" in the sense it will reference and cite its sources when generating an...

Screenshot of Ayhan Fuat Çelik's "The Fall of Stack Overflow" on Observable omitted. The graph in question has since been updated. \@natfriedman via Twitter on Jul 26, 2023 Why the precipitous sudden...

\@jeremyphoward via Twitter on Jul 25, 2023 Be careful of concluding that "GPT 4 can't do " on the basis you tried it once and it didn't work for you. See the thread below for two recent papers showin...

\@pchandrasekar via Twitter on Jul 27, 2023 Today we officially launch the next stage of community and AI here at \@StackOverflow: OverflowAI! Just shared the exciting news on the \@WeAreDevs keynote...

Good Boys (2019), via Yarn We're sorry. We just wanted to learn how to kiss. [ . . . ] Just go online and type in "how to kiss." That's what everyone does. HT: a random clip, containing the...

via answeroverflow.com on Jul 28, 2023 Bringing your Discord channels to Google Answer Overflow is an open source project designed to bring discord channels to your favorite search engine. Set it up i...

via cs.berkeley.edu on Jul 28, 2023 🦍 Gorilla: Large Language Model Connected with Massive APIs Gorilla is a LLM that can provide appropriate API calls. It is trained on three massive machine learnin...

via r/NoStupidQuestions on Jul 13, 2023 What does it mean when people from Canada and US say chamungus in meetings? I am from slovenia and this week we have 5 people from US and toronto office visitin...

Weblink to Marie Haynes' post on Google’s Search Quality Raters

@swiftonsecurity warning about googling phone numbers.

@simonw sharing about finding misleading claims from Claude 2

Claude 2 fails my Claude Shannon hallucination test, producing a summary of a non-existent publication.

\@nadaawg via Threads on Jul 6, 2023 But what about that feature where you tap the Search button twice and it pops open the keyboard? \@spotify way ahead of the curve Single-tap. Screenshot taken manu...

\@gergelyorosz What are good (and efficient) alternatives to ChatGPT \for writing code\ or coding-related topics? So not asking about Copilot alternatives. But GenAI "chat windows" that have been trai...

\@matifaure Thanks for the recommendation, it's actually great for searching! I wish I could ask it to narrow search results to a given time period though (cc \@perplexityai) On Twitter Jul 7, 2023 It...

https://blog.kagi.com/: Kagi is building a novel ad-free, paid search engine and a powerful web browser as a part of our mission to humanize the web. Kagi: Kagi's approach to AI in search Kagi Search...

This tweet is a reply—from the same author—to the tweet in: very few worthwhile tasks? (weblink). [ highlighting added] \@benedictevans In other words, I think the text prompt is a poor UI , quite sep...

Downloaded. > You’re all set > > Once embeddings are finished being generated, you can specify Cody’s context and start asking questions in the Cody Chat. Current status: "Generating repositories embe...

Follow-up: very few 2-3 sentence descriptions connect (weblog). What is a "worthwhile task"? [ highlighting added] \@benedictevans The more I look at chatGPT, the more I think that the fact NLP didn’t...

the definition(s) and use(s) of "prompt engineering" will continue to evolve, shapeshift, fragment and become even more multiple and context-dependent. But still a useful handle? [ highlighting added]...

\@generativist via Twitter on Jun 26, 2023 i imagine there’s no alpha left in adding the word “open” to various names anymore, right? My first thought in response to this was that someone should write...

Follow-up: [\[I want to buy a new SUV which brand is best?\]](/2023/06/28/i-want-to-buy-a-new-suv-which-brand-is-best). I don't think ads[1] are necessarily wrong to have in search results (despite th...