Search is a mess, it seems either broken or bought or shaped by a behemoth. But sparks of disruption in the energy around large language models (LLMs) have helped some to imagine alternative models of search.
## What organizations are best situated to apply their own resources and promote developer attention and energy to this problem and opportunity?
I don’t think we will find this from the largest search-associated technology companies[^later]. Below I will mention some organizations and provide a few comments. These are considering both towards folks who might organize disruptive efforts or pursue open disruptions in search. This is largely an exercise in brainstorming for factors that might be relevant to engaging on this project. This is not directed towards making a prediction. Rather, I want to flexibly play with this question to focus my own attention and action.
Who might be able to align their interests with disruptions in search (and/or disruption of search advertising)? Who might some portion of early adopting companies and independent developers “trust enough”? Who has a user base willing engage in and extend experimentation? Who would explore any part of efforts [to benchmark search experiences](/_posts/2023-12-04-towards-benchmarking-democratization-of-good-search.md)?
[Hugging Face](https://huggingface.co/spaces/huggingchat/chat-ui/discussions/185)? [LangChain](https://blog.langchain.dev/)? [LlamaIndex](https://github.com/run-llama/llama_index)? [Replit](https://www.google.com/search?q=site%3Areplit.com+%28%22web+search%22+OR+%22search+engine%22+OR+%22search+agent%22%29)? Mozilla? [Snowflake](https://www.snowflake.com/blog/snowflake-acquires-neeva-to-accelerate-search-in-the-data-cloud-through-generative-ai/)? (are some of the former Neeva folks looking to address Google's continued dominance?) Databricks? Automattic?
Anthropic? (does their safety model account for the dominance of a single way of searching the web?) Cohere? (They have a [reranker](https://txt.cohere.com/rerank/) and [Coral](https://coral.cohere.com/) (RAG / "grounded" / ["a knowledge assistant for enterprises"](https://txt.cohere.com/introducing-coral/))) Mistral? (in Perplexity AI's [pplx-7b-online & pplx-70b-online APIs](https://blog.perplexity.ai/blog/introducing-pplx-online-llms), [Hugging Face's Chat](https://huggingface.co/chat/), You.com's ["Safe search: Off (uncensored chat)"](https://about.you.com/hc/settings/how-can-i-get-youdotcom-to-respond-to-more-risque-or-controversial-queries/), and [Nagato](https://twitter.com/pelaseyed/status/1732101635789234383)) Yahoo? (or Vespa?) Meta? (noting their the "open sourcing"[^1] of their Llama models)
[Majority World](https://web.archive.org/web/20150429022234/https://news.stanford.edu/news/2007/october10/photogs-101007) developers?
Salesforce? Getty Images? (who has a model for web search that is genuinely both pro-user and creator?) Disney or some other media conglomerate?
Folks organizing to develop tooling for ignored, forgotten, or unseemly purposes?
TikTok? (seems likely to continue to [disrupt search practices](https://www.adweek.com/social-marketing/move-over-google-tiktok-is-the-go-to-search-engine-for-gen-z/) but does not seem inclined (baring regulations) towards sharing technology and integrating with the open web)
[AI2](https://allenai.org/)? (see their [incubator](https://www.ai2incubator.com/)?) Wikimedia Foundation? [Open Philanthropy](/weblinks/2023/11/17/open-philanthropy-rfp/)? Open Society Foundations? Omidyar Network? Knight Foundation? Internet Archive? (see [Internet Archive Scholar search](https://scholar.archive.org/)) Other libraries? Protocol Labs? (See: [Berjon's "Fixing Search"](https://berjon.com/fixing-search/))
Other established search technology providers? (Algolia? Elasticsearch?) Generative search startups? (Perplexity AI has APIs and detailed [technical blogs](https://blog.perplexity.ai/blog/), Phind [released models](https://huggingface.co/Phind), You.com ([API](https://documentation.you.com/quickstart)) & [Andi Search](https://andisearch.com/) have [made comments](https://twitter.com/danielsgriffin/status/1603469733705437186) about [addressing dominance of Google](https://twitter.com/danielsgriffin/status/1697859847335903411)), Metaphor Search has an [API](https://platform.metaphor.systems/).)
[OpenWebSearch.eu](https://openwebsearch.eu/)? (see @mager2023european) Glocal approaches? [SEO-efforts](/tags/seo-for-social-good/)? The academy? (is there [PIT-UN](https://pitcases.org/) work on search? What is the NSF doing? What multi-campus efforts exist around search? What are the big science or [BigScience](https://bigscience.huggingface.co/) folks doing?)
[^1]: Some have challenged various companies' recent uses of "open source".
What might motivate these moves? The pursuit of "relevance"? Or a refusal of the status quo? A drive to repair? Efforts to meet the searchers where they are?
[^later]: Perhaps mapping out such scenarios later would be useful.
Previously...
This is a continuation of [Towards “benchmarking” democratization of good search](/2023/12/04/towards-benchmarking-democratization-of-good-search/).
draft
to be developed further... Feedback welcome!