"Scheherazade, you easily make up stories of Egypt or any country you please."
Reading Plato's Phaedrus1 again I was struck by this line in relation to discussion of fabrication or hallucination in tools like ChatGPT.
Phaedrus
Socrates, you easily make up stories of Egypt or any country you please.
Musing on that line I tweeted:
@danielsgriffin via Twitter on Sep 6, 2023
Fill in the blank.
"[__________], you easily make up stories of Egypt or any country you please." [ ] Anansi
[ ] Borges
[ ] ChatGPT
[ ] Jesus
[ ] Odysseus
[ ] Pinocchio
[ ] Scheherazade
[ ] Socrates
[ ] Wikipedia
\_\_\_\_\_
allegory, fabrication, hallucination, model
I ran the question through various generative search and search-like systems (pre-pending only "Please answer this question:") and was surprised at how they all got it "wrong":
-
ChatGPT-3.5 & ChatGPT-4: Scheherazade
-
Claude 2: Scheherazade
-
Google's Bard: ChatGPT
-
Inflection AI's Pi: Scheherazade
-
llama-2-70b-chat (at Perplexity Labs): [DECLINED TO ANSWER]
-
Perplexity AI: Scheherazade
- w/ Copilot: Scheherazade
- Note: I declined to answer Copilot's clarifying question (which was great, something like 'Which do you think it is?').
- Aside: Note the Copilot question is not retained for review by the user.
- Note: I generally have the AI Model (in Perplexity's Settings) set to
Perplexity, rather thanGPT-4orClaude 2.
- Note: I declined to answer Copilot's clarifying question (which was great, something like 'Which do you think it is?').
- w/ Copilot: Scheherazade
-
You.com's YouChat: Scheherazade
- w/ GPT-4: ChatGPT
Bonus: ChainForge
Here is a ChainForge flow, where I show various prepends and appends and include `Google's Bard` as an option: [https://chainforge.ai/play/?f=iflfrrosd4j4](https://chainforge.ai/play/?f=iflfrrosd4j4)
Search: [chainforge]
Footnotes
-
Via The Perseus Digital Library Project [@crane2001perseus] ↩