cc: @IanArawjo
OK, finally! Here is my first attempt at CF (so slick!)—various roles, only one (overly simplistic) prompt. (I cannot figure out how to link the inspect node…) also the 3.5 and 4 different is so striking.
https://chainforge.ai/play/?f=3m21jazp95wkg
This makes me wonder if folks have studied differences in ‘hallucination’ under these sorts of prompts (“You are”, “Pretend to be”, etc.). Can you prompt-in humility? Have people looked at this? Perhaps this is something @IanArawjo’s http://chainforge.ai could help analyze?
Arawjo, I., Vaithilingam, P., Swoopes, C., Wattenberg, M., & Glassman, E. (2023). ChainForge. https://www.chainforge.ai/. [arawjo2023chainforge]