My first attempt at using ChainForge

    CF is ChainForge (Arawjo et al., 2023)
    @danielsgriffin via Twitter on Aug 28, 2023

    cc: @IanArawjo

    OK, finally! Here is my first attempt at CF (so slick!)—various roles, only one (overly simplistic) prompt. (I cannot figure out how to link the inspect node…) also the 3.5 and 4 different is so striking.

    https://chainforge.ai/play/?f=3m21jazp95wkg

    @lilyraynyc via Twitter on Aug 27, 2023

    The thing I don’t understand about asking ChatGPT to pretend to be an expert or a certain persona is that it will never tell you if it actually has no idea what you’re talking about

    @danielsgriffin via Twitter on Aug 27, 2023

    This makes me wonder if folks have studied differences in ‘hallucination’ under these sorts of prompts (“You are”, “Pretend to be”, etc.). Can you prompt-in humility? Have people looked at this? Perhaps this is something @IanArawjo’s http://chainforge.ai could help analyze?

    References

    Arawjo, I., Vaithilingam, P., Swoopes, C., Wattenberg, M., & Glassman, E. (2023). ChainForge. https://www.chainforge.ai/. [arawjo2023chainforge]