LLM frameworks

ChainForge - chainforge.ai

• "ChainForge is an open-source visual programming environment for prompt engineering, LLM evaluation and experimentation."
• HT: Ian Arawjo (website, Twitter
• citation: @arawjo2023chainforge

Comet - comet.com/

• "Comet provides a meta machine learning platform that enables data scientists & teams to track, compare, explain, & optimize their experiment tracking."

• HT: @omarsar0

  I have been really impressed with the new prompting tools by @Cometml. I already use their tools for tracking and managing my fine-tuned LLMs, so it's cool to see that they also enable LLMOps and prompting tools to easily track and debug prompts at scale.

Cursive - github.com/meistrari/cursive-py

• HT: @mattshumer_

GodMode - github.com/smol-ai/GodMode

• HT: @swyx

LangChain - github.com/langchain-ai/langchain

ragas - explodinggradients/ragas

• "Evaluation framework for your Retrieval Augmented Generation (RAG) pipelines"
• HT: Aaron Tay (website | Twitter)