A framework to create language programs.

Such frameworks have a few core functionalities that are evolving by the day. This includes:

  • Prompt templating
  • Prompt evaluation
  • An LLM interface
  • A RAG interface (vector DB and retriever)
  • 3rd party integrations for LLM and Vector DB providers
  • Workflow orchestration
  • Agentic workflow support

Some popular examples include (in decreasing order of popularity):