FastAPI framework, high performance, easy to learn, fast to code, ready for production

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting yo…

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Manage GPU clusters for running AI models