The easiest tool for fine-tuning LLM models, synthetic data generation, and collaborating on datasets.

A template rendering engine based on Jinja, generating type-safe Rust code at compile time.

transparent proxy server for llama.cpp's server to provide automatic model swapping

MLX Model Manager unifies loading and inferencing with LLMs and VLMs.

🔍 AI search engine - self-host with local or cloud LLMs

Convert ebooks to audiobooks with chapters and metadata using dynamic AI models and voice cloning. Supports 1,107+ languages!

Quickly and securely turn your code projects into LLM prompts, all locally on your own machine!

Integrating ChatGPT into your browser deeply, everything you need is here

🤗 smolagents: a barebones library for agents. Agents write python code to call tools and orchestrate other agents.

EntityDB is an in-browser vector database wrapping indexedDB and Transformers.js over WebAssembly

Excalidraw meets ComfyUI for LLMs

Make websites accessible for AI agents

TTS with kokoro and onnx runtime

You don’t need to read the code to understand how to build!

Use multiple LLM backends in a single crate, simple builder-based configuration, and built-in prompt chaining & templating.

MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. It implements OpenAI-compatible API endpoints, enabling seaml…

An AI web browsing framework focused on simplicity and extensibility.

A Lightweight Face Recognition and Facial Attribute Analysis (Age, Gender, Emotion and Race) Library for Python

Dockerized FastAPI wrapper for Kokoro-82M text-to-speech model w/CPU ONNX and NVIDIA GPU PyTorch support, handling, and auto-stitching

A CLI tool to convert your codebase into a single LLM prompt with source tree, prompt templating, and token counting.

Rust multiprovider generative AI client (Ollama, OpenAi, Anthropic, Groq, Gemini, Cohere, ...)

The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

BionicGPT is an on-premise replacement for ChatGPT, offering the advantages of Generative AI while maintaining strict data confidentiality

This repo includes Claude prompt curation to use Claude better.

Use LLM to generate and execute commands in your shell

A real-time speech-to-speech chatbot powered by Whisper Small, Llama 3.2, and Kokoro-82M.

chat with private and local large language models

Rust bindings to https://github.com/k2-fsa/sherpa-onnx

Production-ready Inference, Ingestion and Indexing built in Rust 🦀