Open source real-time translation app for Android that runs locally

Silero VAD: pre-trained enterprise-grade Voice Activity Detector

Effortless data labeling with AI support from Segment Anything and other awesome models.

📄 Awesome OCR multiple programing languages toolkits based on ONNXRuntime, OpenVINO, PaddlePaddle and PyTorch.

An Engine-Agnostic Deep Learning Framework in Java

🛠A lite C++ AI toolkit: 100+ models with MNN, ORT and TRT, including Det, Seg, Stable-Diffusion, Face-Fusion, etc.🎉

Dockerized FastAPI wrapper for Kokoro-82M text-to-speech model w/CPU ONNX and NVIDIA GPU PyTorch support, handling, and auto-stitching

An OBS plugin for removing background in portrait images (video), making it easy to replace the background when recording or streaming.

🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools

OpenMMLab Model Deployment Framework

Local AI API Platform

QualityScaler - image/video AI upscaler app

🍅🍅🍅YOLOv5-Lite: Evolved from yolov5 and the size of model is only 900+kb (int8) and 1.7M (fp16). Reach 15 FPS on the Raspberry Pi 4B~

TTS with kokoro and onnx runtime

Lightweight nudity detection

Robust realtime face and facial landmark tracking on CPU with Unity integration

Fast ML inference & training for ONNX models in Rust

Voice activity detector (VAD) for the browser with a simple API

Lemonade helps users run local LLMs with the highest performance by configuring state-of-the-art inference engines for their NPUs and GPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

一款简单易用和高性能的AI部署框架 | An Easy-to-Use and High-Performance AI Deployment Framework