A collection of SOTA real-time, multi-object trackers for object detectors

Stable diffusion webui based on diffusers.

The project can achieve FCWS, LDWS, and LKAS functions solely using only visual sensors. using YOLOv5 / YOLOv5-lite / YOLOv8 and Ultra-Fast-Lane-Detection-v2 .

PaddleSlim is an open-source library for deep model compression and architecture search.

PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT

Video Frame Interpolation & Super Resolution using NVIDIA's TensorRT & Tencent's NCNN inference, beautifully crafted and packaged into a single app

TensorRT C++ API Tutorial

InsightFace REST API for easy deployment of face recognition services with TensorRT in Docker.

⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.

OpenMMLab Model Deployment Framework

The ROS warper for yolov8 with tensorrt acceleration

Seeed Studio EdgeLab is an open-source project focused on embedded AI.

TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and performance optimization for mobile devices, and also draws on the advantages of good extensibility and high performance from existed open source efforts. TNN has been deployed in multiple Apps from Tencent, such as Mobile QQ, Weishi, Pitu, etc. Contributions are welcome to work in collaborative with us and make TNN a better framework.

Benchmark inference speed of CNNs with various quantization methods in Pytorch+TensorRT with Jetson Nano/Xavier

NVIDIA DeepStream SDK 6.2 / 6.1.1 / 6.1 / 6.0.1 / 6.0 implementation for YOLO models

Python Streaming Video Analytics Framework With Batteries Included

Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.

Hardware-accelerated, deep learned model support for object detection including DetectNet

The next-generation platform to monitor and optimize your AI costs in one place 🚀

🚀🚀🚀 A collection of some awesome public YOLO object detection series projects.

Efficient CPU/GPU/Vulkan ML Runtimes for VapourSynth (with built-in support for waifu2x, DPIR, RealESRGANv2/v3, Real-CUGAN, RIFE and more!)

VitPose without MMCV dependencies

The first tensorrt implementation for point-based 3d detector, i.e., 3DSSD,SASA,IA-SSD.

A model compression and acceleration toolbox based on pytorch.

Easy and fast 2d human pose estimation using SOTA ViTPose [Y. Xu et al., 2022] finetuned on 25 keypoints skeleton (COCO + Feet)

ONNX and TensorRT implementation of Whisper

NVIDIA® TensorRT™, an SDK for high-performance deep learning inference, includes a deep learning inference optimizer and runtime that delivers low latency and high throughput for inference applications.

Deep Learning API and Server in C++14 support for Caffe, PyTorch,TensorRT, Dlib, NCNN, Tensorflow, XGBoost and TSNE

A repo that uses TensorRT to deploy wll-trained models.