带你从零实现一个高性能的深度学习推理库，支持Unet、Yolov5、Resnet等模型的推理。Implement a high-performance deep learning inference library step by step

Rule engine implementation in Golang

Python Computer Vision & Video Analytics Framework With Batteries Included

Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and minimal learning curve.

FedML - The federated learning and analytics library enabling secure and collaborative machine learning on decentralized data anywhere at any scale. Supporting large-scale cross-silo federated learning, cross-device federated learning on smartphones/IoTs, and research simulation. MLOps and App Marketplace are also enabled (https://open.fedml.ai).

Fast LTLf Log-SAT Solver with Data Payload!

MIVisionX toolkit is a set of comprehensive computer vision and machine intelligence libraries, utilities, and applications bundled into a single toolkit. AMD MIVisionX also delivers a highly optimized open-source implementation of the Khronos OpenVX™ and OpenVX™ Extensions.

Inference slice for bergamot's tiny11 models.

Repository for OpenVINO's extra modules

An optimized neural network operator library for chips base on Xuantie CPU.

A common base representation of python source code for pylint and other projects

Unified Rule Engine. Graph rewriting system for the AtomSpace. Used as reasoning engine for OpenCog.

library of C++ functions that support applications of Stan in Pharmacometrics

PeriFlow: the fastest serving engine for generative AI such as LLMs

A standalone inference server for trained Rubix ML estimators.

Simple first-order logic implementation for .NET.

TinyTensor is a tool for running already trained NN (Neural Network) models to be able to use them for inference of various tasks such as image classification, semantic segmentation, etc.

GPU tensor framework with support for running ONNX models

A rule engine written in Elixir.

Pure Java Llama2 inference with optional multi-GPU CUDA implementation

Lightspeed C++ Neural Network (UE) Inference Library for Chess

Ai edge toolbox，专门面向边端设备尤其是嵌入式RTOS平台，AI模型部署工具链，包括模型推理引擎和模型压缩工具

A rule engine written in Ruby.

Here is a package of an Inference Engine, fully made in C# by myself... You can install it for free following the provided ReadMe documentation. Try it out and don't hesitate to write issues and contribute

Python SDK of PeriFlow: the fastest engine for generative AI such as LLMs

A simple neural network inference framework

GPT-2 inference engine written in Zig

A Machine Learning System for Data Enrichment.

A Rust TinyML Compiler for Neural Network Inference on Embedded Systems