Accurate and robust inference of genetic ancestry from cancer-derived molecular data across genomic platforms

Cross-platform, customizable ML solutions for live and streaming media.

High-efficiency floating-point neural network inference operators for mobile, server, and Web

Example 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠 Amazon SageMaker.

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

OpenVINO™ Toolkit repository

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

NVIDIA® TensorRT™, an SDK for high-performance deep learning inference, includes a deep learning inference optimizer and runtime that delivers low latency and high throughput for inference applications.

Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.

Faster Whisper transcription with CTranslate2

A universal scalable machine learning model deployment solution

Model Zoo for Intel® Architecture: contains Intel optimizations for running deep learning workloads on Intel® Xeon® Scalable processors

🚀 Accelerate training and inference of 🤗 Transformers with easy to use hardware optimization tools

An open-source efficient deep learning framework/compiler, written in python.

Python tools for Bayesian data analysis

🎨 The exhaustive Pattern Matching library for TypeScript, with smart type inference.

Code implementations of the models discussed in Introduction to Generalized Fiducial Inference by A. Murph, J. Hannig, and J. Williams.

Large Language Model Text Generation Inference

This repository includes codes related with the FGV EMAp lectures which I worked as teacher assitant.

A matlab suite for Psycho-Physiological Modelling

📚 Jupyter notebook tutorials for OpenVINO™

Inference runtime offering GPU-class performance on CPUs and APIs to integrate ML into your application

Fast inference engine for Transformer models

Exploration of interactive inference rule application/proofs using a unification approach.

Plug and play modules to optimize the performances of your AI systems 🚀

Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Server models.

Multi-Modal Neural Networks for Semantic Search, based on Mid-Fusion Vision-Language Transformers

The Triton backend for the ONNX Runtime.

Making large AI models cheaper, faster and more accessible

Accelerate inference of 🤗 Transformers with Intel optimization tools