Inference Tools

The simplest way to find the best AI tools!

Free
Freemium
Web
Android
iOS
Featured
New
Verified
Hiring
NSFW
Omron favicon
Omron
Free
Web
inference verification

A decentralized marketplace for AI inference verification on the Bittensor network, enhancing confidentiality with zero-knowledge cryptography.

HyperMink AI favicon
HyperMink AI
Web
inference server

HyperMink AI is an open-source AI inference server that prioritizes accessibility and privacy.

LoRAX favicon
LoRAX
Free
Web
model serving

A multi-LoRA inference server that serves thousands of fine-tuned LLMs on a single GPU.

Pipeshift AI favicon
Pipeshift AI
Web
llm deployment

Infrastructure for fine-tuning and inferencing open-source LLMs with ease.

Myrtle.ai favicon
Myrtle.ai
Web
inference optimization
Hiring (3 jobs)

Optimizing machine learning inference at scale for various applications.

Wallaroo.AI favicon
Wallaroo.AI
Free
Web
model deployment

Streamline deployment and management of ML models from prototype to production across various environments.

W4M.ai favicon
W4M.ai
Web
ai automation

Pushing boundaries in AI with innovative inference and automation technologies.

FuriosaAI favicon
FuriosaAI
Web
ai hardware
Hiring (25 jobs)

AI chip company specializing in efficient hardware for LLMs and multimodal tasks.

ggml favicon
ggml
Free
Web
machine learning

A high-performance tensor library for machine learning focused on efficient inference models.

Positron favicon
Positron
Web
model inference

High-performance transformer inference system for various AI models.

NeuReality favicon
NeuReality
Web
ai deployment
Hiring (11 jobs)

Revolutionizing AI adoption with purpose-built solutions for scalable inference workflows.

Inference.ai favicon
Inference.ai
Free
Web
gpu provisioning
Hiring (3 jobs)

Your go-to cloud GPU provider, offering competitive pricing and a diverse fleet of GPUs globally.

vLLM favicon
vLLM
Web
model serving

A fast library for LLM inference and serving with high throughput and flexible deployment options.

Lepton AI favicon
Lepton AI
Freemium
Web
ai cloud

A powerful cloud-native platform for AI training and inference with high availability and performance.

Lamini favicon
Lamini
Freemium
Web
llm inference
Hiring (5 jobs)

Enterprise LLM Platform for inference and tuning.