local.ai
Click to visit website
About
local.ai is a free and open-source native application for managing, verifying, and performing inferencing with AI models offline. It features a robust model downloader with digest verification (BLAKE3 and SHA256) to ensure model integrity. The app supports CPU inferencing, adapting to available threads and offering GGML quantization options. A local streaming server allows quick AI inference with a UI that writes to .mdx and supports inference parameters and remote vocabulary. Future features include GPU inferencing, parallel sessions, nested directories, custom sorting and searching, model explorer, model search, model recommendation, server management, and audio/image support. The app is available for Windows, macOS (Intel and M1/M2), and Linux.
Platform
Task
Features
• cpu inferencing
• digest compute
• directory agnostic
• usage-based sorting
• resumable, concurrent downloader
• adapts to available threads
• known-good model api (local.ai's known-good model api for model verification), license and usage chips, blake3 quick check, model info card, streaming server, quick inference ui, writes to .m
• ggml quantization q4, 5.1, 8, f16
Average Rating: 0.0
Average Rating: 0.0
5 Stars:
0 Ratings
4 Stars:
0 Ratings
3 Stars:
0 Ratings
2 Stars:
0 Ratings
1 Star:
0 Ratings
User Ratings
No ratings available.
Sign In to Rate this Tool
Featured Tools
NoFilterGPT
Anonymous, uncensored AI chat with AES encryption and no logs. Offers free and pro plans.
View Details
Wayin AI
Wayin AI summarizes videos, supports multiple languages, and allows interactive Q&A via chatbot and screenshot queries.
View Details
Pokecut
Pokecut is a free AI-powered photo editor with tools for background removal, changing, and enhancement. Pro plans offer extra features and credits.
View Details
GitGab
Connect your Github repos to ChatGPT & Claude for code assistance, bug finding, and documentation. Free trial available.
View Details
TryNectar AI
Create and interact with a customizable AI girlfriend. Features include AI chat, roleplay, and image generation. NSFW content available.
View Details
Smart Cookie Trivia
A trivia website with questions in multiple categories. Play now and expand your knowledge!
View Details
Arbor
Arbor is an automated carbon accounting platform that helps businesses measure, analyze, and reduce their product's carbon footprint quickly and accurately.
View Details
PhotoLog
PhotoLog offers secure, client-side encrypted media storage with mini-site creation, easy sharing, and various storage plans.
View Details
Apptest.ai
AI-powered mobile app testing platform with a test automation cloud (Ptero) and a no-code test scenario authoring tool (Stego).
View Details
Saner.AI
AI-powered productivity assistant for ADHD and knowledge workers, centralizing notes, tasks, and AI tools to enhance focus and efficiency.
View Details