AI Infrastructure
Part of AI & Machine Learning
GPU compute and AI training infrastructure
Services(8)
Ownership Structure
Deployment
License Type
Country
83/100
FoundationSelf-HostableMIT
AI & Machine Learning
llama.cpp
LLM inference library in C/C++ with CPU, Metal, CUDA, and OpenVINO support
★ 131.2k
81/100
BootstrappedSelf-HostableMIT
AI & Machine Learning
LocalAI
Self-hosted OpenAI-compatible API for running LLMs locally
★ 49.5k
81/100
BootstrappedSelf-HostableApache-2.0
AI & Machine Learning
vLLM
High-throughput, memory-efficient inference engine for LLMs
★ 93.8k
78/100
EU
Public (EU)
ML Platforms
OVHcloud AI Training
GPU compute instances for AI and machine learning training
73/100
EU
Public (EU)
Compute
Scaleway GPU Instances
Virtual machines with NVIDIA and AMD GPUs for parallel workloads
62/100
BootstrappedSelf-HostableMIT
AI & Machine Learning
Open WebUI
Self-hosted web interface for managing multiple LLM backends
★ 155.7k
59/100
BootstrappedSelf-HostableMIT
AI & Machine Learning
Ollama
Run open language models locally via CLI and API
★ 183.2k
59/100
BootstrappedSelf-HostableAGPL-3.0
AI & Machine Learning
Text Generation WebUI
Local LLM interface with support for multiple backends and extensions
★ 47.7k