AI Infrastructure

Part of AI & Machine Learning

GPU compute and AI training infrastructure

Services(8)

Ownership Structure

Deployment

License Type

Country

BootstrappedSelf-HostableApache-2.0

AI & Machine Learning

vLLM

High-throughput, memory-efficient inference engine for LLMs

FoundationSelf-HostableMIT

AI & Machine Learning

llama.cpp

LLM inference library in C/C++ with CPU, Metal, CUDA, and OpenVINO support

BootstrappedSelf-HostableMIT

AI & Machine Learning

LocalAI

Self-hosted OpenAI-compatible API for running LLMs locally

BootstrappedSelf-HostableAGPL-3.0

AI & Machine Learning

Text Generation WebUI

Local LLM interface with support for multiple backends and extensions

OVHcloud AI Training

GPU compute instances for AI and machine learning training

Scaleway GPU Instances

Virtual machines with NVIDIA and AMD GPUs for parallel workloads

BootstrappedSelf-HostableMIT

AI & Machine Learning

Open WebUI

Self-hosted web interface for managing multiple LLM backends

BootstrappedSelf-HostableMIT

AI & Machine Learning

Ollama

Run open language models locally via CLI and API