Tags

Free AI Tools for LLM proxy

Browse 2 free and freemium AI tools built for LLM proxy.

2 tools

2

2 tools

2

100% free access

0

Freemium / Free Trial

Top Free LLM proxy AI Tools

Discover the best free AI tools tagged LLM proxy — all with free credits or a free plan.

llmproxy logo
llmproxy

A lightweight, high-performance LLM proxy for caching, failover, cost tracking, and seamless integration between local and cloud AI providers.

#AI API#AI Open Source Models#AI Developer Tools
View tool
GreyFox Community Edition logo
GreyFox Community Edition

Self-hosted AI traffic proxy and local operator console for teams to control LLM token usage, enforce user limits, cache responses, and monitor AI traffic.

#AI Developer Tools#AI API
View tool

What Can LLM proxy AI Tools Do?

The most common use cases across AI tools tagged 'LLM proxy'.

Integrate local LLM tools with NVIDIA cloud-hosted models without client modificationsMonitor and track API costs and usage via stats dashboardReduce latency and API calls with response caching for non-streaming requestsTeam management of LLM token usageSelf-hosted AI traffic monitoring and analyticsEnforcing per-user API limits across an organizationCaching repeated AI requests to reduce costsDevelopment and testing with mock mode

Key Features of LLM proxy AI Tools

The most frequently featured capabilities in AI tools tagged 'LLM proxy'.

Emulates Ollama, OpenAI, and llama.cpp APIsTransparent forwarding to NVIDIA's OpenAI-compatible APIOptional response caching with configurable TTL and sizeAutomatic failover and retry on transient upstream errorsLive /stats dashboard for metrics and process monitoringInbound authentication supportMulti-model discoveryStreaming support for chat and completionsOpenAI-compatible proxy endpointLocal Admin UI served from the same containerPer-user token quota enforcement with X-App-User-IdExact response cache for repeated non-streaming requests

AI Tool Categories for LLM proxy

AI tools tagged 'LLM proxy' are listed across these categories.

AI API(2)AI Developer Tools(2)AI Open Source Models(1)

All tools tagged “LLM proxy”

llmproxy logo
llmproxy

A lightweight, high-performance LLM proxy for caching, failover, cost tracking, and seamless integration between local and cloud AI providers.

#AI API#AI Open Source Models#AI Developer Tools
View tool
GreyFox Community Edition logo
GreyFox Community Edition

Self-hosted AI traffic proxy and local operator console for teams to control LLM token usage, enforce user limits, cache responses, and monitor AI traffic.

#AI Developer Tools#AI API
View tool

FAQ about Free LLM proxy AI Tools

Browse 2 free and freemium AI tools built for LLM proxy.

Related AI Categories