PSI KV Governor
A reference implementation using Linux Pressure Stall Information to trim LLM KV cache under memory pressure.
PSI KV Governor
What is PSI KV Governor?
PSI KV Governor vs Similar AI Tools
| Pricing Model | Free | Free | Custom Pricing | Free, Paid |
| Free Credits | ||||
| Key Features |
|
|
|
|
| Pros |
|
|
|
|
| Cons |
|
|
|
|
| Best For |
|
|
|
|
How to use PSI KV Governor?
- 1Check PSI availability: cat /proc/pressure/memory
- 2Run reference simulator: PYTHONPATH=src python -m psi_kv_governor.cli simulate
- 3Build llama.cpp runner: scripts/build_llama_runner.sh
- 4Download demo model: python scripts/download_demo_model.py
- 5Run PSI benchmark: PYTHONPATH=src python benchmarks/pressure_bench.py [options]
PSI KV Governor Key Features
- PSI-based KV cache trimming
- Reference implementation for LLM inference
- Integration with llama.cpp
- Benchmark scripts for evaluating performance
- Configurable trimming parameters
PSI KV Governor Use Cases
- Preventing out-of-memory errors during LLM inference on Linux
- Optimizing memory usage for serving LLMs on constrained systems
- Testing PSI-aware cache management strategies
PSI KV Governor Pricing & Free Credits
PSI KV Governor currently operates on a Free model.
This tool is completely free to use
PSI KV Governor Pros & Cons
Pros
- Leverages Linux kernel PSI for accurate memory pressure detection
- Lightweight and easy to integrate with existing LLM runtimes
- Open-source and customizable
Cons
- Linux-only due to PSI dependency
- Experimental, not production-ready
- Limited documentation and examples
What is PSI KV Governor best for?
- Developers optimizing LLM inference on Linux
- Users of llama.cpp on memory-constrained systems
- Researchers exploring memory-efficient LLM serving
PSI KV Governor FAQ
Top free alternatives to PSI KV Governor
A cooperative gate for shell commands that AI agents run, providing previews, backups, policy enforcement, and audit for tools like Claude Code and Cursor.
Agentcard provides agent-friendly card issuing and payment infrastructure for AI agents, enabling 5-minute setup and autonomous purchases.
Oodle AI provides agent observability with fast trace search, S3-based storage, and out-of-the-box insights to detect silent failures in AI agents.
Jacquard is a small programming language designed for running, reviewing, and trusting programs written by machine-learning models and reviewed by people.
Autonomous security testing platform that finds and fixes access control vulnerabilities in live AI-built apps.
AI-powered social listening tool that monitors Reddit, X, LinkedIn, and 10+ other platforms, filters mentions with AI, and delivers them to your stack via API, Slack, or webhooks.
A unified AI gateway providing access to 300+ leading models through one EU-hosted, GDPR-compliant API with an OpenAI SDK-compatible interface.
Best alternatives AI Tools to PSI KV Governor
DeepSQL is an AI DBA that monitors workloads, optimizes slow queries, and cuts database costs via a self-hosted agent with MCP and Slack integration.
Open-source platform for real-time AI agent security, auditing skills and runtime with community-driven threat rules.
OpenSEO is an open source SEO platform that integrates with AI agents via MCP to provide real SEO data for keyword research, competitor analysis, backlinks, and more.
SureWire Beta is an AI agent validation platform that helps ensure your AI agents are safe and reliable through comprehensive testing.
A deadline-aware LLM router that reduces AI inference costs by automatically finding cheaper service tiers within a user-specified time window.
Run multiple AI coding agents in parallel on isolated git worktrees with a full editor and built-in developer tools.
An open-source cost controller for AI agent loops that stops loops when converged and rolls back before degradation.