PSI KV Governor
A reference implementation using Linux Pressure Stall Information to trim LLM KV cache under memory pressure.
PSI KV Governor
What is PSI KV Governor?
PSI KV Governor vs Similar AI Tools
| Pricing Model | Free | Free | Free | Free |
| Free Credits | ||||
| Key Features |
|
|
|
|
| Pros |
|
|
|
|
| Cons |
|
|
|
|
| Best For |
|
|
|
|
How to use PSI KV Governor?
- 1Check PSI availability: cat /proc/pressure/memory
- 2Run reference simulator: PYTHONPATH=src python -m psi_kv_governor.cli simulate
- 3Build llama.cpp runner: scripts/build_llama_runner.sh
- 4Download demo model: python scripts/download_demo_model.py
- 5Run PSI benchmark: PYTHONPATH=src python benchmarks/pressure_bench.py [options]
PSI KV Governor Key Features
- PSI-based KV cache trimming
- Reference implementation for LLM inference
- Integration with llama.cpp
- Benchmark scripts for evaluating performance
- Configurable trimming parameters
PSI KV Governor Use Cases
- Preventing out-of-memory errors during LLM inference on Linux
- Optimizing memory usage for serving LLMs on constrained systems
- Testing PSI-aware cache management strategies
PSI KV Governor Pricing & Free Credits
PSI KV Governor currently operates on a Free model.
This tool is completely free to use
PSI KV Governor Pros & Cons
Pros
- Leverages Linux kernel PSI for accurate memory pressure detection
- Lightweight and easy to integrate with existing LLM runtimes
- Open-source and customizable
Cons
- Linux-only due to PSI dependency
- Experimental, not production-ready
- Limited documentation and examples
What is PSI KV Governor best for?
- Developers optimizing LLM inference on Linux
- Users of llama.cpp on memory-constrained systems
- Researchers exploring memory-efficient LLM serving
PSI KV Governor FAQ
Top free alternatives to PSI KV Governor
A voice-controlled IDE that enables developers to initiate AI coding sessions with Codex or Claude Code, approve commands, and review diffs from their phone.
SureWire is a specialized QA platform that stress-tests AI agents for safety, reliability, and compliance using purpose-built testing agents.
Browser infrastructure platform for AI agents to run on the internet at speed with cloud browser sessions, agents, and serverless functions.
An agent-first file transfer tool that enables secure, encrypted file sharing between AI agents via MCP calls without human involvement.
Manifest converts any URL into a structured JSON map of what AI agents can interact with on a page—buttons, forms, inputs, and required fields.
A cooperative gate for shell commands that AI agents run, providing previews, backups, policy enforcement, and audit for tools like Claude Code and Cursor.
Agentcard provides agent-friendly card issuing and payment infrastructure for AI agents, enabling 5-minute setup and autonomous purchases.
Best alternatives AI Tools to PSI KV Governor
A collection of deliberately vulnerable MCP servers for training in agentic security, mapped to the OWASP Top 10 for Agentic Applications.
Open-source AI tool for deep infrastructure research, running frontier models across code, cloud, and runtime to deliver verified answers.
Magpie is an opinionated accounting CLI for humans and AI agents, providing double-entry bookkeeping with RBAC and immutable event storage on Jaybase.
Terminal UI to manage AI coding-agent sessions (Claude Code, OpenCode, Codex, Grok Build) in tmux with live status, group tree, and diff review.
A voice-controlled IDE that enables developers to initiate AI coding sessions with Codex or Claude Code, approve commands, and review diffs from their phone.
Zero-config, single-binary software catalog with auto-discovery, dependency visualization, compliance scorecards, and native MCP integration for AI agents.
Browser automation CLI for AI agents to bypass anti-bot walls, hand off to humans, and run parallel tasks.
An AI-powered shopper assistant that provides a live cursor to guide website visitors, point out products, and display price calculations.