<div align="center"
Inference Gateway CLI
An agentic command-line assistant that writes code, understands project context, and uses tools to perform real tasks.
📖 Documentation · 🚀 Quick Start · 🛠️ Tools Reference · 💬 Discussions
<br/
<img src="./assets/tui-chat.png" width="760" alt="infer chat - the interactive TUI with model selection, streaming responses, and a live status bar" /
The infer chat TUI - watch the animated demo
</div
⚠️ Warning
Early Development Stage: This project is in its early development stage and breaking changes are expected until it reaches a stable version. Always use pinned versions by specifying a specific version tag when downloading binaries or using install scripts.
Table of Contents
- Features
- Installation
- Quick Start
- Commands
- Tools for LLMs
- Configuration
- Cost Tracking
- Tool Approval System
- Shortcuts
- Channels (Remote Messaging)
- Heartbeat (Periodic Wake-Up)
- Agent Skills
- Computer Use
- Persistent Memory
- Reminders & Command Hooks
- Global Flags
- Examples
- Development
- License
Features
- Automatic Gateway Management: Automatically downloads and runs the Inference Gateway binary (no Docker required!)
- Zero-Configuration Setup: Start chatting immediately with just your API keys in a .env file
- Interactive Chat: Chat with models using an interactive interface
- Status Monitoring: Check gateway health and resource usage
- Conversation History: Store and retrieve past conversations with multiple storage backends
- Conversation Storage - Detailed storage backend documentation
- Conversation Title Generation - AI-powered title generation system
- Database Migrations - Schema migration system for the SQLite/Postgres backends
- Conversation Versioning: Navigate back in time to previous conversation points (double ESC)
- View message history with timestamps
- Restore conversation to any previous user message
- Permanent deletion of messages after restore point