<div align="center"

Inference Gateway CLI

An agentic command-line assistant that writes code, understands project context, and uses tools to perform real tasks.

📖 Documentation · 🚀 Quick Start · 🛠️ Tools Reference · 💬 Discussions

<br/

<img src="./assets/tui-chat.png" width="760" alt="infer chat - the interactive TUI with model selection, streaming responses, and a live status bar" /

The infer chat TUI - watch the animated demo

</div

⚠️ Warning

Early Development Stage: This project is in its early development stage and breaking changes are expected until it reaches a stable version. Always use pinned versions by specifying a specific version tag when downloading binaries or using install scripts.

Features
Installation
Quick Start
Commands
Tools for LLMs
Configuration

Cost Tracking
Tool Approval System
Shortcuts
Channels (Remote Messaging)
Heartbeat (Periodic Wake-Up)
Agent Skills

Computer Use
Persistent Memory
Reminders & Command Hooks
Global Flags
Examples
Development

License

Features

Automatic Gateway Management: Automatically downloads and runs the Inference Gateway binary (no Docker required!)
Zero-Configuration Setup: Start chatting immediately with just your API keys in a .env file
Interactive Chat: Chat with models using an interactive interface
Status Monitoring: Check gateway health and resource usage
Conversation History: Store and retrieve past conversations with multiple storage backends
Conversation Storage - Detailed storage backend documentation

Conversation Title Generation - AI-powered title generation system
Database Migrations - Schema migration system for the SQLite/Postgres backends
Conversation Versioning: Navigate back in time to previous conversation points (double ESC)
View message history with timestamps
Restore conversation to any previous user message
Permanent deletion of messages after restore point

inference-gateway/cli

Installation

README.md