<div align="center"
Inference Gateway CLI
An agentic command-line assistant that writes code, understands project context, and uses tools to perform real tasks.
</div
⚠️ Warning
Early Development Stage: This project is in its early development stage and breaking changes are expected until it reaches a stable version. Always use pinned versions by specifying a specific version tag when downloading binaries or using install scripts.
Table of Contents
- Features
- Installation
- Quick Start
- Commands
- Tools for LLMs
- Configuration
- Cost Tracking
- Tool Approval System
- Shortcuts
- Channels (Remote Messaging)
- Heartbeat (Periodic Wake-Up)
- Agent Skills
- Computer Use
- Persistent Memory
- Reminders & Command Hooks
- Global Flags
- Examples
- Development
- License
Features
- Automatic Gateway Management: Automatically downloads and runs the Inference Gateway binary (no Docker required!)
- Zero-Configuration Setup: Start chatting immediately with just your API keys in a .env file
- Interactive Chat: Chat with models using an interactive interface
- Status Monitoring: Check gateway health and resource usage
- Conversation History: Store and retrieve past conversations with multiple storage backends
- Conversation Storage - Detailed storage backend documentation
- Conversation Title Generation - AI-powered title generation system
- Database Migrations - Schema migration system for the SQLite/Postgres backends
- Conversation Versioning: Navigate back in time to previous conversation points (double ESC)
- View message history with timestamps
- Restore conversation to any previous user message
- Permanent deletion of messages after restore point
- Learn more →
- Configuration Management: Manage gateway settings via YAML config
- Project Initialization: Set up local project configurations
- Tool Execution: LLMs can execute allowed commands and tools - See all tools →
- Tool Approval System: User approval workflow for sensitive operations with real-time diff visualization
- Agent Modes: Three operational modes for different workflows:
- Standard Mode (default): Normal operation with all configured tools and approval checks
- Plan Mode: Read-only mode for planning and analysis without execution - Learn more →
- Auto-Accept Mode: All tools auto-approved for rapid execution (YOLO mode)
- Toggle between modes with Shift+Tab
- Token Usage Tracking: Accurate token counting with polyfill support for providers that don't return usage metrics
- Cost Tracking: Real-time cost calculation for API usage with per-model breakdown and configurable pricing
- Inline History Auto-Completion: Smart command history suggestions with inline completion
- GitHub Issue References (#): Type # in chat to open a dropdown of the current
repo's open issues. Selecting one inserts a #N token that is highlighted in the input and, on submit, expanded inline into the issue's title, body, and recent comments - so the agent works from full context without a redundant gh issue view lookup. Gracefully no-ops when gh is not installed or the repo has no remote.