AI Chatbot

A versatile python AI chatbot with command-line and Telegram bot interfaces, powered by multiple LLM options using Hugging Face Transformers.

Features

7 model options: Qwen, Llama 3.2, Gemma-2, Phi-3.5 (0.5B to 3.8B sizes)
8 personality presets: pirate, scientist, comedian, philosopher, chef, girlfriend, and more!
User Profile System: Bot remembers your location, interests, and preferences across all conversations! 🧠
Tools & Real-time Data: Weather API integration with MCP (Model Context Protocol) - ask about current weather anywhere!
Telegram bot support - Chat with your AI through Telegram from anywhere!
Location sharing - Share your location to get weather and local area information
Custom system prompts to define chatbot behavior
Maintains conversation history (per-user for Telegram)
Interactive model and personality selection
Runs on both GPU and CPU
Fast inference with model compilation and KV caching
Extensible tool system with semantic matching for adding more capabilities

I'm currently running this occassionally on my desktop GPU with decent performance using the gemma-2b model.