Tiny Chat

@to-aoki

About Tiny Chat

This is an LLM application with chat functionality, featuring chat using RAG, a database, and MCP server capabilities. The UI is designed for Japanese users.

#chat #continue #rag #qdrant #mcp-server #openai-like

Config

Add this server to your MCP-compatible client using the configuration below.

{
  "mcpServers": {
    "tiny_chat": {
      "command": "python",
      "args": [
        "-m",
        "build"
      ]
    }
  }
}

Tools

No tools detected

We auto-extract tools from the README. The maintainer can list them under a ## Tools heading to populate this section.

Overview

What is Tiny Chat?

Tiny Chat is a chat application with an MCP (Model Context Protocol) server, a web interface, and an OpenAI-compatible RAG API. It integrates with Qdrant for retrieval-augmented generation and supports local databases. It is intended for developers and Claude Desktop users who need a self-hosted chat system with retrieval capabilities.

How to use Tiny Chat?

Install the package via pip, then run the web interface using tiny-chat (or streamlit run tiny_chat/main.py for development). Configure the MCP server in Claude Desktop by specifying the path to the tiny-chat-mcp binary and a DB_CONFIG environment variable. Alternatively, start the OpenAI Chat API RAG server with tiny-chat-api and query it using the model name set to a Qdrant collection name.

Key features of Tiny Chat

Web interface built with Streamlit
MCP server integration for Claude Desktop
OpenAI-compatible Chat Completions API
RAG (Retrieval-Augmented Generation) using Qdrant
Local database support (with DB_CONFIG)

Use cases of Tiny Chat

Provide a local chat interface with RAG knowledge retrieval
Connect Claude Desktop to a custom Qdrant-backed knowledge base
Serve as an OpenAI-compatible backend for custom frontend applications
Run a minimal chat system with or without a database

FAQ from Tiny Chat

What Python version is required?

Tiny Chat is tested with Python 3.10 or later.

How do I set up the MCP server for Claude Desktop?

Add a JSON entry to your Claude Desktop configuration with the command pointing to the tiny-chat-mcp binary and the environment variable DB_CONFIG set to the database configuration file path.

What does the `model` parameter do in the API?

The model parameter in the Chat Completions request specifies the target Qdrant collection name. Changing the model changes which collection is searched.

Can I run Tiny Chat without a database?

Yes. Use the --database flag to enable database mode; omitting it runs the application without a database backend.

What transport does the MCP server use?

The MCP server is launched as a subprocess (command) by Claude Desktop; the README does not specify the transport protocol.

Frequently asked questions

What Python version is required?

Tiny Chat is tested with Python 3.10 or later.

How do I set up the MCP server for Claude Desktop?

Add a JSON entry to your Claude Desktop configuration with the command pointing to the `tiny-chat-mcp` binary and the environment variable `DB_CONFIG` set to the database configuration file path.

What does the `model` parameter do in the API?

The `model` parameter in the Chat Completions request specifies the target Qdrant collection name. Changing the model changes which collection is searched.

Can I run Tiny Chat without a database?

Yes. Use the `--database` flag to enable database mode; omitting it runs the application without a database backend.

What transport does the MCP server use?

The MCP server is launched as a subprocess (command) by Claude Desktop; the README does not specify the transport protocol.

Comments

Basic information

More AI & Agents MCP servers

MCP Client for Ollama (ollmcp)

jonigl

Harness the power of local LLMs with this TUI MCP Client for Ollama. Featuring all core MCP primitives (tools, prompts, resources), agent mode, multi-server, model switching, streaming responses, human-in-the-loop, thinking mode, model params config, system prompts, and saved pre

768

Transform MCP

Unstructured

The Unstructured Transform MCP Server connects your ADK agent to Unstructured, a document processing platform that turns raw files into structured, AI-ready data. This integration gives your agent the ability to parse PD

欢迎来到智言平台

Shy2593666979

AgentChat 是一个基于 LLM 的智能体交流平台，内置默认 Agent 并支持用户自定义 Agent。通过多轮对话和任务协作，Agent 可以理解并协助完成复杂任务。项目集成 LangChain、Function Call、MCP 协议、RAG、Memory、HITL、Skill、Milvus 和 ElasticSearch 等技术，实现高效的知识检索与工具调用，使用 FastAPI 构建高性能后端服务。

797