Installation and Setup Guide

Name: Installation and Setup Guide
Author: ricardoborges

@ricardoborges

リポジトリ

Installation and Setup Guide について

LLM chat app for integration tests using llama-stack-client, llama, Ollama, MCP, Tools

#mcp #chat-application #gradio #llm #ollama #llama-stack #mcp-server #mcp-client

基本情報

カテゴリ

AI とエージェント

ランタイム

python

トランスポート

stdio

公開者

ricardoborges

設定

以下の設定を使って、このサーバーを MCP 対応クライアントに追加してください。

{
  "mcpServers": {
    "chatlab": {
      "command": "uv",
      "args": [
        "venv"
      ]
    }
  }
}

ツール

ツールは検出されませんでした

ツールは README から自動的に抽出されます。メンテナーは ## Tools という見出しの下に記載することで、このタブに反映できます。

概要

What is Installation and Setup Guide?

This document provides step-by-step instructions for setting up the development environment and running the ChatLab application. It uses Ollama or Together.ai for LLM inference and LLama-Stack to manage the inference environment.

How to use Installation and Setup Guide?

Follow the installation steps sequentially: install Ollama or obtain a Together.ai API key, set up LLama-Stack using uv and a virtual environment, clone the repository, install dependencies via uv pip install -r myproject.toml, set environment variables (TAVILY_SEARCH_API_KEY, TOGETHER_API_KEY or DEFAULT_STACK="Ollama"), then run gradio main.py.

Key features of Installation and Setup Guide

Step-by-step guide for Ollama and Together.ai setup
Uses LLama-Stack to manage inference environments
Gradio-based web application interface
Supports local and cloud inference models

Use cases of Installation and Setup Guide

Setting up a local LLM environment with Ollama
Configuring cloud inference via Together.ai API
Running the ChatLab application with Gradio UI

FAQ from Installation and Setup Guide

What prerequisites are needed?

Ollama must be installed (unless using Together.ai API) and the virtual environment must be activated correctly.

What dependencies are required?

Ollama or Together.ai API key, LLama-Stack, Python packages as listed in myproject.toml, and a Tavily search API key for search functionality.

Where does data live?

API keys are stored in a .env file (TAVILY_SEARCH_API_KEY, TOGETHER_API_KEY). Model inference runs either locally (Ollama) or on Together.ai servers.