Project Description

what is ZIO-LLM-Proxy?

ZIO-LLM-Proxy is a project that enables integration between OpenAI chat models and local MCP servers through Function Calling, facilitating custom PII checks for sensitive data verification.

how to use ZIO-LLM-Proxy?

To use ZIO-LLM-Proxy, send a message to the proxy, which will then communicate with the LLM and MCP servers to process the request while ensuring sensitive data is handled appropriately.

key features of ZIO-LLM-Proxy?

• Integration with OpenAI chat models for enhanced functionality
• Custom PII checks to verify sensitive data
• User control over sharing sensitive information

use cases of ZIO-LLM-Proxy?

1. Securely processing user queries with sensitive data
2. Integrating local MCP servers with AI models for enhanced data handling
3. Ensuring compliance with data privacy regulations during AI interactions

FAQ from ZIO-LLM-Proxy?

• What programming language is used for ZIO-LLM-Proxy?

The project is built using Scala with the ZIO stack.

• How does the PII check work?

The PII check uses regex to identify sensitive data without exposing it to the user.

• Is there an authentication mechanism?

No authentication mechanism is required for this project.