Intelligent Mixture-of-Models Router for Efficient LLM Inference
-
Updated
Sep 6, 2025 - Python
Intelligent Mixture-of-Models Router for Efficient LLM Inference
LLM Semantic Router: Intelligent Mixture-of-Models (MoM) System with Privacy Preservation and Prompt Guard. The semantic router intelligently directs OpenAI compliant API requests to the most suitable backend models based on semantic understanding of request content.
Open, Lightweight Model for AI Safety.
A Streamlit app for testing Prompt Guard, a classifier model by Meta for detecting prompt attacks.
AI-powered tool for detecting and classifying prompt safety, identifying potential injections and jailbreaks in both raw text and code inputs.
Add a description, image, and links to the prompt-guard topic page so that developers can more easily learn about it.
To associate your repository with the prompt-guard topic, visit your repo's landing page and select "manage topics."