Protect AI ModelScan
Open-source scanner to detect unsafe code in model artifacts before deploy.
Sorting
Lasso Moderation
AI moderation platform with dashboards, custom rules, and live workflows.
Ollama + Llama Guard 3 (local)
Run Llama Guard 3 locally via Ollama to classify prompts/responses for safety.
Google Vertex AI Safety Filters
Adjustable harm thresholds and safety attributes for Gemini/Imagen outputs.
Robust Intelligence AI Firewall
Pre- and post-model guardrails to block unsafe prompts/outputs in production.
Guardrails AI (framework)
Open-source + managed framework for input/output checks and structured outputs.
Lakera Guard
Low-latency API to block prompt injection, data leakage, and jailbreaks.
ActiveFence
Real-time guardrails, automated red teaming, and moderation workflows.
Modulate ToxMod
Proactive, voice-native moderation for live chat in games and communities.
Spectrum Labs
Contextual AI moderation across text/voice; multilingual & compliance-ready.
Microsoft Community Sift (Two Hat)
Enterprise moderation for communities/games with configurable policies.
Clarifai Content Moderation
Production-ready models and workflow tools for automated UGC moderation.
Sightengine
Realtime image/video/text moderation APIs with rich unsafe-content taxonomies.
Hive Moderation
Full-stack text/image/video moderation plus deepfake & AI-content detection.
Jigsaw Perspective API
Toxicity and harassment scoring for UGC; easy-to-integrate REST API.