https://huggingface.co/NousResearch/Minos-v1
Will give the refusal/non-refusal classification after every message
Only tested on my personal environment but im just using a venv rather than a docker env, i believe it should work right out of the box but you may need to either restart the server or do a quick test script referenced in the HF nous/minos page to download the model and confirm it works in your env.
Open WebUI Enterprise — White-labeling, SSO, and dedicated support for your team.