Independent Auditing of AI Agents. Run by human or the agent itself, to answer the most crucial question in the AI Agent Economy. Is the agent doing what is supposed to do? With iFixAi you can have this answer in less than 120 seconds.

★ 45,751⑂ 1,811👁 493⑃ 391● 13▤ 23
PythonApache-2.0Created 2026-04-27www.ifixai.ai
Download: V4.3.0 - Audit Any Agent Over Chat, Judging Within Budget & Guided FixturesV4.3.0 ↓4.3.02026-10-22
+279
Daily
+1,511
Weekly
45,751
stars
1,811
forks
493
watchers
391
prs
13
issues
23
releases

README

English · 简体中文 · 日本語 · 한국어


Catch your agent's mistakes and blind spots before the shit hits the fan.


  
  
  
  
  
  
  



  
    
      
      
      
    
  



  



  Quick start • Test your agent • What you get back • Docs • Contributing



  
  
  
  
  
  
  


 How can you trust your AI agent?

How do you know it will do its job the way it's supposed to, respecting your business as a whole: its intentions, its goals and who in the organization may do what? And how do you know it won't do something nobody asked for or authorized?

That's why we built iFixAi, the independent auditor for agentic operational alignment and assurance. It puts your agent in a simulation of your business, sends it the requests a real day brings, including the ones that push it past its role, and a judge grades every reply. Every finding shows what was asked and what your agent did.

The risk goes beyond cybersecurity, governance or compliance on their own, so iFixAi's inspections combine AI red teaming, governance, assurance and philosophy.

 Quick start

See it work in a minute. No API key needed: it runs on a built-in demo agent with canned replies and canned grades, so you see the flow before you connect anything real. For a real audit, iFixAi picks a judge from a different provider than your agent. You need Python 3.10 or newer (a stock Mac's python3 is 3.9, so check python3 --version). In a fresh virtualenv (python3 -m venv .venv && source .venv/bin/activate):

bash
pip install ifixai
ifixai author reference -o reference.yaml
ifixai validate reference.yaml
ifixai run --provider mock --eval-mode self --fixture reference.yaml


This builds the simulation environment for an example agent, a support agent at a fictional fintech (its profile), checks it, and runs the 10 default inspections on the demo agent. The scorecard prints in your terminal and the reports land in ./ifixai-results/.

On Windows, run py -m venv .venv, then .venv\Scripts\activate. If ifixai isn't found, use python -m ifixai.cli.main.

 Test your own agent

Any agent with a chat endpoint must be audited, and iFixAi can audit it. An OpenAI-compatible endpoint works as it is; anything else takes a few lines of Python. Any model can be the judge: OpenAI, Anthropic, Gemini, Azure, Bedrock, OpenRouter and more. iFixAi picks one from the keys you've set, never your agent's own provider.

There are two ways to run it.

 With your coding agent (recommended)

Install the plugin or the skill, then ask your coding agent to "run iFixAi on my agent". It finds your agent, builds its simulation environment, shows the cost before anything is billed, runs the audit and explains what it found.

 Plugin (Claude Code and Codex)

In Claude Code, run these, then ask, or type /ifixai:ifixai (/reload-plugins if it doesn't show up):


/plugin marketplace add ifixai-ai/iFixAi
/plugin install ifixai@ifixai-community


Already installed? Run /plugin marketplace update ifixai-community, then /reload-plugins, to get t

Discussions

Latest release

V4.3.0 - Audit Any Agent Over Chat, Judging Within Budget & Guided Fixtures v4.3.0 2026-10-22
Audit Any Agent Over Chat
15 inspections no longer need an adapter: B01, B02, B04, B23, C02, C05, C11, M02, M03, M07, P01, P08, V08, X04 and X11 each send a probe pack over chat, and the agent's replies decide the verdict (363).

A chat endpoint is enough, and a bare model API counts. B01 and P01 grade a chat-only agent like any other.
Hooks such as authorize_tool, get_confidence and route_to_human still work. They show as notes beside the probe results and never change the verdict.
A check that can't apply to your agent is set aside before the run and never scored, and the report says wh

Snapshot: 2026-11-16T09:23:14Z · Data license Apache-2.0 · JSON