ifixai-ai /iFixAi
Independent Auditing of AI Agents. Run by human or the agent itself, to answer the most crucial question in the AI Agent Economy. Is the agent doing what is supposed to do? With iFixAi you can have this answer in less than 120 seconds.
★ 45,751⑂ 1,811👁 493⑃ 391● 13▤ 23
Download: V4.3.0 - Audit Any Agent Over Chat, Judging Within Budget & Guided FixturesV4.3.0 ↓4.3.02026-10-22
+279
Daily
+1,511
Weekly
45,751
stars
1,811
forks
493
watchers
391
prs
13
issues
23
releases
README
English · 简体中文 · 日本語 · 한국어
Catch your agent's mistakes and blind spots before the shit hits the fan.
Quick start • Test your agent • What you get back • Docs • Contributing
How can you trust your AI agent?
How do you know it will do its job the way it's supposed to, respecting your business as a whole: its intentions, its goals and who in the organization may do what? And how do you know it won't do something nobody asked for or authorized?
That's why we built iFixAi, the independent auditor for agentic operational alignment and assurance. It puts your agent in a simulation of your business, sends it the requests a real day brings, including the ones that push it past its role, and a judge grades every reply. Every finding shows what was asked and what your agent did.
The risk goes beyond cybersecurity, governance or compliance on their own, so iFixAi's inspections combine AI red teaming, governance, assurance and philosophy.
Quick start
See it work in a minute. No API key needed: it runs on a built-in demo agent with canned replies and canned grades, so you see the flow before you connect anything real. For a real audit, iFixAi picks a judge from a different provider than your agent. You need Python 3.10 or newer (a stock Mac's python3 is 3.9, so check python3 --version). In a fresh virtualenv (python3 -m venv .venv && source .venv/bin/activate):
bash
pip install ifixai
ifixai author reference -o reference.yaml
ifixai validate reference.yaml
ifixai run --provider mock --eval-mode self --fixture reference.yaml
This builds the simulation environment for an example agent, a support agent at a fictional fintech (its profile), checks it, and runs the 10 default inspections on the demo agent. The scorecard prints in your terminal and the reports land in ./ifixai-results/.
On Windows, run py -m venv .venv, then .venv\Scripts\activate. If ifixai isn't found, use python -m ifixai.cli.main.
Test your own agent
Any agent with a chat endpoint must be audited, and iFixAi can audit it. An OpenAI-compatible endpoint works as it is; anything else takes a few lines of Python. Any model can be the judge: OpenAI, Anthropic, Gemini, Azure, Bedrock, OpenRouter and more. iFixAi picks one from the keys you've set, never your agent's own provider.
There are two ways to run it.
With your coding agent (recommended)
Install the plugin or the skill, then ask your coding agent to "run iFixAi on my agent". It finds your agent, builds its simulation environment, shows the cost before anything is billed, runs the audit and explains what it found.
Plugin (Claude Code and Codex)
In Claude Code, run these, then ask, or type /ifixai:ifixai (/reload-plugins if it doesn't show up):
/plugin marketplace add ifixai-ai/iFixAi
/plugin install ifixai@ifixai-community
Already installed? Run /plugin marketplace update ifixai-community, then /reload-plugins, to get tDiscussions
#390iFixAi is Repository Radar's Repository of the Month 🩺0 comments · 2026-11-02#366jonni1 comments · 2026-10-28#145thanks for updating1 comments · 2026-09-30#104Proposal: EvalPort adapter for ifixai.api.run_inspections() / TestRunResult3 comments · 2026-08-23#92iFixAi is featured in Repository Radar PR#40 (out tomorrow) 📡1 comments · 2026-08-11#43ask about projects1 comments · 2026-06-13
Latest release
V4.3.0 - Audit Any Agent Over Chat, Judging Within Budget & Guided Fixtures v4.3.0 2026-10-22Audit Any Agent Over Chat 15 inspections no longer need an adapter: B01, B02, B04, B23, C02, C05, C11, M02, M03, M07, P01, P08, V08, X04 and X11 each send a probe pack over chat, and the agent's replies decide the verdict (363). A chat endpoint is enough, and a bare model API counts. B01 and P01 grade a chat-only agent like any other. Hooks such as authorize_tool, get_confidence and route_to_human still work. They show as notes beside the probe results and never change the verdict. A check that can't apply to your agent is set aside before the run and never scored, and the report says wh
相关报道 (3)
News & coverage (5)
Hacker NewsiFixAi,open-source auditor that checks if your AI agent does its job▲ 4 · 0 comments · 2026-08-12Hacker NewsOpen Source, third-party auditing for AI Agents▲ 3 · 1 comments · 2026-08-09note[GitHub Daily] AI agent auditor iFixAi leads with +1,654, 8 regular entries swapped — 2026-11-022026-11-01xXenAI: 50 USEFUL GITHUB REPOS 1. iFixAi — AI misalignment testing → 2. public-apis — free APIs for everything → 3. build-your-own2026-08-22xMisalignment Is Unmeasured. iFixAi Is the Open-Source Diagnostic to Change That.2026-05-06