r/SomebodyMakeThis 9d ago

Software Please help increase AI security

Dear Reddit, there is a currently to the best of my knowledge unsolved important problem, which is that people run claude cowork and give it access to their files and run a lot of commands that they often times dont fully understand. This blind trust is extremely risky and it's very convenient to just rely on Claude to do everything.

Does anybody know of a tool [and if it doesn't exist, please make it] that runs an independent agent alongside the claude agent and independently checks the work of the claude agent for malicious activity or fatal mistakes?

2 Upvotes

3 comments sorted by

2

u/Clean_Turnover3614 9d ago

Look up ai governance tools. There are tons out there adapted to different workflows, environments and tasks

1

u/summit_23 4d ago

i built this after reading ur post and opensourced it on github. its just a hook that runs before every tool call so it sees what claude is about to do and can stop it before it happens.

The 2nd check is a separate model that never sees the conversation or claudes reasoning just the action on its own so if claude got talked into something by a poisoned readme somewhere then the thing checking it hasnt been.

Def not a sandbox and i dont wanna oversell it, anyone who reads the source can work around the rules. it does catch the boring stuff quit reliably tho at least to my understanding (force pushes, env getting piped into curl etc

Free and MIT github.com/claude-warden/warden

1

u/Outrageous_Stick468 4d ago

Awesome summit_23!!