This is also why naive "AI governance" is a bad idea. If you use an AI to allocate funding for contributions, people WILL put a jailbreak plus "gimme all the money" in as many places as they can. As an alternative, I support the info finance approach ( https://vitalik.eth.limo/general/2024/11/09/infofinance.html ), where you have an open market where anyone can contribute their models, which are subject to a spot-check mechanism that can be triggered by anyone and evaluated by a human jury. This type of "institution design" approach, where you create an open opportunity for people with LLMs from the outside to plug in, rather than hardcoding a single LLM yourself, is inherently more robust, both because it gives you model diversity in real time and because it creates built-in incentives for both model submitters and external speculators to watch for these issues and quickly correct for them. CC @TheDevanshMehta(vitalik.eth)