{"id":16244,"date":"2026-07-03T21:58:03","date_gmt":"2026-07-03T21:58:03","guid":{"rendered":"https:\/\/8657085.xyz\/?p=16244"},"modified":"2026-07-03T21:58:03","modified_gmt":"2026-07-03T21:58:03","slug":"yoshua-bengios-answer-to-ai-you-cant-govern-is-another-ai","status":"publish","type":"post","link":"https:\/\/8657085.xyz\/?p=16244","title":{"rendered":"Yoshua Bengio&#8217;s answer to AI you can&#8217;t govern is another AI"},"content":{"rendered":"<p> <div style=\"display: grid; grid-template-columns: 300px 160px; gap: 2px; width: 460px; background: #eee; padding: 2px;\">\r\n\r\n  <!-- \u6574\u884c\u5bbd\u5e7f\u544a -->\r\n  <div style=\"grid-column: 1\/-1; width: 460px; height: 250px; background: #ccc; display: grid; place-items: center;\">\r\n  <script async type=\"application\/javascript\" src=\"https:\/\/a.magsrv.com\/ad-provider.js\"><\/script> \r\n <ins class=\"eas6a97888e2\" data-zoneid=\"5876674\"><\/ins> \r\n <script>(AdProvider = window.AdProvider || []).push({\"serve\": {}});<\/script>\r\n  <\/div>\r\n  <div style=\"grid-column: 1\/-1; width: 460px; height: 90px; background: #ccc; display: grid; place-items: center;\">\r\n  <script async type=\"application\/javascript\" src=\"https:\/\/a.magsrv.com\/ad-provider.js\"><\/script> \r\n <ins class=\"eas6a97888e2\" data-zoneid=\"5876676\"><\/ins> \r\n <script>(AdProvider = window.AdProvider || []).push({\"serve\": {}});<\/script>\r\n  <\/div>\r\n\r\n  <!-- \u5de6\u4fa7\u7ad6\u6392 -->\r\n  <div style=\"height: 250px; background: #ccc; display: grid; place-items: center;\">\r\n  <script async type=\"application\/javascript\" src=\"https:\/\/a.magsrv.com\/ad-provider.js\"><\/script> \r\n <ins class=\"eas6a97888e2\" data-zoneid=\"5876672\"><\/ins> \r\n <script>(AdProvider = window.AdProvider || []).push({\"serve\": {}});<\/script>\r\n  <\/div>\r\n  <div style=\"height: 500px; background: #ccc; display: grid; place-items: center;\">\r\n  <script async type=\"application\/javascript\" src=\"https:\/\/a.magsrv.com\/ad-provider.js\"><\/script> \r\n <ins class=\"eas6a97888e2\" data-zoneid=\"5876680\"><\/ins> \r\n <script>(AdProvider = window.AdProvider || []).push({\"serve\": {}});<\/script>\r\n  <\/div>\r\n\r\n  <!-- \u53f3\u4fa7\u6469\u5929\u697c\uff08\u548c\u5de6\u4fa7\u5b8c\u5168\u5bf9\u9f50\uff09 -->\r\n  <div style=\"grid-row: 3\/5; height: 750px; background: #ccc; display: grid; place-items: center;\">\r\n  <script async type=\"application\/javascript\" src=\"https:\/\/a.magsrv.com\/ad-provider.js\"><\/script> \r\n <ins class=\"eas6a97888e2\" data-zoneid=\"5876678\"><\/ins> \r\n <script>(AdProvider = window.AdProvider || []).push({\"serve\": {}});<\/script>\r\n  <\/div>\r\n  \r\n  <script async type=\"application\/javascript\" src=\"https:\/\/a.magsrv.com\/ad-provider.js\"><\/script> \r\n <ins class=\"eas6a97888e6\" data-zoneid=\"5876682\"><\/ins> \r\n <script>(AdProvider = window.AdProvider || []).push({\"serve\": {}});<\/script>\r\n<\/div><br \/>\n<\/p>\n<div style=\"padding-right:0;padding-left:0\">\n<p class=\"wp-block-paragraph\">Every technology leader running AI right now is stuck with a question they can\u2019t fully answer.\u00a0<\/p>\n<p class=\"wp-block-paragraph\">Who is watching the AI?\u00a0<\/p>\n<p class=\"wp-block-paragraph\">Yoshua Bengio\u2019s bet is that the watcher should be another AI, designed so it has nothing to gain from misleading you.<\/p>\n<p class=\"wp-block-paragraph\">His Montreal nonprofit, LawZero, released a paper on July 2 making a formal safety case for what it calls \u2018Scientist AI,\u2019 a system designed to answer questions honestly and stay out of the outcome.\u00a0<\/p>\n<p class=\"wp-block-paragraph\">Bengio founded LawZero last year as a nonprofit answerable to no commercial interest. The Mila founder and Canada CIFAR AI Chair has backing from Schmidt Sciences and Open Philanthropy.<\/p>\n<p class=\"wp-block-paragraph\">The research targets a failure mode the team calls \u201cimplicit agency.\u201d\u00a0<\/p>\n<p class=\"wp-block-paragraph\">The model starts chasing goals nobody gave it. It picks this up by imitating people, getting rewarded for the answers they approve of. Sometimes that reads as harmless flattery, but it can also take a swing into deception, or a model that resists being shut off altogether.<\/p>\n<p class=\"wp-block-paragraph\">\u201cMost AI today is trained to act like us, to imitate, to please,\u201d says Bengio.\u00a0<\/p>\n<p class=\"wp-block-paragraph\">Two design choices carry the argument.\u00a0<\/p>\n<p class=\"wp-block-paragraph\">First, the system would learn to separate \u201csomeone claimed X\u201d from \u201cX is true,\u201d so it explains human text rather than taking in human goals as fact. Second, it would be rewarded only for how well its hypotheses explain the evidence, never for what happens after an answer goes out.\u00a0<\/p>\n<p class=\"wp-block-paragraph\">Today\u2019s models are rewarded for answers people approve of, teaching them to flatter and tell users what they want to hear. Cut off from the results of its own predictions, Scientist AI would have no way to learn that softening the truth pays off.<\/p>\n<p class=\"wp-block-paragraph\">LawZero calls the result \u201cdisinterested,\u201d a system with no stake in what its answers cause. When something needs to be done, that\u2019s handled by separate software you can inspect, with a guardrail that blocks any answer it judges as too risky.<\/p>\n<p class=\"wp-block-paragraph\">For anyone accountable for governing AI they didn\u2019t build and can\u2019t fully see, Scientist AI is pitched as a watchdog sitting over other models, which might cause a double-take.<\/p>\n<p class=\"wp-block-paragraph\">\u201cBy analyzing the actions, responses and history of other AI systems, the Scientist AI will more accurately and honestly evaluate whether their actions and responses may cause harm and, if so, block them,\u201d says Iulian Serban, senior director of research and development at LawZero.<\/p>\n<p class=\"wp-block-paragraph\">Accuracy and safety reinforce each other, and the honesty that would make the system useful is the same property that would make deception unlikely.<\/p>\n<p class=\"wp-block-paragraph\">\u201cWe\u2019re building something different,\u201d added Bengio. \u201cA system that mechanically applies the scientific method for hypothesizing and predicting, trying to understand the world and report its beliefs honestly, including about what might harm us. Such a disinterested, scientist-like AI observes and analyzes rather than having hidden drives that can lead to scheming.\u201d<\/p>\n<p class=\"wp-block-paragraph\">LawZero is careful about scope, since the paper gives a formal argument that rests on stated assumptions, not a guarantee. It doesn\u2019t cover deliberate misuse, one-off mistakes, or the more capable agentic systems someone might build on top.\u00a0<\/p>\n<p class=\"wp-block-paragraph\">There is no product yet, only proposed experiments to test whether the assumptions hold.<\/p>\n<p class=\"wp-block-paragraph\">Before deploying another AI to watch your AI, perform an audit of the governance layer.\u00a0<\/p>\n<p class=\"wp-block-paragraph\">Does the watchdog have any stake in what it\u2019s watching, or is it the same approval-trained model as the thing it\u2019s supposed to catch?<\/p>\n<h2 id=\"h-final-shots\" class=\"wp-block-heading\">Final shots<\/h2>\n<ul class=\"wp-block-list\">\n<li>LawZero\u2019s \u2018Scientist AI\u2019 is designed as a monitoring layer over other AI systems, not a chatbot or an agent that acts on its own.<\/li>\n<li>The safety case is mathematical and conditional, resting on assumptions LawZero says still need empirical testing.<\/li>\n<li>The argument covers the risk of the AI developing hidden goals of its own, not people misusing it, or the more autonomous systems someone might build on top.<\/li>\n<\/ul>\n<\/div>\n<p><!-- \u603b\u5bb9\u5668\uff1a\u6700\u5927\u5bbd908px Grid\u7d27\u51d1\u5e03\u5c40 -->\r\n<div style=\"display: grid; grid-template-columns: 728px 160px; gap:2px; width:908px; background:#eee; padding:2px;\">\r\n\r\n  <!-- \u901a\u680f\u9876\u90e8\uff1a\u6700\u5927\u6a2a\u5e45 908x258 \u8de8\u6574\u884c -->\r\n  <div style=\"grid-column:1\/-1; height:258px; background:#ff6b6b; display:grid; place-items:center;\">\r\n    <!-- JuicyAds v3.0 -->\r\n<script type=\"text\/javascript\" data-cfasync=\"false\" async src=\"https:\/\/poweredby.jads.co\/js\/jads.js\"><\/script>\r\n<ins id=\"1114307\" data-width=\"908\" data-height=\"258\"><\/ins>\r\n<script type=\"text\/javascript\" data-cfasync=\"false\" async>(adsbyjuicy = window.adsbyjuicy || []).push({'adzone':1114307});<\/script>\r\n<!--JuicyAds END-->\r\n  <\/div>\r\n\r\n  <!-- \u7b2c\u4e8c\u901a\u680f\uff1a728\u00d790 \u901a\u680f -->\r\n  <div style=\"grid-column:1\/-1; height:90px; background:#4ecdc4; display:grid; place-items:center;\">\r\n    <!-- JuicyAds v3.0 -->\r\n<script type=\"text\/javascript\" data-cfasync=\"false\" async src=\"https:\/\/poweredby.jads.co\/js\/jads.js\"><\/script>\r\n<ins id=\"1114300\" data-width=\"728\" data-height=\"90\"><\/ins>\r\n<script type=\"text\/javascript\" data-cfasync=\"false\" async>(adsbyjuicy = window.adsbyjuicy || []).push({'adzone':1114300});<\/script>\r\n<!--JuicyAds END-->\r\n  <\/div>\r\n\r\n  <!-- \u5de6\u4fa7\u4e3b\u680f\uff1a\u591a\u5e7f\u544a\u5806\u53e0 -->\r\n  <div style=\"display:grid; gap:2px;\">\r\n    <div style=\"height:60px; background:#45b7d1; display:grid; place-items:center;\">\r\n\t<!-- JuicyAds v3.0 -->\r\n<script type=\"text\/javascript\" data-cfasync=\"false\" async src=\"https:\/\/poweredby.jads.co\/js\/jads.js\"><\/script>\r\n<ins id=\"1114308\" data-width=\"468\" data-height=\"60\"><\/ins>\r\n<script type=\"text\/javascript\" data-cfasync=\"false\" async>(adsbyjuicy = window.adsbyjuicy || []).push({'adzone':1114308});<\/script>\r\n<!--JuicyAds END-->\r\n\t<\/div>\r\n    <div style=\"height:250px; background:#ffe066; display:grid; place-items:center;\">\r\n\t<!-- JuicyAds v3.0 -->\r\n<script type=\"text\/javascript\" data-cfasync=\"false\" async src=\"https:\/\/poweredby.jads.co\/js\/jads.js\"><\/script>\r\n<ins id=\"1114299\" data-width=\"300\" data-height=\"250\"><\/ins>\r\n<script type=\"text\/javascript\" data-cfasync=\"false\" async>(adsbyjuicy = window.adsbyjuicy || []).push({'adzone':1114299});<\/script>\r\n<!--JuicyAds END-->\r\n\t<\/div>\r\n    <div style=\"height:250px; background:#ff9ecd; display:grid; place-items:center;\">\r\n\t<!-- JuicyAds v3.0 -->\r\n<script type=\"text\/javascript\" data-cfasync=\"false\" async src=\"https:\/\/poweredby.jads.co\/js\/jads.js\"><\/script>\r\n<ins id=\"1114305\" data-width=\"250\" data-height=\"250\"><\/ins>\r\n<script type=\"text\/javascript\" data-cfasync=\"false\" async>(adsbyjuicy = window.adsbyjuicy || []).push({'adzone':1114305});<\/script>\r\n<!--JuicyAds END-->\r\n\t<\/div>\r\n    <div style=\"height:139px; background:#c792ea; display:grid; place-items:center;\">\r\n\t<!-- JuicyAds v3.0 -->\r\n<script type=\"text\/javascript\" data-cfasync=\"false\" async src=\"https:\/\/poweredby.jads.co\/js\/jads.js\"><\/script>\r\n<ins id=\"1114302\" data-width=\"133\" data-height=\"139\"><\/ins>\r\n<script type=\"text\/javascript\" data-cfasync=\"false\" async>(adsbyjuicy = window.adsbyjuicy || []).push({'adzone':1114302});<\/script>\r\n<!--JuicyAds END-->\r\n\t<\/div>\r\n    <div style=\"height:125px; background:#91e7ac; display:grid; place-items:center;\">\r\n\t\r\n<!-- JuicyAds v3.0 -->\r\n<script type=\"text\/javascript\" data-cfasync=\"false\" async src=\"https:\/\/poweredby.jads.co\/js\/jads.js\"><\/script>\r\n<ins id=\"1114303\" data-width=\"125\" data-height=\"125\"><\/ins>\r\n<script type=\"text\/javascript\" data-cfasync=\"false\" async>(adsbyjuicy = window.adsbyjuicy || []).push({'adzone':1114303});<\/script>\r\n<!--JuicyAds END-->\r\n\t<\/div>\r\n  <\/div>\r\n\r\n  <!-- \u53f3\u4fa7\u7ad6\u680f\uff1a160\u00d7600 \u6574\u5217\u9ad8\u5e7f\u544a -->\r\n  <div style=\"grid-row:3\/8; height:600px;  display:grid; place-items:center;\">\r\n    <!-- JuicyAds v3.0 -->\r\n<script type=\"text\/javascript\" data-cfasync=\"false\" async src=\"https:\/\/poweredby.jads.co\/js\/jads.js\"><\/script>\r\n<ins id=\"1114301\" data-width=\"160\" data-height=\"600\"><\/ins>\r\n<script type=\"text\/javascript\" data-cfasync=\"false\" async>(adsbyjuicy = window.adsbyjuicy || []).push({'adzone':1114301});<\/script>\r\n<!--JuicyAds END-->\r\n  <\/div>\r\n\r\n<\/div><br \/>\n<br \/> Yoshua Bengio&#8217;s answer to AI you can&#8217;t govern is another AI<br \/>\n<br \/>#Yoshua #Bengios #answer #govern<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Every technology leader running AI right now is stuck with a question they can\u2019t fully&#8230;<\/p>\n","protected":false},"author":1,"featured_media":16245,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[7],"tags":[1959,13721,13722,13720],"class_list":["post-16244","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-stories","tag-answer","tag-bengios","tag-govern","tag-yoshua"],"featured_image_urls":{"full":["https:\/\/8657085.xyz\/wp-content\/uploads\/2026\/07\/Photo-by-Philipp-Katzenberger-on-Unsplash.png",1600,900,false],"thumbnail":["https:\/\/8657085.xyz\/wp-content\/uploads\/2026\/07\/Photo-by-Philipp-Katzenberger-on-Unsplash-150x150.png",150,150,true],"medium":["https:\/\/8657085.xyz\/wp-content\/uploads\/2026\/07\/Photo-by-Philipp-Katzenberger-on-Unsplash-300x169.png",300,169,true],"medium_large":["https:\/\/8657085.xyz\/wp-content\/uploads\/2026\/07\/Photo-by-Philipp-Katzenberger-on-Unsplash-768x432.png",640,360,true],"large":["https:\/\/8657085.xyz\/wp-content\/uploads\/2026\/07\/Photo-by-Philipp-Katzenberger-on-Unsplash-1024x576.png",640,360,true],"1536x1536":["https:\/\/8657085.xyz\/wp-content\/uploads\/2026\/07\/Photo-by-Philipp-Katzenberger-on-Unsplash-1536x864.png",1536,864,true],"2048x2048":["https:\/\/8657085.xyz\/wp-content\/uploads\/2026\/07\/Photo-by-Philipp-Katzenberger-on-Unsplash.png",1600,900,false],"covernews-slider-full":["https:\/\/8657085.xyz\/wp-content\/uploads\/2026\/07\/Photo-by-Philipp-Katzenberger-on-Unsplash-1115x715.png",1115,715,true],"covernews-slider-center":["https:\/\/8657085.xyz\/wp-content\/uploads\/2026\/07\/Photo-by-Philipp-Katzenberger-on-Unsplash-800x500.png",800,500,true],"covernews-featured":["https:\/\/8657085.xyz\/wp-content\/uploads\/2026\/07\/Photo-by-Philipp-Katzenberger-on-Unsplash-1024x576.png",1024,576,true],"covernews-medium":["https:\/\/8657085.xyz\/wp-content\/uploads\/2026\/07\/Photo-by-Philipp-Katzenberger-on-Unsplash-540x340.png",540,340,true],"covernews-medium-square":["https:\/\/8657085.xyz\/wp-content\/uploads\/2026\/07\/Photo-by-Philipp-Katzenberger-on-Unsplash-400x250.png",400,250,true]},"author_info":{"display_name":"admin","author_link":"https:\/\/8657085.xyz\/?author=1"},"category_info":"<a href=\"https:\/\/8657085.xyz\/?cat=7\" rel=\"category\">Stories<\/a>","tag_info":"Stories","comment_count":"0","_links":{"self":[{"href":"https:\/\/8657085.xyz\/index.php?rest_route=\/wp\/v2\/posts\/16244","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/8657085.xyz\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/8657085.xyz\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/8657085.xyz\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/8657085.xyz\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=16244"}],"version-history":[{"count":0,"href":"https:\/\/8657085.xyz\/index.php?rest_route=\/wp\/v2\/posts\/16244\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/8657085.xyz\/index.php?rest_route=\/wp\/v2\/media\/16245"}],"wp:attachment":[{"href":"https:\/\/8657085.xyz\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=16244"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/8657085.xyz\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=16244"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/8657085.xyz\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=16244"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}