{"id":8748,"date":"2025-03-07T12:17:52","date_gmt":"2025-03-07T12:17:52","guid":{"rendered":"https:\/\/fusionmindlabs.com\/blogs\/openais-ex-policy-lead-criticizes-ai-safety-record\/"},"modified":"2025-03-07T12:17:52","modified_gmt":"2025-03-07T12:17:52","slug":"openais-ex-policy-lead-criticizes-ai-safety-record","status":"publish","type":"post","link":"https:\/\/fusionmindlabs.com\/blogs\/openais-ex-policy-lead-criticizes-ai-safety-record\/","title":{"rendered":"OpenAI&#8217;s ex-policy lead criticizes AI safety record"},"content":{"rendered":"\n<\/p>\n<h2>Criticism of OpenAI&#8217;s Approach to AI Safety<\/h2>\n<p>A former high-profile policy researcher at OpenAI, Miles Brundage, has taken to social media to express his criticism of the company&#8217;s approach to deploying potentially risky AI systems. Brundage claims that OpenAI is &quot;rewriting the history&quot; of its deployment strategy.<\/p>\n<h2>OpenAI&#8217;s Current Philosophy on AI Safety<\/h2>\n<p>Earlier this week, OpenAI published a document outlining its current philosophy on AI safety and alignment. The document states that the development of Artificial General Intelligence (AGI) is a &quot;continuous path&quot; that requires &quot;iteratively deploying and learning&quot; from AI technologies. OpenAI views the first AGI as just one point along a series of systems of increasing usefulness, and believes that the way to make the next system safe and beneficial is to learn from the current system.<\/p>\n<h2>Brundage&#8217;s Criticism<\/h2>\n<p>However, Brundage disagrees with OpenAI&#8217;s characterization of its approach. He claims that the company&#8217;s release of GPT-2, a precursor to the AI systems powering ChatGPT, was actually an example of the iterative deployment strategy that OpenAI is now embracing. Brundage, who was involved in the release of GPT-2, says that the model was released incrementally, with lessons shared at each step, and that many security experts at the time thanked OpenAI for its caution.<\/p>\n<h2>The Release of GPT-2<\/h2>\n<p>GPT-2 was announced in 2019 and was a cutting-edge AI system at the time. Due to concerns about the risk of malicious use, OpenAI initially refused to release the model&#8217;s source code, instead giving selected news outlets limited access to a demo. The decision was met with mixed reviews from the AI industry, with some experts arguing that the threat posed by GPT-2 had been exaggerated. OpenAI eventually released a partial version of GPT-2 six months after the model&#8217;s unveiling, followed by the full system several months later.<\/p>\n<h2>Brundage&#8217;s Concerns<\/h2>\n<p>Brundage believes that OpenAI&#8217;s approach to AI safety is motivated by a desire to prioritize product releases over caution. He fears that the company&#8217;s aim is to set up a burden of proof where concerns about AI safety are dismissed as &quot;alarmist&quot; and require overwhelming evidence of imminent dangers to act on them. Brundage argues that this mentality is &quot;very dangerous&quot; for advanced AI systems.<\/p>\n<h2>OpenAI&#8217;s History and Competitive Pressures<\/h2>\n<p>OpenAI has historically been accused of prioritizing &quot;shiny products&quot; over safety and rushing product releases to beat rival companies to market. The company has reportedly projected that its annual losses could triple to $14 billion by 2026, and is under pressure to compete with rival AI labs such as DeepSeek. Experts like Brundage question whether the trade-off between safety and product releases is worth it, and whether OpenAI&#8217;s approach to AI safety is prioritizing profits over caution.<\/p>\n<h2>Conclusion<\/h2>\n<p>The debate over OpenAI&#8217;s approach to AI safety highlights the ongoing challenges and trade-offs in the development of advanced AI systems. As the industry continues to evolve, it remains to be seen whether OpenAI&#8217;s approach will prioritize safety and caution or prioritize product releases and profits.<\/p>\n\n<br \/><a href=\"https:\/\/techcrunch.com\/2025\/03\/06\/openais-ex-policy-lead-criticizes-the-company-for-rewriting-its-ai-safety-history\/\" rel=\"nofollow noopener\" target=\"_blank\">Source Link<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Criticism of OpenAI&#8217;s Approach to AI Safety A former high-profile policy researcher at OpenAI, Miles Brundage, has taken to social media to express his criticism of the company&#8217;s approach to&#8230;<\/p>\n","protected":false},"author":0,"featured_media":8749,"comment_status":"","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[47],"tags":[2801,164,660],"class_list":["post-8748","post","type-post","status-publish","format-standard","has-post-thumbnail","category-news","tag-miles-brundage","tag-openai","tag-policy"],"jetpack_featured_media_url":"https:\/\/fusionmindlabs.com\/blogs\/wp-content\/uploads\/sites\/9\/2025\/03\/GettyImages-1934195443-e.jpg","_links":{"self":[{"href":"https:\/\/fusionmindlabs.com\/blogs\/wp-json\/wp\/v2\/posts\/8748","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/fusionmindlabs.com\/blogs\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/fusionmindlabs.com\/blogs\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/fusionmindlabs.com\/blogs\/wp-json\/wp\/v2\/comments?post=8748"}],"version-history":[{"count":0,"href":"https:\/\/fusionmindlabs.com\/blogs\/wp-json\/wp\/v2\/posts\/8748\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/fusionmindlabs.com\/blogs\/wp-json\/wp\/v2\/media\/8749"}],"wp:attachment":[{"href":"https:\/\/fusionmindlabs.com\/blogs\/wp-json\/wp\/v2\/media?parent=8748"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/fusionmindlabs.com\/blogs\/wp-json\/wp\/v2\/categories?post=8748"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/fusionmindlabs.com\/blogs\/wp-json\/wp\/v2\/tags?post=8748"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}