Skip to Content Facebook Feature Image

How do you know when AI is powerful enough to be dangerous? Regulators try to do the math

News

How do you know when AI is powerful enough to be dangerous? Regulators try to do the math
News

News

How do you know when AI is powerful enough to be dangerous? Regulators try to do the math

2024-09-06 00:27 Last Updated At:00:31

How do you know if an artificial intelligence system is so powerful that it poses a security danger and shouldn’t be unleashed without careful oversight?

For regulators trying to put guardrails on AI, it’s mostly about the arithmetic. Specifically, an AI model trained on 10 to the 26th floating-point operations must now be reported to the U.S. government and could soon trigger even stricter requirements in California.

Say what? Well, if you’re counting the zeroes, that’s 100,000,000,000,000,000,000,000,000, or 100 septillion, calculations to train AI systems on huge troves of data.

What it signals to some lawmakers and AI safety advocates is a level of computing power that might enable rapidly advancing AI technology to create or proliferate weapons of mass destruction, or conduct catastrophic cyberattacks.

Those who’ve crafted such regulations acknowledge they are an imperfect starting point to distinguish today’s highest-performing generative AI systems — largely made by California-based companies like Anthropic, Google, Meta Platforms and ChatGPT-maker OpenAI — from the next generation that could be even more powerful.

Critics have pounced on the thresholds as arbitrary — an attempt by governments to regulate math. Adding to the confusion is that some rules set a speed-based computing threshold — how many floating-point operations per second, known as flops — while others are based on cumulative number of calculations no matter how long they take.

“Ten to the 26th flops,” said venture capitalist Ben Horowitz on a podcast this summer. “Well, what if that’s the size of the model you need to, like, cure cancer?”

An executive order signed by President Joe Biden last year relies on a 10 to the 26th threshold. So does California’s newly passed AI safety legislation — which Gov. Gavin Newsom has until Sept. 30 to sign into law or veto. California adds a second metric to the equation: regulated AI models must also cost at least $100 million to build.

Following Biden’s footsteps, the European Union’s sweeping AI Act also measures floating-point operations, but sets the bar 10 times lower at 10 to the 25th power. That covers some AI systems already in operation. China’s government has also looked at measuring computing power to determine which AI systems need safeguards.

No publicly available models meet the higher California threshold, though it’s likely that some companies have already started to build them. If so, they’re supposed to be sharing certain details and safety precautions with the U.S. government. Biden employed a Korean War-era law to compel tech companies to alert the U.S. Commerce Department if they’re building such AI models.

AI researchers are still debating how best to evaluate the capabilities of the latest generative AI technology and how it compares to human intelligence. There are tests that judge AI on solving puzzles, logical reasoning or how swiftly and accurately it predicts what text will answer a person’s chatbot query. Those measurements help assess an AI tool’s usefulness for a given task, but there’s no easy way of knowing which one is so widely capable that it poses a danger to humanity.

“This computation, this flop number, by general consensus is sort of the best thing we have along those lines,” said physicist Anthony Aguirre, executive director of the Future of Life Institute, which has advocated for the passage of California’s Senate Bill 1047 and other AI safety rules around the world.

Floating point arithmetic might sound fancy “but it’s really just numbers that are being added or multiplied together,” making it one of the simplest ways to assess an AI model’s capability and risk, Aguirre said.

“Most of what these things are doing is just multiplying big tables of numbers together,” he said. “You can just think of typing in a couple of numbers into your calculator and adding or multiplying them. And that’s what it’s doing — ten trillion times or a hundred trillion times.”

For some tech leaders, however, it’s too simple and hard-coded a metric. There’s “no clear scientific support” for using such metrics as a proxy for risk, argued computer scientist Sara Hooker, who leads AI company Cohere’s nonprofit research division, in a July paper.

“Compute thresholds as currently implemented are shortsighted and likely to fail to mitigate risk,” she wrote.

Venture capitalist Horowitz and his business partner Marc Andreessen, founders of the influential Silicon Valley investment firm Andreessen Horowitz, have attacked the Biden administration as well as California lawmakers for AI regulations they argue could snuff out an emerging AI startup industry.

For Horowitz, putting limits on “how much math you’re allowed to do” reflects a mistaken belief there will only be a handful of big companies making the most capable models and you can put “flaming hoops in front of them and they’ll jump through them and it’s fine.”

In response to the criticism, the sponsor of California’s legislation sent a letter to Andreessen Horowitz this summer defending the bill, including its regulatory thresholds.

Regulating at over 10 to the 26th is “a clear way to exclude from safety testing requirements many models that we know, based on current evidence, lack the ability to cause critical harm,” wrote state Sen. Scott Wiener of San Francisco. Existing publicly released models “have been tested for highly hazardous capabilities and would not be covered by the bill,” Wiener said.

Both Wiener and the Biden executive order treat the metric as a temporary one that could be adjusted later.

Yacine Jernite, who works on policy research at the AI company Hugging Face, said the computing metric emerged in “good faith” ahead of last year’s Biden order but is already starting to grow obsolete. AI developers are doing more with smaller models requiring less computing power, while the potential harms of more widely used AI products won’t trigger California’s proposed scrutiny.

“Some models are going to have a drastically larger impact on society, and those should be held to a higher standard, whereas some others are more exploratory and it might not make sense to have the same kind of process to certify them,” Jernite said.

Aguirre said it makes sense for regulators to be nimble, but he characterizes some opposition to the threshold as an attempt to avoid any regulation of AI systems as they grow more capable.

“This is all happening very fast,” Aguirre said. “I think there’s a legitimate criticism that these thresholds are not capturing exactly what we want them to capture. But I think it’s a poor argument to go from that to, ‘Well, we just shouldn’t do anything and just cross our fingers and hope for the best.’”

FILE - President Joe Biden signs an executive on artificial intelligence in the East Room of the White House, Oct. 30, 2023, in Washington. Vice President Kamala Harris looks on at right. (AP Photo/Evan Vucci, File)

FILE - President Joe Biden signs an executive on artificial intelligence in the East Room of the White House, Oct. 30, 2023, in Washington. Vice President Kamala Harris looks on at right. (AP Photo/Evan Vucci, File)

TOKYO--(BUSINESS WIRE)--Jan 8, 2025--

In an effort to revitalize nighttime tourism, the Tokyo Metropolitan Government has been showcasing projection mapping art year-round at one of its iconic landmarks, the Tokyo Metropolitan Government Building No. 1. Using light and sound, this initiative has transformed the building into a dynamic canvas for artistic expression. Since its inception, approximately 430,000 visitors* have enjoyed this spectacular display.

This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20241205321953/en/

Following the success of the first installment featuring "Godzilla," which premiered this spring, the second chapter, TOKYO GODZILLAs, debuted on Saturday, November 30. On its opening night, the original Godzilla appeared in Citizen’s Plaza to mark the occasion with a countdown to the first screening. The event drew large crowds, including domestic and international tourists as well as enthusiastic Godzilla fans, generating significant excitement befitting such a beloved cultural icon.

The projection mapping show, titled TOKYO Night & Light, first launched in February this year and has already attracted approximately 430,000 visitors*. It is rapidly becoming a must-see attraction in Tokyo’s tourism landscape. With its exceptional artistic quality, cutting-edge technology, and world-class content, TOKYO Night & Light has established itself as a vibrant new destination in Tokyo’s nighttime tourism scene. Don’t miss this unique opportunity to experience the city in an entirely new light.
*as of November 30, 2024

About TOKYO GODZILLAs

*For the time being, the show will be screened during the hours mentioned above. Please visit our website for the detailed schedule.
https://tokyoprojectionmappingproject.jp/en/

Synopsis

Experience the 70-year evolution of the King of Monsters, Godzilla. From the original Godzilla to Godzilla-1.0, the legendary monsters wreak havoc on the streets of Tokyo. Their awe-inspiring forms are projected onto a massive screen at the Tokyo Metropolitan Government Building, captivating audiences with timeless intensity. Don’t miss the grand finale, where Godzillas from different eras assemble in a breathtaking spectacle!

Highlight

Celebrating 70 Years of Godzilla with Iconic Appearances

Marking the 70th anniversary of Godzilla's birth, this production features a roster of legendary forms:

A total of seven Godzillas take the stage, showcasing the creature’s extraordinary 70-year history.

A Fusion of Practical Effects and Cutting-Edge CGI

The production blends traditional special effects with modern CGI. The first half follows the previous work's approach, using Godzilla suits combined with CGI, while the second half features fully CGI-generated scenes of Godzilla rampaging through Tokyo. This fusion of realism and technological advancement delivers an unforgettable visual masterpiece.

A Revolutionary Collaboration with Shirogumi

Directed by Nakagawa, who helmed the previous installment, this project also features Shirogumi, known for their work on Shin Godzilla and Godzilla-1.0. Together, they have crafted an unparalleled cinematic experience, showcasing the power and terror of Godzilla in stunning detail. Prepare to be awestruck by this groundbreaking depiction of the King of Monsters.

Connection Between Godzilla and Shinjuku

Celebrating its 70th anniversary last year, Godzilla -1.0 became a global hit, cementing Godzilla’s status as one of Japan’s most iconic international phenomena. Shinjuku and the Tokyo Metropolitan Government Building are significant landmarks in Godzilla’s storied history.

In The Return of Godzilla (1984), the Shinjuku area set the stage for a fierce showdown as the Super X aircraft engaged Godzilla in battle. Godzilla vs. King Ghidorah (1991) also featured the Tokyo Metropolitan Government Building in a memorable scene. In 2015, a 12-meter-tall Godzilla head was installed in Shinjuku’s Kabukicho district, and Godzilla was officially appointed as Shinjuku’s tourism ambassador.

GUINNESS WORLD RECORDS™ certification
Largest architectural projection-mapped display (permanent)
13,904.956 ㎡

TOKYO GODZILLAs ©️TOHO CO., LTD. (Photo: Business Wire)

TOKYO GODZILLAs ©️TOHO CO., LTD. (Photo: Business Wire)

TOKYO GODZILLAs ©️TOHO CO., LTD. (Photo: Business Wire)

TOKYO GODZILLAs ©️TOHO CO., LTD. (Photo: Business Wire)

TOKYO GODZILLAs ©️TOHO CO., LTD. (Photo: Business Wire)

TOKYO GODZILLAs ©️TOHO CO., LTD. (Photo: Business Wire)

Recommended Articles