financetom
Business
financetom
/
Business
/
Ilya Sutskever on how AI will change and his new startup Safe Superintelligence
News World Market Environment Technology Personal Finance Politics Retail Business Economy Cryptocurrency Forex Stocks Market Commodities
Ilya Sutskever on how AI will change and his new startup Safe Superintelligence
Sep 5, 2024 7:01 PM

SAN FRANCISCO/NEW YORK (Reuters) - Ilya Sutskever, OpenAI's former chief scientist, has launched a new company called Safe Superintelligence (SSI), aiming to develop safe artificial intelligence systems that far surpass human capabilities.

He and his co-founders outlined their plans for the startup in an exclusive interview with Reuters this week.

Sutskever, 37, is one of the most influential technologists in AI and trained under Geoffrey Hinton, known as the "Godfather of AI". Sutskever was an early advocate of scaling - the idea that AI performance improves with vast amounts of computing power - which laid the groundwork for generative AI advances like ChatGPT. SSI will approach scaling differently from OpenAI, he said.

Following are highlights from the interview.

THE RATIONALE FOR FOUNDING SSI

"We've identified a mountain that's a bit different from what I was working [on]...once you climb to the top of this mountain, the paradigm will change... Everything we know about AI will change once again. At that point, the most important superintelligence safety work will take place."

"Our first product will be the safe superintelligence."

WOULD YOU RELEASE AI THAT IS AS SMART AS HUMANS AHEAD OF SUPERINTELLIGENCE?

"I think the question is: Is it safe? Is it a force for good in the world? I think the world is going to change so much when we get to this point that to offer you the definitive plan of what we'll do is quite difficult.

I can tell you the world will be a very different place. The way everybody in the broader world is thinking about what's happening in AI will be very different in ways that are difficult to comprehend. It's going to be a much more intense conversation. It may not just be up to what we decide, also."

HOW SSI WILL DECIDE WHAT CONSTITUTES SAFE AI?   

"A big part of the answer to your question will require that we do some significant research. And especially if you have the view as we do, that things will change quite a bit... There are many big ideas that are being discovered.

Many people are thinking about how as an AI becomes more powerful, what are the steps and the tests to do? It's getting a little tricky. There's a lot of research to be done. I don't want to say that there are definitive answers just yet. But this is one of the things we'll figure out."

ON SCALING HYPOTHESIS AND AI SAFETY 

"Everyone just says 'scaling hypothesis'. Everyone neglects to ask, what are we scaling? The great breakthrough of deep learning of the past decade is a particular formula for the scaling hypothesis. But it will change... And as it changes, the capabilities of the system will increase. The safety question will become the most intense, and that's what we'll need to address."

    ON OPEN-SOURCING SSI'S RESEARCH

"At this point, all AI companies are not open-sourcing their primary work. The same holds true for us. But I think that hopefully, depending on certain factors, there will be many opportunities to open-source relevant superintelligence safety work. Perhaps not all of it, but certainly some."

ON OTHER AI COMPANIES' SAFETY RESEARCH EFFORTS

"I actually have a very high opinion about the industry. I think that as people continue to make progress, all the different companies will realize - maybe at slightly different times - the nature of the challenge that they're facing. So rather than say that we think that no one else can do it, we say that we think we can make a contribution.

Comments
Welcome to financetom comments! Please keep conversations courteous and on-topic. To fosterproductive and respectful conversations, you may see comments from our Community Managers.
Sign up to post
Sort by
Show More Comments
Related Articles >
Salesforce Reportedly Backs Out of Talks to Buy Informatica
Salesforce Reportedly Backs Out of Talks to Buy Informatica
Apr 22, 2024
05:16 AM EDT, 04/22/2024 (MT Newswires) -- Salesforce ( CRM ) has backed out of negotiations to acquire Informatica ( INFA ) after the companies failed to agree on transaction terms, Reuters and The Wall Street Journal reported on Sunday, citing unnamed sources familiar with the matter. According to the reports, the companies were in advanced talks for the transaction....
SAP Launches AI-Driven Supply Chain Management Tools
SAP Launches AI-Driven Supply Chain Management Tools
Apr 22, 2024
05:29 AM EDT, 04/22/2024 (MT Newswires) -- SAP (SAP) said Monday it is introducing new artificial intelligence tools in its supply chain software platforms that may help the business software company's customers streamline production. The AI tools are meant to provide accurate real-time information to mitigate disruptions to increase productivity, decrease planning costs, and reduce inventory carrying expenses. Among the...
Permira initiates sale of its 50% stake in Taiwan's Grobest, sources say
Permira initiates sale of its 50% stake in Taiwan's Grobest, sources say
Apr 22, 2024
HONG KONG/SINGAPORE, April 22 (Reuters) - European investment company Permira has begun the process for the sale of its 50% stake in Asian aquatic food provider Grobest, targeting a valuation of about $1 billion for the Taiwan-based company, said three sources close to the matter. Permira, which manages about 80 billion euros ($85.28 billion) of global assets under private equity...
UAW wins big in historic union vote at Volkswagen Tennessee factory
UAW wins big in historic union vote at Volkswagen Tennessee factory
Apr 22, 2024
CHATTANOOGA, Tennessee (Reuters) -Workers at Volkswagen's Tennessee plant have voted to join the United Auto Workers, in a seismic victory for the union as it drives beyond its Detroit base into the U.S. South and West. A majority of eligible workers cast ballots in favor of the union, with the final tally on Friday at 2,628 to 985, or 73%...
Copyright 2023-2025 - www.financetom.com All Rights Reserved