OpenAI co-founder Ilya Sutskever has recently announced the launch of a new AI firm called Safe Superintelligence Inc. Along with former OpenAI member Daniel Levy and former Apple AI lead Daniel Gross, Sutskever aims to prioritize safety in the development of superintelligence.
The main goal of Safe Superintelligence Inc. is to create a “safe superintelligence” that will benefit humanity. The firm believes that achieving safe superintelligence is the most critical technical challenge of our time. They are assembling a team of top engineers and researchers dedicated to focusing solely on safe superintelligence.
The firm’s approach is to prioritize safety above all else, without being distracted by commercial pressures or product cycles. Safe Superintelligence Inc. plans to advance its capabilities quickly while ensuring that safety remains the primary focus.
Investors are supportive of the firm’s mission to prioritize safe development. While the amount of capital raised has not been disclosed, raising funds is not expected to be an issue for the company. Safe Superintelligence Inc. will be headquartered in Palo Alto, California, with offices in Tel Aviv, Israel.
The launch of Safe Superintelligence Inc. follows a dispute at OpenAI, where Sutskever was involved in an attempt to remove CEO Sam Altman from his position in November 2023. Safety concerns were raised at OpenAI during this time, and several employees, including Jan Leike and Gretchen Krueger, left the company citing AI safety concerns.
Despite the dispute at OpenAI, Sutskever maintains a good relationship with Altman and has not disclosed specific reasons for his departure from the company. The establishment of Safe Superintelligence Inc. brings the issue of AI safety to the forefront, emphasizing the importance of developing superintelligence in a safe and responsible manner.
The firm’s commitment to prioritizing safety in AI development sets a new standard in the industry. By focusing on safe superintelligence, Safe Superintelligence Inc. aims to contribute positively to the advancement of AI technology while ensuring that ethical considerations remain at the forefront of their work.