A group of OpenAI insiders is demanding greater transparency from AI companies about the “serious risks” posed by artificial intelligence and calling for protection for employees who voice concerns.
The open letter, posted Tuesday and signed by current and former employees from AI companies including OpenAI, highlights the strong financial incentives for AI companies to avoid effective oversight. The signatories urge AI companies to create a culture that welcomes criticism and protects those who raise concerns, especially as the law struggles to keep pace with technological advancements.
While AI companies have acknowledged the risks associated with AI, such as manipulation and the potential loss of control leading to human extinction, the group insists more should be done to educate the public about these risks and protective measures. They argue that AI companies are unlikely to share critical information voluntarily under current regulations.
The letter emphasizes the need for employees to speak out and calls for companies to refrain from enforcing disparagement agreements or retaliating against those who highlight risks. The group notes that ordinary whistleblower protections are insufficient because they focus on illegal activities, whereas many AI-related risks are not yet regulated.
This letter comes at a time when companies are rapidly integrating generative AI tools into their products, and regulators and consumers are grappling with responsible use. Many tech experts and leaders have called for a temporary pause in the AI race or for government intervention to establish a moratorium.
In response, an OpenAI spokesperson stated that the company is “proud of our track record providing the most capable and safest AI systems” and believes in a scientific approach to addressing risks. OpenAI highlighted its anonymous integrity hotline and Safety and Security Committee but Daniel Ziegler, an early machine-learning engineer at OpenAI, expressed skepticism about the company’s commitment to transparency.
Apple $AAPL CEO Tim Cook just said this about AI on Apple’s earnings call:
“We continue to feel very bullish about our opportunity in generative AI. We are making significant investments and we’re looking forward to sharing some very exciting things with our customers soon.
We…
— Evan (@StockMKTNewz) May 2, 2024
Ziegler emphasized the importance of having the right culture and processes to allow employees to speak out about their concerns and hopes the letter will encourage more professionals in the AI industry to go public with their concerns.
Meanwhile, Apple is expected to announce a partnership with OpenAI at its annual Worldwide Developer Conference to integrate generative AI into the iPhone. “We see generative AI as a key opportunity across our products,” Apple CEO Tim Cook said in a recent earnings call.
