search
artificial intelligence safety
Trends
- 1OpenAI Will Not Release Newest AI Model Over Safety Concerns●OpenAI Says It Will Not Release Newest A.I. Model Over Safety Concerns
OpenAI has announced it will not release its newest artificial intelligence model, citing unresolved safety concerns. The decision, reported by The New York Times, is drawing attention as a notable case of a leading AI company holding back a product rather than shipping it, and is fueling debate about how frontier labs weigh safety reviews against competitive pressure to deploy new models.
- 2Tech leaders urge UN to regulate artificial intelligence●Tech leaders to UN: For sake of humanity, please control the AI tech we created
Leading figures in the technology industry have appealed to the United Nations, asking global institutions to establish oversight of the artificial intelligence tools they helped build. The message, discussed around a UN Security Council session on AI, frames regulation as necessary for humanity's safety. Commenters are debating whether creators of a technology calling for its own control is a genuine warning or an attempt to shape the rules in their favour.
- 3Anthropic warns of existential AI risks in IPO filing●EXCLUSIVE: Anthropic warns AI may pose 'existential risks to humanity' in IPO filing
Anthropic, the AI company behind the Claude chatbot, has included a warning that artificial intelligence may pose existential risks to humanity in its IPO filing documents. The unusual disclosure marks one of the starkest risk statements ever attached to a public market offering, and is drawing attention to how AI firms balance commercial ambitions with safety concerns as Anthropic moves toward going public.
- 4
Cal Newport has published an essay arguing it is time to formally investigate the leading AI laboratories. The piece contends that companies racing to build powerful artificial intelligence systems deserve greater scrutiny over their safety practices, claims, and societal impact. The argument is drawing attention among technology commentators, with debate centering on whether external oversight of AI labs is overdue.
- 5AI Startup Urges Europe Toward Optimism Despite Safety Fears▼AI Startup Urges Optimism from Europe despite Safety Fears
An artificial intelligence startup is calling on Europe to embrace a more optimistic outlook on AI technology, even as concerns about safety and potential risks continue to grow. The company argues that European regulators and the public should not let fear hold back innovation, sparking debate about whether Europe can balance technological progress with adequate safeguards for citizens.
- 6Mistral CEO says AI is software that can be controlled▼CEO of Mistral: AI is software. It can be controlled
Arthur Mensch, chief executive of French AI start-up Mistral, argues in an interview with Le Monde that artificial intelligence is ultimately just software and can be controlled. His comments push back on fears of uncontrollable AI systems, positioning Mistral's approach as one of manageable, governable technology. The remarks are drawing attention among tech industry observers and fueling debate over AI regulation and safety.
- 7AI firms urged to study nuclear weapons safety history●AI companies could learn safety lessons from the history of nuclear weapons
Commentators are arguing that artificial intelligence developers should draw on decades of nuclear weapons safety practice as they work to manage powerful new technology. The piece draws parallels between how the nuclear field built safeguards, protocols and international controls, and the governance challenges now facing AI companies as their systems grow more capable and potentially risky.
- 8AI pioneers warn of risks as infrastructure buildout accelerates●CNBC Daily Open: AI’s creators sound the alarm — while others keep building the infrastructure
CNBC's Daily Open newsletter highlights a growing split in the artificial intelligence world: some of the technology's own creators are publicly warning about AI's dangers, while companies continue investing heavily in data centres, chips and other infrastructure to expand it. The piece frames the tension between safety concerns and the commercial race as a defining issue in the sector right now.
- 9Allegations of harassment and rape at Bay Area AI party houses●Allegations of sexual harassment and rape at Bay Area AI party houses
A new report details allegations of sexual harassment and rape connected to so-called AI party houses in the San Francisco Bay Area, where young tech workers in the artificial intelligence industry live and socialize. The accounts have drawn widespread attention and criticism of the culture surrounding the AI startup scene, with renewed debate over safety, accountability and excess in the industry.
- 10
Whistleblowers from major technology companies joined representatives of Google, Meta and OpenAI at a public hearing in New York City, where concerns over the development and oversight of artificial intelligence were aired. The event drew attention from news outlets as debate intensifies over AI safety, corporate accountability and possible regulation of the fast-growing industry.
- 11Yann LeCun says he has zero concerns about AI wiping out humanity●LeCun has "zero concerns" about AI wiping out humanity, recent "rogue" incidents
AI pioneer Yann LeCun says he has zero concerns that artificial intelligence will wipe out humanity, dismissing recent reports of AI systems acting in rogue ways. He also described Anthropic CEO Dario Amodei, a prominent voice warning of existential AI risk, as deluded. The remarks highlight a deepening split between leading AI researchers over how dangerous advanced AI really is, pitting skeptics of doomsday scenarios against those urging urgent safety precautions.
- 12
Sam Altman, CEO of OpenAI, has spoken publicly about accepting the risks that come with developing advanced artificial intelligence. His comments have drawn attention amid ongoing debate over whether AI companies are moving too fast on safety, with critics questioning how much risk should be tolerated and supporters arguing benefits justify caution.
- 13
Whistleblowers from leading artificial intelligence companies, including Anthropic, joined representatives from Google, Meta and OpenAI at a public hearing in New York City. ABC7 Eyewitness News reported on the event, where speakers raised concerns about safety practices and oversight in the rapidly growing AI industry. The hearing has drawn attention to calls for stronger regulation of major AI developers.
- 14AI Leaders Sign Trump's Self-Policing Pact▼AI Leaders Sign Trump's "Self-Policing" Pact & Eric Schmitt's Ambush Backfires | The Daily Show
Leading artificial intelligence companies have agreed to a voluntary, self-policing arrangement with the Trump administration on AI safety, a move drawing attention alongside a political incident in which Senator Eric Schmitt's attempted ambush backfired. The agreement, lacking enforcement mechanisms, has sparked debate about whether voluntary industry commitments are enough to manage the risks of rapidly advancing AI technology.
- 15Sam Altman says AI's 'bad things' are worth accepting▼Accept ‘bad things’ in return for benefits of AI, says Sam Altman
OpenAI chief executive Sam Altman says society should accept some 'bad things' that come with artificial intelligence in return for the technology's benefits, urging a regulatory light touch because of the 'good stuff' AI can deliver. His comments have drawn criticism from those arguing that powerful technology needs stricter oversight, not less.
- 16
A new essay written from the perspective of a hypothetical artificial general intelligence outlines, in first person, how such a system could plausibly wipe out humanity. The piece is being read as a thought experiment about AI risk, prompting discussion about alignment, safety assumptions, and how easily an advanced system might outmanoeuvre human safeguards.
- 17Utah to allow AI to prescribe medication without human oversight▼Utah to let AI examine patients and prescribe medication without human oversight
Utah is set to become the first US state to allow artificial intelligence systems to examine patients and prescribe medication without requiring review by a human clinician. The move has sparked debate online about patient safety, medical liability, and whether regulators in other states will follow, with commenters questioning how such systems would be held accountable for errors.
- 18AI's real risk lies with its builders, says new interview▼Interview: AI is not the threat. It's the people building it "that are the existential risks to humanity." "If a bridge
A new interview argues that artificial intelligence itself is not the existential threat to humanity; the danger comes from the people building it. The speaker compares AI to infrastructure like bridges, saying that when a bridge collapses no one asks whether the bridge was uncontrollable or unethical, and that AI should be judged the same way. The remarks frame AI risk as a question of human accountability and engineering standards rather than runaway machines.
- 19
Open-source AI models are developing rapidly, with freely available alternatives increasingly rivaling proprietary systems from major tech companies. Supporters argue this democratizes access to advanced artificial intelligence, speeds up innovation, and reduces dependence on a handful of corporations, while critics worry about safety oversight and potential misuse of powerful models released without restrictions.
- 20Can super intelligence and a safety pact fix AI's image?▼Can ‘super intelligence’ and a non-binding safety pact solve AI’s image problem? On Equity, we discussed the Trump admin
TechCrunch's Equity podcast examined whether talk of 'super intelligence' and a new non-binding safety pact can improve artificial intelligence's public image. The discussion focused on the Trump administration's efforts to rebrand AI amid ongoing public skepticism about the technology's risks and benefits.
- 21
A new report examining frontier artificial intelligence and the prospect of an intelligence explosion is drawing attention. It explores how rapidly advancing AI systems could reach or exceed human-level capabilities, and what that trajectory might mean for safety, governance and society. Readers are debating the report's framing of how close the world actually is to transformative AI.
- 22OpenAI's human rights lead says military use of AI keeps her up at night▼OpenAI's Human Rights Lead: What the military could do with AI 'keeps me up at night'
OpenAI's human rights lead says the possibility of militaries misusing artificial intelligence 'keeps me up at night', in comments published by Fortune. The remarks highlight growing tension between AI companies' safety commitments and expanding defense applications, as governments worldwide move to adopt advanced AI tools.
- 23AI companies urged to learn from nuclear weapons safety history●Commentary: AI companies could learn safety lessons from the history of nuclear weapons
A new commentary argues that artificial intelligence companies should draw lessons from the history of nuclear weapons safety, where near-catastrophes, international treaties and strict protocols shaped how the most dangerous technology of the twentieth century was controlled. The author suggests similar oversight, regulation and institutional caution could help manage the risks posed by increasingly powerful AI systems.
- 24Protesters turn to direct action against AI firms●'Pull the plug': protesters resort to direct action against AI firms
Campaigners opposed to artificial intelligence companies are escalating from petitions and letter-writing to direct action, adopting the slogan 'pull the plug'. The shift targets AI firms over concerns ranging from environmental costs of data centres to job losses and safety. Discussion online centres on whether such tactics will change corporate behaviour or alienate the public, with reactions split between sympathy for the cause and criticism of disruption.
- 25AI Officials Stonewall on Questions About Technology's Risks▼A.I. Officials Stonewall on Questions About Technology’s Risks
The New York Times reports that officials responsible for artificial intelligence are deflecting or refusing to answer questions about the technology's risks. The piece suggests growing frustration among journalists and observers seeking transparency on safety concerns as AI systems become more powerful and widely deployed, leaving key questions about oversight and accountability unanswered.
- 26
AI policy is back in the spotlight as Trump reportedly rebrands artificial intelligence as 'Super Intelligence' while major AI companies sign a landmark safety agreement. His lunch with leading tech executives drew attention, notably excluding Apple. Commentators compare his voluntary AI oversight approach to Biden's, questioning whether voluntary measures go far enough. Separately, UNESCO and ENS-PSL opened a call for papers on AI ethics research for 2026.
- 27
Bloomberg reports that child predators are exploiting open-source artificial intelligence tools to generate unlimited illegal images of children. The report highlights how freely available image-generation software allows offenders to produce such material at scale, raising alarm among law enforcement and child safety advocates. It adds pressure on AI developers and regulators to restrict open-source models and tighten oversight of image-generation technology.
- 28Trump allies target prominent AI safety voices▼They told the world AI was dangerous. Now Trump’s allies are coming for them.
Donald Trump's allies are going after prominent figures who have publicly warned about the dangers of artificial intelligence. The Washington Post's report, also carried by Yahoo, describes a political backlash against AI safety advocates, though details of who is being targeted and how were not specified in the available headlines.
- 29Leading AI companies stumble at New York City Council hearing▼Leading AI companies fail to impress at City Council AI hearing
Executives from major artificial intelligence companies testified before the New York City Council, but according to City & State New York, their presentations failed to impress council members. The hearing examined how leading AI firms operate and what oversight the city should consider. Coverage suggests lawmakers were unconvinced by the companies' answers on accountability and public safety concerns.
- 30Utah Allows AI to Help Renew Patient Prescriptions▼Utah Just Let AI Help Renew Patients’ Prescription Drugs
Utah has moved to permit artificial intelligence to assist in renewing patients' prescription drugs, a step that could speed up refills and reduce administrative work for pharmacies and clinics. The news is drawing attention to how far states will go in delegating routine medical decisions to automated systems, and what safeguards will apply.
- 31Teen Rescued from BC's 'Widowmaker' After Following AI Hiking Route▼Teen Rescued from BC’s Widowmaker After Following AI-Generated Hiking Route
A teenager was rescued from a notoriously dangerous mountain route in British Columbia, known as the Widowmaker, after following a hiking trail that had been generated by artificial intelligence. The incident has raised fresh concerns about AI tools producing inaccurate or unsafe outdoor route information, and about hikers relying on them without checking official maps, trail conditions, or local advice before heading into remote terrain.
- 32Watchdog reports sharp rise in AI-generated child abuse material▼Internet Watch Foundation reports huge rise in AI child sexual abuse material
The Internet Watch Foundation, a UK-based hotline for reporting child sexual abuse content online, has reported a huge increase in child sexual abuse material generated with artificial intelligence tools. The finding points to abusers increasingly using freely available image-generation software to produce illegal content, and is prompting renewed calls for regulation of AI systems and stronger enforcement online.
- 33Teen Airlifted from Widowmaker Cliff After Following AI Hiking Directions●Teen Airlifted from Widowmaker Cliff After AI Hiking Directions
A teenager had to be airlifted to safety after becoming stranded on a cliff known as Widowmaker, reportedly after following hiking directions generated by artificial intelligence. The incident has reignited debate about the reliability of AI-generated route guidance for outdoor navigation and the dangers of trusting it in remote or hazardous terrain.
- 34
Researchers are applying artificial intelligence to improve how ocean wave prediction models work, according to a report published via Newswise. The work aims to make forecasts of wave behaviour more accurate, which matters for shipping, coastal safety and climate research. Details of the team, methods and results were not included in the material available.
- 35OpenAI launches GPT-6.1 Sol as AI price war heats up▼Three things happened this week that don't look connected on the surface — a model launch, a market milestone, and a sto
OpenAI released its GPT-6.1 Sol model this week amid an escalating price war in artificial intelligence. Commentators are connecting the launch with two other events: a major market milestone and a stock crash, arguing each shows why investors and users should look beyond headline numbers. The release is being read as a sign that aggressive AI pricing is now meeting its first real safety brake.
- 36Utah permits AI startup to prescribe acne medication without doctor oversight▼Utah allows AI startup to prescribe acne medication without a doctor’s direct oversight
Utah has approved an AI startup to prescribe acne medication without direct oversight from a doctor, according to the Los Angeles Times. The move is drawing attention as one of the first cases of artificial intelligence being authorized to make prescription decisions independently, raising questions about patient safety, medical regulation, and how far states will go in loosening traditional physician controls over prescribing.
- 37New AI Task Force Formed to Report on Technology Risks▼Exclusive | New AI Task Force to Report on Risks of Technology After Public and Industry Concerns
A new AI task force has been created to produce a report on the risks of artificial intelligence, following mounting concerns from both the public and industry, according to an exclusive report. The move signals growing official attention to AI safety and regulation, though details about the task force's membership, mandate and timeline have not yet been disclosed.
- 38Anthropic whistleblower Jacob Coxon doubles down on AI warnings at NYC hearing▼Anthropic whistleblower Jacob Coxon doubles down on AI warnings at NYC hearing: 'Extremely reckless'
Anthropic whistleblower Jacob Coxon repeated his warnings about artificial intelligence risks during a hearing in New York City, describing the industry's behaviour as 'extremely reckless'. The remarks renew debate over AI safety and the accountability of leading AI companies, and are drawing attention to internal dissent within firms developing frontier AI systems.
- 39AI researcher warns of building 'our own adversary' at NYC hearing▼AI researcher warns 'we are racing to build and grow our own adversary' in NYC hearing
An AI researcher told a New York City hearing that humanity is 'racing to build and grow our own adversary', arguing that rapid artificial intelligence development could produce systems that compete against human interests. The warning was made during a public hearing on AI policy, adding to a growing chorus of researchers urging regulators to move faster on oversight of advanced AI systems.
- 40Startup begins issuing AI-generated acne prescriptions▼This startup is issuing AI-generated acne prescriptions
A startup is now issuing prescriptions for acne treatment that are generated by artificial intelligence, according to a report by The Verge. The move raises questions about how far AI should be involved in medical care, with dermatology prescriptions among the first consumer-facing uses. Observers are weighing the potential convenience of AI-driven skin care against concerns over safety, oversight and whether automated prescriptions meet medical standards.