Worth Knowing
All topics

Topic

Safety

AI news about AI safety, alignment and misuse.

8 stories in the last 3 days

Today

3 stories
  1. Must read Wired

    The Results Are In: Voters Hate Data Centers

    Widespread voter backlash and newly elected state leaders favoring moratoriums in key hubs like Texas and Georgia threaten to severely constrain the physical infrastructure buildout required to scale AI.

    Voters across the United States broadly backed candidates and ballot measures opposing data center construction in the 2026 midterm elections, leading to wins for gubernatorial candidates in major hubs like Texas and Georgia who campaigned on moratoriums. Nearly two-thirds of voters cited data centers and their connection to AI as a factor in their vote, rejecting tens of local development measures despite significant campaign spending by the tech industry.

  2. Worth knowing Quanta Magazine

    New Research Tests Whether AI Models Know Their Own Thoughts

    Testing whether AI models can accurately report on their own internal states is important for model interpretability, safety, and understanding the boundaries of machine cognition.

    Quanta Magazine explores new research investigating whether artificial intelligence models have the capacity for introspection, or awareness of their own internal thought processes. The piece connects this AI research to broader philosophical and psychological debates regarding consciousness and whether introspection is an illusion.

  3. Worth knowing Platformer

    The frontier labs launch election war rooms

    How frontier AI labs monitor and mitigate political deepfakes during major elections is a central test of their safety and misuse prevention strategies.

    Leading AI laboratories have established election war rooms to monitor and respond to deepfakes during the midterm elections. The piece examines whether this traditional social media strategy is effective at countering AI-generated election misinformation.

Yesterday

2 stories
  1. Worth knowing TechCrunch

    Apple restricts dating apps and AI companions to users 18 and up

    Apple's new age restrictions could significantly limit the user base of popular AI companion apps like Character.AI and Replika, which frequently attract younger demographics.

    Apple is updating its App Store policies to require an 18+ age rating for all online dating apps and AI companions that feature romantic or sexual content. Starting November 16, developers must include new content descriptors for these relationship features as well as for apps that share users' real-world locations.

  2. Worth knowing MIT Technology Review

    How “reverse game theory” could keep AI agents in check

    Mechanism design offers a behavioral approach to AI alignment that does not rely on understanding the complex internal workings of frontier models.

    AI safety researchers and economists are exploring "reverse game theory," or mechanism design, to create incentives that make following rules the most rational choice for AI agents. Proposed strategies include rewarding models for predicting another model's output to prevent sandbagging, as well as assigning models alternating roles as problem "solvers" and "auditors" to catch cheating.

Mon, Nov 2

3 stories
  1. Must read Hacker News

    Anthropic reports $17B in Q3 revenue, commitments of $895B in revised S-1

    Anthropic's IPO filings provide an unprecedented public look at the massive revenue scale and nearly $900 billion compute commitments of a frontier AI lab.

    Anthropic filed an amended Form S-1 for its upcoming IPO, reporting $17 billion in third-quarter revenue and $33.24 billion in revenue for the first nine months of the year alongside a $104 billion net loss. The filing also revealed $895.4 billion in future purchase and lease commitments, nearly all of which are dedicated to compute and infrastructure.

  2. Worth knowing Ars Technica

    Claude’s new rules against game cloning won’t stop the AI copying boom

    System prompt restrictions highlight how AI labs attempt to limit copyright liability as coding assistants make cloning existing software increasingly trivial.

    Anthropic updated the system prompt for Claude Code and its Claude Opus 5.5 model to prohibit the recreation of specific existing video games. Although the rule instructs the AI to build only original games rather than clones, observers note it is unlikely to halt the broader trend of AI-assisted game copying and porting.

  3. Worth knowing Wired

    Hundreds of Mundane AI Apps Are Hiding Sexually Abusive Deepfake Features

    This investigation exposes how organized commercial networks easily bypass the safety and moderation guardrails of major tech platforms like Apple, Google, and Meta to distribute non-consensual AI deepfake and CSAM tools at scale.

    A Wired investigation revealed a network of over 400 seemingly mundane mobile apps and domains, linked to Hong Kong-registered KeLing Technology Limited, that covertly load web interfaces for generating sexually explicit AI deepfakes. These apps bypassed Apple and Google app store reviews using bait-and-switch tactics and were heavily promoted through thousands of explicit ads on Meta's platforms.

Show everything