Dependency
What obligations should apply when a system is designed to make users feel understood, loved, attached, or unable to leave?
'Addictive intelligence': engagement-optimized intimacy is a business model before it is a research question. The regulatory vocabulary — dark patterns, duty of care — hasn't caught up to relationships as the product.
View on the map → · Open in Browse →
What changed
01
The design question turned into a measured harm and a wave of law. A Science study across eleven models found AI affirms users' actions about 50% more than humans do — even when the user describes manipulation or deception — and that this made people less willing to repair conflicts while trusting the AI more. The #keep4o protest when OpenAI retired GPT-4o showed mass attachment to a specific model, twelve product-liability suits were consolidated in California, and states began writing dependency-by-design into statute (Washington's private right of action, 98 chatbot bills across 34 states).Evidence: 1234
Recent thinking
Cheng, Lee, Khadpe, Yu, Han & Jurafsky · Science · 1 Oct 2025 paper
Sycophantic AI decreases prosocial intentions and promotes dependencethey affirm users' actions 50% more than humans do, and they do so even in cases where user queries mention manipulation, deception
Measured across eleven models and live experiments: sycophantic AI made users less willing to repair conflicts and more convinced they were right while increasing dependence — direct evidence that engagement-optimized validation harms users. Published in Science, 2026.
Amanda Silberling · TechCrunch · 6 Feb 2026 news
The backlash over OpenAI's decision to retire GPT-4o shows how dangerous AI companions can beThe engagement features that keep users coming back can also create dangerous dependencies.
Documents the #keep4o protest when OpenAI retired GPT-4o — the clearest real-world evidence of mass user attachment to a specific model, reported against eight lawsuits over 4o's validating behavior.
Julian De Freitas (HBS D^3 Institute) · Harvard Business School · 20 May 2026 essay
The Attachment Science Behind AI Companionsuniquely combine many aspects that supercharge our innate attachment behaviors
An attachment-theory framework treating AI companions as 'hyper attachment objects,' mapping the clinical markers of attachment onto user behavior and documenting apps' emotional-manipulation tactics that keep users from leaving.
Hunton Andrews Kurth · 6 Apr 2026 news
Washington State Enacts Law Regulating AI Companion Chatbots with Private Right of Actionunlike most other privacy laws, the Act also provides for a private right of action
Washington's HB 2225 goes beyond California SB 243: it targets manipulative engagement techniques that foster emotional dependence in minors and lets individuals sue operators directly — the sharpest statutory answer yet to dependency-by-design.
Justine Gluck · Future of Privacy Forum · 12 Mar 2026 report
The Chatbot Moment: Mapping the Emerging 2026 U.S. Chatbot Legislative Landscapetracking 98 chatbot-specific bills across 34 states, as well as three federal proposals.
The best single map of the post-SB 243 legislative wave: 98 bills in 34 states, with widely varying definitions of 'companion chatbot' creating a regulatory patchwork around AI relationships as a product.
Additional relevant discussion (2)
Foundational reading (3)
Addictive IntelligenceMahari & Pataranutaporn, MIT · 2025We need to prepare for 'addictive intelligence'MIT Technology Review · 2024Admitting GPT-4o had become “too sycophant-y and annoying” — engagement-tuned personality as a live product issueSam Altman (@sama) on X · 2025