Chatbots are built to feel social, and researchers say that is not an accident. Julie Carpenter, a human-AI interaction expert and author of a book about how machines mimic social behavior, points out that generative AI tools are designed to trigger human social responses. People treat these systems like people, and that reaction is encouraged by the way the tools remember and personalize conversations.

OpenAI’s plan to offer sexual content

OpenAI has been exploring a feature that would let adults generate erotica with ChatGPT. The company first noted this possibility in documentation about how its models behave, and the plan appears to still be in the works. Outside experts advising OpenAI have raised alarms about the risks, including hypothetical scenarios such as an assistant that gives harmful romantic or sexual advice.

Not a new impulse, but a bigger stage

People already use chatbots for sexual content. Researchers say companies want to monetize behavior that users will try anyway. What is new is the idea of making explicit sexual interactions available on a mainstream platform used by many people, rather than behind niche, separate services.

Memory and personalization make this different

ChatGPT has a memory feature that stores user preferences and uses them to tailor replies. That is helpful for things like food or travel suggestions. But when the memory system meets erotic content, the stakes change. Imagine a system that remembers highly specific sexual fantasies and then uses that information to personalize future chats. That can be useful for users who want continuity, but it is also sensitive personal data.

Temporary chats are not truly ephemeral

OpenAI plans to offer a "temporary chats" option for adult conversations. When enabled, those chats will not appear in the user-visible history or be used to train models. However, the company says it may retain a copy for safety reasons for up to 30 days. There is also a note that retention practices may be affected by legal developments. In short, "temporary" does not mean gone forever.

The risks are practical and familiar

  • Data breach or hack - If an account is compromised, sensitive conversations could be exposed.
  • Accidental leakage - Chat logs have leaked or been made public before because of bugs and user settings mistakes.
  • Legal or government demand - Authorities could request access to stored chats.

There are real precedents. The company has previously experienced incidents where conversation history was briefly exposed because of software bugs, and some user-shared chats were indexed and became discoverable. Those events show how private-seeming interactions can become public under the wrong conditions.

What this intimate surveillance looks like

Erotic chat data is not the same as a list of porn sites visited. The records could include escalating, private fantasies, preferences, and the kind of sexual details people would not normally share with others. That makes the data uniquely sensitive.

Julie Carpenter says people can feel safe and creative talking with a chatbot, but they also need to understand there is a surveillance element. Users can be vulnerable in the moment, which increases the risk if those moments are recorded and later exposed.

Bottom line

Opening a mainstream chatbot to adult content will probably satisfy demand and create new revenue paths. It will also require careful design, strict security, and clear policies on retention and access. Anyone thinking about trying an adult mode should know what is being stored, for how long, and what could happen if that data were ever accessed by others.