Vancouver Television · International

When AI writes personal messages, people weigh convenience against honesty and trust

When AI writes personal messages, people weigh convenience against honesty and trust

Research cited in a San Francisco “confession” display suggests people may feel guilty using AI for personal messages even when they still do it.

The Story

A purple “confession box” set up at Alamo Square in San Francisco asked passersby to share secrets, with one sign reading: “Confession box: Everyone has an AI secret.”

Among the notes were examples of people using chatbots to draft deeply personal communications, including: “I had AI write my breakup text,” “I had ChatGPT date my boyfriend. Every text,” “I used AI to write my girlfriend’s grandmother’s 80th birthday letter,” and “I used AI to win an argument. Lol, not proud, but I won.”

Oliva Tai, an artist who has repeated the project more than a dozen times in the Bay Area, New York and Denver, said calling it a “confession” suggests people were admitting using AI makes them feel guilty, but many still use it.

As more people turn to chatbots to write emails or handle mundane tasks, the questions posed include whether using AI for personal messages crosses a line and whether it is ever acceptable to use AI for messages such as holiday cards or birthday notes, or for communications like love letters or wedding vows.

Danielle Hass, a professor at Kennesaw State University in Georgia, conducted vignette-based experiments as part of a Ph.D. in consumer behaviour, and found that people who had used AI before felt just as guilty as those who hadn’t.

Hass said, “Everyone felt guilty,” adding: “The driver of this relationship was dishonesty, that people felt like they were manipulating.”

Scott Claessens, a senior researcher at the University of Bristol in the UK, said his research suggests people who use AI are perceived as lazier, less competent and less trustworthy.

Claessens noted that people already supplement social tasks, such as using pre-written birthday cards or poems in love notes, but said the effortless way AI works turns people off because it reduces a visible signal of invested effort.

Sarah Newman, who collaborated with Tai as director of art and education at Harvard University’s metaLAB, said AI adoption is happening so quickly that norms will likely emerge about when it is appropriate to use AI.

Newman suggested using conflicted feelings as a guide, saying the test could be whether a person would feel comfortable telling their partner they used AI for wedding vows.

Newman added, “Personal messages don’t need to be perfect,” and said, “Part of what makes these messages authentic and endearing is that they are imperfect.”

Tai and Claessens said some situations could warrant using AI in personal communication, including when a partner doesn’t share a native language and in cases where people have learning disabilities such as dyslexia.

← More stories