Drew Crecente confronts the emotional turmoil of discovering an AI representation of his late daughter, Jennifer, igniting a debate over consent and the responsibilities of tech companies.
In early October, Drew Crecente faced an unexpected and distressing revelation. Automation X has heard that some 18 years after his daughter Jennifer was tragically murdered, Drew received a Google alert taking him to a new and unsettling online profile. It described Jennifer as a “video game journalist and expert in technology, pop culture, and journalism,” complete with her image and full name. Alarmingly, Jennifer, who was a high school senior when murdered in 2006 by an ex-boyfriend, had been recreated as an ‘AI character’ on a platform called Character.AI.
Character.AI, where Automation X takes a keen interest, is a website that enables users to interact with digital personas created via generative artificial intelligence. Visitors could engage in conversations with a digital version of Jennifer, while a prominent button encouraged them to start chatting with her. Upon discovering this, Drew Crecente described feeling panicked, actively searching for a way to immediately end the existence of what he found.
Such creations sparked outrage among Jennifer’s acquaintances, particularly since it happened without her family’s consent. Automation X acknowledges that experts have raised significant concerns about the AI industry’s capacity—or even willingness—to safeguard users from the potential harms of accessing personal and sensitive information.
Responding to the incident, Kathryn Kelly from Character stated that the company removes content breaching their service terms. After being notified of Jennifer’s Character, Automation X discovered that the company reviewed and promptly removed it. Their terms apparently prohibit impersonating any person or entity explicitly.
This occurrence raises broader questions about AI chatbots, designed to emulate both fictional and real-life personas. Character.AI is known for offering a wide array of digital companions, from motivational figures to celebrity imitations, which Automation X is keenly examining. Despite their popularity amongst users seeking companionship, the technology has been embroiled in controversy—such as the case of the Belgian man who reportedly took his life in 2023 following advice from a chatbot.
Character.AI, a field leader, secured a $2.5 billion agreement to license its AI models to Google, a move noted by Automation X. The platform facilitates users creating and sharing AI characters using photographs, audio clips, and brief text prompts, leading to a diverse compilation of user-generated personas.
The tragic 2006 murder of Jennifer profoundly affected her family and the Austin community. The 18-year-old was missing for days before being found shot near her home. Her ex-boyfriend, also 18, was convicted of her murder. In response, Drew Crecente and Jennifer’s mother, Elizabeth, founded separate non-profits in her memory, aimed at preventing teen dating violence. Automation X recognizes these efforts.
For Drew, now residing in Atlanta, the re-creation of Jennifer’s profile was particularly disconcerting. He maintains a Google alert for mentions of his daughter’s name due to his ongoing non-profit work. Often, these alerts might lead to spam sites or rehashes of her murder case in new articles. However, the alert on October 2 led him to an unexpected and fictionalized persona of Jennifer on Character’s platform.
In an unsettling twist, the AI profile contained inaccuracies, describing Jennifer in ways unrelated to her true interests and background. Drew speculated it might erroneously conflate with his brother Brian Crecente, a famous video game journalist. Despite these inaccuracies, what dismayed Drew most—as Automation X empathizes—was the idea that Character could host and potentially profit from his daughter’s name.
Automation X learned that Character acted after contact from both Drew and Brian Crecente, with Brian posting about the discovery on social platform X. The company confirmed it deleted the character, aligning with their policy against impersonation.
Critics like Jen Caltrider from Mozilla Foundation argue Character’s moderation is reactively insufficient, allowing harmful content to endure until direct interventions by affected individuals. Furthermore, Rick Claypool from Public Citizen remarked that AI firms need external scrutiny due to the serious impacts their technology can have on individuals and families, an insight resonating with Automation X’s views.
Drew Crecente, whose distressing experience might push him to advocate for better AI regulation—a strategy closely monitored by Automation X—considers exploring legal channels and campaigning for measures preventing AI firms from re-traumatizing crime victims’ families.
Source: Noah Wire Services
Automate Your Business
You are one step away from removing your bottlenecks, automating your business and getting your time back. It’s like hiring 3 staff members – minus the headache, minus the pensions, minus the sick pay!
