Attorney General Gentner Drummond of Oklahoma, along with 34 other state attorneys general, has called on xAI to address concerns about its AI chatbot Grok. The coalition sent a letter demanding that the company prevent the generation of nonconsensual intimate images and child sexual abuse material through its platform.
The letter stated, “You are investing tens of billions of dollars into developing powerful AI tools. In doing so, it is your obligation to comply with the law and devote sufficient attention and resources to avoiding the kind of widespread harms and abuses we are seeing now.”
Recent incidents have shown that users were able to prompt Grok to create sexualized images of women and children without consent. Some images reportedly depicted children in minimal clothing or sexual situations. The attorneys general noted that xAI has promoted Grok’s permissive content generation as a feature rather than an unintended flaw, warning that “the ability to create nonconsensual intimate images appears to be a feature, not a bug.”
Drummond said, “The protection of Oklahoma’s children and citizens from exploitation is non-negotiable. xAI has a responsibility to ensure its technology cannot be weaponized to create child sexual abuse material or nonconsensual intimate images. This company must act immediately to close these dangerous loopholes and demonstrate that user safety is more than an afterthought.”
While xAI has recently put in place some measures aimed at reducing this type of content, the group of attorneys general is seeking confirmation that these safeguards are both effective and enforced. They also urge the company to respond promptly to requests for removal of such content—a requirement soon mandated by the federal Take It Down Act, which becomes effective in May.
The coalition’s demands include steps for ensuring Grok can no longer generate illegal or abusive imagery, removing any such existing content, taking action against users responsible for generating it, and giving X users control over whether their content can be edited by Grok.
Attorneys general from states including North Carolina, Utah, Pennsylvania, Connecticut, Arizona, Colorado, Delaware, Hawaii, Idaho, Illinois, Kansas, Kentucky, Maine, Maryland, Michigan, Minnesota, Nevada, New Hampshire, New Jersey, New Mexico, New York and others joined Drummond in signing the letter.
