Lowestoft and Beccles MP Jess Asato has launched a High Court claim against Elon Musk's xAI company, which is the creator of the Grok artificial intelligence chatbot.
The Labour MP says the legal action is intended to pursue accountability over the chatbot's ability to generate sexualised images of women and children.
In a statement, she said safeguards could have been built into the technology but were not implemented.
She said: "The ability of Grok to strip women and children was not an accident. Safeguards could have been built into the chatbot, but its creators chose not to."
Jess Asato added that the High Court claim is aimed at holding those responsible for the technology accountable for those decisions.
The case focuses on concerns about AI-generated imagery and the safeguards used by developers to prevent misuse of the technology.
The move has received backing from Prime Minister Sir Keir Starmer, who has publicly supported the legal action.
As the MP for Lowestoft, Ms Asato said she believes stronger accountability is needed when developing and deploying artificial intelligence tools capable of generating realistic images.
Further details of the legal proceedings are expected to emerge as the case progresses through the courts.

Lowestoft Bridge Could Shut Next Week
Beccles Sunday Market Marks Successful Sixth Week
Suffolk Police Road Crash Appeal
Record Breaking Weather Records for Beccles
Missing Falcon Found in Lowestoft
East Suffolk Football Fans in Mexico City for England Match
New Lowestoft seafront development officially opens for summer
Major restoration begins at Bungay Butter Cross