The source of a high-tech new form of election interference, a "deepfaked" robocall spoofing the voice of President Joe Biden that was sent to New Hampshire residents ahead of the state's primary election last month, has been identified, prosecutors said Tuesday. The people involved could face criminal charges.
Two Texas-based companies are among those involved in the calls, which were "a real-life example of an attempt to use AI to interfere with an election," New Hampshire Attorney General John Formella said at a news conference at the Department of Justice headquarters in Concord.
"We had not seen as example as concrete as this," he added.
The two companies have received cease-and-desist letters from New Hampshire prosecutors and the FCC, Formella said, and his office has opened a criminal investigation. The calls were traced back through the telecommunications system through collaboration with federal authorities and other attorneys general.
The source of the call was Texas-based Life Corporation and a man named Walter Monk, prosecutors said. NBC News has reached out to them for comment.
The calls were transmitted by a company called Lingo Telecom, a Texas-based voice service provider, which suspended Life Corporation after learning the calls were under investigation, according to prosecutors, whose probe into what happened is ongoing.
Get Tri-state area news delivered to your inbox. Sign up for NBC New York's News Headlines newsletter.
"We are committed to keeping our elections free, fair and secure. We will not tolerate any action that seeks to undermine our elections or our democratic process," Formella said.
U.S. & World
The "deepfake," as such AI-generated fake media are called, has prompted new warnings about the effects of disinformation on elections. The calls were sent the Sunday before the election, apparently mostly to registered Democrats, Formella said. It used a voice similar to Biden’s, employed his often-used phrase, “What a bunch of malarkey” and falsely suggested that voting in the primary would preclude voters from casting a ballot in November’s general election.
Formella previously said the calls appeared illegal, and said Tuesday that they are believed to have violated various state and federal laws. He didn't want to speak for federal prosecutors on whether they were expected to bring charges.
But he said that his announcement was meant to be a deterrent for others who may be thinking of producing deepfakes meant to sway voters, and that they "think if this happens again, we can track the calls even faster and identify the calls even faster."
In the run-up to the primary, Formella warned residents to ignore any such phone calls.
"These messages appear to be an unlawful attempt to disrupt the New Hampshire Presidential Primary Election and to suppress New Hampshire voters," a release from Formella's office said. "New Hampshire voters should disregard the content of this message entirely."
They added that, despite the message saying, "your vote makes a difference in November, not this Tuesday," voters are able to vote in both the primary and general elections.
Republican Gov. Chris Sununu called the robocall an illegal act of voter suppression.
Anyone who received the message was asked to email the Department of Justice Election Law Unit at electionlaw@doj.nh.gov sharing when they received the call or message, where it came from, what it said and any other information that may be relevant.
At the time, NBC Boston asked New Hampshire Secretary of State David Scanlan, who administers elections in the Granite State, about the message, and he said he was aware both about the messages and the investigation into them.
The presence of the apparent deepfake — media created through machine learning that convincingly imitates a real person — "reinforces kind of a national concern that has been out there about the effect of artificial intelligence and how it might impact elections and campaigns in negative ways," Scanlan said.
He also noted that, as deepfake technology is brand new, part of the response to it will have to be voters doing diligence on what they see and hear.
"This is a new area in elections and so we're going to have to study it and figure it out, but there needs to be a quick response to misinformation and disinformation that's out there. And the voters have to take some responsibility, too, in understanding the facts and not believing everything they see, because something like this fake news can come by and just throw people off," Scanlan said.
The fake message said "voting this Tuesday only enables the Republicans in their quest to elect Donald Trump again. Your vote makes a difference in November, not this Tuesday." The calls falsely showed up to recipients as coming from the personal cellphone number of Kathy Sullivan, a former state Democratic Party chair who helps run Granite for America, a super PAC that supported the Biden write-in campaign. Biden's name was kept off the ballot iN New Hampshire because in deference to South Carolina’s new lead-off position for the Democratic primaries. Still, Biden won the Democratic primary as a write-in candidate.
Biden campaign manager Julie Chavez Rodriguez told NBC News her team was discussing any additional actions that it might take beyond the state investigation, adding in a statement, "Spreading disinformation to suppress voting and deliberately undermine free and fair elections will not stand, and fighting back against any attempt to undermine our democracy will continue to be a top priority for this campaign."
NBC Boston's Matt Prichard contributed to this report.
