AI advances could lead to more child sexual abuse videos, watchdog warns | Child protection




Advances in artificial intelligence are being used by paedophiles to produce AI-generated videos of child sexual abuse that could increase in volume as the technology improves, according to a safety watchdog.

The majority of such cases seen by the Internet Watch Foundation involve manipulation of existing child sexual abuse material (CSAM) or adult pornography, with a child’s face transplanted on to the footage. A handful of examples involve entirely AI-made videos lasting about 20 seconds, the IWF said.

The organisation, which monitors CSAM around the world, said it was concerned that more AI-made CSAM videos could emerge as the tools behind them become more widespread and easier to use.

Dan Sexton, chief technology officer at the IWF, said if the use of AI video tools followed the same trend as AI-made still images, which have increased in volume as the technology has improved and become more widely available, more CSAM videos could emerge.

“I would tentatively say that if it follows the same trends, then we will see more videos,” he said, adding that future videos could also be of “higher quality and realism”.

IWF analysts said the majority of videos seen by the organisation on a dark web forum used by paedophiles were partial deepfakes, where AI models freely available online are used to impose a child’s face, including images of known CSAM victims, on existing CSAM videos or adult pornography. The IWF said it found nine such videos.

A smaller number of wholly AI-made videos were of a more basic quality, according to the analysts, but they said this would be the “worst” that fully synthetic video would be.

The IWF added that AI-made CSAM images have become more photo-realistic this year compared with 2023, when it first started seeing such content.

Its snapshot study this year of a single dark web forum – which anonymises users and shields them from tracking – found 12,000 new AI-generated images posted over a month-long period. Nine out of 10 of those images were so realistic they could be prosecuted under the same UK laws covering real CSAM, the IWF said.

The organisation, which operates a hotline for the public to report abuse, said it had found examples of AI-made CSAM images being sold online by offenders in place of non-AI made CSAM.

The IWF’s chief executive, Susie Hargreaves, said: “Without proper controls, generative AI tools provide a playground for online predators to realise their most perverse and sickening fantasies. Even now, the IWF is starting to see more of this type of material being shared and sold on commercial child sexual abuse websites on the internet.”

The IWF is pushing for law changes that will criminalise making guides to generate AI-made CSAM as well as making “fine-tuned” AI models that can produce such material.

The cross-bench peer and child safety campaigner Baroness Kidron tabled an amendment to the proposed data protection and digital information bill this year that would have criminalised creating and distributing such models. The bill fell by the wayside after Rishi Sunak called the general election in May.

Last week the Guardian reported that AI-made CSAM was overwhelming US law enforcement’s ability to identify and rescue real-life victims.



Source link

Posted: 2024-07-22 06:48:53

Bournemouth protest LIVE: Seaside town braced for chaos as anti-immigration clash expected
 



... Read More

Edmonton-based news outlet highlights plight of women and girls in Afghanistan
 



... Read More

Pound hits one-year high amid US interest rate cut hopes; PwC braces for China ban over Evergrande audit – business live | Business
 



... Read More

'Beautiful' colours to paint your bedroom to 'add brightness' to dull rooms
 



... Read More

Broken orbital bone sidelines Raptors all-star Scottie Barnes minimum 3 weeks
 



... Read More

Horoscope for the first week of August: Leo, Libra, Virgo and more
 



... Read More

Britain end 60-year wait to compete for America’s Cup after beating Italy | America's Cup
 



... Read More

Samples from far side of the moon show history of ancient volcanoes
 



... Read More