EU plan to force messaging apps to scan for child sexual abuse material (CSAM) risks millions of false positives, experts warn

Source: techcrunch.com 5/2/24

A controversial push by European Union lawmakers to legally require messaging platforms to scan citizens’ private communications for child sexual abuse material (CSAM) could lead to millions of false positives per day, hundreds of security and privacy experts warned in an open letter Thursday.

Concern over the EU proposal has been building since the Commission proposed the CSAM-scanning plan two years ago — with independent experts, lawmakers across the European Parliament and even the bloc’s own Data Protection Supervisor among those sounding the alarm.

The EU proposal would not only require messaging platforms that receive a CSAM detection order to scan for known CSAM; they would also have to use unspecified detection scanning technologies to try to pick up unknown CSAM and identify grooming activity as it’s taking place — leading to accusations of lawmakers indulging in magical thinking-levels of technosolutionism.

Critics argue the proposal asks the technologically impossible and will not achieve the stated aim of protecting children from abuse. Instead, they say, it will wreak havoc on Internet security and web users’ privacy by forcing platforms to deploy blanket surveillance of all their users in deploying risky, unproven technologies, such as client-side scanning.

Read the full article

 

Related posts

Subscribe
Notify of

We welcome a lively discussion with all view points - keeping in mind...

 

  1. Your submission will be reviewed by one of our volunteer moderators. Moderating decisions may be subjective.
  2. Please keep the tone of your comment civil and courteous. This is a public forum.
  3. Swear words should be starred out such as f*k and s*t and a**
  4. Please avoid the use of derogatory labels.  Use person-first language.
  5. Please stay on topic - both in terms of the organization in general and this post in particular.
  6. Please refrain from general political statements in (dis)favor of one of the major parties or their representatives.
  7. Please take personal conversations off this forum.
  8. We will not publish any comments advocating for violent or any illegal action.
  9. We cannot connect participants privately - feel free to leave your contact info here. You may want to create a new / free, readily available email address that are not personally identifiable.
  10. Please refrain from copying and pasting repetitive and lengthy amounts of text.
  11. Please do not post in all Caps.
  12. If you wish to link to a serious and relevant media article, legitimate advocacy group or other pertinent web site / document, please provide the full link. No abbreviated / obfuscated links. Posts that include a URL may take considerably longer to be approved.
  13. We suggest to compose lengthy comments in a desktop text editor and copy and paste them into the comment form
  14. We will not publish any posts containing any names not mentioned in the original article.
  15. Please choose a short user name that does not contain links to other web sites or identify real people.  Do not use your real name.
  16. Please do not solicit funds
  17. No discussions about weapons
  18. If you use any abbreviation such as Failure To Register (FTR), Person Forced to Register (PFR) or any others, the first time you use it in a thread, please expand it for new people to better understand.
  19. All commenters are required to provide a real email address where we can contact them.  It will not be displayed on the site.
  20. Please send any input regarding moderation or other website issues via email to moderator [at] all4consolaws [dot] org
  21. We no longer post articles about arrests or accusations, only selected convictions. If your comment contains a link to an arrest or accusation article we will not approve your comment.
  22. If addressing another commenter, please address them by exactly their full display name, do not modify their name. 
ACSOL, including but not limited to its board members and agents, does not provide legal advice on this website.  In addition, ACSOL warns that those who provide comments on this website may or may not be legal professionals on whose advice one can reasonably rely.  
 

19 Comments
Inline Feedbacks
View all comments

The acronym is wrong it is actually SCAM

“…could lead to millions of false positives per day…” Exactly. I’m in a facebook group where we post pictures of redheads for others in the group to admire. One of the pictures I posted was a pretty redhead gal in a bikini. She was clearly an adult and it was also clearly not nudity but the picture got flagged by FB as “child sexual abusive material”. I quickly contested it and after a human actually looked at it, it was agreed that there was nothing wrong with the picture and the flag was removed.
When you try to have machines do what a human should be doing, all kinds of problems will arise.

This is fine. Let them waste a gross amount of time and resources chasing ghosts.

Welcome to 1984. This is the aim of “democratic” societies everywhere now.

ECPAT, Budapest Convention on Cyber Crime & NCMEC are fascist organizations that are the biggest threats to internet speech in the western world. We need to be vigilante when these goons start proposing survelliance tools like this which will quickly trap innocents with a broad net.

Getting every EU member on the same page is like herding cats. And this plan might provide an excuse for quasi-authoritarian governments like Hungary to monitor online communication of citizens that oppose them.

Last edited 14 days ago by J. Brown

Sounds like the EU wants to relate to their cousins across the pond in Washington by spying on its citizens that those in power find immoral. Can’t imagine how many reputations, lives will be ruined, and costs to their justice systems if this happens.

I’ll always remember when Picasa, then Microsoft’s “free” image-saving, in the cloud platform decided that 19th Century painter Henry Scott Tuke’s oil painting showing some boys lying on their stomachs naked on the beach – in that age, an extremely common occurrence – decided that that image constituted “child sexual abuse material” and accused the person attempting to save it to the cloud of violating their terms of service and warning them of a pending investigation. Further, they were not “allowed” to simply remove it from their collection while it was being investigated.

That tells you everything that is wrong with that term, “child sexual abuse material,” right there and what can happen to people when they run afoul of the obsessives who’ve bent society to their twisted conception of normality and redefined words like “abuse” and “offend” to mean whatever they want them to be. The busybodies have taken over everything!

There are discussions in Congress regarding this same tactic as seen here in this article:

I was a victim of online sextortion in high school. Here’s what I want parents and kids to know (GMA via Yahoo, 8 May 2024)