Stuff

    Subscribe to our newsletter

    What's Hot
    github's copilot

    So this is how it feels when the robots come for your job: what GitHub’s Copilot ‘AI assistant’ means for coders

    July 2, 2022
    higgs boson

    Higgs boson: ten years after its discovery, why this particle could unlock new physics beyond the standard model

    July 2, 2022
    Xiaomi 12

    At least one of Xiaomi’s flagship 12-series devices coming to South Africa on 8 July

    July 1, 2022
    Facebook Twitter Instagram YouTube SoundCloud
    Trending
    • So this is how it feels when the robots come for your job: what GitHub’s Copilot ‘AI assistant’ means for coders
    • Higgs boson: ten years after its discovery, why this particle could unlock new physics beyond the standard model
    • At least one of Xiaomi’s flagship 12-series devices coming to South Africa on 8 July
    • Vodacom spends R460 million on expanding coverage in Limpopo
    • Stuff’s Top Five Tablets (at the moment)
    • Google’s South African domain went down briefly. But it’s back up, crisis averted
    • Niantic’s Campfire is a Pokémon Go social media app (with more to follow)
    • 2022 Ford EcoSport Titanium review – Outdone by its cheaper siblings
    Facebook Twitter Instagram YouTube
    Stuff Stuff
    • News
      • App News
      • Business News
      • Camera News
      • Gaming News
      • Headphone News
      • Industry News
      • Internet News
      • Laptops News
      • Motoring News
      • Other Tech News
      • Phone News
      • Tablet News
      • Technology News
      • TV News
      • Wearables News
    • Reviews
      • Camera Reviews
      • Car Reviews
      • Featured Reviews
      • Game Reviews
      • Headphone Reviews
      • Laptop Reviews
      • Other Tech Reviews
      • Phone Reviews
      • Tablet Reviews
      • Wearables Reviews
    • Columns
    • Stuff Guides
    • Podcasts & Videos
      • Videos
      • Stuffed
      • Stuffing Around
      • Tech Byte
      • T2S2
    • Win
    • Subscribe
      • Print
      • Digital
        • Google Play
        • iTunes
        • Download
        • Zinio
    • Stuff Shop
      • Shop Now
      • My Account
      • Downloads
    • Contact Us
      • Get In Touch
      • Advertise
    0 Shopping Cart
    Stuff
    Home » News » App News » Millions of user messages are reportedly reviewed by WhatsApp moderators
    App News

    Millions of user messages are reportedly reviewed by WhatsApp moderators

    Max MilellaBy Max MilellaSeptember 9, 2021No Comments4 Mins Read
    whatsapp
    Share
    Facebook Twitter LinkedIn Pinterest Email

    As much as WhatsApp (and its parent company Facebook) received endless criticism of late over its more obviously skeevy privacy practices, we’ve always given it credit for its more laudable efforts, namely its end-to-end encryption on sent and received messages. We recently praised it for updating this function to have it include cloud-stored chat backups.

    But now even that speck of positivity has been sullied. It has recently been discovered that the messaging app’s encryption service isn’t so private after all, with millions of user messages being reviewed by WhatsApp moderators.

    WhatsApp giveth and WhatsApp taketh away

    On Wednesday, ProPublica (a nonprofit newsroom self-described as “investigat[ing] abuses of power”) released an exhaustive report detailing WhatsApp’s privacy promises compared to its actual practices, paying particular attention to the messenger service’s end-to-end encryption feature.

    With said encryption feature in place, for the longest time users have (understandably) believed their messages to be entirely safe from prying eyes, even from WhatsApp and Facebook themselves. ProPublica’s findings show a pretty blunt contradiction to this — around 1,000 people employed by Facebook moderate messages flagged by users as potentially harmful or abusive.

    Users on the receiving end of messages can report them for a number of reasons: scams, fraud, child sexual abuse material (CSAM), and other potentially illegal content. From there, the message is lumped together with the sender’s previous four messages in that chat thread and sent off to WhatsApp’s review system. 

    These messages are sent off automatically into a ‘reactive’ queue and by AI into a ‘proactive’ queue. The former relies on human moderators to review, and the latter uses AI to sort through a user’s unencrypted metadata, such as their name, phone number, profile picture and more. Reviewers apparently scrutinise millions of messages a week.

    But, it’s still encrypted

    It is important to note that the end-to-end encryption between the sender and receiver is not broken during this process. WhatsApp still cannot read messages outside of the few that are sent to Facebook after they’re reported.

    Members of the moderation team (WhatsApp doesn’t actually call it that, but then, it wouldn’t?) examine information in both queues, looking for any policy violations. They can then do nothing if the flagged message turns out to be fine, ban the offending user if it breaks policy, or put them on a watch list if the message doesn’t technically break any rules but is still suspicious. 

    The messaging app could, instead of having people go through messages themselves, utilise an AI system instead. And while there’s nothing firm (yet) to indicate that WhatsApp or Facebook are reviewing even unflagged messages, the point is they could be. Having been less than honest about their review system in the first place, we’re not going to blame anyone for assuming they are. 

    A snag in the plan

    What’s more is that, according to ProPublica, the review process is rife with blunders as well. For example, the review service spans across 180 countries, meaning messages come in in a variety of different languages. According to a moderator, there are often no native speakers able to examine messages in certain languages. Rather, reviewers have to make use of Facebook’s translation tool, which can apparently be so inaccurate that it sometimes mislabels messages in Arabic as being in Spanish. What’s more, is that it doesn’t, or rather can’t account for slang, innuendo, or political context. 

    The automated process itself has its share of errors, often reporting companies selling razors or bras as offering weapons or as a “sexually oriented business” respectively. There are also instances of harmless photos being reported, such as a picture of someone’s child taking a bath sent to a family member flagged as CSAM. Furthermore, it’s left to humans to decide whether AI flagged material is truly breaking policy, such as by weighing up whether a severed head in a picture is real or a Halloween prop.

    The system is abused constantly too, says another moderator. People can prank their friends by changing group names and then reporting them. “At the worst of it, we were probably getting tens of thousands of those,” they said. “They figured out some words the algorithm did not like.”

    Now, while the intentions of this system aren’t particularly offensive (if Facebook was using the data it dug up through flagged messages for ad-tracking that would be heinous) it points to a lack of transparency from WhatsApp to its users.

    As Ars Technica so poignantly points out, WhatsApp’s security and privacy page reads, “WhatsApp has no ability to see the content of messages,” which sneakily leaves itself open to interpretation. Not really something you want from this kinda thing. The messaging app is already in hot water with the EU over transparency with its users, and this certainly doesn’t help its case.

    apps consumer honesty Content Moderation Facebook featured privacy transparency WhatsApp
    Share. Facebook Twitter Pinterest LinkedIn WhatsApp Reddit Tumblr Email
    Max Milella

      Related Posts

      github's copilot

      So this is how it feels when the robots come for your job: what GitHub’s Copilot ‘AI assistant’ means for coders

      July 2, 2022
      higgs boson

      Higgs boson: ten years after its discovery, why this particle could unlock new physics beyond the standard model

      July 2, 2022
      Xiaomi 12

      At least one of Xiaomi’s flagship 12-series devices coming to South Africa on 8 July

      July 1, 2022

      Leave A Reply Cancel Reply

      In The Mag
      Stuff June-July 2022 Latest Issue

      In This Issue – The Outdoors (June-July 2022) Issue

      By Brett VenterMay 30, 20221

      Once again, we are asking you to check out a new issue of Stuff Magazine.…

      2021 Wish List
      wish list Stuff Wish List 2021

      Stuff Wish List: for the tech impaired

      By Duncan PikeDecember 22, 20210

      Are you from the time before being glued to a smartphone was considered normal? Here’s…

      Wishlist DIY Stuff tech

      Stuff Wish List: for the DIY Diehard

      December 21, 2021
      Wish List Gearhead

      Stuff Wish List: For the petrol-soaked gearhead

      December 20, 2021
      outsiders

      Stuff Wish List: for the Outsiders

      December 17, 2021

      Latest Video

      Sonos

      SONOS Roam SL unboxing by Toby Shapshak

      March 30, 2022
      Mini Cooper

      The Mini Cooper SE Electric with Toby Shapshak

      March 18, 2022
      MSI Crosshair 15 Rainbox Six Extraction Edition unboxing

      MSI Crosshair 15 Rainbox Six Extraction Edition unboxing

      March 16, 2022
      Samsung Galaxy S22 Ultra Unboxing

      Samsung Galaxy S22 Ultra unboxing with Toby Shapshak

      March 16, 2022
      Contact

      South Africa's Consumer Tech News Hub

      General: [email protected]
      Subscriptions: [email protected] or 087 353 1291
      Editorial: 072 735 2614
      Sales: 083 375 2418

      Facebook Twitter Instagram YouTube SoundCloud

      Subscribe to Updates

      • Terms and Conditions
      • Privacy & POPI
      • My account
      © 2022 Stuff Group. Designed by Chronon.

      Type above and press Enter to search. Press Esc to cancel.