Stuff

    Subscribe to our newsletter

    What's Hot
    Nvidia

    Asus will bring the very first 500Hz gaming monitor to market

    May 24, 2022
    Solar Power South Africa 2023

    Two 100MW solar projects approved for SA, should go into operation from September 2023

    May 24, 2022
    Snapchat

    Snapchat ‘borrows’ from Instagram for a change, is set to launch parental controls

    May 24, 2022
    Facebook Twitter Instagram YouTube SoundCloud
    Trending
    • Asus will bring the very first 500Hz gaming monitor to market
    • Two 100MW solar projects approved for SA, should go into operation from September 2023
    • Snapchat ‘borrows’ from Instagram for a change, is set to launch parental controls
    • Qualcomm unveils new flagship Snapdragon 8 Plus Gen 1 and mid-range Snapdragon 7 Gen 1
    • How many bots are on Twitter? The question is difficult to answer and misses the point
    • Corsair begins exploring the gaming laptop space with its Voyager notebook
    • Dolmen review (Xbox One) – Dark Souls meets Dead Space, but lacking depth
    • Cape Town to receive new traffic lights for MyCiTi transport
    Facebook Twitter Instagram YouTube
    Stuff Stuff
    • News
      • App News
      • Business News
      • Camera News
      • Gaming News
      • Headphone News
      • Industry News
      • Internet News
      • Laptops News
      • Motoring News
      • Other Tech News
      • Phone News
      • Tablet News
      • Technology News
      • TV News
      • Wearables News
    • Reviews
      • Camera Reviews
      • Featured Reviews
      • Game Reviews
      • Headphone Reviews
      • Laptop Reviews
      • Other Tech Reviews
      • Phone Reviews
      • Tablet Reviews
      • Wearables Reviews
    • Columns
    • Stuff Guides
    • Podcasts & Videos
      • Videos
      • Stuffed
      • Stuffing Around
      • Tech Byte
      • T2S2
    • Win
    • Subscribe
      • Print
      • Digital
        • Google Play
        • iTunes
        • Download
        • Zinio
    • Stuff Shop
      • Shop Now
      • My Account
      • Downloads
    • Contact Us
      • Get In Touch
      • Advertise
    0 Shopping Cart
    Stuff
    Home » News » App News » Millions of user messages are reportedly reviewed by WhatsApp moderators
    App News

    Millions of user messages are reportedly reviewed by WhatsApp moderators

    Max MilellaBy Max MilellaSeptember 9, 2021No Comments4 Mins Read
    whatsapp
    Share
    Facebook Twitter LinkedIn Pinterest Email

    As much as WhatsApp (and its parent company Facebook) received endless criticism of late over its more obviously skeevy privacy practices, we’ve always given it credit for its more laudable efforts, namely its end-to-end encryption on sent and received messages. We recently praised it for updating this function to have it include cloud-stored chat backups.

    But now even that speck of positivity has been sullied. It has recently been discovered that the messaging app’s encryption service isn’t so private after all, with millions of user messages being reviewed by WhatsApp moderators.

    WhatsApp giveth and WhatsApp taketh away

    On Wednesday, ProPublica (a nonprofit newsroom self-described as “investigat[ing] abuses of power”) released an exhaustive report detailing WhatsApp’s privacy promises compared to its actual practices, paying particular attention to the messenger service’s end-to-end encryption feature.

    With said encryption feature in place, for the longest time users have (understandably) believed their messages to be entirely safe from prying eyes, even from WhatsApp and Facebook themselves. ProPublica’s findings show a pretty blunt contradiction to this — around 1,000 people employed by Facebook moderate messages flagged by users as potentially harmful or abusive.

    Users on the receiving end of messages can report them for a number of reasons: scams, fraud, child sexual abuse material (CSAM), and other potentially illegal content. From there, the message is lumped together with the sender’s previous four messages in that chat thread and sent off to WhatsApp’s review system. 

    These messages are sent off automatically into a ‘reactive’ queue and by AI into a ‘proactive’ queue. The former relies on human moderators to review, and the latter uses AI to sort through a user’s unencrypted metadata, such as their name, phone number, profile picture and more. Reviewers apparently scrutinise millions of messages a week.

    But, it’s still encrypted

    It is important to note that the end-to-end encryption between the sender and receiver is not broken during this process. WhatsApp still cannot read messages outside of the few that are sent to Facebook after they’re reported.

    Members of the moderation team (WhatsApp doesn’t actually call it that, but then, it wouldn’t?) examine information in both queues, looking for any policy violations. They can then do nothing if the flagged message turns out to be fine, ban the offending user if it breaks policy, or put them on a watch list if the message doesn’t technically break any rules but is still suspicious. 

    The messaging app could, instead of having people go through messages themselves, utilise an AI system instead. And while there’s nothing firm (yet) to indicate that WhatsApp or Facebook are reviewing even unflagged messages, the point is they could be. Having been less than honest about their review system in the first place, we’re not going to blame anyone for assuming they are. 

    A snag in the plan

    What’s more is that, according to ProPublica, the review process is rife with blunders as well. For example, the review service spans across 180 countries, meaning messages come in in a variety of different languages. According to a moderator, there are often no native speakers able to examine messages in certain languages. Rather, reviewers have to make use of Facebook’s translation tool, which can apparently be so inaccurate that it sometimes mislabels messages in Arabic as being in Spanish. What’s more, is that it doesn’t, or rather can’t account for slang, innuendo, or political context. 

    The automated process itself has its share of errors, often reporting companies selling razors or bras as offering weapons or as a “sexually oriented business” respectively. There are also instances of harmless photos being reported, such as a picture of someone’s child taking a bath sent to a family member flagged as CSAM. Furthermore, it’s left to humans to decide whether AI flagged material is truly breaking policy, such as by weighing up whether a severed head in a picture is real or a Halloween prop.

    The system is abused constantly too, says another moderator. People can prank their friends by changing group names and then reporting them. “At the worst of it, we were probably getting tens of thousands of those,” they said. “They figured out some words the algorithm did not like.”

    Now, while the intentions of this system aren’t particularly offensive (if Facebook was using the data it dug up through flagged messages for ad-tracking that would be heinous) it points to a lack of transparency from WhatsApp to its users.

    As Ars Technica so poignantly points out, WhatsApp’s security and privacy page reads, “WhatsApp has no ability to see the content of messages,” which sneakily leaves itself open to interpretation. Not really something you want from this kinda thing. The messaging app is already in hot water with the EU over transparency with its users, and this certainly doesn’t help its case.

    apps consumer honesty Content Moderation Facebook featured privacy transparency WhatsApp
    Share. Facebook Twitter Pinterest LinkedIn WhatsApp Reddit Tumblr Email
    Max Milella

      Related Posts

      Nvidia

      Asus will bring the very first 500Hz gaming monitor to market

      May 24, 2022
      Solar Power South Africa 2023

      Two 100MW solar projects approved for SA, should go into operation from September 2023

      May 24, 2022
      Snapchat

      Snapchat ‘borrows’ from Instagram for a change, is set to launch parental controls

      May 24, 2022

      Leave A Reply Cancel Reply

      In The Mag
      Stuff April-May 2022 Latest Issue

      In This Issue – The Smart Home (April-May 2022) Issue

      By Brett VenterApril 4, 20220

      It’s time for a brand-new issue of your favourite tech publication. The April-May- 2022 edition…

      2021 Wish List
      wish list Stuff Wish List 2021

      Stuff Wish List: for the tech impaired

      By Duncan PikeDecember 22, 20210

      Are you from the time before being glued to a smartphone was considered normal? Here’s…

      Wishlist DIY Stuff tech

      Stuff Wish List: for the DIY Diehard

      December 21, 2021
      Wish List Gearhead

      Stuff Wish List: For the petrol-soaked gearhead

      December 20, 2021
      outsiders

      Stuff Wish List: for the Outsiders

      December 17, 2021

      Latest Video

      Sonos

      SONOS Roam SL unboxing by Toby Shapshak

      March 30, 2022
      Mini Cooper

      The Mini Cooper SE Electric with Toby Shapshak

      March 18, 2022
      MSI Crosshair 15 Rainbox Six Extraction Edition unboxing

      MSI Crosshair 15 Rainbox Six Extraction Edition unboxing

      March 16, 2022
      Samsung Galaxy S22 Ultra Unboxing

      Samsung Galaxy S22 Ultra unboxing with Toby Shapshak

      March 16, 2022
      Contact

      South Africa's Consumer Tech News Hub

      General: [email protected]
      Subscriptions: [email protected] or 087 353 1291
      Editorial: 072 735 2614
      Sales: 083 375 2418

      Facebook Twitter Instagram YouTube SoundCloud

      Subscribe to Updates

      • Terms and Conditions
      • Privacy & POPI
      • My account
      © 2022 Stuff Group. Designed by Chronon.

      Type above and press Enter to search. Press Esc to cancel.