LOADING ...

Discord Explains How It Handles Harassment, Doxxing, And Threatening Behavior

Nathan Grayson Aug 14, 2019 at 07:35. 6 comments

Discord, the only way young people communicate via voice after we collectively agreed to stop answering phone calls several years ago, is trying to be more open about how it handles harassment, threats, doxxing, and other forms of abuse on its platform. In order to do this, it plans to release regular “transparency reports,” the first of which is available to peruse now.

The idea, says Discord, is to keep people clued into the decision-making underlying the 250-million-user chat service so that people can understand why things do and, in some cases, don’t get done.

“We believe that publishing a Transparency Report is an important part of our accountability to you—it’s kind of like a city’s crime statistics,” said the company. “We made it our goal not only to provide the numbers for you to see, but also to walk you through some obstacles that we face every day so that you can understand why we make the decisions we do and what the results of those decisions are.”

The numbers are fascinating, albeit not wholly unexpected if you display symptoms of being Too Online. First, a graph of reports received by Discord from the start of the year until April:

“Other” is the most reported category, but harassment comes in behind it at 17.3 percent. Significant pieces of the multi-colored pie also go to hacks/cheats, threatening behavior, NSFW content, exploitative content, doxxing, spamming, raiding, malware, and self-harm. Discord does not mince words in describing what these categories refer to. Exploitative content is defined as “A user discovers their intimate photos are being shared without their consent; two minors’ flirting leads to trading intimate images with each other” while one example of NSFW content is “A user joins a server and proceeds to DM bloody and graphic violent images (gore) to other server members.”

After Discord receives a report, the company’s trust and safety team “acts as detectives, looking through the available evidence and gathering as much information as possible.” Initially, they focus on reported messages, but investigations can expand into entire servers “dedicated to bad behavior” or historical patterns of rule-breaking. “We spend a lot of time here because we believe the context in which something is posted is important and can change the meaning entirely (like whether something’s said in jest, or is just plain harassment),” wrote Discord.

If there’s a violation, the team then takes action, which can mean anything from removing the content in question to removing a whole server from Discord. However, the percentage of reports that caused Discord to spring into action earlier this year was relatively small. Just 12.49 percent of harassment reports got actioned, for example. Other categories saw Discord intervene more often, but most percentages were still relatively small: 33.17 percent for threatening behavior, 6.86 percent for self-harm, 44.34 percent for cheats/hacks, 41.72 percent for doxxing, 60.15 percent for malware, 14.74 percent for exploitative content, 58.09 percent for NSFW content, 28.72 percent for raiding, and the big outlier, 95.09 percent for spam.

Discord explained that action percentages are lower than you might expect because many reports simply don’t pass muster. Some are false or malicious, with people taking words out of context or banding together to report innocent users. Others demand too much for too little. “We may receive a harassment report about a user who said to another user, ‘I hate your dog,’ and the reporter wants the other user banned,” said the company. Other reports that Discord doesn’t action might include information, but no concrete evidence. Lastly, users sometimes apply the wrong category to reports, but Discord says it still actions those, but it may not count toward action percentages.

From January to April, the biggest contributors to bans were spam and exploitative content. Spam accounted for 89 percent of account bans—a total of 119,244 accounts. On the exploitative content side of things, Discord banned 10,642 accounts, and it says it’s doing its best to squelch that issue—perhaps due to its well-documented troubles with child porn in the past.

“We’ve been spending significant resources on proactively handling Exploitative Content, which encompasses non-consensual pornography (revenge porn/’deep fakes’) and any content that falls under child safety (which includes child sexual abuse material, lolicon, minors accessing inappropriate material, and more),” the company wrote. “We think that it is important to take a very strong stance against this content, and while only some four thousand reports of this behavior were made to us, we took action on tens of thousands of users and thousands of servers that were involved in some form of this activity.”

Discord also removed thousands of servers during the first few months of the year, mostly focusing on hacks/cheats. However, servers focused on hate speech, harassment, and “dangerous ideologies”—again, an area where Discord has struggled in the past —are also a big focus. On a related note, the company also discussed its response to videos and memes born of the March 14 Christchurch shooting.

“At first, our primary goal was removing the graphic video as quickly as possible, wherever users may have shared it,” the company said. “Although we received fewer reports about the video in the following hours, we saw an increase in reports of ‘affiliated content.’ We took aggressive action to remove users glorifying the attack and impersonating the shooter; we took action on servers dedicated to dissecting the shooter’s manifesto, servers in support of the shooter’s agenda, and even memes that were made and distributed around the shooting... Over the course of the first ten days after this horrific event, we received a few hundred reports about content related to the shooting and issued 1,397 account bans alongside 159 server removals for related violations.”

Discord closed out the report by saying it believes that this sort of transparency should be “a norm” among tech companies, so that people can “better determine how platforms keep their users safe.” The Anti-Defamation League, an anti-hate organization dedicated to fighting bigotry and defending civil rights, agrees.

“Discord’s first transparency report is a meaningful step toward real tech platform transparency, which other platforms can learn from,” the organization wrote in a statement about Discord’s report. “We look forward to collaborating with them to further expand their transparency efforts, so that the public, government and civil society can better understand the nature and workings of the online platforms that are and will continue to shape our society.”

6 Comments

Other Nathan Grayson's posts

Two Of Steam's Top Games Last Month Were Anime Sex Games Two Of Steam's Top Games Last Month Were Anime Sex Games

SteamedSteamed is dedicated to all things in and around Valve’s PC gaming service.  It’s no great secret that Steam is overflowing with anime games intended to titillate portions of its vast user base. But how many people pay attention to these seemingly niche games, really? Turns out, enough people do that two of these games ended up on Valve’s latest...

Final Fantasy VIII’s remastered version now has a concrete release date Final Fantasy VIII’s remastered version now has a concrete release date

Final Fantasy VIII’s remastered version now has a concrete release date. It’s coming to PS4, Switch, Xbox One, and PC on September 3. Bid a fond farewell to that classic Squall meme while you can.

Ion Fury Studio Apologizes For Developers' 'Sexist And Transphobic' Comments, Will Patch Out Offensive Jokes Ion Fury Studio Apologizes For Developers' 'Sexist And Transphobic' Comments, Will Patch Out Offensive Jokes

The developer of the acclaimed new retro shooter Ion Fury has apologized for what it referred to as “sexist and transphobic” comments made by two of its employees on Discord. It has also promised to patch out several “homophobic” jokes that were included in the game itself.Ion Fury, which was released on August 15, was largely met with gushing...

CD Projekt has released a lengthy video of The Witcher 3 running on the Nintendo Switch CD Projekt has released a lengthy video of The Witcher 3 running on the Nintendo Switch

CD Projekt has released a lengthy video of The Witcher 3 running on the Nintendo Switch. It’s impressive that the developer managed to squeeze such a massive game onto Nintendo’s diminutive game slab, but there’s some gnarly pop-in that—if I’m being honest—is distracting me to a worrying degree. Hopefully I’ll be able to adjust to it when the port...

Suggested posts

Now Game Developers Have To Ask Fans Not To Harass Them Over The Epic Store Now Game Developers Have To Ask Fans Not To Harass Them Over The Epic Store

One of the easiest bits of news to miss on Monday’s Gamescom Opening Night Live show was tucked away in an ad for the Epic Games Store. A simple sizzle reel that showcased a number of games exclusive to the controversial digital PC game storefront included an upcoming indie that previously wasn’t in Epic’s roster: Oddworld Soulstorm. Shortly after,...

GameStop Lays Off Over 100 People, Including Nearly Half Of Game Informer's Staff GameStop Lays Off Over 100 People, Including Nearly Half Of Game Informer's Staff

The struggling retail chain GameStop laid off over a hundred employees today, both at its corporate headquarters in Grapevine, Texas and at other offices including its subsidiary Game Informer magazine in Minnesota, where nearly half of the editorial staff lost their jobs in a surprise cut.“As part of the previously announced GameStop Reboot initiative to transform our business for the...

Two Of Steam's Top Games Last Month Were Anime Sex Games Two Of Steam's Top Games Last Month Were Anime Sex Games

SteamedSteamed is dedicated to all things in and around Valve’s PC gaming service.  It’s no great secret that Steam is overflowing with anime games intended to titillate portions of its vast user base. But how many people pay attention to these seemingly niche games, really? Turns out, enough people do that two of these games ended up on Valve’s latest...

Fallout 76 Group’s Raid Attempt Foiled By Notorious Power Armor Glitch Fallout 76 Group’s Raid Attempt Foiled By Notorious Power Armor Glitch

In Fallout 76, power armor can keep you safe, or it can become a horrible tomb entrapping unsuspecting players until the end of time (or until they reset their game). That’s what happened to one group of players attempting Fallout 76’s brand new raid.Added today as part of patch 12, Vault 94 is the game’s first raid, inviting up...

Turns Out Part Of The New Destiny Trailer Leaked Two-And-A-Half Years Ago Turns Out Part Of The New Destiny Trailer Leaked Two-And-A-Half Years Ago

The makers of Destiny have a long and storied tradition of reusing content from the cutting room floor, and the upcoming Shadowkeep expansion is no exception, with fans discovering that this week’s new trailer features a cut-scene that was leaked on the internet before Destiny 2 even came out.Way back in February of 2017, when Rise of Iron was...

The Sims 4 Is Getting Magic The Sims 4 Is Getting Magic

The Sims 4 Realms of Magic expansion is bringing witchcraft and wizardry to The Sims 4.The Sims has had magic-related expansions in the past, like The Sims’s Makin’ Magic expansion, so it seemed like it would be only a matter of time before The Sims 4 got one. Realm of Magic comes with a new neighborhood called Glimmerbrook, and...

My Language-Learning App Has A Leaderboard And It's Ruining My Life My Language-Learning App Has A Leaderboard And It's Ruining My Life

Kotaku Game DiaryDaily thoughts from a Kotaku staffer about a game we're playing.  I tried to wean myself off my mobile games by learning a new language. Now, instead of being obsessed with tapping on mobile games, I’m obsessed with my language-learning app. Damn it.I’m a fidgety person. I touch my hair a lot, pick at my nails and scratch...

The New Mario & Sonic Olympics Game Lets You Play As 2D Characters The New Mario & Sonic Olympics Game Lets You Play As 2D Characters

Your browser does not support HTML5 video tag.Click here to view original GIFMario & Sonic at the Olympic Games Tokyo 2020 is kicking it old school. The latest installment of the all-star mascot competition, due out November 5 for the Switch, adds ten sprite-based 2D events to its normal selection of 3D fare. Look at pixel Mario’s tiny legs go!...

I Love Designing My Own Controllers I Love Designing My Own Controllers

A couple of weeks ago my go-to Xbox One controller got into an altercation with a 470-pound electric wheelchair and lost. After spending hours browsing online stores for the perfect pre-built replacement, I decided to return to Microsoft’s Xbox Design Lab and make my own. It’s blue, pink, and yellow and uniquely mine. I love that. Even if someone...

Ion Fury Studio Apologizes For Developers' 'Sexist And Transphobic' Comments, Will Patch Out Offensive Jokes Ion Fury Studio Apologizes For Developers' 'Sexist And Transphobic' Comments, Will Patch Out Offensive Jokes

The developer of the acclaimed new retro shooter Ion Fury has apologized for what it referred to as “sexist and transphobic” comments made by two of its employees on Discord. It has also promised to patch out several “homophobic” jokes that were included in the game itself.Ion Fury, which was released on August 15, was largely met with gushing...

Language