One of many greatest challenges Twitter has proper now’s to cut back abuse and bullying on its platform. Final week, the corporate’s head of product, Kayvon Beykpour, sat down with Wired editor-in-chief Nicholas Thompson throughout the Client Electronics Present (CES) in Las Vegas to debate toxicity on the platform, the well being of conversations, and extra. By way of the interview, he revealed some points of Twitter’s work to deal with abusive and offensive content material.
Beykpour mentioned one of many steps the corporate takes to cut back toxicity is to de-rank abusive replies utilizing machine studying:
I feel more and more, leveraging machine studying to try to mannequin the behaviors that we predict are most optimum for that space. So for instance, we want to present replies which can be most probably to be replied to. That’s one attribute you would possibly wish to optimize for, not the one attribute by any means. You’ll wish to deemphasize replies which can be more likely to be blocked or reported for abuse.
He added that Twitter optimizes replies which can be extra more likely to get reactions or replies. Nevertheless, it tweaks its algorithm to de-rank replies which can be reaction-worthy, but abusive.
When Thompson requested him about how the corporate tries to regulate system so it doesn’t incentivize toxicity, Beykpour mentioned the social community trains its AI fashions rigorously to know its guidelines and rules:
Right now, a really distinguished method that we leverage AI to attempt to decide toxicity is mainly having an excellent definition of what our guidelines are, after which having an enormous quantity of pattern knowledge round tweets that violate guidelines and constructing fashions round that.
Mainly we’re attempting to foretell the tweets which can be more likely to violate our guidelines. And that’s only one type of what folks would possibly take into account abusive, as a result of one thing that you just would possibly take into account abusive will not be in opposition to our insurance policies, and that’s the place it will get tough.
The final line is kind of intriguing, and is probably going on the coronary heart of many an argument surrounding Twitter. Customers who get banned usually complain that Twitter’s moderation wasn’t adequately nuanced to know the context of the tweets that acquired them in hassle. On the flip facet, some accounts aren’t banned once they tweet controversial or abusive content material.
When Thompson jokingly requested if Twitter deliberate to present abusers a ‘crimson tick’ or roll out a toxicity rating to de-incentivize them, Beykpour waved it off, and mentioned the corporate is experimenting with extra delicate options in its beta app, akin to hiding like counts and retweet counts.
Twitter’s problem when it comes to coaching its AI and moderation staff is to think about the ever-changing social and political context of various geographies. Some phrases or statements that had been normalized a couple of years in the past, is perhaps abusive within the present context. So, the corporate must overview and refine its coverage always.
The entire interview is stuffed with attention-grabbing tidbits about how Twitter is considering the way forward for its platform, together with open-sourcing it. Discover it on Wired here.
Blockchain companies dished out nearly $1M in bug bounties last year