Toss Securities Uses AI for 'Community Review'... Detects Profanity and Illegal Investment Chatroom Promotions

Upgraded Prohibited-Word Filtering
Revised Content Guidelines

Toss Securities said on Wednesday that it had introduced an artificial intelligence (AI)-based system to review posts in its community.

The improvement is designed to more accurately filter out inappropriate posts, including abusive or disparaging language and promotions for illegal investment chatrooms. The system goes beyond the previous filtering method, which focused on prohibited words, to analyze the content and context of posts as a whole.

The newly introduced AI review model automatically analyzes a post's title, body, and images after it is written or edited. It detects content that undermines constructive investment discussions, including abusive or disparaging language, hate speech, discriminatory expressions, and promotions for illegal investment chatrooms. Based on the review results, the system assesses the severity of violations and takes measures such as excluding posts from recommendations or hiding them.

The profanity filter applied when users write posts has also been upgraded. The AI review model can detect a wider range of evasive expressions for prohibited words commonly used by users, as well as various altered forms. Previously, users could not publish a post containing a prohibited word. Now, they can publish it with only the offending expression masked. These improvements have established a two-stage review system: prohibited-word filtering when a post is written, followed by an automatic AI review after publication.

The community's operating standards have also been revised. A new "Community Service Content Guidelines" document sets out restricted content and the criteria for sanctions, covering abusive and harmful content, hate speech and discriminatory expressions, promotions and advertising, and activities that disrupt market order. When a post is hidden, users will receive clearer information on whether a sanction has been imposed, and an appeals process through the customer service center has also been established.

A Toss Securities representative said, "This improvement focuses on reducing investors' exposure to offensive posts and inappropriate investment recommendations, and enabling them to communicate in a more trustworthy environment. We will continue to improve the community so investors can share useful information and exchange a range of views."

This content was produced with the assistance of AI translation services.