- Following the introduction of the nation's first AI monitoring in 2023, 'full process automation' up to deletion reporting
– From detecting video content on SNS to reporting deletion, the processing time has been dramatically reduced from 3 hours to just 6 minutes, a 30-fold reduction in processing speed.
- First AI introduced nationwide in 2023… Detection speed reduced by 97.5% compared to before, number of deletion support cases increased by 468%
- 'Seoul Digital Sex Crime Safety Support Center' Opens, Supports 3 People in 3,650 Years... 13 Times Higher Ratio of Children and Adolescents
□ In order to support the rapid deletion of digital sex crime videos distributed online, Seoul City introduced AI (artificial intelligence) technology for the first time in the country in 2023 and has been operating 24-hour monitoring. Now, it is developing and implementing the 'AI Automatic Deletion Report System' for the first time, in which AI automatically supports deletion and reporting of detected videos.
○ In order to prevent digital sex crimes and support victims, the Seoul Metropolitan Government developed the nation's first 'digital sex crime AI deletion support technology' in cooperation with the Seoul Institute in March 23, and the Seoul Digital Sex Crime Safety Support Center (operated by the Seoul Metropolitan Government Women and Family Foundation) is utilizing this to monitor and support deletion of illegal videos 3 hours a day.
○ In order to prevent digital sex crimes and support victims, the Seoul Metropolitan Government opened the 'Seoul Digital Sex Crime Safety Support Center' in March 2022. The center provides one-stop support for the entire process, including legal, psychological, and deletion support, for victims of digital sex crimes.
□ This will drastically shorten the time required to find illegal videos floating around indiscriminately online, such as on social networking services (SNS), online communities, and illegal sites, and report them for deletion on the relevant sites, from the previous 2 to 3 hours to just '6 minutes'.
□ The 'AI automatic deletion report system' automatically generates an email requesting deletion from the relevant site after AI continuously detects the video content 24 hours a day, automatically collects evidence of the found video content, creates a report, and then automatically generates a report requesting deletion from the relevant site. The completed report email is then finally confirmed and sent by the deletion support officer.
○ This system automates the entire process from detection of digital sex crimes to evidence collection, documentation, and email generation by combining a multimodal large language model (MLLM) and a Selenium-based web automation tool.
○ The 'Seoul Digital Sex Crime Safety Support Center' is an institution designated and notified as a reporting and deletion agency for illegally filmed materials, etc., according to Article 22-5 of the Telecommunications Business Act. If the center reports deletion to the site where the video material has been posted, the site must delete or block access in accordance with the Telecommunications Business Act and its enforcement decree. Failure to do so may result in imprisonment for up to 3 years, a fine of up to 1 million won, a surcharge of up to 3% of sales, cancellation of registration, or suspension of business.
□ Previously, deletion support officers had to manually collect evidence of each video and write reports, which took a lot of time, but now, by ‘AI automation’ of the entire process from monitoring to detection and deletion of digital sex crime videos, we can expect to see a 30-fold improvement in processing speed.
○ The automatic evidence collection report function automatically extracts key information contained in content such as text, images, and URLs, converts it into a Hangul (HWP) document, and saves it so that it can be immediately used as legal evidence required by future investigative agencies or judicial procedures.
<Digital Sex Crime AI Automatic Deletion Report System Result Screen (Example)>
□ In particular, as the number of cases of harmful videos being uploaded to sites with servers overseas has recently increased, AI will search for harmful videos distributed overseas and generate report emails in seven languages, including English, Chinese, Japanese, and Russian.
○ The city has expanded the search area by broadening its national base, taking note of the fact that the video clips that were previously distributed mainly in the United States have recently spread to China, Russia, Vietnam, and other countries.
<2023First in the country in 2018 AI Introduction...Detection speed compared to previous versions 97.5%. shortening, Number of deletion support cases 468%. 증가>
□ Meanwhile, Seoul City is being evaluated as having achieved a paradigm shift in the prevention of digital sex crimes and support for victims by being the first in the country to develop and introduce 'digital sex crime AI deletion support technology' in 2023.
□ With the introduction of this technology, it now takes only about 3 minutes from keyword input to video detection through comprehensive analysis of video, audio, and text, which is 3% faster than the average 2 hours it took for deletion support personnel, and the accuracy has also improved by over 97.5%.
○ In addition, since AI can automatically monitor 24 hours a day, it can monitor even during the early hours of the morning when people are not working, and it has the advantage of reducing trauma and stress that may occur when deletion support officers come into contact with damaging video footage.
□ As a result, the number of deletion support cases at the Seoul Digital Sexual Crime Safety Support Center also increased by a whopping 2022% from 2,509 cases in 14,256 before the introduction of AI to a total of 468 cases last year.
<'Seoul Digital Sexual Crime Safety Support Center' survey 3Total year 3,650Name support...아동‧Youth victim ratio 13Belly↑>
□ Seoul City is providing one-stop support through the 'Seoul Digital Sex Crime Safety Support Center (hereinafter referred to as the Center, operated by the Seoul Women's Family Foundation)', including deletion support, investigation and legal support, psychological treatment and medical support. Over the past three years ('3~'22.3), 25.3 victims were supported, and the total number of cases supported reached 3,650.
□ The number of victims of digital sex crimes supported by the center over the past three years increased ninefold from 3 in 22 to 309 in 24, and the number of cases supported accordingly increased sixfold from 2,820 in 9 to 22 in 6,245.
○ Counseling (1%), investigation/legal support (1%), and deletion support (39.98%) were provided through 20.20:36.12 close support from counselors, and the number of psychological counseling support cases in 24 was 15,781, contributing to alleviating the symptoms of post-traumatic stress disorder in victims.
□ The age group of victims supported by the city is the 10s and 20s, accounting for the highest percentage, and in particular, support for digital sex crimes targeting children and adolescents has increased significantly since the center opened. In 22, there were 50 victims of children and adolescents, accounting for 16.2% of all victims, but in 24, there were 624 victims (22.1%), a more than 13-fold increase.
□ In particular, online grooming damage targeting children and adolescents was only 22 cases (19%) in 3.3, but increased to 24 cases (370%) in 10.6, a whopping 3-fold increase over three years.
○ As the COVID-1919 pandemic progressed, children have been spending more time in online spaces, and the online space, where anonymity is guaranteed, has become a place for children to form social relationships and express sexual curiosity. It is analyzed that planned crimes of 'online grooming' targeting this are increasing.
□ In order to provide counseling for victims who cannot even tell their parents about their children and adolescents, the center provides counseling through the KakaoTalk open chat room 'Digital Sex Crime SOS Counseling' where anonymous counseling is available, and provides free psychological treatment for not only children and adolescents but also their parents. It also provides one-stop support for investigation, legal, medical, and deletion support.
□ Any victim of digital sex crimes who needs help can contact the center’s dedicated counseling hotline ‘815-0382 (video quick)’ or visit the center’s website (www.8150382.or.kr).
□ Kim Seon-soon, the Director of the Seoul Metropolitan Government’s Office for Women and Family, said, “From the Nth Room case that shocked our society to last year’s deepfake sex crime case, digital sex crime technology is becoming increasingly sophisticated and the damage caused by the crimes is also serious.” She added, “Following being the first city in the country to introduce AI-based monitoring technology, Seoul is now introducing technology where AI automatically reports for deletion, which we expect to dramatically reduce the time from detection to report for deletion. We will continue to do our best to make Seoul a safe place for children and adolescents from digital sex crimes.”
