1
|
Amerini I, Barni M, Battiato S, Bestagini P, Boato G, Bruni V, Caldelli R, De Natale F, De Nicola R, Guarnera L, Mandelli S, Majid T, Marcialis GL, Micheletto M, Montibeller A, Orrù G, Ortis A, Perazzo P, Puglisi G, Purnekar N, Salvi D, Tubaro S, Villari M, Vitulano D. Deepfake Media Forensics: Status and Future Challenges. J Imaging 2025; 11:73. [PMID: 40137185 PMCID: PMC11943306 DOI: 10.3390/jimaging11030073] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2025] [Revised: 02/19/2025] [Accepted: 02/24/2025] [Indexed: 03/27/2025] Open
Abstract
The rise of AI-generated synthetic media, or deepfakes, has introduced unprecedented opportunities and challenges across various fields, including entertainment, cybersecurity, and digital communication. Using advanced frameworks such as Generative Adversarial Networks (GANs) and Diffusion Models (DMs), deepfakes are capable of producing highly realistic yet fabricated content, while these advancements enable creative and innovative applications, they also pose severe ethical, social, and security risks due to their potential misuse. The proliferation of deepfakes has triggered phenomena like "Impostor Bias", a growing skepticism toward the authenticity of multimedia content, further complicating trust in digital interactions. This paper is mainly based on the description of a research project called FF4ALL (FF4ALL-Detection of Deep Fake Media and Life-Long Media Authentication) for the detection and authentication of deepfakes, focusing on areas such as forensic attribution, passive and active authentication, and detection in real-world scenarios. By exploring both the strengths and limitations of current methodologies, we highlight critical research gaps and propose directions for future advancements to ensure media integrity and trustworthiness in an era increasingly dominated by synthetic media.
Collapse
Affiliation(s)
- Irene Amerini
- Department of Computer, Control and Management Engineering, Sapienza University of Rome, 00185 Roma, Italy; (I.A.); (T.M.)
| | - Mauro Barni
- Department of Information Engineering and Mathematics, University of Siena, 53100 Siena, Italy; (M.B.); (N.P.)
| | - Sebastiano Battiato
- Department of Mathematics and Computer Science, University of Catania, 95125 Catania, Italy; (S.B.); (A.O.)
| | - Paolo Bestagini
- Department of Electronics, Information and Bioengineering (DEIB), Politecnico di Milano, 20133 Milano, Italy; (P.B.); (S.M.); (D.S.); (S.T.)
| | - Giulia Boato
- Department of Information Engineering and Computer Science, University of Trento, 38123 Trento, Italy; (G.B.); (F.D.N.); (A.M.)
- Truebees S.r.l., 20900 Monza, Italy
| | - Vittoria Bruni
- Department of Basic and Applied Sciences for Engineering, Sapienza University of Rome, 00185 Roma, Italy; (V.B.); (D.V.)
| | - Roberto Caldelli
- CNIT, National Inter-University Consortium for Telecommunications, 50134 Florence, Italy;
- Department of Engineering and Sciences, Universitas Mercatorum, 00186 Rome, Italy
| | - Francesco De Natale
- Department of Information Engineering and Computer Science, University of Trento, 38123 Trento, Italy; (G.B.); (F.D.N.); (A.M.)
- CNIT, University of Trento, 38122 Trento, Italy
| | | | - Luca Guarnera
- Department of Mathematics and Computer Science, University of Catania, 95125 Catania, Italy; (S.B.); (A.O.)
| | - Sara Mandelli
- Department of Electronics, Information and Bioengineering (DEIB), Politecnico di Milano, 20133 Milano, Italy; (P.B.); (S.M.); (D.S.); (S.T.)
| | - Taiba Majid
- Department of Computer, Control and Management Engineering, Sapienza University of Rome, 00185 Roma, Italy; (I.A.); (T.M.)
| | - Gian Luca Marcialis
- Department of Electrical and Electronic Engineering, University of Cagliari, 09123 Cagliari, Italy; (G.L.M.); (M.M.); (G.O.)
| | - Marco Micheletto
- Department of Electrical and Electronic Engineering, University of Cagliari, 09123 Cagliari, Italy; (G.L.M.); (M.M.); (G.O.)
| | - Andrea Montibeller
- Department of Information Engineering and Computer Science, University of Trento, 38123 Trento, Italy; (G.B.); (F.D.N.); (A.M.)
| | - Giulia Orrù
- Department of Electrical and Electronic Engineering, University of Cagliari, 09123 Cagliari, Italy; (G.L.M.); (M.M.); (G.O.)
| | - Alessandro Ortis
- Department of Mathematics and Computer Science, University of Catania, 95125 Catania, Italy; (S.B.); (A.O.)
| | - Pericle Perazzo
- Department of Information Engineering, University of Pisa, 56122 Pisa, Italy;
| | - Giovanni Puglisi
- Department of Mathematics and Computer Science, University of Cagliari, 09124 Cagliari, Italy;
| | - Nischay Purnekar
- Department of Information Engineering and Mathematics, University of Siena, 53100 Siena, Italy; (M.B.); (N.P.)
| | - Davide Salvi
- Department of Electronics, Information and Bioengineering (DEIB), Politecnico di Milano, 20133 Milano, Italy; (P.B.); (S.M.); (D.S.); (S.T.)
| | - Stefano Tubaro
- Department of Electronics, Information and Bioengineering (DEIB), Politecnico di Milano, 20133 Milano, Italy; (P.B.); (S.M.); (D.S.); (S.T.)
| | - Massimo Villari
- MIFT Department, University of Messina, Viale F. Stagno d’Alcontres, 31, 98166 Messina, Italy;
| | - Domenico Vitulano
- Department of Basic and Applied Sciences for Engineering, Sapienza University of Rome, 00185 Roma, Italy; (V.B.); (D.V.)
| |
Collapse
|
2
|
Taddi VV, Kohli RK, Puri P. Perception, use of social media, and its impact on the mental health of Indian adolescents: A qualitative study. World J Clin Pediatr 2024; 13:97501. [PMID: 39350908 PMCID: PMC11438920 DOI: 10.5409/wjcp.v13.i3.97501] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/01/2024] [Revised: 07/18/2024] [Accepted: 08/05/2024] [Indexed: 08/30/2024] Open
Abstract
BACKGROUND Mental illness is a health challenge faced by adolescents that has grown worse after the Coronavirus disease 2019 pandemic. Research on social media and young people's mental health has recently increased, and numerous studies have examined whether frequent use of social media is linked to issues such as anxiety, stress, depression, eating disorders, insomnia, frustration, feeling alone, and externalizing problems among adolescents. This influence of social media on adolescents' lives is clear, with many platforms like Facebook, Instagram, and YouTube playing an important role in daily interactions and self-expression. Even though social media offers numerous benefits, such as connectivity and information sharing, excessive usage can have detrimental effects on mental health, particularly among adolescents. AIM To study the impact of social media on the mental wellbeing of adolescents, and the associated potential dangers in India. METHODS A total of 204 adolescents aged 14 years to 23 years were included in the study. This study explored the intricate relationship between social media usage and adolescent mental health in India. The study employs a cross-sectional survey design to capture a snapshot of adolescent mental health and social media usage patterns. Data collection involved administering structured questionnaires and the analysis utilized quantitative methods, including descriptive statistics. RESULTS Excessive use of social media is correlated with increased stress, anxiety, and depression. Adolescents engage in compulsive behaviors such as scrolling in the middle of the night, which negatively impacts their mental and physical health, and leads to significant sleep disruption. Findings from the study aim to provide insights into the current state of adolescent mental health and inform strategies to promote positive wellbeing in the Indian population. CONCLUSION The study underscores the need for further research to better understand the complex interplay between social media and adolescent mental health, and need for effective strategies to combat online harassment.
Collapse
Affiliation(s)
- Vishnu V Taddi
- Amity Institute of Forensic Sciences, Amity University, Noida 201313, India
| | - Ravshish K Kohli
- Amity Institute of Forensic Sciences, Amity University, Noida 201313, India
| | - Pooja Puri
- Amity Institute of Forensic Sciences, Amity University, Noida 201313, India
| |
Collapse
|
3
|
Dong C, Chen X, Hu R, Cao J, Li X. MVSS-Net: Multi-View Multi-Scale Supervised Networks for Image Manipulation Detection. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 2023; 45:3539-3553. [PMID: 35671312 DOI: 10.1109/tpami.2022.3180556] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
As manipulating images by copy-move, splicing and/or inpainting may lead to misinterpretation of the visual content, detecting these sorts of manipulations is crucial for media forensics. Given the variety of possible attacks on the content, devising a generic method is nontrivial. Current deep learning based methods are promising when training and test data are well aligned, but perform poorly on independent tests. Moreover, due to the absence of authentic test images, their image-level detection specificity is in doubt. The key question is how to design and train a deep neural network capable of learning generalizable features sensitive to manipulations in novel data, whilst specific to prevent false alarms on the authentic. We propose multi-view feature learning to jointly exploit tampering boundary artifacts and the noise view of the input image. As both clues are meant to be semantic-agnostic, the learned features are thus generalizable. For effectively learning from authentic images, we train with multi-scale (pixel / edge / image) supervision. We term the new network MVSS-Net and its enhanced version MVSS-Net++. Experiments are conducted in both within-dataset and cross-dataset scenarios, showing that MVSS-Net++ performs the best, and exhibits better robustness against JPEG compression, Gaussian blur and screenshot based image re-capturing.
Collapse
|
4
|
Supporting Newsrooms with Journalistic Knowledge Graph Platforms: Current State and Future Directions. TECHNOLOGIES 2022. [DOI: 10.3390/technologies10030068] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Increasing competition and loss of revenues force newsrooms to explore new digital solutions. The new solutions employ artificial intelligence and big data techniques such as machine learning and knowledge graphs to manage and support the knowledge work needed in all stages of news production. The result is an emerging type of intelligent information system we have called the Journalistic Knowledge Platform (JKP). In this paper, we analyse for the first time knowledge graph-based JKPs in research and practice. We focus on their current state, challenges, opportunities and future directions. Our analysis is based on 14 platforms reported in research carried out in collaboration with news organisations and industry partners and our experiences with developing knowledge graph-based JKPs along with an industry partner. We found that: (a) the most central contribution of JKPs so far is to automate metadata annotation and monitoring tasks; (b) they also increasingly contribute to improving background information and content analysis, speeding-up newsroom workflows and providing newsworthy insights; (c) future JKPs need better mechanisms to extract information from textual and multimedia news items; (d) JKPs can provide a digitalisation path towards reduced production costs and improved information quality while adapting the current workflows of newsrooms to new forms of journalism and readers’ demands.
Collapse
|
5
|
Abstract
Responsible consumption practice is crucial to minimizing waste as part of sustainable development (SDG 12). This can be achieved by extending product life in a cradle-to-cradle system as part of a circular economy. However, are consumers willing to extend product life by reusing materials? The phenomenon of re-commerce, where consumers sell products to each other (C2C), takes place in physical as well as web-based markets. This project focuses on enabling factors for re-commerce practices on Facebook among consumers in Bangladesh. A review of existing literature provided grounds for an empirical focus group study of Bangladeshi consumers. Using a social practice theory perspective in a thematic analysis shows that enabling factors in terms of technical competence, context-bound conditions influencing meanings such as socially accepted procedures, and practical practices relating to materials such as payment forms and logistics support, all serve as enabling or hindering factors. The study contributes to the understanding of conditions for re-commerce practices as part of a circular economy system where consumers are encouraged to engage in responsible consumption by extending product life cycles.
Collapse
|
6
|
Identification of Social-Media Platform of Videos through the Use of Shared Features. J Imaging 2021; 7:jimaging7080140. [PMID: 34460776 PMCID: PMC8404930 DOI: 10.3390/jimaging7080140] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2021] [Revised: 07/28/2021] [Accepted: 08/04/2021] [Indexed: 12/02/2022] Open
Abstract
Videos have become a powerful tool for spreading illegal content such as military propaganda, revenge porn, or bullying through social networks. To counter these illegal activities, it has become essential to try new methods to verify the origin of videos from these platforms. However, collecting datasets large enough to train neural networks for this task has become difficult because of the privacy regulations that have been enacted in recent years. To mitigate this limitation, in this work we propose two different solutions based on transfer learning and multitask learning to determine whether a video has been uploaded from or downloaded to a specific social platform through the use of shared features with images trained on the same task. By transferring features from the shallowest to the deepest levels of the network from the image task to videos, we measure the amount of information shared between these two tasks. Then, we introduce a model based on multitask learning, which learns from both tasks simultaneously. The promising experimental results show, in particular, the effectiveness of the multitask approach. According to our knowledge, this is the first work that addresses the problem of social media platform identification of videos through the use of shared features.
Collapse
|