Clinical studies have shown that facial expressions and body posture in depressed patients differ significantly from those of healthy individuals. Combining relevant behavioral features with artificial intelligence technology can effectively improve the efficiency of depression detection, thereby assisting doctors in early identification of patients. This study aims to develop an end-to-end multimodal recognition model combining facial expressions and body posture via deep learning techniques, enabling rapid preliminary screening of depression.

We invited 146 subjects (73 in the patient group and 73 in the control group) to participate in an emotion-stimulus experiment for depression recognition. We focused on differentiating depression patients from the control group by analyzing changes in body posture and facial expressions under emotional stimuli. We first extracted images of body position and facial emotions from the video, then used a pre-trained ResNet-50 network to extract features. Additionally, we analyzed facial expression features using OpenFace for sequence analysis. Subsequently, various deep learning frameworks were combined to assess the severity of depression.

We found that under different stimuli, facial expression units AU04, AU07, AU10, AU12, AU17, and AU26 had significant effects in the emotion-stimulus experiment, with these features generally being negative. The decision-level fusion model based on facial expressions and body posture achieved excellent results, with the highest accuracy of 0.904 and an F1 score of 0.901.

The experimental results suggest that depression patients exhibit predominantly negative facial expressions. This study validates the emotion-stimulus experiment, demonstrating that combining facial expressions and body posture enables accurate preliminary depression screening.

Most related research focuses on a single variable of verbal and nonverbal behaviors independently without considering their associations. Therefore, it is important to understand subclinical depression in the entire population.

This study investigated the cross-modal co-occurrence of nonverbal behavior with vocal emotions, prosody, and content words in individuals with subclinical depression.

A total of 70 participants assigned to the subclinical depression and control groups participated in structured interviews. Elan software was used to layer, transcribe, and annotate materials. A support vector machine was used to confirm the two models.

Cross-modal co-occurrence analysis revealed that the subclinical depression group mainly exhibited strong relationships between the nonverbal behavior "holding hands" and the words including "conflict," "hope" and "suicide," while the control group exhibited strong relationship between the nonverbal behavior "holding hands" and the content words including "happy," "despair" and "stress," and strong relationships of more nonverbal behaviors with more positive and negative words. The "pause" and "hesitation" of prosody were strongly associated nodes with the subclinical depression group, while "pause" and "delight" (vocal emotion) were strongly associated nodes with the control group. The accuracy rates of the two models through support vector machine were high and could be confirmed.

The results of the cross-modal co-occurrence analysis revealed negative thoughts and moods of individuals with subclinical depression, whose nonverbal behavior was closely connected with verbal factors.

Accurate assessment of shoulder range of motion (ROM) is crucial for evaluating patient progress. Traditional manual goniometry often lacks precision and is subject to inter-observer variability, especially in measuring shoulder internal rotation (IR). This study introduces an artificial intelligence (AI)-based approach that uses clinical photography to improve the accuracy of ROM quantification. We analyzed a total of 150 clinical photographs, including 100 shoulder and 50 elbow images, taken between January and April 2022. An MMPose model with an HR-NET backbone architecture, pre-trained on the COCO-WholeBody dataset, was used to detect 17 anatomical landmarks. A random forest classifier (PoseRF) then categorized poses, and ROM angles were calculated. Concurrently, two clinicians independently measured shoulder IR at the vertebral level, and inter-observer agreement was evaluated. Linear regression analyses were conducted to correlate the AI-derived measurements with the clinicians' assessments. The AI-based algorithm accurately detected anatomical landmarks in 96% of shoulder and 100% of elbow images. Pose detection achieved 95% accuracy overall, with 100% accuracy for specific shoulder (abduction, flexion, external rotation) and elbow (flexion, extension) poses. Intraclass correlation coefficients (ICCs) between the AI algorithm and human observers ranged from 0.965 to 0.997, indicating excellent inter-observer reliability. Kruskal-Wallis test showed no statistically significant differences in ROM measurements among the AI algorithm and two human observers across all joint angles (p > 0.05). The AI-based algorithm demonstrated performance comparable to that of human observers in quantifying shoulder and elbow ROM from clinical photographs. For shoulder internal rotation, the AI approach showed potential for improved consistency compared to traditional methods.

The online version contains supplementary material available at 10.1007/s13534-024-00432-w.

Sarcopenia is a muscle-wasting condition that affects older individuals. It can lead to changes in movement patterns, which can increase the risk of falls and other injuries.

Older women participants aged ≥65 years who could walk independently were recruited and classified into two groups based on knee extension strength (KES). Participants with low KES scores were assigned to the possible sarcopenia group (PSG; n=7) and an 8-week exercise intervention was implemented. Healthy seniors with high KES scores were classified as the reference group (RG; n=4), and a 3-week exercise intervention was conducted. Kinematic movement data were recorded during the intervention period. All participants' exercise repetitions were used in the data analysis (number of data points=1,128).

The PSG showed significantly larger movement patterns in knee rotation during wide squats compared to the RG, attributed to weakened lower limb strength. The voting classifier, trained on the movement patterns from wide squats, determined that significant differences in overall movement patterns between the two groups persisted until the end of the exercise intervention. However, after the exercise intervention, significant improvements in lower limb strength in the PSG resulted in reduced knee rotation range of motion and max, thereby stabilizing movements and eliminating significant differences with the RG.

This study suggests that exercise interventions can modify the movement patterns in older individuals with possible sarcopenia. These findings provide fundamental data for developing an exercise management system that remotely tracks and monitors the movement patterns of older adults during exercise activities.

The objective of this study is to explore and enhance the diagnostic process of unipolar and bipolar disorders. The primary focus is on leveraging automated processes to improve the accuracy and accessibility of diagnosis. The study aims to introduce an audio corpus collected from patients diagnosed with these disorders, annotated using the Clinical Global Impressions Scale (CGI) by psychiatrists.

Traditional diagnostic methods rely on the clinician's expertise and consideration of co-existing mental disorders. However, this study proposes the implementation of automated processes in the diagnosis, providing quantitative measures and enabling prolonged observation of patients. The paper introduces a speech signal pipeline for CGI state classification, with a specific focus on selecting the most discriminative features. Acoustic features such as prosodies, MFCC, and LPC coefficients are examined in the study. The classification process utilizes common machine learning methods.

The results of the study indicate promising outcomes for the automated diagnosis of bipolar and unipolar disorders using the proposed speech signal pipeline. The audio corpus annotated with CGI by psychiatrists achieved a classification accuracy of 95% for the two-class classification. For the four- and seven-class classifications, the results were 77.3% and 73%, respectively, demonstrating the potential of the developed method in distinguishing different states of the disorders.

Video-based action recognition is becoming a vital tool in clinical research and neuroscientific study for disorder detection and prediction. However, action recognition currently used in non-human primate (NHP) research relies heavily on intense manual labor and lacks standardized assessment. In this work, we established two standard benchmark datasets of NHPs in the laboratory: MonkeyinLab (MiL), which includes 13 categories of actions and postures, and MiL2D, which includes sequences of two-dimensional (2D) skeleton features. Furthermore, based on recent methodological advances in deep learning and skeleton visualization, we introduced the MonkeyMonitorKit (MonKit) toolbox for automatic action recognition, posture estimation, and identification of fine motor activity in monkeys. Using the datasets and MonKit, we evaluated the daily behaviors of wild-type cynomolgus monkeys within their home cages and experimental environments and compared these observations with the behaviors exhibited by cynomolgus monkeys possessing mutations in the MECP2 gene as a disease model of Rett syndrome (RTT). MonKit was used to assess motor function, stereotyped behaviors, and depressive phenotypes, with the outcomes compared with human manual detection. MonKit established consistent criteria for identifying behavior in NHPs with high accuracy and efficiency, thus providing a novel and comprehensive tool for assessing phenotypic behavior in monkeys.

Epidemiological studies report high levels of anxiety and depression amongst adolescents. These psychiatric conditions and complex interplays of biological, social and environmental factors are important risk factors for suicidal behaviours and suicide, which show a peak in late adolescence and early adulthood. Although deaths by suicide have fallen globally in recent years, suicide deaths are increasing in some countries, such as the US. Suicide prevention is a challenging global public health problem. Currently, there aren't any validated clinical biomarkers for suicidal diagnosis, and traditional methods exhibit limitations. Artificial intelligence (AI) is budding in many fields, including in the diagnosis of medical conditions. This review paper summarizes recent studies (past 8 years) that employed AI tools for the automated detection of depression and/or anxiety disorder and discusses the limitations and effects of some modalities. The studies assert that AI tools produce promising results and could overcome the limitations of traditional diagnostic methods. Although using AI tools for suicidal ideation exhibits limitations, these are outweighed by the advantages. Thus, this review article also proposes extracting a fusion of features such as facial images, speech signals, and visual and clinical history features from deep models for the automated detection of depression and/or anxiety disorder in individuals, for future work. This may pave the way for the identification of individuals with suicidal thoughts.

To review the recent progress of machine learning for the early diagnosis of depression (major depressive disorder). The source of data was 32 original studies in the Web of Science. The search terms were "depression" (title) and "random forest" (abstract). The eligibility criteria were the dependent variable of depression, the interventions of machine learning (the decision tree, the naïve Bayesian, the random forest, the support vector machine and/or the artificial neural network), the outcomes of accuracy and/or the area under the receiver operating characteristic curve (AUC) for the early diagnosis of depression, the publication year of 2000 or later, the publication language of English and the publication journal of SCIE/SSCI. Different machine learning methods would be appropriate for different types of data for the early diagnosis of depression, e.g., logistic regression, the random forest, the support vector machine and/or the artificial neural network in the case of numeric data, the random forest in the case of genomic data. Their performance measures reported varied within 60.1-100.0 for accuracy and 64.0-96.0 for the AUC. Machine learning provides an effective, non-invasive decision support system for early diagnosis of depression.

Rapid technological advancements are altering people's communication styles. With the growth of the Internet, social networks (Twitter, Facebook, Telegram, and Instagram) have become popular forums for people to share their thoughts, psychological behavior, and emotions. Psychological analysis analyzes text and extracts facts, features, and important information from the opinions of users. Researchers working on psychological analysis rely on social networks for the detection of depression-related behavior and activity. Social networks provide innumerable data on mindsets of a person's onset of depression, such as low sociology and activities such as undergoing medical treatment, a primary emphasis on oneself, and a high rate of activity during the day and night. In this paper, we used five machine learning classifiers-decision trees, K-nearest neighbor, support vector machines, logistic regression, and LSTM-for depression detection in tweets. The dataset is collected in two forms-balanced and imbalanced-where the oversampling of techniques is studied technically. The results show that the LSTM classification model outperforms the other baseline models in the depression detection healthcare approach for both balanced and imbalanced data.