Smartphone Application for the Analysis of Prosodic Features in Running Speech with a Focus on Bipolar Disorders: System Performance Evaluation and Case Study
Open accessThe DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Abstract
Bipolar disorder is one of the most common mood disorders characterized by large and invalidating mood swings. Several projects focus on the development of decision support systems that monitor and advise patients, as well as clinicians. Voice monitoring and speech signal analysis can be exploited to reach this goal. In this study, an Android application was designed for analyzing running speech using a smartphone device. The application can record audio samples and estimate speech fundamental frequency, F0, and its changes. F0-related features are estimated locally on the smartphone, with some advantages with respect to remote processing approaches in terms of privacy protection and reduced upload costs. The raw features can be sent to a central server and further processed. The quality of the audio recordings, algorithm reliability and performance of the overall system were evaluated in terms of voiced segment detection and features estimation. The results demonstrate that mean F0 from each voiced segment can be reliably estimated, thus describing prosodic features across the speech sample. Instead, features related to F0 variability within each voiced segment performed poorly. A case study performed on a bipolar patient is presented.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Recent advances in speech processing (112) also suggest that mobile platforms could be employed to identify and monitor speech characteristics that may be altered by DBS.”
From Could Wearable and Mobile Technology Improve the Management of Essential Tremor? (2018) · cites this paper as [112]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Design and Implementation of FFTW3
Frigo, M., & Johnson, S. G. (2005) · Proceedings of the IEEE · doi:10.1109/jproc.2004.840301 · Cited by 5,086 · cited 1×
“For this purpose, two libraries were linked to the application for fast Fourier transform [30] and managing sound files in wav format [31].”
MethodPrevalence and Correlates of Bipolar Spectrum Disorder in the World Mental Health Survey Initiative
Merikangas, K. R., Jin, R., He, J.-P., Kessler, R. C., Lee, S., Sampson, N. A., Viana, M. C., Andrade, L. H., Hu, C., Karam, E. G., et al. (2011) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2011.12 · Cited by 2,627 · cited 1×
“Bipolar disorders are defined as the periodical oscillations of pathological moods, eventually alternating between euthymic or normal states [4,5].”
BackgroundA review of depression and suicide risk assessment using speech analysis
Cummins, N., Scherer, S., Krajewski, J., Schnieder, S., Epps, J., & Quatieri, T. F. (2015) · Speech Communication · doi:10.1016/j.specom.2015.03.004 · Cited by 1,003 · cited 1×
“In fact, speech production is a complex phenomenon that is influenced by the autonomic and somatic nervous systems, through the modulation of breathing activity, vocal muscles tension, salivation and mucus secretion [11–13].”
BackgroundNeuropsychology of bipolar disorder: a review
Quraishi, S., & Frangou, S. (2002) · Journal of Affective Disorders · doi:10.1016/s0165-0327(02)00091-5 · Cited by 571 · cited 1×
“Bipolar disorders are defined as the periodical oscillations of pathological moods, eventually alternating between euthymic or normal states [4,5].”
BackgroundExpression of emotion in voice and music
Scherer, K. R. (1995) · Journal of Voice · doi:10.1016/s0892-1997(05)80231-0 · Cited by 470 · cited 1×
“In fact, speech production is a complex phenomenon that is influenced by the autonomic and somatic nervous systems, through the modulation of breathing activity, vocal muscles tension, salivation and mucus secretion [11–13].”
BackgroundA sawtooth waveform inspired pitch estimator for speech and music
Camacho, A., & Harris, J. G. (2008) · The Journal of the Acoustical Society of America · doi:10.1121/1.2951592 · Cited by 426 · cited 2×
“This step is accomplished using a variation of the sawtooth waveform inspired pitch estimator algorithm (SWIPE’) [24], which estimates F0 at given time instants using a spectral matching approach.”
MethodBauer, M. S. (1991) · Archives of General Psychiatry · doi:10.1001/archpsyc.1991.01810330031005 · Cited by 407 · cited 1×
“Our results are in line with clinical models of bipolar disorders that consider depressive and maniac symptoms at the extremities of a continuous scale, while euthymia is in the middle [34].”
ResultDetection of Clinical Depression in Adolescents’ Speech During Family Interactions
Low, L.-S. A., Maddage, M. C., Lech, M., Sheeber, L. B., & Allen, N. B. (2011) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2010.2091640 · Cited by 256 · cited 1×
“Voice-related features were found to have a predictive value for developing depressive symptoms in adolescents [14].”
BackgroundVoice acoustical measurement of the severity of major depression
Cannizzaro, M., Harel, B., Reilly, N., Chappell, P., & Snyder, P. J. (2004) · Brain and Cognition · doi:10.1016/j.bandc.2004.05.003 · Cited by 233 · cited 1×
“A relationship between speech-related features describing prosodic changes and depression severity was observed [15].”
BackgroundMoore, E., Clements, M. A., Peifer, J. W., & Weisser, L. (2008) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2007.900562 · Cited by 220 · cited 1×
“Glottal, prosodic and vocal tract features could discriminate depressed subjects with respect to controls [16].”
Background
Cited by
Dogan, E., Sander, C., Wagner, X., Hegerl, U., & Kohls, E. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7006 · Cited by 177
“Processing data locally on the smartphone has been suggested as one possible solution [47].”
BackgroundSeppälä, J., De Vita, I., Jämsä, T., Miettunen, J., Isohanni, M., Rubinstein, K., Feldman, Y., Grasa, E., Corripio, I., Berdun, J., et al. (2019) · JMIR Mental Health · doi:10.2196/mental.9819 · Cited by 148
Rusz, J., Hlavnička, J., Tykalová, T., Novotný, M., Dušek, P., Šonka, K., & Růžička, E. (2018) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2018.2851787 · Cited by 131
“phones are useful for detecting vocal changes [29], [41]–[44].”
BackgroundObjective assessment of depressive symptoms with machine learning and wearable sensors data
Ghandeharioun, A., Fedor, S., Sangermano, L., Ionescu, D., Alpert, J., Dale, C., Sontag, D., & Picard, R. (2017) · 2017 Seventh International Conference on Affective Computing and Intelligent Interaction (ACII) · doi:10.1109/acii.2017.8273620 · Cited by 116
“Most previous work has addressed a classification problem, usually binary, within this area [19], [20].”
BackgroundSmartphone-based objective monitoring in bipolar disorder: status and considerations
Faurholt-Jepsen, M., Bauer, M., & Kessing, L. V. (2018) · International Journal of Bipolar Disorders · doi:10.1186/s40345-017-0110-8 · Cited by 98
Gooding, P., & Kariotis, T. (2021) · JMIR Mental Health · doi:10.2196/24668 · Cited by 100
Antosik-Wójcińska, A. Z., Dominiak, M., Chojnacka, M., Kaczmarek‐Majer, K., Opara, K. R., Radziszewska, W., Olwert, A., & Święcicki, Ł. (2020) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2020.104131 · Cited by 90
Objective smartphone data as a potential diagnostic marker of bipolar disorder
Faurholt-Jepsen, M., Busk, J., Þórarinsdóttir, H., Frost, M., Bardram, J. E., Vinberg, M., & Kessing, L. V. (2019) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/0004867418808900 · Cited by 77
Smartphones Offer New Opportunities in Clinical Voice Research
Manfredi, C., Lebacq, J., Cantarella, G., Schoentgen, J., Orlandi, S., Bandini, A., & Dejonckere, P. H. O. (2016) · Journal of Voice · doi:10.1016/j.jvoice.2015.12.020 · Cited by 82
Real-time mobile monitoring of bipolar disorder: a review of evidence and future directions
Dunster, G. P., Swendsen, J. D., & Merikangas, K. R. (2020) · Neuropsychopharmacology · doi:10.1038/s41386-020-00830-5 · Cited by 77
“There has also been a rapid growth of other passive measures employed to track multiple domains in people with BD, such as speech patterns [19, 20].”
BackgroundA Wearable System for the Evaluation of the Human-Horse Interaction: A Preliminary Study
Guidi, A., Lanatà, A., Baragli, P., Valenza, G., & Scilingo, E. P. (2016) · Electronics · doi:10.3390/electronics5040063 · Cited by 45
“In addition, their flexibility allows researchers and clinicians to face the large variability of biomedical signals and tasks in monitoring subjects during their daily activities [48–52].”
BackgroundSelf-citationUsing ML and Data-Mining Techniques in Automatic Vulnerability Software Discovery
(2021) · International Journal of Advanced Trends in Computer Science and Engineering · doi:10.30534/ijatcse/2021/871032021 · Cited by 42
Hernandez-Cruz, N., Castro, L. A., Medina-Quero, J., Favela, J., Michán, L., & Mortenson, W. B. (2021) · Journal of Healthcare Informatics Research · doi:10.1007/s41666-020-00087-z · Cited by 45
“[155] developed an Android application for analysing speech while using a smartphone device.”
MethodUsing Acoustic Speech Patterns From Smartphones to Investigate Mood Disorders: Scoping Review
Flanagan, O., Chan, A. H. Y., Roop, P. S., & Sundram, F. (2021) · JMIR mhealth and uhealth · doi:10.2196/24352 · Cited by 42
“Included studies used single-arm observational designs [38-45], quasi-experimental designs [46-48], and observational case reports [49,50].”
BackgroundMethodEvaluation of Acoustic Analyses of Voice in Nonoptimized Conditions
van der Woerd, B., Wu, M., Parsa, V., Doyle, P. C., & Fung, K. (2020) · Journal of Speech, Language, and Hearing Research · doi:10.1044/2020_jslhr-20-00212 · Cited by 38
Microphone and Audio Compression Effects on Acoustic Voice Analysis: A Pilot Study
Cavalcanti, J. C., Englert, M., Júnior, M. J. A. D. O., & Constantini, A. C. (2021) · Journal of Voice · doi:10.1016/j.jvoice.2020.12.005 · Cited by 37
Faurholt‐Jepsen, M., Rohani, D. A., Busk, J., Vinberg, M., Bardram, J. E., & Kessing, L. V. (2021) · International Journal of Bipolar Disorders · doi:10.1186/s40345-021-00243-3 · Cited by 43
Or, F., Torous, J. B., & Onnela, J.-P. “. (2017) · Psychiatric Rehabilitation Journal · doi:10.1037/prj0000279 · Cited by 31
“Furthermore, contrary to the expectation that increased speech frequency was associated only with (hypo)mania, increased speech frequency in audio was also observed during the transition from hypomania to depression (Guidi et al., 2015).”
BackgroundMethodInfluentialVoice analytics in the wild: Validity and predictive accuracy of common audio-recording devices
Busquet, F., Efthymiou, F., & Hildebrand, C. (2023) · Behavior Research Methods · doi:10.3758/s13428-023-02139-9 · Cited by 41
“…correlational (as opposed to causal) evidence that different vocal features extracted on different audio-recording devices covary, i.e., increasing amplitude on one device corresponds to an increasing amplitude on another device (Guidi et al., 2015; Manfredi et al., 2017; Uloza et al., 2015).”
BackgroundResultComparison of Acoustic Voice Features Derived From Mobile Devices and Studio Microphone Recordings.
Fahed, V. S., Doheny, E. P., Busse, M., Hoblyn, J., & Lowery, M. (2022) · Journal of Voice · doi:10.1016/j.jvoice.2022.10.006 · Cited by 28
“Our results are in agreement with previous findings of high correlation between F0, SD F0, and jitter from microphone and Android smartphone devices.(49) However, the analysis in that study was conducted on running speech using a custom-made application for Android.”
ResultFeatures of vocal frequency contour and speech rhythm in bipolar disorder
Guidi, A., Schoentgen, J., Bertschy, G., Gentili, C., Scilingo, E. P., & Vanello, N. (2017) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2017.01.017 · Cited by 28
“Therefore, a system based on a smartphone device, and aiming at analyzing prosodic features in running speech, has been proposed to monitor bipolar patients [8].”
BackgroundSelf-citationCould Wearable and Mobile Technology Improve the Management of Essential Tremor?
Daneault, J.-F. (2018) · Frontiers in Neurology · doi:10.3389/fneur.2018.00257 · Cited by 21
“Recent advances in speech processing (112) also suggest that mobile platforms could be employed to identify and monitor speech characteristics that may be altered by DBS.”
BackgroundKaczmarek‐Majer, K., Dominiak, M., Antosik-Wójcińska, A. Z., Hryniewicz, O., Kamińska, O., Opara, K. R., Owsiński, J. W., Radziszewska, W., Sochacka, M., & Święcicki, Ł. (2024) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.13735 · Cited by 31
“22,23,25,26 The results of this study are partially consistent with the above findings, that is, males in mania tend to speak with a higher tone of voice.”
InfluentialMunnings, A. J. (2019) · Journal of Voice · doi:10.1016/j.jvoice.2018.12.018 · Cited by 19
Gillett, G., McGowan, N. M., Palmius, N., Bilderbeck, A. C., Goodwin, G. M., & Saunders, K. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.610457 · Cited by 20
Using voice biomarkers for frailty classification
Lang, Y. R., Zoubi, S., Cialic, R., & Orenstein, T. (2023) · GeroScience · doi:10.1007/s11357-023-00872-9 · Cited by 12
“It has been suggested that the patient’s voice can be used as an indicator of health and functional ability [7, 8].”
Smartphone-based Mental State Estimation: A Survey from a Machine Learning Perspective
Fukazawa, Y., Yamamoto, N., Hamatani, T., Ochiai, K., Uchiyama, A., & Ohta, K. (2020) · Journal of Information Processing · doi:10.2197/ipsjjip.28.16 · Cited by 20
“7%) 23 [35], [42], [44], [45], [47], [53], [62], [63], [72], [74], [75], [76], [80] [32], [39], [41], [51], [61] [32], [41], [43], [55], [67] (100%)”
BackgroundMethodInfluentialFellendorf, F. T., Hamm, C., Dalkner, N., Platzer, M., Sattler, M. C., Bengesser, S., Lenger, M., Pilz, R., Birner, A., Queissner, R., et al. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.641241 · Cited by 16
Acoustic and Natural Language Markers for Bipolar Disorder: A Pilot, mHealth Cross-Sectional Study
Crocamo, C., Cioni, R. M., Canestro, A., Nasti, C., Palpella, D., Piacenti, S., Bartoccetti, A., Re, M., Simonetti, V., Pietro, C. B. D. S., et al. (2025) · JMIR Formative Research · doi:10.2196/65555 · Cited by 17
“It has been argued that speech features may be useful to detect a trait [55] rather than a state [56] in BD.”
Kim, T., Choi, J., Kwang-il, K., & Ko, M. (2024) · JMIR Medical Informatics · doi:10.2196/57298 · Cited by 12
“Voice biomarkers have been successfully used to identify acute diseases such as COVID-19, cognitive dysfunction, Parkinson disease, and psychiatric disorders [8-11].”
Process and Outcome Evaluations of Smartphone Apps for Bipolar Disorder: Scoping Review
Tatham, I., Clarke, E., Grieve, K. A., Kaushal, P., Smeddinck, J. D., Barron, E., & Sharma, A. (2021) · Journal of Medical Internet Research · doi:10.2196/29114 · Cited by 10
“Multimedia Appendix 2 describes the characteristics and assessment compliance of each study [22-33], and Multimedia Appendix 3 describes the results of the respective compliance with the standards set out in the MMAT [22-33].”
InfluentialHuang, R., Ren, G., & Hu, J. (2017) · Trials · doi:10.1186/s13063-017-1996-2 · Cited by 9
“Several other Chinese studies have reported low levels of treatment adherence by patients with TB [21, 22].”
BackgroundAlqahtani, F., & Orji, R. (2025) · Human Behavior and Emerging Technologies · doi:10.1155/hbe2/8111089 · Cited by 14
Severus, E., Ebner‐Priemer, U., Beier, F., Mühlbauer, E., Ritter, P. S., Hill, H., & Bauer, M. (2019) · Der Nervenarzt · doi:10.1007/s00115-019-00816-9 · Cited by 5
The Ethics of Passive Data and Digital Phenotyping in Neurosurgery
Senders, J. T., Maher, N., Hulsbergen, A. F. C., Lamba, N., Bredenoord, A. L., & Broekman, M. L. D. (2019) · Springer eBooks · doi:10.1007/978-3-030-05502-8_14 · Cited by 5
Mao, S., Khalifa, Y., Zhang, Z., Shu, K., Suri, A., Bouzid, Z., & Sejdić, E. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-818914-6.00002-8 · Cited by 3
Rajput, S. Q., Memon, K., & Palli, G. H. (2023) · Mehran University Research Journal of Engineering and Technology · doi:10.22581/muet1982.2401.2175 · Cited by 3
VOice analysis with Iphones: a low Cost Experimental Solution
van der Woerd, B. D. (2019) · Scholarship@Western (Western University) · Cited by 5
Chirilă, M. (2020) · International Journal of Clinical Practice · doi:10.1111/ijcp.13670 · Cited by 2
Digital Diagnostic and Therapeutic Approaches in Bipolar Disorder
Faurholt‐Jepsen, M., & Kessing, L. V. (2025) · Springer eBooks · doi:10.1007/978-3-031-85519-1_38 · Cited by 1
Wearable Electronics and Embedded Computing Systems for Biomedical Applications
Scilingo, E. P., & Valenza, G. (2017) · MDPI eBooks · doi:10.3390/books978-3-03842-387-4 · Cited by 1
Self-citationAn Exploratory Study to Detect Temporal Orientation Using Bluetooth's sensor
Hernandez-Cruz, N., Demiray, B., Bert Arnrich, A., & Favela, J. (2019) · International Conference on Pervasive Computing Technologies for Healthcare · doi:10.1145/3329189.3329223 · Cited by 1
“In contrast to the methodology reported by the related work [18], [19] which exclusively used proximity technology, we adopt smartphone surveys as a mechanism to capture participants’ thoughts.”
ResultPersuasive system design methods to deliver a cardio-rehabilitation program of post mi outpatients
Ottaviano, M. (2016) · UPM Digital Archive (Technical University of Madrid) · doi:10.20868/upm.thesis.39738
Self-citationFellendorf, F. T., Hamm, C., Platzer, M., Lenger, M., Dalkner, N., Bengesser, S., Birner, A., Queissner, R., Sattler, M. C., Pilz, R., et al. (2021) · Fortschritte der Neurologie · Psychiatrie · doi:10.1055/a-1503-4986
ABISHEVA, Y., Rusetsky, Y. Y., Daniyarova, A., AZHENOV, T., Имашева, Б. С., Almabayev, Y. A., TURYSBEKOVA, D., & UTEGENOV, A. (2022) · Archives of the Balkan Medical Union · doi:10.31688/abmu.2022.57.1.09
Assessment of Voice Parameters of Symptomatic and Remitted Patients of Bipolar Disorder
Pal, A., Jotdar, A., Shukla, R., & Soni, A. (2025) · Annals of Indian Psychiatry · doi:10.4103/aip.aip_221_24
Metadata
- Authors
- Guidi, A., Salvi, S., Ottaviano, M., Gentili, C., Bertschy, G., De Rossi, D., Scilingo, E., & Vanello, N.
- Affiliations
- University of Pisa (IT)
- Universidad Politécnica de Madrid (ES)
- Inserm (FR)
- Dipartimento di Ingegneria dell’Informazione, University of Pisa, Via G. Caruso 16, Pisa 56122, Italy
- Corresponding author
- Guidi, Andrea
- Venue
- Sensors
- Publisher
- MDPI AG
- Published
- 2015-11-06
- Volume
- 15
- Issue
- 11
- Pages
- 28070-28087
- ISSN
- 1424-8220 (ISSN-L)
- PMC
- PMC4701269
- OpenAlex
- W2153933853
- Cited by
- 46
- References
- 33
- Citations by year
- 2025: 4 · 2024: 2 · 2023: 3 · 2022: 2 · 2021: 11 · 2020: 5 · 2019: 5 · 2018: 5 · 2017: 6 · 2016: 3
- FWCI
- 7.05
- Type
- journal article
- Language
- en
- Open access
- gold
- dx.doi.org
- Licence
- Locations
- Sensors (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- UPM Digital Archive (Technical University of Madrid) (acceptedVersion, cc-by)
- HAL (submittedVersion, cc-by)
- CINECA IRIS Institutial research information system (University of Pisa) (submittedVersion, cc-by-nc-nd)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Hispana (submittedVersion, cc-by)
- Padua Research Archive (University of Padova) (submittedVersion, cc-by)
- Funders
- European Commission (247777)
- FP7 Information and Communication Technologies
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Health Sciences › Health Professions › Speech and Hearing › Voice and Speech Disorders
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Keywords
- bipolar disorder, prosodic features, fundamental frequency estimation, mobile application, voice monitoring, mood tracking, decision support system, Android application
- MeSH terms
- Smartphone, Adult, Bipolar Disorder, Female, Humans, Male, Monitoring, Physiologic, Pilot Projects, Speech, Voice, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.