• Moving psychological assessment out of the controlled laboratory setting: Practical challenges 

      Holmlund, Terje Bektesevic; Foltz, Peter W.; Cohen, Alex S.; Johansen, Håvard D.; Sigurdsen, Randi; Fugeli, Pål; Bergsager, Dagfinn; Cheng, Jian; Bernstein, Jared; Rosenfeld, Elizabeth; Elvevåg, Brita (Journal article; Tidsskriftartikkel; Peer reviewed, 2019-03)
      Behavioral assessment using smart devices affords novel methods, notably remote self-administration by the individuals themselves. However, this new approach requires navigating complex legal and technical terrain. Given the limited empirical data that currently exists, we provide and discuss anecdotes of the methodological, technical, legal, and cultural issues associated with an implementation in ...
    • Natural language processing markers for psychosis and other psychiatric disorders: emerging themes and research agenda from a cross-linguistic workshop 

      Corona Hernandez, Hugo; Corcoran, Cheryl M.; Achim, Amélie M; de Boer, Janna N.; Boerma, Tessel; Brederoo, Sanne G; Cecchi, Guillermo A; Ciampelli, Silvia; Elvevåg, Brita; Fusaroli, Riccardo; Giordano, Silvia; Hauglid, Mathias K.; van Hessen, Arjan; Hinzen, Wolfram; Homan, Philipp; de Kloet, Sybren F; Schuite-Koops, Sanne; Kuperberg, Gina R; Maheshwari, Kritika; Mota, Natalia B; Parola, Alberto; Rocca, Roberta; Sommer, Iris E. C.; Truong, Khiet; Voppel, Alban; van Vugt, Marieke; Winjen, Frank; Palaniyappan, Lena (Journal article; Tidsskriftartikkel; Peer reviewed, 2023-03-22)
      This workshop summary on natural language processing (NLP) markers for psychosis and other psychiatric disorders presents some of the clinical and research issues that NLP markers might address and some of the activities needed to move in that direction. We propose that the optimal development of NLP markers would occur in the context of research efforts to map out the underlying mechanisms of ...
    • Predicting self-injurious thoughts in daily life using ambulatory assessment of state cognition 

      Le, Thanh P.; Moscardini, Emma; Cowan, Tovah; Elvevåg, Brita; Holmlund, Terje Bektesevic; Foltz, Peter W.; Tucker, Raymond P.; Schwartz, Elana K.; Cohen, Alex S. (Journal article; Tidsskriftartikkel; Peer reviewed, 2021-04-12)
      Self-injurious thoughts (SITs) fluctuate considerably from moment to moment. As such, “static” and temporally stable predictors (e.g., demographic variables, prior history) are suboptimal in predicting imminent SITs. This concern is particularly true for “online” cognitive abilities, which are important for understanding SITs, but are typically measured using tests selected for temporal stability. ...
    • Psychiatric Risk Assessment from the Clinician´s Perspective: Lessons for the Future 

      Cohen, Alex S.; Fedechko, Taylor L.; Schwartz, Elana K.; Le, Thanh P.; Foltz, Peter W.; Bernstein, Jared; Cheng, Jian; Rosenfeld, Elizabeth; Elvevåg, Brita (Journal article; Tidsskriftartikkel; Peer reviewed, 2019-06-01)
      Accurate prediction of risk-states in Serious Mental Illnesses (SMIs) is critical for reducing their massive societal burden. Risk-state assessments are notably inaccurate. Recent innovations, including widely available and inexpensive mobile technologies for ambulatory “biobehavioral” data, can reshape risk assessment. To help understand and accelerate clinician involvement, we surveyed 90 ...
    • Reflections on measuring disordered thoughts as expressed via language 

      Elvevåg, Brita (Journal article; Tidsskriftartikkel; Peer reviewed, 2023-02-06)
      Thought disorder, as inferred from disorganized and incoherent speech, is an important part of the clinical presentation in schizophrenia. Traditional measurement approaches essentially count occurrences of certain speech events which may have restricted their usefulness. Applying speech technologies in assessment can help automate traditional clinical rating tasks and thereby complement the ...
    • Reflections on the nature of measurement in language-based automated assessments of patients' mental state and cognitive function 

      Foltz, Peter W.; Chandler, Chelsea; Diaz-Asper, Catherine; Cohen, Alex S.; Rodriguez, Zachary; Holmlund, Terje Bektesevic; Elvevåg, Brita (Journal article; Tidsskriftartikkel; Peer reviewed, 2022-09-22)
      Modern advances in computational language processing methods have enabled new approaches to the measurement of mental processes. However, the field has primarily focused on model accuracy in predicting performance on a task or a diagnostic category. Instead the field should be more focused on determining which computational analyses align best with the targeted neurocognitive/psychological functions ...
    • Reflections on the nature of measurement in language-based automated assessments of patients' mental state and cognitive function 

      Foltz, Peter W.; Chandler, Chelsea; Diaz-Asper, Catherine; Cohen, Alex S.; Rodriguez, Zachary; Holmlund, Terje Bektesevic; Elvevåg, Brita (Journal article; Tidsskriftartikkel; Peer reviewed, 2022-09-22)
      Modern advances in computational language processing methods have enabled new approaches to the measurement of mental processes. However, the field has primarily focused on model accuracy in predicting performance on a task or a diagnostic category. Instead the field should be more focused on determining which computational analyses align best with the targeted neurocognitive/psychological functions ...
    • Reflections on the nature of measurement in language-based automated assessments of patients' mental state and cognitive function 

      Foltz, Peter W.; Chandler, Chelsea; Diaz-Asper, Catherine; Holmlund, Terje Bektesevic; Elvevåg, Brita (Journal article; Tidsskriftartikkel; Peer reviewed, 2022-09-22)
      Modern advances in computational language processing methods have enabled new approaches to the measurement of mental processes. However, the field has primarily focused on model accuracy in predicting performance on a task or a diagnostic category. Instead the field should be more focused on determining which computational analyses align best with the targeted neurocognitive/psychological functions ...
    • Towards a temporospatial framework for measurements of disorganization in speech using semantic vectors 

      Holmlund, Terje Bektesevic; Chandler, Chelsea; Foltz, Peter W.; Diaz-Asper, Catherine; Cohen, Alex S.; Rodriguez, Zachary; Elvevåg, Brita (Journal article; Tidsskriftartikkel; Peer reviewed, 2022-11-10)
      Incoherent speech in schizophrenia has long been described as the mind making “leaps” of large distances between thoughts and ideas. Such a view seems intuitive, and for almost two decades, attempts to operationalize these conceptual “leaps” in spoken word meanings have used language-based embedding spaces. An embedding space represents meaning of words as numerical vectors where a greater proximity ...
    • Translating Natural Language Processing into Mainstream Schizophrenia Assessment 

      Elvevåg, Brita; Cohen, Alex S. (Journal article; Tidsskriftartikkel; Peer reviewed, 2022-09-01)
      Natural language processing (NLP) is a multidisciplinary field that involves objectifying aspects of language. Specifically, it understands human language by leveraging statistical and linguistic knowledge. NLP’s potential for enhancing the administration, accuracy, and objectivity of clinical assessments in psychiatry has been touted, as well as its potential for promoting equity in health care. ...
    • Updating verbal fluency analysis for the 21st century: Applications for psychiatry 

      Holmlund, Terje Bektesevic; Cheng, Jian; Foltz, Peter W.; Cohen, Alex S.; Elvevåg, Brita (Journal article; Tidsskriftartikkel; Peer reviewed, 2019-02-07)
      Evaluating patients’ verbal fluency by counting the number of unique words (e.g., animals) produced in a short-period (e.g., 1–3 min) is one of the most widely employed cognitive tests in psychiatric research. We introduce new methods to analyze fluency output that leverage modern computational language technology. This enables moving beyond simple word counts to charting the temporal dynamics of ...
    • Using Automated Speech Processing for Repeated Measurements in a Clinical Setting of the Behavioral Variability in the Stroop Task 

      Holmlund, Terje Bektesevic; Cohen, Alex S; Cheng, Jian; Foltz, Peter W.; Bernstein, Jared; Rosenfeld, Elisabeth; Laeng, Bruno; Elvevåg, Brita (Journal article; Tidsskriftartikkel; Peer reviewed, 2023-03-04)
      The Stroop interference task is indispensable to current neuropsychological practice. Despite this, it is limited in its potential for repeated administration, its sensitivity and its demands on professionals and their clients. We evaluated a digital Stroop deployed using a smart device. Spoken responses were timed using automated speech recognition. Participants included adult nonpatients (N = ...
    • Using automated syllable counting to detect missing information in speech transcripts from clinical settings 

      Diaz-Asper, Marama; Holmlund, Terje Bektesevic; Chandler, Chelsea; Diaz-Asper, Catherine; Foltz, Peter W.; Cohen, Alex S.; Elvevåg, Brita (Journal article; Tidsskriftartikkel; Peer reviewed, 2022-07-05)
      Speech rate and quantity reflect clinical state; thus automated transcription holds potential clinical applications. We describe two datasets where recording quality and speaker characteristics affected transcription accuracy. Transcripts of low-quality recordings omitted significant portions of speech. An automated syllable counter estimated actual speech output and quantified the amount of ...
    • Using machine learning in psychiatry: The need to establish a framework that nurtures trustworthiness 

      Chandler, Chelsea; Foltz, Peter W.; Elvevåg, Brita (Journal article; Tidsskriftartikkel; Peer reviewed, 2019-11-01)
      The rapid embracing of artificial intelligence in psychiatry has a flavor of being the current “wild west”; a multidisciplinary approach that is very technical and complex, yet seems to produce findings that resonate. These studies are hard to review as the methods are often opaque and it is tricky to find the suitable combination of reviewers. This issue will only get more complex in the absence ...
    • Validating Biobehavioral Technologies for Use in Clinical Psychiatry 

      Cohen, Alex S.; Cox, Christopher R.; Tucker, Raymond P.; Mitchell, Kyle R.; Schwartz, Elana K.; Le, Thanh P.; Foltz, Peter W.; Holmlund, Terje Bektesevic; Elvevåg, Brita (Journal article; Tidsskriftartikkel; Peer reviewed, 2021-06-11)
      The last decade has witnessed the development of sophisticated biobehavioral and genetic, ambulatory, and other measures that promise unprecedented insight into psychiatric disorders. As yet, clinical sciences have struggled with implementing these objective measures and they have yet to move beyond “proof of concept.” In part, this struggle reflects a traditional, and conceptually flawed, application ...
    • What Drives Animal Fluency Performance in Cantonese-Speaking Chinese Patients with Adult-Onset Psychosis? 

      Hui, Christy Lai-Ming; See, Sally Hiu-Wah; Chiu, Tsz-Ching; Pintos, Andrea Stephanie; Kroyer, Johanna M.; Suen, Yi-Nam; Lee, Edwin Ho-Ming; Chan, Sherry Kit-Wa; Chang, Wing-Chung; Elvevåg, Brita; Chen, Eric Yu-Hai (Journal article; Tidsskriftartikkel; Peer reviewed, 2023-02-27)
      Among the numerous studies investigating semantic factors associated with functioning in psychotic patients, most have been conducted on western populations. By contrast, the current cross-sectional study involved native Cantonese-speaking Chinese participants. Using the category fluency task, we compared performance between patients and healthy participants and examined clinical and sociodemographic ...