Mind-assisting / digital phenotyping

Curious platform screenshot

Monitoring experience and cognition — using a platform to build your own data collection, research, assessment, and intervention apps

I created Curious (gettingcurious.com, formerly "MindLogger") to enable anyone anywhere to create their own mobile/web applications for conducting end-to-end encrypted, remote data collection, assessments, cognitive tasks, and interventions. It is easy to use and rich with features (survey tools, audio/video recordings, drawing, geolocation, specialized millisecond-precision cognitive tasks, etc.). My primary use is for (1) ecological momentary assessments, to know what people are thinking, feeling, and how they are behaving in their daily lives, and (2) collecting performance task data in Curious alongside sensor data (EEG, EMG, electrodermal, movement, heart rate, eye tracking, pupillometry, etc.). The project has received over $10 million in funding from the State of California, NIH, MIT, Paris LPI, and Hearst, Stavros Niarchos, and Hirani foundations.

LinguaLearn app Language app

GenAI-powered language tools for research and interventions

LinguaLearn is a set of tools under development that uses deep learning models, sound morphing, LLM-based word games, and real-time visual feedback to help people improve their pronunciation and verbal fluency.

MediaMentor is a new project that will use an LLM to help families grapple with concerning video content by introducing an interactive avatar that detects and discusses this content with the viewer.

Mosaic is a database and recommendation system that will use LLMs, expert source content, and template guides to generate personalized mental health guides for use by patients, parents, educators, and clinicians.

Publications

Publication

B Mulholland, I Goodall-Halliwell, R Wallace, L Chitiz, B Mckeown, A Rastan, G Poerio, R Leech, A Turnbull, A Klein, M Milham, J Wammes, E Jefferies, J Smallwood. Patterns of ongoing thought in the real world. Consciousness and Cognition 114:103530 (2023). doi:10.1016/j.concog.2023.103530

Publication

F Schoeller, A Horowitz, P Maes, A Jain, N Reggente, LC Moore, M Trousselard, A Klein, L Barca, G Pezzulo, M Allen, V Adrien, M Miller, R Salomon, G Riva, D DiLernia, M Tsakiris, C Verdonk, MA Chalah, G Dumas, K Friston. Interoceptive technologies for clinical neuroscience. Neuroscience & Biobehavioral Reviews 156:105478 (2023). doi:10.1016/j.neubiorev.2023.105478

Publication Publication

L Omberg, E Chaibub Neto, TM Perumal, A Pratap, J Adams, BR Bloem, BM Bot, M Elson, SM Goldman, MR Kellen, K Kieburtz, A Klein, MA Little, R Schneider, C Suver, C Tarolli, CM Tanner, AD Trister, J Wilbanks, ER Dorsey, LM Mangravite. Remote smartphone monitoring of Parkinson's disease and individual response to therapy. Nature Biotechnology 40:480-487 (2022). doi: doi.org/10.1038/s41587-021-00974-9

Commentary: W Maetzler, A Pilotto. Digital assessment at home - mPower against Parkinson disease. Nature Reviews Neurology 17:661-662 (2021). doi:10.1038/s41582-021-00567-9

Publication

LM Alexander, J Escalera, L Ai, C Andreotti, K Febre, A Mangone, NV Potler, N Langer, A Alexander, M Kovacs, S Litke, B O'Hagan, B Bronstein, A Bui, M Bushey, V Castagna, N Camacho, E Chan, D Citera, J Clucas, S Cohen, M Eaves, B Fradera, N Grant-Villegas, G Green, C Gregory, E Hart, S Harris, C Lord, D Kahn, K Kabotyanski, K Kleinman, B Koo, E Kramer, A Margolis, KR Merikangas, J Milham, G Minniti, R Neuhaus, A Nussbaum, Y Osman, LC Parra, KR Pugh, A Racanello, A Restrepo, T Saltzman, B Septimus, R Tobe, R Waltz, A Williams, A Yeo, FX Castellanos, A Klein, T Paus, BL Leventhal, RC Craddock, HS Koplewicz, MP Milham. An open resource for transdiagnostic research in pediatric mental health and learning disorders. Scientific Data. 4:170181 (2017). doi:10.1038/sdata.2017.181

Proceedings and proposals

Invertebrate sleep and learning

I have collaborated with my identical twin brother for years, and the following studies have focused on how invertebrate sleep impacts a society, when and where bees sleep, and how it affects their ability to communicate.