Click here to sign in with or
Forget Password?
Learn more
share this!
25
Twit
Share
Email
February 21, 2024
This article has been reviewed according to Science X’s editorial process and policies. Editors have highlighted the following attributes while ensuring the content’s credibility:
fact-checked
peer-reviewed publication
trusted source
proofread
by Public Library of Science
Complex neuroimaging data can be explored through translation into an audiovisual format—a video with accompanying musical soundtrack—to help interpret what happens in the brain when performing certain behaviors.
David Thibodeaux and colleagues at Columbia University, US, present this technique in the open-access journal PLOS ONE. Examples of these beautiful “brain movies” are included below.
Recent technological advances have made it possible for multiple components of activity in the awake brain to be recorded in real time. Scientists can now observe, for instance, what happens in a mouse’s brain when it performs specific behaviors or receives a certain stimulus. However, such research produces large quantities of data that can be difficult to intuitively explore to gain insights into the biological mechanisms behind brain activity patterns.
Prior research has shown that some brain imaging data can be translated into audible representations. Building on such approaches, Thibodeaux and colleagues developed a flexible toolkit that enables translation of different types of brain imaging data—and accompanying video recordings of lab animal behavior—into audiovisual representations.
The researchers then demonstrated the new technique in three different experimental settings, showing how audiovisual representations can be prepared with data from various brain imaging approaches, including 2D wide-field optical mapping (WFOM) and 3D swept confocally aligned planar excitation (SCAPE) microscopy.
The toolkit was applied to previously collected WFOM data that detected both neural activity and brain blood flow changes in mice engaging in different behaviors, such as running or grooming.
Neuronal data was represented by piano sounds that struck in time with spikes in brain activity, with the volume of each note indicating magnitude of activity and its pitch indicating the location in the brain where the activity occurred.
Meanwhile, blood flow data were represented by violin sounds. The piano and violin sounds, played in real time, demonstrate the coupled relationship between neuronal activity and blood flow. Viewed alongside a video of the mouse, a viewer can discern which patterns of brain activity corresponded to different behaviors.
The authors note that their toolkit is not a substitute for quantitative analysis of neuroimaging data. Nonetheless, it could help scientists screen large datasets for patterns that might otherwise have gone unnoticed and are worth further analysis.
The authors add, “Listening to and seeing representations of [brain activity] data is an immersive experience that can tap into this capacity of ours to recognize and interpret patterns (consider the online security feature that asks you to ‘select traffic lights in this image’—a challenge beyond most computers, but trivial for our brains)…[It] is almost impossible to watch and focus on both the time-varying [brain activity] data and the behavior video at the same time, our eyes will need to flick back and forth to see things that happen together.”
“You generally need to continually replay clips over and over to be able to figure out what happened at a particular moment. Having an auditory representation of the data makes it much simpler to see (and hear) when things happen at the exact same time.”
More information: Audiovisualization of real-time neuroimaging data, PLoS ONE (2024). DOI: 10.1371/journal.pone.0297435. journals.plos.org/plosone/arti … journal.pone.0297435
Explore further
Facebook
Twitter
Email
Feedback to editors
Feb 22, 2024
0
Feb 22, 2024
0
Feb 21, 2024
0
Feb 21, 2024
0
Feb 20, 2024
0
7 hours ago
20 hours ago
22 hours ago
22 hours ago
22 hours ago
22 hours ago
23 hours ago
23 hours ago
Feb 23, 2024
Feb 23, 2024
Nov 20, 2023
Aug 2, 2021
Jul 19, 2023
Mar 30, 2023
Apr 26, 2021
Dec 7, 2020
7 hours ago
20 hours ago
22 hours ago
22 hours ago
Feb 23, 2024
Feb 23, 2024
Use this form if you have come across a typo, inaccuracy or would like to send an edit request for the content on this page. For general inquiries, please use our contact form. For general feedback, use the public comments section below (please adhere to guidelines).
Please select the most appropriate category to facilitate processing of your request
Thank you for taking time to provide your feedback to the editors.
Your feedback is important to us. However, we do not guarantee individual replies due to the high volume of messages.
Your email address is used only to let the recipient know who sent the email. Neither your address nor the recipient’s address will be used for any other purpose. The information you enter will appear in your e-mail message and is not retained by Medical Xpress in any form.
Get weekly and/or daily updates delivered to your inbox. You can unsubscribe at any time and we’ll never share your details to third parties.
More information Privacy policy
We keep our content available to everyone. Consider supporting Science X’s mission by getting a premium account.
Daily science news on research developments and the latest scientific innovations
The latest engineering, electronics and technology advances
The most comprehensive sci-tech news coverage on the web
Leave a Reply