Intracranial EEG monitoring in pre-surgical evaluation of patients with epilepsy is essential to localize the seizure onset zone and seizure spread. MRI coregistration with intracranial electrodes is then used to make sense of the anatomic correlation of the epileptiform activity. However, analyzing epilepsy through mapping EEG data and MRI visualization can be time-consuming and is subject to bi-dimensional planes. By using software applications for analyzing MRI scans, specialists search for suitable Axial, Sagittal and Coronal planes to be able to observe the depth of electrodes and determine seizure sites from different perspectives.

Immersive technologies can enhance the analysis process by providing virtual holograms of the brain that can visualize where seizures originate and how they propagate, thereby reducing the time specialists spend on mentally integrating EEG data and MRI scans, and increasing precision. We leverage immersive technologies such as augmented reality and virtual reality to integrate intracranial EEG and structural MRI data to help specialists to be able to identify different onset seizures and track seizure propagating through different brain regions. We aim to show the temporal dynamics of EEG data over brain areas created from MRI scans.

We will be developing an immersive application that will provide the following features:

  • Show the MRI scan and the EEG data in a spatial environment
  • Allow doctors to select the start and end of a seizure in any EEG channel
  • Link EEG channels with the specific electrode that generates them
  • Fuse the EEG data with the MRI data by highlighting where a seizure is occurring in the brain
  • Visualizing how seizures propagate through the brain over time Figure 1 conceptualizes this system.

After the initial system is completed, we will utilize machine learning techniques to semi-automate the identification of the start and end of seizures as well as for linking EEG channels to electrodes in the brain.