<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Neurol.</journal-id>
<journal-title>Frontiers in Neurology</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Neurol.</abbrev-journal-title>
<issn pub-type="epub">1664-2295</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fneur.2014.00272</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Neuroscience</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Low Consistency of Four Brain Connectivity Measures Derived from Intracranial Electrode Measurements</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>Jones</surname> <given-names>Stephen E.</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="corresp" rid="cor1">&#x0002A;</xref>
<uri xlink:href="http://frontiersin.org/people/u/111543"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Beall</surname> <given-names>Erik B.</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<uri xlink:href="http://frontiersin.org/people/u/198589"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Najm</surname> <given-names>Imad</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
</contrib>
<contrib contrib-type="author">
<name><surname>Sakaie</surname> <given-names>Ken E.</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<uri xlink:href="http://frontiersin.org/people/u/49630"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Phillips</surname> <given-names>Michael D.</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<uri xlink:href="http://frontiersin.org/people/u/198434"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Zhang</surname> <given-names>Myron</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<uri xlink:href="http://frontiersin.org/people/u/197959"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Gonzalez-Martinez</surname> <given-names>Jorge A.</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<uri xlink:href="http://frontiersin.org/people/u/124524"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Cleveland Clinic</institution>, <addr-line>Cleveland, OH</addr-line>, <country>USA</country></aff>
<aff id="aff2"><sup>2</sup><institution>Ohio State University College of Medicine</institution>, <addr-line>Columbus, OH</addr-line>, <country>USA</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: David Vaughan, The Florey Institute of Neuroscience and Mental Health, Australia</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Andreas Schulze-Bonhage, University Medical Center Freiburg, Germany; Giridhar Padmanabhan Kalamangalam, University of Texas Health Science Center, USA</p></fn>
<corresp content-type="corresp" id="cor1">&#x0002A;Correspondence: Stephen E. Jones, U15, 9500 Euclid Avenue, Cleveland, OH 44195, USA e-mail: <email>joness19&#x00040;ccf.org</email></corresp>
<fn fn-type="other" id="fn001"><p>This article was submitted to Epilepsy, a section of the journal Frontiers in Neurology.</p></fn>
</author-notes>
<pub-date pub-type="epub">
<day>19</day>
<month>12</month>
<year>2014</year>
</pub-date>
<pub-date pub-type="collection">
<year>2014</year>
</pub-date>
<volume>5</volume>
<elocation-id>272</elocation-id>
<history>
<date date-type="received">
<day>07</day>
<month>07</month>
<year>2014</year>
</date>
<date date-type="accepted">
<day>02</day>
<month>12</month>
<year>2014</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2014 Jones, Beall, Najm, Sakaie, Phillips, Zhang and Gonzalez-Martinez.</copyright-statement>
<copyright-year>2014</copyright-year>
<license license-type="open-access" xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract>
<p>Measures of brain connectivity are currently subject to intense scientific and clinical interest. Multiple measures are available, each with advantages and disadvantages. Here, we study epilepsy patients with intracranial electrodes, and compare four different measures of connectivity. Perhaps the most direct measure derives from intracranial electrodes; however, this is invasive and spatial coverage is incomplete. These electrodes can be actively stimulated to trigger electrophysical responses to provide the first measure of connectivity. A second measure is the recent development of simultaneous BOLD fMRI and intracranial electrode stimulation. The resulting BOLD maps form a measure of effective connectivity. A third measure uses low frequency BOLD fluctuations measured by MRI, with functional connectivity defined as the temporal correlation coefficient between their BOLD waveforms. A fourth measure is structural, derived from diffusion MRI, with connectivity defined as an integrated diffusivity measure along a connecting pathway. This method addresses the difficult requirement to measure connectivity between any two points in the brain, reflecting the relatively arbitrary location of the surgical placement of intracranial electrodes. Using a group of eight epilepsy patients with intracranial electrodes, the connectivity from one method is compared to another method using all paired data points that are in common, yielding an overall correlation coefficient. This method is performed for all six paired-comparisons between the four methods. While these show statistically significant correlations, the magnitudes of the correlation are relatively modest (<italic>r</italic><sup>2</sup> between 0.20 and 0.001). In summary, there are many pairs of points in the brain that correlate well using one measure yet correlate poorly using another measure. These experimental findings present a complicated picture regarding the measure or meaning of brain connectivity.</p>
</abstract>
<kwd-group>
<kwd>intracranial electrodes</kwd>
<kwd>brain stimulation</kwd>
<kwd>functional MRI</kwd>
<kwd>structural connectivity</kwd>
<kwd>functional connectivity</kwd>
</kwd-group>
<counts>
<fig-count count="8"/>
<table-count count="3"/>
<equation-count count="0"/>
<ref-count count="22"/>
<page-count count="11"/>
<word-count count="7811"/>
</counts>
</article-meta>
</front>
<body>
<sec id="S1" sec-type="introduction">
<title>Introduction</title>
<p>The importance of brain connectivity is self-evident given the underlying network structure of the brain. Structural MRI, which interrogates each point in the brain, is invaluable to science and medicine. The point-to-point relationships of connectivity imaging are equally as invaluable, if not more so, given the inherent network nature of brain functions. As such, connectivity imaging represents the next step in the continuing evolution of neuroimaging. However, unlike structural imaging, contemporary connectivity analyses have not yielded findings of relevance for treatment in individual patients.</p>
<p>There are many measures of connectivity, which could be dichotomized into functional and structural. Examples of structural connectivity are derived from invasive measures such as axonal tracing or nuclear tracing, with the prime non-invasive method of MRI using diffusion-weighted imaging (dMRI). Examples of functional connectivity include measures derived from scalp EEG, intracranial EEG, PET studies, cortical thickness studies, task-related fMRI, and resting state fMRI (rsfMRI). All these methods have advantages and disadvantages, related to spatial and temporal resolution, coverage, effectiveness, and invasiveness. Given numerous methodologies and metrics of connectivity (<xref ref-type="bibr" rid="B1">1</xref>, <xref ref-type="bibr" rid="B2">2</xref>), it is natural to compare them with the hypothesis that if the metrics are sensitive to the underlying network architecture of the brain, then the connectivity measures should strongly correlate with each other. This inquiry raises the question about the exact definition of connectivity, and what could be considered the &#x0201C;gold standard.&#x0201D;</p>
<p>The paper focuses on recent measurements obtained from a group of eight patients with medically intractable epilepsy, who underwent both invasive electroencephalographic (EEG) and evoked potentials mapping with implantable intracranial electrodes and advanced neuroimaging with MRI. Using these methods, a total of four modalities of connectivity were explored: structural connectivity using dMRI, functional connectivity using rsfMRI, functional connectivity using precise electrical stimulation and recording (cortico-cortical evoked potentials, CCEPs) from intracranial electrodes, and combined intracranial stimulation and BOLD fMRI. These four modalities of connectivity are compared on a pairwise basis, and we show that although the comparisons reveal statistically significant correlations, the correlation values are modest. Furthermore, these methods, as commonly interpreted today, do not reach the same consensus. In other words, there are many pairs of points in the brain that correlate strongly using modality A, but correlate weakly using modality B, and visa versa. A possible future method to unify these differences may incorporate a mathematical model of brain function, which would permit the translation of one connectivity measure to another.</p>
</sec>
<sec id="S2" sec-type="materials|methods">
<title>Materials and Methods</title>
<p>Four different measures of connectivity are used in this study; all measured in epilepsy patients who underwent an invasive evaluation to better localize and map the extent of the epileptogenic zone (EZ). The four measures are functional connectivity derived from electrophysiological response to electrical stimulation (CCEPs); functional connectivity derived from low-frequency BOLD oscillations in the rsfMRI; functional connectivity derived from simultaneous direct electrical stimulation and BOLD functional MRI (DES-fMRI); and structural connectivity derived from dMRI using high-angular resolution diffusion imaging (HARDI).</p>
<p>After obtaining IRB approval, a total of eight patients were enrolled. All patients were recruited from the Cleveland Clinic Epilepsy Center with a diagnosis of intractable focal epilepsy, and underwent an intensive evaluation culminating in the placement of intracranial electrodes. All patients underwent CCEP stimulation, with multiple locations of stimulation, including the Broca&#x02019;s speech region, and the presumed EZ. The first four patients had HARDI and rsfMRI performed prior to implantation, and the last four had HARDI and rsfMRI performed after implantation. These measurements were performed as a &#x0201C;piggy back&#x0201D; during their standard clinical care, and did not interfere with their clinical care. Table <xref ref-type="table" rid="T1">1</xref> lists some clinical characteristics of the patients and the different modalities that were measured.</p>
<table-wrap position="float" id="T1">
<label>Table 1</label>
<caption><p><bold>Details of intracranial electrodes placed in eight patients</bold>.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th valign="top" align="left">Patient Number</th>
<th valign="top" align="center">Age</th>
<th valign="top" align="center">Implantation</th>
<th valign="top" align="center">Number of intracranial contacts</th>
<th valign="top" align="center">Number of CCEP stimulations</th>
<th valign="top" align="center">dMRI rsfMRI</th>
<th valign="top" align="center">DES-fMRI</th>
<th valign="top" align="left">Location of stimulation</th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">1</td>
<td valign="top" align="center">45</td>
<td valign="top" align="center">SDG<xref ref-type="table-fn" rid="tfn1"><sup>a</sup></xref></td>
<td valign="top" align="center">123</td>
<td valign="top" align="center">4</td>
<td valign="top" align="center">Y</td>
<td valign="top" align="center"/>
<td valign="top" align="left">Left Broca, Left Wernike, Ictal onset zone &#x000D7;2</td>
</tr>
<tr>
<td valign="top" align="left">2</td>
<td valign="top" align="center">40</td>
<td valign="top" align="center">SEEG<xref ref-type="table-fn" rid="tfn2"><sup>b</sup></xref></td>
<td valign="top" align="center">57</td>
<td valign="top" align="center">9</td>
<td valign="top" align="center">Y</td>
<td valign="top" align="center"/>
<td valign="top" align="left">Multiple bi-occipital and right temporal</td>
</tr>
<tr>
<td valign="top" align="left">3</td>
<td valign="top" align="center">19</td>
<td valign="top" align="center">SDG</td>
<td valign="top" align="center">106</td>
<td valign="top" align="center">7</td>
<td valign="top" align="center">Y</td>
<td valign="top" align="center"/>
<td valign="top" align="left">Left Broca, Wernike, ictal onset zone &#x000D7;3</td>
</tr>
<tr>
<td valign="top" align="left">4</td>
<td valign="top" align="center">40</td>
<td valign="top" align="center">SEEG</td>
<td valign="top" align="center">104</td>
<td valign="top" align="center">5</td>
<td valign="top" align="center">Y</td>
<td valign="top" align="center"/>
<td valign="top" align="left">Multiple right frontoparietal</td>
</tr>
<tr>
<td valign="top" align="left">5</td>
<td valign="top" align="center">25</td>
<td valign="top" align="center">SEEG</td>
<td valign="top" align="center">120</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center"/>
<td valign="top" align="center">Y</td>
<td valign="top" align="left">Left orbito-frontal</td>
</tr>
<tr>
<td valign="top" align="left">6</td>
<td valign="top" align="center">41</td>
<td valign="top" align="center">SEEG</td>
<td valign="top" align="center">130</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center"/>
<td valign="top" align="center">Y</td>
<td valign="top" align="left">Right posterior cingulate</td>
</tr>
<tr>
<td valign="top" align="left">7</td>
<td valign="top" align="center">42</td>
<td valign="top" align="center">SEEG</td>
<td valign="top" align="center">160</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center"/>
<td valign="top" align="center">Y</td>
<td valign="top" align="left">Right peri-insula</td>
</tr>
<tr>
<td valign="top" align="left">8</td>
<td valign="top" align="center">54</td>
<td valign="top" align="center">SEEG</td>
<td valign="top" align="center">130</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center"/>
<td valign="top" align="center">Y</td>
<td valign="top" align="left">Right orbito-frontal</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn id="tfn1"><p><italic><sup>a</sup>SDG: subdural grids</italic>.</p></fn>
<fn id="tfn2"><p><italic><sup>b</sup>SEEG: stereoencephalography</italic>.</p></fn>
</table-wrap-foot>
</table-wrap>
<sec id="S2-1">
<title>Cortico-cortical evoked potentials</title>
<p>All CCEP stimulations used a GRASS used current-controlled Grass Technologies S88 and SUI-7 units (Astro-Med), with the following parameters: 1&#x02009;Hz unipolar pulses with alternating polarity between pulses, 0.3&#x02009;ms pulsewidth, with variable current (4&#x02013;15&#x02009;mA), applied across an adjacent electrode pair. An optical current isolator was used to ensure that the patient was isolated from ground. For each CCEP stimulation location shown in Table <xref ref-type="table" rid="T1">1</xref>, between 16 and 60 (typically around 45) stimulating pulses were sent from the chosen electrode pair, and waveform responses were recorded from all other implanted contacts, at a 1&#x02009;kHz recording rate. Four patients also had CCEP performed while simultaneously undergoing MRI, and for these patients a stimulation frequency of at least 10&#x02009;Hz was required to elicit a robust BOLD response (<xref ref-type="bibr" rid="B3">3</xref>). The CCEP voltage waveforms obtained at each electrode were averaged, discarding any outliers that were usually due to motion and other artifacts. Because of the alternating polarity of each pulse, most of the stimulus artifact was removed, and average waveforms could be reliable seen as early as 5&#x02009;ms after the stimulus. A scalar baseline was subtracted from each waveform, derived from an average of the waveform during a 40&#x02009;ms window obtained just before the stimulus. There are many methods to &#x0201C;score&#x0201D; the strength of the averaged CCEP waveform, which can be used as the measure of electrophysiological connectivity. Typically, these methods use the average voltage during a time window after stimulus. Other methods can use the slope, latency, integral, magnitude, and other features of the voltage waveform. For this paper, the chosen time window depended on the other modality used to compare CCEP connectivity: for comparison with structural connectivity, a 5&#x02009;ms window starting 10&#x02009;ms after the stimulus was used to reflect the rapid first-pass excitation of distal cortex; for comparison with resting state connectivity a 100&#x02009;ms window starting at 20&#x02009;ms was used to reflect the longer timescale of an integrative process.</p>
</sec>
<sec id="S2-2">
<title>Resting state fMRI</title>
<p>For all studies, rsfMRI was performed on a 3T Siemens Trio (Siemens Medical Solutions, Erlangen, Germany), using a whole-brain EPI sequence: 132 repetitions of 31 4-mm thick axial slices; TE/TR, 29&#x02009;ms/2,800&#x02009;ms; matrix, 128&#x02009;&#x000D7;&#x02009;128; FOV, 256&#x02009;mm&#x02009;&#x000D7;&#x02009;256&#x02009;mm; receive bandwidth, 250&#x02009;kHz. EPI data were unwarped using a field map prior to coregistration to the unwarped diffusion acquisition space (described below in Section Structural connectivity), which was used to cross-compare the different measures. Patients were instructed to rest with their eyes closed and refrain from any voluntary motion. The data were corrected for motion, adaptive physiologic noise sources (<xref ref-type="bibr" rid="B4">4</xref>, <xref ref-type="bibr" rid="B5">5</xref>), and second-order motion (<xref ref-type="bibr" rid="B6">6</xref>). The data were interpolated to the DWI space (see below). Functional connectivity maps of the brain were produced using a seed approach, yielding a pairwise temporal correlation coefficient to every other brain voxel. The seed was selected to be the site of stimulation. The time waveforms used in the correlation were the average waveforms of the 27 voxels of a voxel and its nearest neighbors, excluding any CSF-containing voxels.</p>
</sec>
<sec id="S2-3">
<title>Direct electrical stimulation and functional MRI</title>
<p>Direct electrical stimulation and functional MRI (DES-fMRI) is a recently developed modality (<xref ref-type="bibr" rid="B3">3</xref>) in which simultaneous fMRI is acquired during stimulation of a single intracranial electrode. The procedure was conducted in an intraoperative MRI suite with the patients under general anesthesia. Using appropriate stimulation frequencies and currents (typically around 20&#x02009;Hz and 4&#x02013;8&#x02009;mA), robust BOLD activation could be generated both proximal and distal to the electrodes. Typically, the activation occurred in patterns that reflect the underlying network. Both positive and &#x0201C;negative&#x0201D; activation could be triggered. Activation could also be induced by white matter stimulation. Using this method, the connectivity metric between the stimulation point S and another point P can be defined as the degree of BOLD change or its statistical significance at point P. Thus, the usual 3D BOLD maps can be viewed as a connectivity map. Prior to DES-fMRI the patients had a comparable CCEP stimulation performed outside of the MRI with all electrodes in place and recording the stimulation&#x02019;s response, thereby measuring electrophysiological connectivity. By co-localizing the electrode location to the DES-fMRI, a comparison could be directly made between electrophysiological connectivity and DES-fMRI connectivity.</p>
</sec>
<sec id="S2-4">
<title>Structural connectivity</title>
<p>High-angular resolution diffusion imaging images were obtained on a Siemens Trio (Siemens Medical Solutions, Erlangen, Germany) with a standard 12-channel head coil. The HARDI acquisition provided whole-brain coverage with 2.5&#x02009;mm isotropic voxels (256&#x02009;mm&#x02009;&#x000D7;&#x02009;256&#x02009;mm FOV, 102&#x02009;&#x000D7;&#x02009;102 matrix, 48 slices. TE&#x02009;&#x0003D;&#x02009;77&#x02009;ms, TR&#x02009;&#x0003D;&#x02009;6500&#x02009;ms, BW&#x02009;&#x0003D;&#x02009;1442&#x02009;Hz/pixel, partial Fourier factor&#x02009;&#x0003D;&#x02009;5/8, 61 non-collinear diffusion-weighting gradients with robust ordering with <italic>b</italic>&#x02009;&#x0003D;&#x02009;1000&#x02009;s/mm<sup>2</sup> and 7 <italic>b</italic>&#x02009;&#x0003D;&#x02009;0 volumes, two averages). Warping effects were addressed by using static image-based unwarping (<xref ref-type="bibr" rid="B7">7</xref>) on the diffusion data prior to diffusivity calculation. Motion correction was performed with an iterative algorithm (<xref ref-type="bibr" rid="B8">8</xref>) that updated gradient vectors (<xref ref-type="bibr" rid="B9">9</xref>). Fiber orientation distributions were calculated in each voxel by spherical deconvolution (<xref ref-type="bibr" rid="B10">10</xref>) with user-independent optimized regularization (<xref ref-type="bibr" rid="B11">11</xref>). Local transition probabilities were calculated by integrating over the solid angle of a vector connecting each voxel with its 26 neighbors.</p>
<p>The cross-modal comparison performed in this project places additional demands on metrics to measure structural connectivity. For example, since intracranial electrode contacts can be placed in any arbitrary place in the brain, the task of comparing structural to electrophysiological connectivity requires that the structural metric be able to assess or &#x0201C;score&#x0201D; a connection between any two points in the brain. Since these two points may not necessarily both lie along a large fiber track, deterministic methods will fail and probabilistic methods are favored. A further demand is that the &#x0201C;seed&#x0201D; and/or &#x0201C;target&#x0201D; points may lie on the cortical surface, in a region of low FA that hinders the reliable start to a trajectory. One difficulty with probabilistic methods is that they can be computationally inefficient, if they adopt a method of randomly forming a path and discarding it if it fails to reach a target. To account for this difficulty a partial differential equation (PDE) approach was developed that is the solution of a probabilistic method assuming an infinite number of trials, akin to the underlying relationship between a PDE and Monte Carlo solution to classes of differential equations (<xref ref-type="bibr" rid="B12">12</xref>). Details of this method are presented in the Data Sheet 1 in Supplementary Material.</p>
</sec>
<sec id="S2-5">
<title>Coregistration</title>
<p>The processes of coregistration of the electrode positions to the MRI voxels started with a thin section head CT following implantation of electrodes. Then using in-house techniques, all electrode contact positions were identified and recorded (<xref ref-type="bibr" rid="B13">13</xref>). The CT scan was then registered to the anatomical scan (T1-weighted MPRAGE) obtained prior to surgery, and the positions of all electrodes translated into the MRI-space. All image registration was affine and performed using FSL FLIRT (<xref ref-type="bibr" rid="B14">14</xref>, <xref ref-type="bibr" rid="B15">15</xref>). Segmentation was performed on the T1 MPRAGE images using the Freesurfer package (<uri xlink:href="http://surfer.nmr.mgh.harvard.edu/">http://surfer.nmr.mgh.harvard.edu/</uri>), whose parcelation maps were interpolated into the dMRI space.</p>
</sec>
<sec id="S2-6">
<title>Paired correlation and statistical measures</title>
<p>For each of the four modalities, as summarized in Table <xref ref-type="table" rid="T2">2</xref>, using a single location as a &#x0201C;seed,&#x0201D; a large set of connectivity values can be computed to targets outside of the seed: for the CCEP modality the targets are the other recording electrodes (which can number up to 200), and for each target a connectivity value can be computed; for the other modalities the targets are the remaining voxels occupying cortical gray matter, which can number up to 5000&#x02013;10,000. For a given patient with an intracranial electrode used for CCEP stimulation, all four measures of connectivity can be computed using the stimulation location as a common seed. This permits a cross-comparison between the modalities; specifically the connectivity from the seed to any target point can be compared between the four modalities. The comparison can be made for all targets in the form of a two-dimensional scatter plot, with each axis representing the magnitude of a modality&#x02019;s connectivity. One measure of the consistency between two modalities is the Pearson correlation coefficient, such that a value of 1 is a perfect correlation and 0 is no correlation. A <italic>p</italic>-value for the correlation coefficient is also obtained. These values were computed using Interactive Data Language (IDL, Exelis, Boulder CO, USA).</p>
<table-wrap position="float" id="T2">
<label>Table 2</label>
<caption><p><bold>Summary of the four measures of connectivity used for comparisons in epilepsy patients who underwent evaluation with intracranial electrodes</bold>.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th valign="top" align="left"/>
<th valign="top" align="left">Category</th>
<th valign="top" align="left">Method</th>
<th valign="top" align="left">Measure of connectivity</th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">1</td>
<td valign="top" align="left">Electrophysiological-stimulated</td>
<td valign="top" align="left">CCEP</td>
<td valign="top" align="left">Mean voltage during short time window</td>
</tr>
<tr>
<td valign="top" align="left">2</td>
<td valign="top" align="left">Functional-passive</td>
<td valign="top" align="left">Resting state fMRI</td>
<td valign="top" align="left">Temporal correlation coefficient, seed-based approach</td>
</tr>
<tr>
<td valign="top" align="left">3</td>
<td valign="top" align="left">Functional-stimulated</td>
<td valign="top" align="left">DES-fMRI</td>
<td valign="top" align="left"><italic>t</italic>-score from a BOLD activation map</td>
</tr>
<tr>
<td valign="top" align="left">4</td>
<td valign="top" align="left">Structural-passive</td>
<td valign="top" align="left">dMRI</td>
<td valign="top" align="left">Product of local connectivities along pathway determined from PDE approach</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>Aside from AFNI (<xref ref-type="bibr" rid="B22">22</xref>), FSL, and Freesurfer routines, all software routines were developed in house using the Interactive Data Language (IDL, Exelis, Boulder CO, USA). All IRB and HIPPA requirements were strictly followed.</p>
</sec>
</sec>
<sec id="S3">
<title>Results</title>
<sec id="S3-7">
<title>Cortico-cortical evoked potentials</title>
<p>Robust distal and proximal activation is easily elicited with this technique. The top panel of Figure <xref ref-type="fig" rid="F1">1</xref> shows a typical example of one complete electrode recording obtained in the parietal lobe of a patient with a large subdural grid array (&#x00023;1), who was stimulated in the frontal Broca&#x02019;s regions (as determined earlier by speech arrest using higher currents and frequencies). A series of 46 CCEP recordings are seen via their stimulation artifact (tall alternating spikes), occurring over a recording duration of 50&#x02009;s. The middle panel of Figure <xref ref-type="fig" rid="F1">1</xref> shows an overlay of the 46 CCEP recordings from the same electrode mapped to a common stimulation time point, with the red line showing the mean signal. This plot reveals the degree of variability typical in these electrophysiological experiments. The white line in the bottom panel of Figure <xref ref-type="fig" rid="F1">1</xref> shows the mean signal from an electrode in the parietal lobe known to be associated with language (as determined earlier using speech arrest obtained after stimulation at higher currents and frequencies). The observation of speech arrest and the robust CCEP signal implies that both the stimulation and recording points lie on a portion of the language network, i.e., the presumed Broca&#x02019;s and Wernicke&#x02019;s area. The overlaid red line was obtained from an adjacent electrode about 10&#x02009;mm distant, which appears markedly different, showing minimal evoked potential. The difference in these two graphs across 10&#x02009;mm indicates the spatial scale across which markedly different EP connectivities can be measured using this technique.</p>
<fig position="float" id="F1">
<label>Figure 1</label>
<caption><p><bold>Top: example of raw data recorded from one intracranial electrode (in this case overlaying the presumed Wernicke&#x02019;s area in the left angular gyrus) in response to stimulation from left Broca&#x02019;s region</bold>. There are a total of 46 alternating unipolar stimulations seen as spikes from stimulation artifact. The middle panel shows the overlay of all 46 waveforms as referenced to a common stimulation time. The red line shows the average of the waveforms, with a prominent downward peak at 100&#x02009;ms, followed by an upward peak at 230&#x02009;ms. The bottom panel shows the same average waveform overlaid with the waveform obtained from one adjacent electrode 10&#x02009;mm away, showing strong spatial variability from distal stimulation.</p></caption>
<graphic xlink:href="fneur-05-00272-g001.tif"/>
</fig>
<p>Figure <xref ref-type="fig" rid="F2">2</xref> shows an inflated surface reconstruction with an overlay of the CCEP response, obtained over a grid array of 120 electrodes. The electrical stimulation was applied to the left inferior frontal gyrus at <italic>t</italic>&#x02009;&#x0003D;&#x02009;0&#x02009;ms for a duration of 0.3&#x02009;ms, at the location shown by the two small white circles in the first image. Red colors represent positive voltage and blue are negative, using a threshold of&#x02009;&#x000B1;&#x02009;50&#x02009;&#x003BC;V, respectively. The displayed time periods are the times during which the voltage was averaged. The figure shows the relatively rapid evolution of the pattern of response during the first 50&#x02009;ms: a very early negative response is seen around the supramarginal gyrus, followed by intense activation in the temporal lobe which reverses polarity by 50&#x02009;ms. Other temporal patterns can be seen, and altogether reveals the complex nature of globally evoked potentials stimulated by a point source.</p>
<fig position="float" id="F2">
<label>Figure 2</label>
<caption><p><bold>Voltage patterns recorded from left-sided subdural grids in response to a CCEP stimulation at left Broca&#x02019;s region (whose electrode-pair is shown as two white circles in the first image)</bold>. The underlay is the inflated brain. Voltages are taken as the average during a 5&#x02009;ms window. Red represents positive voltages greater than 50&#x02009;mV; blue represents voltages less than &#x02212;50&#x02009;mV. A total of six images are shown with mean voltages taken from the displayed time intervals. Note the rapid evolution of voltage spread, which qualitatively follows the expected connection along the arcuate fasciculus.</p></caption>
<graphic xlink:href="fneur-05-00272-g002.tif"/>
</fig>
</sec>
<sec id="S3-8">
<title>Resting state fMRI</title>
<p>Figure <xref ref-type="fig" rid="F3">3</xref> shows an example of resting state connectivity as revealed from the temporal correlation coefficients using a seed method. Using the same patient in Figure <xref ref-type="fig" rid="F2">2</xref>, the seed point was taken as the stimulation location in the inferior frontal lobe, at the functional location of Broca&#x02019;s area as determined by earlier speech arrest. The green-yellow color indicates a positive correlation value greater than 0.5. The seed points are shown by the white circles, representing the locations of the stimulation electrode pair. The image reveals the widespread network of correlated resting-state fluctuations, which roughly correspond to the presumed distal language regions of the superior and inferior temporal gyri. We define our second measure of connectivity as the magnitude of the correlation coefficient. Due to the inherent three-dimensional nature of MRI, a complete map of connectivity can be produced and compared with other measures.</p>
<fig position="float" id="F3">
<label>Figure 3</label>
<caption><p><bold>Resting state connectivity map of left hemisphere, using seed-based approach with seed located at left Broca&#x02019;s region as indicated by two white circles</bold>. These are the same locations used for CCEP stimulation in Figure <xref ref-type="fig" rid="F2">2</xref>. The color scale reflects the value of the temporal correlation coefficient, with green-yellow representing any value greater than 0.5. Qualitatively there is strong correlation from Broca&#x02019;s region to other expected language areas in the left temporal lobe.</p></caption>
<graphic xlink:href="fneur-05-00272-g003.tif"/>
</fig>
</sec>
<sec id="S3-9">
<title>Direct electrical stimulation and functional MRI</title>
<p>The major results of the DES-fMRI experiments has been recently reported (<xref ref-type="bibr" rid="B3">3</xref>), and was performed safely and successfully in four patients using the methods described above. Figure <xref ref-type="fig" rid="F4">4</xref> shows an example from one patient (&#x00023;5 in Table <xref ref-type="table" rid="T1">1</xref>) who was stimulated in the left orbito-frontal region, as shown by the small black asterisk highlighted by the magenta arrow. The overlaid color represents the magnitude of the statistical map (<italic>t</italic>-score) as indicated by the color bar. This image reveals many of the salient features from all patients: (1) robust BOLD activation can be induced; (2) activation is seen both proximally (e.g., adjacent insula and hippocampus) and distally (e.g., opposite hemisphere); (4) the patterns of activation are suggestive of underlying networks, e.g., the strong linear activation along the limbic system of the cingulate gyrus; and (5) robust deactivation (or &#x0201C;negative&#x0201D; activation) is seen, which also appears to conform to underlying networks. We hypothesize for this research that the magnitude of the <italic>t</italic>-score is our third measure of connectivity. Due to the inherent three-dimensional nature of MRI, a complete map of connectivity can be produced and compared with other measures.</p>
<fig position="float" id="F4">
<label>Figure 4</label>
<caption><p><bold>Map of BOLD response in brain due to stimulation of an electrode-contact pair shown as asterisks indicated by the magenta arrow</bold>. The color bar to the right shows the value of the <italic>t</italic>-statistic, using a threshold magnitude of 3. Among the features represented are activation both proximal and distal to the contacts (including contralateral side); activation along known anatomic features such as the left cingulate gyrus; and strong negative activation as seen in the bilateral sensorimotor regions. The stimulation used a 32&#x02009;s block design with an alternating unipolar 8&#x02009;mA pulse at 20&#x02009;Hz. The TR was 2&#x02009;s, over four blocks for a 5&#x02009;min acquisition. The patient was under general anesthesia (<xref ref-type="bibr" rid="B3">3</xref>).</p></caption>
<graphic xlink:href="fneur-05-00272-g004.tif"/>
</fig>
</sec>
<sec id="S3-10">
<title>dMRI connectivity</title>
<p>Figure <xref ref-type="fig" rid="F5">5</xref> shows an example of the PDE method of tractography, using for the seed the mid-pons, and for the target the entire neocortex. A total of 200,000 tracks are produced, but for clarity only the 14,000 connecting to the precentral gyrus are displayed, which is an anterior view showing the resulting cortico-spinal tracks. Each pathway is color-coded by the magnitude of the pathway-score described in the methods. Note the method successfully tracks to all portions of the precentral gyrus, and is not affected by problems from crossing fibers from the corpus callosum or the superior longitudinal fasciculus. As expected, there is relatively strong connectivity to the upper and lower extremities, and lower connectivity to the bulbar region. The collective pathway follows the expected twisting-ribbon geometry of the known cortico-spinal tract.</p>
<fig position="float" id="F5">
<label>Figure 5</label>
<caption><p><bold>Example of tractography using the method developed for this work, using as a seed the cortical spinal tract at the level of the central pons, and displaying all tracts connecting that location to all voxels located in the precentral gyrus</bold>. Each path is color-coded by the strength of the global connectivity score as described in the Data Sheet 1 in Supplementary Material (yellow-green represents high structural connectivity; blue is intermediate; red is low). The method recapitulates the known set of pathways connecting both medial and lateral aspects of the precentral gyrus, and is not significantly affected by crossing fibers from the transcallosal and superior longitudinal fasciculus.</p></caption>
<graphic xlink:href="fneur-05-00272-g005.tif"/>
</fig>
<p>By applying this method to the invasive patients, using as the seed the location of the stimulating electrodes and using as the target the remaining neocortex, a full cortical map can be produced wherein every cortical voxel obtains a value related to the pathway score. We assume for this research that the magnitude of the pathways-score is our fourth measure of connectivity. Again, due to the inherent three-dimensional nature of MRI, a complete map of connectivity can be produced and compared with other measures.</p>
<p>Figure <xref ref-type="fig" rid="F6">6</xref> is an example of the dMRI method applied to the same patient in Figures <xref ref-type="fig" rid="F2">2</xref> and <xref ref-type="fig" rid="F3">3</xref>, using as a seed the left Broca&#x02019;s region and then tracking to and scoring all remaining gray matter voxels. The white circles again represent the location of the stimulating electrodes, which were identified to stimulate Broca&#x02019;s region. The color scale is normalized so that yellow-green is a higher pathway-score than blue. The pattern shows increased connectivity to the presumed language regions of the parietal lobe, in addition to connections in the frontal lobe. This procedure was repeated for all stimulation sites in patients &#x00023;1&#x02013;4. Since all cortical voxels can be scored, complete comparisons can be made to the other methods that compute a connectivity value at all cortical voxels, namely rsfMRI and DES-fMRI. CCEP is the only method of the four presented that computes a connectivity score at a relatively small number (100&#x02013;200) of locations.</p>
<fig position="float" id="F6">
<label>Figure 6</label>
<caption><p><bold>Left lateral view of structural connectivity, using the electrode locations (white circles) stimulating Broca&#x02019;s region as a seed and connecting to all other cortical gray matter voxels</bold>. This is the same patient shown in Figures <xref ref-type="fig" rid="F2">2</xref> and <xref ref-type="fig" rid="F3">3</xref>. The green color indicates higher structural connectivity, whereas blue color indicates lower structural connectivity.</p></caption>
<graphic xlink:href="fneur-05-00272-g006.tif"/>
</fig>
</sec>
<sec id="S3-11">
<title>Cross-correlations</title>
<p>After applying these four methods of computing connectivity to a common seed location in an epilepsy patient with intracranial electrodes, a paired comparison can be made between any two selected methods. Figure <xref ref-type="fig" rid="F7">7</xref> displays the six different paired comparisons possible from four methods, each shown as a two-dimensional scatter plot with each axis representing the connectivity value of a selected method. The data from different seed locations are superimposed on each plot. In addition, all available data from the eight patients are also superimposed on each plot. For each plot, the Pearson correlation coefficient <italic>r</italic><sup>2</sup> and its associated <italic>p</italic>-value are computed from the entire ensemble of displayed data points. These numbers are printed at the top and also listed in Table <xref ref-type="table" rid="T3">3</xref>. Hypothesizing that the value of the correlation coefficient is a measure of the consistency between two methods of connectivity, there is a wide range of correspondence ranging from 0.001 to 0.20. All of the correlations show statistical significance, even for the lowest values, and is likely due to the enormous number of data points available for comparison. The lowest correlations are associated with rsfMRI, which the highest are related to CCEPs.</p>
<fig position="float" id="F7">
<label>Figure 7</label>
<caption><p><bold>The main result is displayed as a set of six paired comparisons from four different methods of measuring connectivity</bold>. Each square shows a two-dimensional scatter plot of points using the methods labeled along the axes. The data are a compilation from all eight patients. For data comparing the CCEP method, a point is plotted for each electrode contact. For the other comparisons a point is plotted for each cortical voxel, thus these plots have a higher density of points. The units of the CCEPs scale in &#x003BC;V; the units of the rsfMRI are the Pearson correlation coefficient typically ranging from &#x02212;1 to 1; the units of fMRI are the statistical <italic>t</italic>-score (using the absolute value when compared with CCEP); and the units of the dMRI are arbitrary with 0 representing negligible structural connectivity and 10 representing strong structural connectivity. The value of the Pearson correlation coefficient <italic>r</italic><sup>2</sup> computed from the data within each plot is printed in the top right corner; its associated <italic>p</italic>-value is printed in the top left corner.</p></caption>
<graphic xlink:href="fneur-05-00272-g007.tif"/>
</fig>
<table-wrap position="float" id="T3">
<label>Table 3</label>
<caption><p><bold>Paired comparison of four methods for brain connectivity</bold>.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th valign="top" align="left"/>
<th valign="top" align="center">CCEP</th>
<th valign="top" align="center">DES-fMRI</th>
<th valign="top" align="center">rsfMRI</th>
<th valign="top" align="center">dMRI</th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">CCEP</td>
<td valign="top" align="center" style="background-color:#B3B3B3;">&#x000A0;</td>
<td valign="top" align="center"><italic>r</italic><sup>2</sup>&#x02009;&#x0003D;&#x02009;0.20</td>
<td valign="top" align="center"><italic>r</italic><sup>2</sup>&#x02009;&#x0003D;&#x02009;0.004</td>
<td valign="top" align="center"><italic>r</italic><sup>2</sup>&#x02009;&#x0003D;&#x02009;0.11</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center" style="background-color:#B3B3B3;">&#x000A0;</td>
<td valign="top" align="center">&#x0003C;10<sup>&#x02212;5</sup></td>
<td valign="top" align="center">&#x0003C;10<sup>&#x02212;4</sup></td>
<td valign="top" align="center">&#x0003C;10<sup>&#x02212;5</sup></td>
</tr>
<tr>
<td valign="top" align="left">DES-fMRI</td>
<td valign="top" align="center"/>
<td valign="top" align="center" style="background-color:#B3B3B3;">&#x000A0;</td>
<td valign="top" align="center"><italic>r</italic><sup>2</sup>&#x02009;&#x0003D;&#x02009;0.001</td>
<td valign="top" align="center"><italic>r</italic><sup>2</sup>&#x02009;&#x0003D;&#x02009;0.04</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center"/>
<td valign="top" align="center" style="background-color:#B3B3B3;">&#x000A0;</td>
<td valign="top" align="center">&#x0003C;10<sup>&#x02212;4</sup></td>
<td valign="top" align="center">&#x0003C;10<sup>&#x02212;6</sup></td>
</tr>
<tr>
<td valign="top" align="left">rsfMRI</td>
<td valign="top" align="center"/>
<td valign="top" align="center"/>
<td valign="top" align="center" style="background-color:#B3B3B3;">&#x000A0;</td>
<td valign="top" align="center"><italic>r</italic><sup>2</sup>&#x02009;&#x0003D;&#x02009;0.001</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center"/>
<td valign="top" align="center"/>
<td valign="top" align="center" style="background-color:#B3B3B3;">&#x000A0;</td>
<td valign="top" align="center">&#x0003C;10<sup>&#x02212;6</sup></td>
</tr>
<tr>
<td valign="top" align="left">dMRI</td>
<td valign="top" align="center"/>
<td valign="top" align="center"/>
<td valign="top" align="center"/>
<td valign="top" align="center" style="background-color:#B3B3B3;">&#x000A0;</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p><italic>The top number is the Pearson correlation coefficient <italic>r</italic><sup>2</sup>, and the number below is the associated p-value</italic>.</p>
</table-wrap-foot>
</table-wrap>
</sec>
</sec>
<sec id="S4" sec-type="discussion">
<title>Discussion</title>
<p>Although the four measures of connectivity show statistically significant correlation coefficients, the most striking observation for a given pair-correlation is the large scatter of points, particularly on the measures that permit inclusion of all voxels in the brain. That is, for a given pair of measures, there are many pairs of voxels in the brain that show a high level correlation using method A, with a low correlation using method B; and visa versa. While the statistically significant trend is scientifically useful for group comparisons, any possible medical applications to an individual patient require more robust metrics or another paradigm for understanding these discrepancies. There are many possible causes for the low correlation values, some may be intrinsic to the brain and its function, while others are technical and methodological, both of which are now discussed.</p>
<p>One likely contributor to the discrepancy in the pair correlation is the failure to correctly co-localize a point in MRI space with the source of an EEG signal. One reason is technical, that the co-registered position of the electrode as determined by CT is not correctly co-located to the corresponding point on the MRI. The error can be due to either the CT or MRI: brain shift occurring during the presence of implanted electrodes during CT, or warping of the MRI due to field gradients, particularly at the brain&#x02019;s base. Another reason is the exact location of the voltage source. That is, although the subtraction of an adjacent electrode-contact pair measures a given signal, there exists some uncertainty about the exact location of the source of the signal with respect to the paired contacts. If it is a point source, it is likely that the distance from the source to the electrode pair is comparable to the distance between the electrode contacts. For example, if the contacts are separated by 5&#x02009;mm, that could represent a distance of two voxels from the imaged locations of the electrodes. This possibility is complicated by the reality that most sources will be distributed, likely over a spatial scale at least as large as 5&#x02009;mm. One approach to address this consideration is to incorporate a source model of the CCEP waveforms (<xref ref-type="bibr" rid="B16">16</xref>) rather than directly use the electric signals that come from the equipment. However, source modeling is complex and introduces its own assumptions and uncertainties.</p>
<p>In addition to robust positive BOLD activation seen during stimulated fMRI, there are network-like regions of &#x0201C;negative&#x0201D; activation, or relative deactivation. This phenomenon is often seen with task-related paradigms and sometimes is attributed to the design, for example where the &#x0201C;rest&#x0201D; cycle is not truly at rest. However, in our DES-fMRI experiments the patient is anesthetized and the negative BOLD patterns appear as a consequence of positive stimulation. It is uncertain if this negative activation is the result of direct point-to-point action potentials from the stimulated region to the negatively activated cortex, or the result of positive stimulation to secondary cortex that in turn deactivates cortex. Regardless, it raises the question of how a shower of signals delivered to cortex results in relative deactivation. One possible explanation is that there is tremendous neuronal processing that occurs in a segment of cortex before electrical responses that synchronize sufficiently to produce a macroscopic voltage capable of detection with intracranial or extracranial electrodes. For example, it is known that an area at least 10&#x02009;cm<sup>2</sup> of synchronized cortex is required for detection by a scalp electrode (<xref ref-type="bibr" rid="B17">17</xref>). The vast number of neurons required for this ensemble response is likely much more than the number initially stimulated by an incoming wave of action potentials. Thus, between the moment of initial stimulation and macroscopic signal detection there must be a computational buildup with tremendous intra-cortical processing. Although initially stimulated in a positive sense by a relative small number of neurons, this intra-cortical processing could proceed in either increased or decreased tone, that is, either positive or negative reaction.</p>
<p>Another uncertainty likely contributing to the poor correlation regarding comparisons with CCEP signals is the scalar metric derived from the signal and used for comparison. One detail is which time window of the CCEP signal is most appropriate for comparison? For example, regarding comparison with structural connectivity may best compare with the early time course of the signal, perhaps a time scale comparable to the axonal transit time, say between 5 and 15&#x02009;ms. On the contrary, regarding comparison with resting state connectivity or DES-fMRI, which likely elicit and more steady-state ensemble reaction of brain activity, a better comparison with structural activity might be to average the signal intensity over a much longer period of time, perhaps 0.1&#x02013;1.0&#x02009;s.</p>
<p>A source of variability leading to poor correlation may be the manner of electrical stimulation, particularly with the variables of current and frequency. Regarding current, larger currents will stimulate a larger volume of tissue, which may alter the distal patterns of response (<xref ref-type="bibr" rid="B18">18</xref>). Experimentally it is difficult to know the optimum current since the current is raised until a desired effect is noticed, whose threshold can vary in different brain regions. Similarly, the 1&#x02009;Hz stimulation frequency of CCEP may elicit a different network of activation than at a higher &#x02013; and more physiologic &#x02013; frequency. These are all experimental values worthy of exploration in future studies.</p>
<p>All data were derived from patients with long-standing and intractable epilepsy, whose brains feature foci of abnormal cortical excitability. These foci likely correspond to the nodes of some network, which raises the possibility of associated abnormal connectivity. This variation could contribute to the scatter seen with an ensemble of paired correlations.</p>
<p>In addition to the large scatter of paired correlations between two given modalities, there is strong variation of the overall correlation between the various pairs of modalities, for example the correlation between CCEP and DES-fMRI is the largest at <italic>r</italic><sup>2</sup>&#x02009;&#x0003D;&#x02009;0.20, while that between DES-fMRI and rsfMRI (and dMRI and rsfMRI) is the weakest at <italic>r</italic><sup>2</sup>&#x02009;&#x0003D;&#x02009;0.001. This difference may reflect the underlying scale of the modality: at one extreme dMRI reflects simple node-to-node connectivity between any two cortical points, whereas rsfMRI connectivity reflects a more &#x0201C;ensemble&#x0201D; of brain activity including the effects of feedback circuits containing multiple nodes. Thus the correlation coefficient may be highest between modalities featuring simple node-to-node connectivity (for example dMRI, and CCEPS derived from early time measurements), and lowest between any modality compared with rsfMRI. The initial expectancy that different measures of connectivity are mutually consistent may be misguided, for example a strong correlation between structural and functional connectivity, and that a pathway to better understanding one measure of connectivity it a detailed analysis of its difference to other measures.</p>
<p>While the <italic>quantitative</italic> comparison of the different connectivity measures is poor, often the qualitative patterns of the maps can seem similar. For example, the lateral surface images in Figures <xref ref-type="fig" rid="F2">2</xref>, <xref ref-type="fig" rid="F3">3</xref>, and <xref ref-type="fig" rid="F6">6</xref> are from the same patient for the modalities of CCEPs, rsfMRI, and dMRI connectivity, where the seed for each modality is the left Broca&#x02019;s area. While detailed pair-correlations of voxel-to-voxel scatter plots show the typical finding of a significant but weak correlation, the overall patterns of correlation compare well qualitatively to the eye. This could raise the possibility that coarse features of connectivity are similar, but there are errors in the details.</p>
<p>The practical clinical question arises about how such sophisticated comparisons, metrics, or models could be used to benefit patients with epilepsy. For example, how might knowledge of a network directly help the clinician? The ultimate goal is identification of the EZ, wherein removal of that tissue inhibits the electrophysiological cascade that erupts into a seizure. Assuming the EZ is one node in a network, an alternative approach could be resection of non-EZ node in the network such that its removal interrupts any epileptogenic circuitry that contributes to seizure generation. One of the major problems in the process of the presurgical localization of the EZ through scalp EEG recordings is the issue of false localization of a surface activity that is the result of a network/subcortical spread from a distant focus (in a different gyrus, lobe and at times hemisphere) (<xref ref-type="bibr" rid="B19">19</xref>). Optimizing non-invasive measures of connectivities would undoubtedly assist in the identification of the correct focus and would therefore result in the optimization of the surgical results through the resection of the source of the electrical activity rather than a non-needed resection of the wrong falsely localized &#x0201C;focus.&#x0201D; Another approach to how epilepsy might benefit from an accurate relation of the different measures of connectivity is discussed in Figure <xref ref-type="fig" rid="F8">8</xref>. The data in Figure <xref ref-type="fig" rid="F8">8</xref> illustrate the more comprehensive nature of DES-fMRI for the mapping of all the nodes of a particular epileptic network as fMRI measures BOLD changes in the whole brain while depth or subdural electrodes measure a much more restricted part of the cortex that is based on a hypothesis that is generated from less than optimal non-invasive methods as discussed above.</p>
<fig position="float" id="F8">
<label>Figure 8</label>
<caption><p><bold>Example of the possible clinical utility derived from accurate correspondence of different connectivity measures</bold>. While EEG or CCEP measures may form a gold standard, the drawback is limited brain coverage. The use of an EEG source model may improve local coverage between electrodes, but fails to adequately compute electrophysiological activity further outside these regions. The top row of images shows the EEG source model (computed using Brainstorm) from stimulation of an electrode in the right insular region in a patient with 12 right-sided stereotactically placed EEG depth electrodes (not shown). Visualization of the brain&#x02019;s response to stimulation appears more continuous in the regions of reliable computation (region bounded by white line), and may offer superior comparison to other methods of connectivity. Note the region of reliable results is only covers a minority of the entire brain. The bottom row shows the corresponding DES-fMRI BOLD connectivity map derived from stimulation of the same electrode-pair as the top row. While there is qualitative correspondence of the connectivity maps in the region of the temporal lobe and insula, the DES-fMRI map encompasses the entire brain and reveals strong areas of activation outside the coverage of SEEG electrodes, namely in the right parietal lobe. Establishing a reliable relation between these two measures of connectivity could synergistically enhance the coverage of invasive electrodes.</p></caption>
<graphic xlink:href="fneur-05-00272-g008.tif"/>
</fig>
<p>One possible approach is to compare activated networks that are indigenously and spontaneously activated by interictal discharges to those stimulated externally. A technical problem to surmount is that, at a sufficiently small spatial scale, the exact location of depth electrode contacts can be relatively random with respect to the exact location of the EZ. But if sufficiently close, stimulation of the electrode contacts involving the EZ might activate the same spatial network as indigenous activation from an interictal discharge. If these patterns can be observed, for example using the full 3D capability of BOLD imaging, then overlap of the two maps can serve as verification that the location of stimulation by an electrode is the same location as the EZ. In effect, the BOLD pattern revealed by an interictal discharge could serve as a fingerprint regarding the origin of activation (the epileptic focus). In the far future, an enticing strategy would be any new method that can elicit an interictal discharge, or a seizure, which can be turned on and off as desired, and thereby forms the &#x0201C;task&#x0201D; in a BOLD fMRI experiment. This might be accomplished using a pharmacological method to &#x0201C;stress&#x0201D; the system, or modulate the thresholds to uncover epileptic activities in a controlled fashion.</p>
<p>Another approach is to examine the local vs. distal patterns of activation. The hypothesis could be that local cortical activation in the region of the EZ is augmented by the underlying disease and seizure history. Similar to a spreading depression, and propagated by innumerable interneurons along the cortical layers, local activation could appear different than distal stimulation elicited by long range white matter fiber tracks in terms of both amplitude and speed. For example, the mono-synaptic character of long range connections may proceed at a faster rate than polysynaptic connections within the cortical layers. (<xref ref-type="bibr" rid="B20">20</xref>) The presence of disease could alter this comparison whereby local activation proceeds abnormally quickly with abnormally high magnitude. The concept of altered local reactivity is supported by electrophysiological observations to local electrodes upon stimulation of the EZ, wherein the magnitude of local electrodes is exaggerated (<xref ref-type="bibr" rid="B21">21</xref>).</p>
<p>One potential avenue of failure represented in Figure <xref ref-type="fig" rid="F7">7</xref> may result from an ill-posed assumption, namely that the correct comparison between different modalities is a simple pairwise correlation between them. Perhaps a better metric for one modality may incorporate information from other modalities. For example, functional connectivity could be informed from structural connectivity and thereby correct or exclude comparisons that that are not structurally connected. Further, functional connectivity between any pair of points may be influenced more by a multi-nodal network that connects them rather than a single point-to-point connection. This possibility suggests the future importance of a complete brain model that incorporates all the measurable modalities. Such a model can, in effect, translate between the metrics of different modalities. The ultimate goal would be a sufficiently sophisticated model that could conceivably model an individual brain. Such a model could not practically occur at the microscopic spatial scale of neurons, but at the mesoscopic scale of the imaging voxel. The challenge is finding a method to reliably inform the model, i.e., set all the innumerable parameters with information obtained from a non-invasive modality. Such a modality would need to be sufficiently content-rich to inform a large model. One possibility would be long-term resting state fMRI, informed by structural imaging from dMRI methods. This development would represent the next step in the evolution of neuroimaging, in which the imaging biomarker moves from being the images themselves, to a mathematical brain model that is informed by images.</p>
</sec>
<sec id="S5">
<title>Conclusion</title>
<p>A significant next step in the future of imaging brain function is connectivity; however, there are many different metrics for connectivity. This work presents experimental observations with cross-comparisons of four methods produced from eight epilepsy patients with intracranial electrodes. The major result is that although the four methods show statistically significant paired-consistency as computed by a non-zero correlation value, the magnitude of the correlations is relatively poor. Thus there is less cross-modal consensus than might be expected with a simple view of brain connectivity. For example, using two modalities A and B, there are many regions of the brain that show strong connectivity using A but low connectivity using B; and visa versa. The reason for the discrepancies is likely inherent to fundamental differences in the different modalities, thus the objective of a strong simple pairwise correlation is ill-posed. However, we envision that strong correlations can be recovered with the use of an intermediary mathematical model of the brain that can translate the connectivity between different modalities.</p>
</sec>
<sec id="S6">
<title>Conflict of Interest Statement</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec id="S7" sec-type="supplementary-material">
<title>Supplementary Material</title>
<p>The Supplementary Material for this article can be found online at <uri xlink:href="http://www.frontiersin.org/Journal/10.3389/fneur.2014.00272/abstract">http://www.frontiersin.org/Journal/10.3389/fneur.2014.00272/abstract</uri></p>
<supplementary-material xlink:href="Data_Sheet_1.DOCX" id="SM1" mimetype="applicationn/DOCX" xmlns:xlink="http://www.w3.org/1999/xlink"/>
<supplementary-material xlink:href="Image_1.TIF" id="SM2" mimetype="applicationn/TIF" xmlns:xlink="http://www.w3.org/1999/xlink"/>
<supplementary-material xlink:href="Image_2.TIF" id="SM3" mimetype="applicationn/TIF" xmlns:xlink="http://www.w3.org/1999/xlink"/>
<supplementary-material xlink:href="Image_3.TIF" id="SM4" mimetype="applicationn/TIF" xmlns:xlink="http://www.w3.org/1999/xlink"/>
</sec>
</body>
<back>
<ref-list>
<title>References</title>
<ref id="B1"><label>1</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Honey</surname> <given-names>CJ</given-names></name> <name><surname>Sporns</surname> <given-names>O</given-names></name> <name><surname>Cammoun</surname> <given-names>L</given-names></name> <name><surname>Gigandet</surname> <given-names>X</given-names></name> <name><surname>Thiran</surname> <given-names>JP</given-names></name> <name><surname>Meuli</surname> <given-names>R</given-names></name> <etal/></person-group> <article-title>Predicting human resting-state functional connectivity from structural connectivity</article-title>. <source>Proc Natl Acad Sci U S A</source> (<year>2009</year>) <volume>106</volume>(<issue>6</issue>):<fpage>2035</fpage>&#x02013;<lpage>40</lpage>.<pub-id pub-id-type="doi">10.1073/pnas.0811168106</pub-id><pub-id pub-id-type="pmid">19188601</pub-id></citation></ref>
<ref id="B2"><label>2</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Skudlarski</surname> <given-names>P</given-names></name> <name><surname>Jagannathan</surname> <given-names>K</given-names></name> <name><surname>Calhoun</surname> <given-names>VD</given-names></name> <name><surname>Hampson</surname> <given-names>M</given-names></name> <name><surname>Skudlarska</surname> <given-names>BA</given-names></name> <name><surname>Pearlson</surname> <given-names>G</given-names></name></person-group>. <article-title>Measuring brain connectivity: diffusion tensor imaging validates resting state temporal correlations</article-title>. <source>Neuroimage</source> (<year>2008</year>) <volume>43</volume>(<issue>3</issue>):<fpage>554</fpage>&#x02013;<lpage>61</lpage>.<pub-id pub-id-type="doi">10.1016/j.neuroimage.2008.07.063</pub-id><pub-id pub-id-type="pmid">18771736</pub-id></citation></ref>
<ref id="B3"><label>3</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jones</surname> <given-names>SE</given-names></name> <name><surname>Zhang</surname> <given-names>M</given-names></name> <name><surname>Avitsian</surname> <given-names>R</given-names></name> <name><surname>Bhattachya</surname> <given-names>P</given-names></name> <name><surname>Bulacio</surname> <given-names>J</given-names></name> <name><surname>Cendes</surname> <given-names>F</given-names></name> <etal/></person-group> <article-title>Functional MRI networks induced by intracranial stimulation may help defining the epileptogenic zone</article-title>. <source>Brain Connect</source> (<year>2014</year>) <volume>4</volume>(<issue>4</issue>):<fpage>286</fpage>&#x02013;<lpage>98</lpage>.<pub-id pub-id-type="doi">10.1089/brain.2014.0225</pub-id><pub-id pub-id-type="pmid">24735069</pub-id></citation></ref>
<ref id="B4"><label>4</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Beall</surname> <given-names>EB</given-names></name> <name><surname>Lowe</surname> <given-names>MJ</given-names></name></person-group>. <article-title>Isolating physiologic noise sources with independently determined spatial measures</article-title>. <source>Neuroimage</source> (<year>2007</year>) <volume>37</volume>(<issue>4</issue>):<fpage>1286</fpage>&#x02013;<lpage>300</lpage>.<pub-id pub-id-type="doi">10.1016/j.neuroimage.2007.07.004</pub-id><pub-id pub-id-type="pmid">17689982</pub-id></citation></ref>
<ref id="B5"><label>5</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Beall</surname> <given-names>EB</given-names></name> <name><surname>Lowe</surname> <given-names>MJ</given-names></name></person-group>. <article-title>The non-separability of physiologic noise in functional connectivity MRI with spatial ICA at 3T</article-title>. <source>J Neurosci Methods</source> (<year>2010</year>) <volume>191</volume>(<issue>2</issue>):<fpage>263</fpage>&#x02013;<lpage>76</lpage>.<pub-id pub-id-type="doi">10.1016/j.jneumeth.2010.06.024</pub-id><pub-id pub-id-type="pmid">20600313</pub-id></citation></ref>
<ref id="B6"><label>6</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bullmore</surname> <given-names>ET</given-names></name> <name><surname>Brammer</surname> <given-names>MJ</given-names></name> <name><surname>Rabe-Hesketh</surname> <given-names>S</given-names></name> <name><surname>Curtis</surname> <given-names>VA</given-names></name> <name><surname>Morris</surname> <given-names>RG</given-names></name> <name><surname>Williams</surname> <given-names>SC</given-names></name> <etal/></person-group> <article-title>Methods for diagnosis and treatment of stimulus-correlated motion in generic brain activation studies using fMRI</article-title>. <source>Hum Brain Mapp</source> (<year>1999</year>) <volume>7</volume>(<issue>1</issue>):<fpage>38</fpage>&#x02013;<lpage>48</lpage>.<pub-id pub-id-type="doi">10.1002/(SICI)1097-0193(1999)7:1&#x0003C;38::AID-HBM4&#x0003E;3.3.CO;2-H</pub-id><pub-id pub-id-type="pmid">9882089</pub-id></citation></ref>
<ref id="B7"><label>7</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Holland</surname> <given-names>D</given-names></name> <name><surname>Kuperman</surname> <given-names>JM</given-names></name> <name><surname>Dale</surname> <given-names>AM</given-names></name></person-group>. <article-title>Efficient correction of inhomogeneous static magnetic field-induced distortion in echo planar imaging</article-title>. <source>Neuroimage</source> (<year>2010</year>) <volume>50</volume>(<issue>1</issue>):<fpage>175</fpage>.<pub-id pub-id-type="doi">10.1016/j.neuroimage.2009.11.044</pub-id><pub-id pub-id-type="pmid">19944768</pub-id></citation></ref>
<ref id="B8"><label>8</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sakaie</surname> <given-names>KE</given-names></name> <name><surname>Lowe</surname> <given-names>MJ</given-names></name></person-group>. <article-title>Quantitative assessment of motion correction for high angular resolution diffusion imaging</article-title>. <source>Magn Reson Imaging</source> (<year>2010</year>) <volume>28</volume>:<fpage>290</fpage>&#x02013;<lpage>6</lpage>.<pub-id pub-id-type="doi">10.1016/j.mri.2009.07.004</pub-id><pub-id pub-id-type="pmid">19695824</pub-id></citation></ref>
<ref id="B9"><label>9</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Leemans</surname> <given-names>A</given-names></name> <name><surname>Jones</surname> <given-names>DK</given-names></name></person-group>. <article-title>The B-matrix must be rotated when correcting for subject motion in DTI data</article-title>. <source>Magn Reson Med</source> (<year>2009</year>) <volume>61</volume>:<fpage>1336</fpage>&#x02013;<lpage>49</lpage>.<pub-id pub-id-type="doi">10.1002/mrm.21890</pub-id><pub-id pub-id-type="pmid">19319973</pub-id></citation></ref>
<ref id="B10"><label>10</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tournier</surname> <given-names>JD</given-names></name> <name><surname>Calamante</surname> <given-names>F</given-names></name> <name><surname>Gadian</surname> <given-names>DG</given-names></name> <name><surname>Connelly</surname> <given-names>A</given-names></name></person-group>. <article-title>Direct estimation of the fiber orientation density function from diffusion-weighted MRI data using spherical deconvolution</article-title>. <source>Neuroimage</source> (<year>2004</year>) <volume>23</volume>(<issue>3</issue>):<fpage>1176</fpage>&#x02013;<lpage>85</lpage>.<pub-id pub-id-type="doi">10.1016/j.neuroimage.2004.07.037</pub-id><pub-id pub-id-type="pmid">15528117</pub-id></citation></ref>
<ref id="B11"><label>11</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sakaie</surname> <given-names>KE</given-names></name> <name><surname>Lowe</surname> <given-names>MJ</given-names></name></person-group>. <article-title>An objective method for regularization of fiber orientation distributions derived from diffusion-weighted MRI</article-title>. <source>Neuroimage</source> (<year>2007</year>) <volume>34</volume>:<fpage>169</fpage>&#x02013;<lpage>76</lpage>.<pub-id pub-id-type="doi">10.1016/j.neuroimage.2006.08.034</pub-id><pub-id pub-id-type="pmid">17030125</pub-id></citation></ref>
<ref id="B12"><label>12</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhang</surname> <given-names>M</given-names></name> <name><surname>Sakaie</surname> <given-names>KE</given-names></name> <name><surname>Jones</surname> <given-names>SE</given-names></name></person-group>. <article-title>Logical foundations and fast implementation of probabilistic tractography</article-title>. <source>IEEE Trans Med Imaging</source> (<year>2013</year>) <volume>32</volume>(<issue>8</issue>):<fpage>1397</fpage>&#x02013;<lpage>410</lpage>.<pub-id pub-id-type="doi">10.1109/TMI.2013.2257179</pub-id><pub-id pub-id-type="pmid">2356</pub-id></citation></ref>
<ref id="B13"><label>13</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Matsumoto</surname> <given-names>R</given-names></name> <name><surname>Nair</surname> <given-names>DR</given-names></name> <name><surname>LaPresto</surname> <given-names>E</given-names></name> <name><surname>Najm</surname> <given-names>I</given-names></name> <name><surname>Bingaman</surname> <given-names>W</given-names></name> <name><surname>Shibasaki</surname> <given-names>H</given-names></name> <etal/></person-group> <article-title>Functional connectivity in the human language system: a cortico-cortical evoked potential study</article-title>. <source>Brain</source> (<year>2004</year>) <volume>127</volume>(<issue>Pt 10</issue>):<fpage>2316</fpage>&#x02013;<lpage>30</lpage>.<pub-id pub-id-type="doi">10.1093/brain/awh246</pub-id><pub-id pub-id-type="pmid">15269116</pub-id></citation></ref>
<ref id="B14"><label>14</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jenkinson</surname> <given-names>M</given-names></name> <name><surname>Smith</surname> <given-names>SM</given-names></name></person-group>. <article-title>A global optimisation method for robust affine registration of brain images</article-title>. <source>Med Image Anal</source> (<year>2001</year>) <volume>5</volume>:<fpage>143</fpage>&#x02013;<lpage>56</lpage>.<pub-id pub-id-type="doi">10.1016/S1361-8415(01)00036-6</pub-id><pub-id pub-id-type="pmid">11516708</pub-id></citation></ref>
<ref id="B15"><label>15</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jenkinson</surname> <given-names>M</given-names></name> <name><surname>Bannister</surname> <given-names>PR</given-names></name> <name><surname>Brady</surname> <given-names>JM</given-names></name> <name><surname>Smith</surname> <given-names>SM</given-names></name></person-group>. <article-title>Improved optimisation for the robust and accurate linear registration and motion correction of brain images</article-title>. <source>Neuroimage</source> (<year>2002</year>) <volume>17</volume>:<fpage>825</fpage>&#x02013;<lpage>41</lpage>.<pub-id pub-id-type="doi">10.1006/nimg.2002.1132</pub-id><pub-id pub-id-type="pmid">12377157</pub-id></citation></ref>
<ref id="B16"><label>16</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cosandier-Rim&#x000E9;l&#x000E9;</surname> <given-names>D</given-names></name> <name><surname>Merlet</surname> <given-names>I</given-names></name> <name><surname>Badier</surname> <given-names>JM</given-names></name> <name><surname>Chauvel</surname> <given-names>P</given-names></name> <name><surname>Wendling</surname> <given-names>F</given-names></name></person-group>. <article-title>The neuronal sources of EEG: modeling of simultaneous scalp and intracerebral recordings in epilepsy</article-title>. <source>Neuroimage</source> (<year>2008</year>) <volume>42</volume>(<issue>1</issue>):<fpage>135</fpage>&#x02013;<lpage>46</lpage>.<pub-id pub-id-type="doi">10.1016/j.neuroimage.2008.04.185</pub-id><pub-id pub-id-type="pmid">18515148</pub-id></citation></ref>
<ref id="B17"><label>17</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tao</surname> <given-names>JX</given-names></name> <name><surname>Baldwin</surname> <given-names>M</given-names></name> <name><surname>Ray</surname> <given-names>A</given-names></name> <name><surname>Hawes-Ebersole</surname> <given-names>S</given-names></name> <name><surname>Ebersole</surname> <given-names>JS</given-names></name></person-group>. <article-title>The impact of cerebral source area and synchrony on recording scalp electroencephalography ictal patterns</article-title>. <source>Epilepsia</source> (<year>2007</year>) <volume>48</volume>(<issue>11</issue>):<fpage>2167</fpage>&#x02013;<lpage>76</lpage>.<pub-id pub-id-type="doi">10.1111/j.1528-1167.2007.01224.x</pub-id><pub-id pub-id-type="pmid">17662060</pub-id></citation></ref>
<ref id="B18"><label>18</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ranck</surname> <given-names>JB</given-names></name></person-group>. <article-title>Which elements are excited in electrical stimulation of mammalian central nervous system: a review</article-title>. <source>Brain Res</source> (<year>1975</year>) <volume>98</volume>:<fpage>417</fpage>&#x02013;<lpage>40</lpage>.<pub-id pub-id-type="doi">10.1016/0006-8993(75)90364-9</pub-id></citation></ref>
<ref id="B19"><label>19</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wang</surname> <given-names>ZI</given-names></name> <name><surname>Jin</surname> <given-names>K</given-names></name> <name><surname>Kakisaka</surname> <given-names>Y</given-names></name> <name><surname>Mosher</surname> <given-names>JC</given-names></name> <name><surname>Bingaman</surname> <given-names>WE</given-names></name> <name><surname>Kotagal</surname> <given-names>P</given-names></name> <etal/></person-group> <article-title>Imag(in)ing seizure propagation: MEG-guided interpretation of epileptic activity from a deep source</article-title>. <source>Hum Brain Mapp</source> (<year>2012</year>) <volume>33</volume>(<issue>12</issue>):<fpage>2797</fpage>&#x02013;<lpage>801</lpage>.<pub-id pub-id-type="doi">10.1002/hbm.21401</pub-id><pub-id pub-id-type="pmid">22328363</pub-id></citation></ref>
<ref id="B20"><label>20</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Muller</surname> <given-names>L</given-names></name> <name><surname>Destexhe</surname> <given-names>A</given-names></name></person-group>. <article-title>Propagating waves in thalamus, cortex and the thalamocortical system: experiments and models</article-title>. <source>J Physiol Paris</source> (<year>2012</year>) <volume>106</volume>(<issue>5&#x02013;6</issue>):<fpage>222</fpage>&#x02013;<lpage>38</lpage>.<pub-id pub-id-type="doi">10.1016/j.jphysparis.2012.06.005</pub-id><pub-id pub-id-type="pmid">22863604</pub-id></citation></ref>
<ref id="B21"><label>21</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Iwasaki</surname> <given-names>M</given-names></name> <name><surname>Enatsu</surname> <given-names>R</given-names></name> <name><surname>Matsumoto</surname> <given-names>R</given-names></name> <name><surname>Novak</surname> <given-names>E</given-names></name> <name><surname>Thankappen</surname> <given-names>B</given-names></name> <name><surname>Piao</surname> <given-names>Z</given-names></name> <etal/></person-group> <article-title>Accentuated cortico-cortical evoked potentials in neocortical epilepsy in areas of ictal onset</article-title>. <source>Epileptic Disord</source> (<year>2010</year>) <volume>12</volume>(<issue>4</issue>):<fpage>292</fpage>&#x02013;<lpage>302</lpage>.<pub-id pub-id-type="doi">10.1684/epd.2010.0334</pub-id><pub-id pub-id-type="pmid">20952353</pub-id></citation></ref>
<ref id="B22"><label>22</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cox</surname> <given-names>RW</given-names></name> <name><surname>Hyde</surname> <given-names>JS</given-names></name></person-group>. <article-title>Software tools for analysis and visualization of fMRI data</article-title>. <source>NMR Biomed</source> (<year>1997</year>) <volume>10</volume>:<fpage>171</fpage>&#x02013;<lpage>8</lpage>.<pub-id pub-id-type="doi">10.1002/(SICI)1099-1492(199706/08)10:4/5&#x0003C;171::AID-NBM453&#x0003E;3.0.CO;2-L</pub-id><pub-id pub-id-type="pmid">9430344</pub-id></citation></ref>
</ref-list>
</back>
</article>