Hi all,<br><br><div> I'm wondering if there's a way to speed up the loading of an edf file into eeglab using pop_biosig without loading a GUI. </div><div><br></div><div> When I use the MATLAB GUI, I can do:</div>
<div>eeglab;</div><div>clear;</div><div> If I save the path, then loading all subsequent edf files goes a lot faster (10 seconds vs 10 minutes).</div><div><br></div><div> My issue is that I'm trying to process my data in parallel, so I'm using a non-GUI based MATLAB where I need to reload the path on each processing node that I'm using. When I try to make the processing node do "eeglab;", since I can't use a GUI (and other reasons), MATLAB errors out.</div>
<div> I feel like eeglab compiles mex files or does something to speed the process up, but I can't figure out what from reading the code.</div><div><br></div><div><br></div><div> Does anyone have a fix?</div><div>
<br></div><div><br></div><div><br></div><div><br></div><div>Details, if it helps:</div><div><div> I'm currently working with a database of 100 GB (and growing) of .edf files, each with 26 channels. Subjects have between 10MB and 800MB of data in one file. Of course, I load one hour of one channel at a time and loop through. If I don't do that, I get out of memory errors. (Loading more than an hour also gives memory problems.)</div>
<div> My home machine is an iMac OSX 10.5.8 with 4GB of RAM and I'm working on a linux based cluster with up to 16GB of RAM per computing node. Cluster MATLAB is 2010b, local MATLAB is 2009a.</div><div><br></div><div>
Actual call:</div><div>EEG=pop_biosig(fname,'channels',i,'blockrange',[(j-1)*window_length j*window_length],'blockepoch','off');</div><div><br></div><div>fname is filename</div><div>i is the channel index (1:26)</div>
<div>j is the block index (1:header.records/window_length)</div><div>window_length= 60*60 (seconds) = 1 hour</div><div><br></div><div><br></div><div>Thanks so much,</div><div><br></div><div>Wesley</div><div><br>-- <br>Wesley Kerr<br>
UCLA MD-PhD Program<div>Biomathematics<br><div>Cohen Lab</div><div><a href="mailto:wesleytk@ucla.edu" target="_blank">wesleytk@ucla.edu</a></div></div>
</div></div>