[Eeglablist] Memory issue using Clean Rawdata and ASR

Fri Sep 30 09:30:01 PDT 2022

Arno, with 64 GB of ram, what is the maximum fixed amount of memory we can specify? Does the default of 64 mean 64 GB?

Thanks.

Get Outlook for Android<https://urldefense.com/v3/__https://aka.ms/AAb9ysg__;!!Mih3wA!Cu9eLSPPsmKBl-sSvpCJau9diiYkhLie6jP6GkGL1nZ72xHC9Ob_fuOwvUHycO1pWjlIKMU4il-8nUdzlbSkmL8$  >
________________________________
From: eeglablist <eeglablist-bounces at sccn.ucsd.edu> on behalf of Delorme, Arnaud via eeglablist <eeglablist at sccn.ucsd.edu>
Sent: Friday, September 23, 2022 12:48:10 PM
Cc: EEGLAB List <eeglablist at sccn.ucsd.edu>
Subject: Re: [Eeglablist] Memory issue using Clean Rawdata and ASR

**Warning: This email originated external to the NMSU email system. Do not click on links or open attachments unless you are sure the content is safe.

The reason the function will stop being deterministic if you use the available memory (instead of a fixed amount) is that the available memory determines the block size. If the block size changes, then the function results vary in a minor way.

Arno

> On Sep 23, 2022, at 10:59 AM, Delorme, Arnaud <adelorme at ucsd.edu> wrote:
>
> Hi Stan,
>
> Yes, I was referring to “available memory”
>
> Arno
>
>> On Sep 23, 2022, at 10:34 AM, Stanley A. KLEIN <sklein at berkeley.edu> wrote:
>>
>> Arno, could you clarify what you meant by:
>> "The problem with using the available memory is that clean_rawdata becomes non deterministic (the results are not reproducible)."
>>
>> What were you referring to regarding "available memory"?
>>
>> Stan
>>
>>
>>
>>
>> On Fri, Sep 23, 2022 at 9:20 AM Delorme, Arnaud via eeglablist <eeglablist at sccn.ucsd.edu> wrote:
>> The problem with using the available memory is that clean_rawdata becomes non deterministic (the results are not reproducible).
>> This is why the default was set to 64.
>> Best wishes,
>>
>> Arno
>>
>>> On Sep 12, 2022, at 10:44 AM, Daniele Scanzi via eeglablist <eeglablist at sccn.ucsd.edu> wrote:
>>>
>>> Hi Ben,
>>>
>>> My colleague and I encountered the same problem. Looks like the issue is
>>> with the default setting of the *maxmem* parameter in clean_artifacts.
>>> Rather than calculating the maximum available memory to use, it was set to
>>> 64. There is a good explanation of the issue here:
>>> https://urldefense.com/v3/__https://nam10.safelinks.protection.outlook.com/?url=https*3A*2F*2Furldefense.com*2Fv3*2F__https*3A*2F*2Fgithub.com*2Fsccn*2Fclean_rawdata*2Fissues*2F41__*3B!!Mih3wA!EHSPfFNYav5qz0rzogBxUHcZ6-koe-fr1mWNz16xmwJSOWLMiPyKIO4x-2AIWHwh9UB4qa38mXxpt8fIXb406mZUeq5f1IA*24&data=05*7C01*7Cjkroger*40nmsu.edu*7C48025bb917024ce8778608da9d9d65a5*7Ca3ec87a89fb84158ba8ff11bace1ebaa*7C1*7C0*7C637995596586076655*7CUnknown*7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0*3D*7C3000*7C*7C*7C&sdata=i3C5eYlNAnWJhkIKQb*2FRSVj3Uq2NSbH6jXaZ8ayHa5E*3D&reserved=0__;JSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUlJQ!!Mih3wA!Cu9eLSPPsmKBl-sSvpCJau9diiYkhLie6jP6GkGL1nZ72xHC9Ob_fuOwvUHycO1pWjlIKMU4il-8nUdzKyQhLac$  
>>>
>>> The workaround is described in the first comment. You basically want to
>>> force *asr_process* and *asr_calibrate* to use the available memory and not
>>> a default value.
>>>
>>> Hope this helps!
>>>
>>> Daniele Scanzi
>>> The University of Auckland
>>>
>>> On Tue, 13 Sept 2022 at 05:07, Developmental Psychopathology Lab via
>>> eeglablist <eeglablist at sccn.ucsd.edu> wrote:
>>>
>>>> Hi,
>>>>
>>>> We are receiving an error when running the "Clean Rawdata and ASR" for
>>>> automatic artifact rejection. The single data file we are using has been
>>>> filtered and average referenced. We receive the following error message:
>>>>
>>>> "Not enough memory, This is not a bug (Error occurred in function
>>>> asr_process() at line 132)"
>>>>
>>>> We are running the 64-bit version of MATLab.
>>>> Our Java Heap Memory Preference is at it's highest (4,066 MB).
>>>> The workspace preference for maximum array size is 10000.
>>>>
>>>> Any help would be greatly appreciated,
>>>>
>>>> Ben Swanson
>>>> Lab Coordinator
>>>>
>>>> Developmental Psychopathology Lab
>>>> Spence Labs, Room 111
>>>> University of Iowa
>>>> P: (319) 353-1977
>>>> E: devpsy-lab at uiowa.edu<mailto:devpsy-lab at uiowa.edu>
>>>>
>>>>
>>>>
>>>> _______________________________________________
>>>> Eeglablist page: https://urldefense.com/v3/__https://nam10.safelinks.protection.outlook.com/?url=http*3A*2F*2Fsccn.ucsd.edu*2Feeglab*2Feeglabmail.html&data=05*7C01*7Cjkroger*40nmsu.edu*7C48025bb917024ce8778608da9d9d65a5*7Ca3ec87a89fb84158ba8ff11bace1ebaa*7C1*7C0*7C637995596586076655*7CUnknown*7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0*3D*7C3000*7C*7C*7C&sdata=fmP4cHWjAW3WDexKvnmy0wAn0lkfqHkT05Fc7YyTw1Y*3D&reserved=0__;JSUlJSUlJSUlJSUlJSUlJSUlJSUl!!Mih3wA!Cu9eLSPPsmKBl-sSvpCJau9diiYkhLie6jP6GkGL1nZ72xHC9Ob_fuOwvUHycO1pWjlIKMU4il-8nUdzl9UDw3c$  
>>>> To unsubscribe, send an empty email to
>>>> eeglablist-unsubscribe at sccn.ucsd.edu
>>>> For digest mode, send an email with the subject "set digest mime" to
>>>> eeglablist-request at sccn.ucsd.edu
>>>>
>>> _______________________________________________
>>> Eeglablist page: https://urldefense.com/v3/__https://nam10.safelinks.protection.outlook.com/?url=http*3A*2F*2Fsccn.ucsd.edu*2Feeglab*2Feeglabmail.html&data=05*7C01*7Cjkroger*40nmsu.edu*7C48025bb917024ce8778608da9d9d65a5*7Ca3ec87a89fb84158ba8ff11bace1ebaa*7C1*7C0*7C637995596586076655*7CUnknown*7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0*3D*7C3000*7C*7C*7C&sdata=fmP4cHWjAW3WDexKvnmy0wAn0lkfqHkT05Fc7YyTw1Y*3D&reserved=0__;JSUlJSUlJSUlJSUlJSUlJSUlJSUl!!Mih3wA!Cu9eLSPPsmKBl-sSvpCJau9diiYkhLie6jP6GkGL1nZ72xHC9Ob_fuOwvUHycO1pWjlIKMU4il-8nUdzl9UDw3c$  
>>> To unsubscribe, send an empty email to eeglablist-unsubscribe at sccn.ucsd.edu
>>> For digest mode, send an email with the subject "set digest mime" to eeglablist-request at sccn.ucsd.edu
>>
>> _______________________________________________
>> Eeglablist page: https://urldefense.com/v3/__https://nam10.safelinks.protection.outlook.com/?url=http*3A*2F*2Fsccn.ucsd.edu*2Feeglab*2Feeglabmail.html&data=05*7C01*7Cjkroger*40nmsu.edu*7C48025bb917024ce8778608da9d9d65a5*7Ca3ec87a89fb84158ba8ff11bace1ebaa*7C1*7C0*7C637995596586076655*7CUnknown*7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0*3D*7C3000*7C*7C*7C&sdata=fmP4cHWjAW3WDexKvnmy0wAn0lkfqHkT05Fc7YyTw1Y*3D&reserved=0__;JSUlJSUlJSUlJSUlJSUlJSUlJSUl!!Mih3wA!Cu9eLSPPsmKBl-sSvpCJau9diiYkhLie6jP6GkGL1nZ72xHC9Ob_fuOwvUHycO1pWjlIKMU4il-8nUdzl9UDw3c$  
>> To unsubscribe, send an empty email to eeglablist-unsubscribe at sccn.ucsd.edu
>> For digest mode, send an email with the subject "set digest mime" to eeglablist-request at sccn.ucsd.edu
>

_______________________________________________
Eeglablist page: https://urldefense.com/v3/__https://nam10.safelinks.protection.outlook.com/?url=http*3A*2F*2Fsccn.ucsd.edu*2Feeglab*2Feeglabmail.html&data=05*7C01*7Cjkroger*40nmsu.edu*7C48025bb917024ce8778608da9d9d65a5*7Ca3ec87a89fb84158ba8ff11bace1ebaa*7C1*7C0*7C637995596586232887*7CUnknown*7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0*3D*7C3000*7C*7C*7C&sdata=mI9Ng03APS5N0URpBd9mPHbNLwXqtVqbRA5yF8iYjZg*3D&reserved=0__;JSUlJSUlJSUlJSUlJSUlJSUlJSUl!!Mih3wA!Cu9eLSPPsmKBl-sSvpCJau9diiYkhLie6jP6GkGL1nZ72xHC9Ob_fuOwvUHycO1pWjlIKMU4il-8nUdzhGmCMro$  
To unsubscribe, send an empty email to eeglablist-unsubscribe at sccn.ucsd.edu
For digest mode, send an email with the subject "set digest mime" to eeglablist-request at sccn.ucsd.edu