<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Hi Luca,</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Thank you for checking it.</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
> No, I'm not using an M1 chip and yes, it seemed to be deterministic.</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
> Setting the ABT_THREAD_STACKSIZE=100000 seems to have fixed the issue.<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
If this is the case, I believe the stack size is too small for your workload.</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
It's basically a stack overflow (Pthreads typically uses a few megabytes but Argobots by default sets 4KB because Argobots applications tend to create many ULTs). There's no quick patch to fundamentally solve it.</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
(We had so many discussions: one solution is <a href="https://github.com/pmodels/argobots/pull/327">https://github.com/pmodels/argobots/pull/327</a>)</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Please set <span style="background-color:rgb(255,255,255); display:inline!important">ABT_THREAD_STACKSIZE <span>manually by yourself or ask the application developer to set it before initialization (supposedly, using setenv() before ABT_init()).</span></span></div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span style="background-color:rgb(255,255,255); display:inline!important"><span><br>
</span></span></div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span style="background-color:rgb(255,255,255); display:inline!important"><span>if you have any questions or find other issues, please feel free to let us know!</span></span></div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span style="background-color:rgb(255,255,255); display:inline!important"><span><br>
</span></span></div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span style="background-color:rgb(255,255,255); display:inline!important"><span>Thanks,</span></span></div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Shintaro</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
  </div>
<div id="appendonsend"></div>
<hr tabindex="-1" style="display:inline-block; width:98%">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" color="#000000" style="font-size:11pt"><b>From:</b> Jean Luca Bez <jlbez@lbl.gov><br>
<b>Sent:</b> Friday, June 25, 2021 2:09 PM<br>
<b>To:</b> Iwasaki, Shintaro <siwasaki@anl.gov><br>
<b>Cc:</b> discuss@argobots.org <discuss@argobots.org>; discuss@lists.argobots.org <discuss@lists.argobots.org><br>
<b>Subject:</b> Re: [argobots-discuss] ABT segfault in MacOS</font>
<div> </div>
</div>
<div>
<div dir="ltr">Hi Shintaro,
<div><br>
</div>
<div>Thank you for the quick response! </div>
<div><br>
</div>
<div>No, I'm not using an M1 chip and yes, it seemed to be determinitic.</div>
<div><br>
</div>
<div>Setting the ABT_THREAD_STACKSIZE=100000 seems to have fixed the issue. </div>
<div><br>
</div>
<div>Best,</div>
<div>Jean Luca</div>
</div>
<br>
<div class="x_gmail_quote">
<div dir="ltr" class="x_gmail_attr">On Fri, Jun 25, 2021 at 12:02 PM Iwasaki, Shintaro <<a href="mailto:siwasaki@anl.gov">siwasaki@anl.gov</a>> wrote:<br>
</div>
<blockquote class="x_gmail_quote" style="margin:0px 0px 0px 0.8ex; border-left:1px solid rgb(204,204,204); padding-left:1ex">
<div dir="ltr">
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Hi Luca,</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Thank you for reporting an issue. Just a quick confirmation:</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span style="margin:0px; font-size:12pt">0. Just in case, are you using an M1 chip?<br>
</span><span style="color:rgb(0,0,0); font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt">1. Can you increase the stack size of ULT (by default 4KB, the following increases it to 100KB) and see if the problem happens?</span><br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
ABT_THREAD_STACKSIZE=100000 ./your_app.exe</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
2. Is it deterministic? Does it happen at the same place every time?</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span style="color:rgb(0,0,0); font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt">3. <span style="background-color:rgb(255,255,255); display:inline">Maybe it encounters another issue. I'd truly appreciate it if you could send me a program/script
 that can reproduce this issue.</span></span><br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Best,</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Shintaro</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div id="x_gmail-m_1007553072076268163appendonsend"></div>
<hr style="display:inline-block; width:98%">
<div id="x_gmail-m_1007553072076268163divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" color="#000000" style="font-size:11pt"><b>From:</b> Jean Luca Bez via discuss <<a href="mailto:discuss@lists.argobots.org" target="_blank">discuss@lists.argobots.org</a>><br>
<b>Sent:</b> Friday, June 25, 2021 1:45 PM<br>
<b>To:</b> <a href="mailto:discuss@argobots.org" target="_blank">discuss@argobots.org</a> <<a href="mailto:discuss@argobots.org" target="_blank">discuss@argobots.org</a>><br>
<b>Cc:</b> Jean Luca Bez <<a href="mailto:jlbez@lbl.gov" target="_blank">jlbez@lbl.gov</a>><br>
<b>Subject:</b> [argobots-discuss] ABT segfault in MacOS</font>
<div> </div>
</div>
<div>
<div dir="ltr">Hi,
<div><br>
</div>
<div>I compiled the last git version of Argobots in MacOS, ran the tests and they all passed. However, when running an application I am getting some strange segfault that appears to come from ABT. Does anyone have faced similar issues?</div>
<div><br>
</div>
<div>
<p style="margin-top: 0px; margin-bottom: 0px;margin:0px; font-variant-numeric:normal; font-variant-east-asian:normal; font-stretch:normal; font-size:11px; line-height:normal; font-family:Menlo; color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures"><span> </span>*** Process received signal ***</span></p>
<p style="margin-top: 0px; margin-bottom: 0px;margin:0px; font-variant-numeric:normal; font-variant-east-asian:normal; font-stretch:normal; font-size:11px; line-height:normal; font-family:Menlo; color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures"><span> </span>Signal: Segmentation fault: 11 (11)</span></p>
<p style="margin-top: 0px; margin-bottom: 0px;margin:0px; font-variant-numeric:normal; font-variant-east-asian:normal; font-stretch:normal; font-size:11px; line-height:normal; font-family:Menlo; color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures"><span> </span>Signal code:<span> 
</span>(0)</span></p>
<p style="margin-top: 0px; margin-bottom: 0px;margin:0px; font-variant-numeric:normal; font-variant-east-asian:normal; font-stretch:normal; font-size:11px; line-height:normal; font-family:Menlo; color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures"><span> </span>Failing at address: 0x0</span></p>
<p style="margin-top: 0px; margin-bottom: 0px;margin:0px; font-variant-numeric:normal; font-variant-east-asian:normal; font-stretch:normal; font-size:11px; line-height:normal; font-family:Menlo; color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures"><span> </span>[ 0] 0 <span>
  </span>libsystem_platform.dylib<span>            </span>0x00007fff20428d7d _sigtramp + 29</span></p>
<p style="margin-top: 0px; margin-bottom: 0px;margin:0px; font-variant-numeric:normal; font-variant-east-asian:normal; font-stretch:normal; font-size:11px; line-height:normal; font-family:Menlo; color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures"><span> </span>[ 1] 0 <span>
  </span>??? <span>                                </span>0x0000000000000000 0x0 + 0</span></p>
<p style="margin-top: 0px; margin-bottom: 0px;margin:0px; font-variant-numeric:normal; font-variant-east-asian:normal; font-stretch:normal; font-size:11px; line-height:normal; font-family:Menlo; color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures"><span> </span>[ 2] 0 <span>
  </span>libabt.1.dylib<span>                      </span>0x0000000105bdbdc0 ABT_thread_create + 128</span></p>
<p style="margin-top: 0px; margin-bottom: 0px;margin:0px; font-variant-numeric:normal; font-variant-east-asian:normal; font-stretch:normal; font-size:11px; line-height:normal; font-family:Menlo; color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures"><span> </span>[ 3] 0 <span>
  </span>libh5async.dylib<span>                    </span>0x00000001064bde1f push_task_to_abt_pool + 559</span></p>
<p style="margin-top: 0px; margin-bottom: 0px;margin:0px; font-variant-numeric:normal; font-variant-east-asian:normal; font-stretch:normal; font-size:11px; line-height:normal; font-family:Menlo; color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures"><span> </span>[ 4] 0 <span>
  </span>libh5async.dylib<span>                    </span>0x00000001064e6a02 async_group_create + 1890</span></p>
<p style="margin-top: 0px; margin-bottom: 0px;margin:0px; font-variant-numeric:normal; font-variant-east-asian:normal; font-stretch:normal; font-size:11px; line-height:normal; font-family:Menlo; color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures"><span> </span>[ 5] 0 <span>
  </span>libh5async.dylib<span>                    </span>0x00000001064c4061 H5VL_async_group_create + 321</span></p>
<p style="margin-top: 0px; margin-bottom: 0px;margin:0px; font-variant-numeric:normal; font-variant-east-asian:normal; font-stretch:normal; font-size:11px; line-height:normal; font-family:Menlo; color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures"><span> </span>[ 6] 0 <span>
  </span>libhdf5.1000.dylib<span>                  </span>0x0000000105f6f794 H5VL__group_create + 180</span></p>
<p style="margin-top: 0px; margin-bottom: 0px;margin:0px; font-variant-numeric:normal; font-variant-east-asian:normal; font-stretch:normal; font-size:11px; line-height:normal; font-family:Menlo; color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures"><span> </span>[ 7] 0 <span>
  </span>libhdf5.1000.dylib<span>                  </span>0x0000000105f6f569 H5VL_group_create + 217</span></p>
<p style="margin-top: 0px; margin-bottom: 0px;margin:0px; font-variant-numeric:normal; font-variant-east-asian:normal; font-stretch:normal; font-size:11px; line-height:normal; font-family:Menlo; color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures"><span> </span>[ 8] 0 <span>
  </span>libhdf5.1000.dylib<span>                  </span>0x0000000105d48a04 H5G__create_api_common + 660</span></p>
<p style="margin-top: 0px; margin-bottom: 0px;margin:0px; font-variant-numeric:normal; font-variant-east-asian:normal; font-stretch:normal; font-size:11px; line-height:normal; font-family:Menlo; color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures"><span> </span>[ 9] 0 <span>
  </span>libhdf5.1000.dylib<span>                  </span>0x0000000105d485f5 H5Gcreate2 + 325</span></p>
<p style="margin-top: 0px; margin-bottom: 0px;margin:0px; font-variant-numeric:normal; font-variant-east-asian:normal; font-stretch:normal; font-size:11px; line-height:normal; font-family:Menlo; color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures"><span> </span>[10] 0 <span>
  </span>async_test_parallel.exe <span>            </span>0x0000000105bbcb43 main + 739</span></p>
<p style="margin-top: 0px; margin-bottom: 0px;margin:0px; font-variant-numeric:normal; font-variant-east-asian:normal; font-stretch:normal; font-size:11px; line-height:normal; font-family:Menlo; color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures"><span> </span>[11] 0 <span>
  </span>libdyld.dylib <span>                      </span>0x00007fff203fef5d start + 1</span></p>
<p style="margin-top: 0px; margin-bottom: 0px;margin:0px; font-variant-numeric:normal; font-variant-east-asian:normal; font-stretch:normal; font-size:11px; line-height:normal; font-family:Menlo; color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures"><span> </span>[12] 0 <span>
  </span>??? <span>                                </span>0x0000000000000001 0x0 + 1</span></p>
<p style="margin-top: 0px; margin-bottom: 0px;margin:0px; font-variant-numeric:normal; font-variant-east-asian:normal; font-stretch:normal; line-height:normal; color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures"><font face="arial, sans-serif"><br>
</font></span></p>
<p style="margin-top: 0px; margin-bottom: 0px;margin:0px; font-variant-numeric:normal; font-variant-east-asian:normal; font-stretch:normal; line-height:normal; color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures"><font face="arial, sans-serif">Thank you,</font></span></p>
<p style="margin-top: 0px; margin-bottom: 0px;margin:0px; font-variant-numeric:normal; font-variant-east-asian:normal; font-stretch:normal; line-height:normal; color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures"><font face="arial, sans-serif">Jean Luca</font></span></p>
</div>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</body>
</html>