[Llvm-bgq-discuss] trouble with clang on BGQ IO nodes
Hal Finkel
hfinkel at anl.gov
Tue Mar 25 08:46:32 CDT 2014
----- Original Message -----
> From: "John A. Biddiscombe" <biddisco at cscs.ch>
> To: "Hal Finkel" <hfinkel at anl.gov>
> Cc: "llvm-bgq-discuss at lists.alcf.anl.gov" <llvm-bgq-discuss at lists.alcf.anl.gov>
> Sent: Tuesday, March 25, 2014 8:43:24 AM
> Subject: RE: [Llvm-bgq-discuss] trouble with clang on BGQ IO nodes
>
> Hal, (+ cc'ing back to, list as I must have hit reply by mistake)
>
> Thanks. Any idea when you might be doing your next release.
> I ask because I just run some benchmarks (another email coming) and
> get bad results which will hopefully go away.
I'm planning on doing it this week.
-Hal
>
> JB
>
>
> > -----Original Message-----
> > From: Hal Finkel [mailto:hfinkel at anl.gov]
> > Sent: 25 March 2014 14:38
> > To: Biddiscombe, John A.
> > Subject: Re: [Llvm-bgq-discuss] trouble with clang on BGQ IO nodes
> >
> > ----- Original Message -----
> > > From: "John A. Biddiscombe" <biddisco at cscs.ch>
> > > To: "Hal Finkel" <hfinkel at anl.gov>
> > > Sent: Tuesday, March 25, 2014 8:30:33 AM
> > > Subject: RE: [Llvm-bgq-discuss] trouble with clang on BGQ IO
> > > nodes
> > >
> > > Hal,
> > >
> > > > No, but then again, I've not specifically tested it. Can you
> > > > run the
> > > > command (the long one with clang -cc1 below) under a debugger
> > > > and,
> > > > when it crashes, go up to the frame that actually generated the
> > > > exception, and type 'disassemble' (there will be an arrow
> > > > pointing
> > > > to the guilty
> > > > instruction) and
> > > > also 'info registers' and send the relevant output.
> > >
> > > disassembly here (let me know if I didn't do it right), info at
> > > end
> >
> > This is good, thanks! It looks like the new build generated Altivec
> > instructions
> > (which won't work on the A2 login nodes or the IONs). I'll fix this
> > in the next
> > build.
> >
> > -Hal
> >
> > >
> > > Program received signal SIGFPE, Arithmetic exception.
> > > 0x0000000010214bcc in
> > >
> > ._ZNSt3__112basic_stringIcNS_11char_traitsIcEENS_9allocatorIcEEE6assignIP
> > KcEENS_9enable_ifIXsr21__is_forward_iteratorIT_EE5valueERS5_E4type
> > >
> > > ESA_SA_
> > > ()
> > > Missing separate debuginfos, use: debuginfo-install
> > > glibc-2.12-1.107.el6.ppc64 libedit-2.11-4.20080712cvs.1.el6.ppc64
> > > libgcc-4.4.7-3.el6.ppc64 libstdc++-4.4.7-3.
> > >
> > > el6.ppc64
> > > ncurses-libs-5.7-3.20090208.el6.ppc64 zlib-1.2.3-29.el6.ppc64
> > > (gdb) disassemble
> > > Dump of assembler code for function
> > >
> > ._ZNSt3__112basic_stringIcNS_11char_traitsIcEENS_9allocatorIcEEE6assignIP
> > KcEENS_9enable_ifIXsr21__is_forward_iteratorIT_EE5va
> > > lueERS5_E4typeESA_SA_:
> > > 0x00000000102149e4 <+0>: mflr r0
> > > 0x00000000102149e8 <+4>: std r0,16(r1)
> > > 0x00000000102149ec <+8>: stdu r1,-208(r1)
> > > 0x00000000102149f0 <+12>: std r30,192(r1)
> > > 0x00000000102149f4 <+16>: mr r30,r3
> > > 0x00000000102149f8 <+20>: std r23,136(r1)
> > > 0x00000000102149fc <+24>: std r28,176(r1)
> > > 0x0000000010214a00 <+28>: std r29,184(r1)
> > > 0x0000000010214a04 <+32>: std r24,144(r1)
> > > 0x0000000010214a08 <+36>: std r25,152(r1)
> > > 0x0000000010214a0c <+40>: std r26,160(r1)
> > > 0x0000000010214a10 <+44>: std r27,168(r1)
> > > 0x0000000010214a14 <+48>: mr r29,r5
> > > 0x0000000010214a18 <+52>: mr r28,r4
> > > 0x0000000010214a1c <+56>: li r23,22
> > > 0x0000000010214a20 <+60>: lbz r3,0(r30)
> > > 0x0000000010214a24 <+64>: subf r24,r28,r29
> > > 0x0000000010214a28 <+68>: extsb r3,r3
> > > 0x0000000010214a2c <+72>: cmpwi r3,-1
> > > 0x0000000010214a30 <+76>: bgt 0x10214a44
> > >
> > <._ZNSt3__112basic_stringIcNS_11char_traitsIcEENS_9allocatorIcEEE6assignI
> > PKcEENS_9enable_ifIXsr21__is_forward_
> > >
> > iteratorIT_EE5valueERS5_E4typeESA_SA_+96>
> > > 0x0000000010214a34 <+80>: ld r3,0(r30)
> > > 0x0000000010214a38 <+84>: clrldi r4,r3,1
> > > 0x0000000010214a3c <+88>: rldicl r3,r3,8,56
> > > 0x0000000010214a40 <+92>: addi r23,r4,-1
> > > 0x0000000010214a44 <+96>: cmpld r24,r23
> > > 0x0000000010214a48 <+100>: ble 0x10214a84
> > >
> > <._ZNSt3__112basic_stringIcNS_11char_traitsIcEENS_9allocatorIcEEE6assignI
> > PKcEENS_9enable_ifIXsr21__is_forward_
> > >
> > iteratorIT_EE5valueERS5_E4typeESA_SA_+160>
> > > 0x0000000010214a4c <+104>: lis r4,32767
> > > 0x0000000010214a50 <+108>: subf r5,r23,r24
> > > 0x0000000010214a54 <+112>: ori r4,r4,65535
> > > 0x0000000010214a58 <+116>: rldicr r4,r4,32,31
> > > 0x0000000010214a5c <+120>: oris r4,r4,65535
> > > 0x0000000010214a60 <+124>: ori r4,r4,65519
> > > 0x0000000010214a64 <+128>: subf r4,r23,r4
> > > 0x0000000010214a68 <+132>: cmpld r4,r5
> > > 0x0000000010214a6c <+136>: blt 0x10214c78
> > >
> > <._ZNSt3__112basic_stringIcNS_11char_traitsIcEENS_9allocatorIcEEE6assignI
> > PKcEENS_9enable_ifIXsr21__is_forward_
> > >
> > iteratorIT_EE5valueERS5_E4typeESA_SA_+660>
> > > 0x0000000010214a70 <+140>: extsb r3,r3
> > > 0x0000000010214a74 <+144>: cmpwi r3,-1
> > > 0x0000000010214a78 <+148>: ble 0x10214aa0
> > >
> > <._ZNSt3__112basic_stringIcNS_11char_traitsIcEENS_9allocatorIcEEE6assignI
> > PKcEENS_9enable_ifIXsr21__is_forward_
> > >
> > iteratorIT_EE5valueERS5_E4typeESA_SA_+188>
> > > 0x0000000010214a7c <+152>: addi r27,r30,1
> > > 0x0000000010214a80 <+156>: b 0x10214aa4
> > >
> > <._ZNSt3__112basic_stringIcNS_11char_traitsIcEENS_9allocatorIcEEE6assignI
> > PKcEENS_9enable_ifIXsr21__is_forward_
> > >
> > iteratorIT_EE5valueERS5_E4typeESA_SA_+192>
> > > 0x0000000010214a84 <+160>: extsb r3,r3
> > > 0x0000000010214a88 <+164>: cmpwi r3,-1
> > > 0x0000000010214a8c <+168>: ble 0x10214a98
> > >
> > <._ZNSt3__112basic_stringIcNS_11char_traitsIcEENS_9allocatorIcEEE6assignI
> > PKcEENS_9enable_ifIXsr21__is_forward_
> > >
> > iteratorIT_EE5valueERS5_E4typeESA_SA_+180>
> > > 0x0000000010214a90 <+172>: addi r3,r30,1
> > > 0x0000000010214a94 <+176>: b 0x10214b4c
> > >
> > <._ZNSt3__112basic_stringIcNS_11char_traitsIcEENS_9allocatorIcEEE6assignI
> > PKcEENS_9enable_ifIXsr21__is_forward_
> > >
> > iteratorIT_EE5valueERS5_E4typeESA_SA_+360>
> > > 0x0000000010214a98 <+180>: ld r3,16(r30)
> > > 0x0000000010214a9c <+184>: b 0x10214b4c
> > >
> > <._ZNSt3__112basic_stringIcNS_11char_traitsIcEENS_9allocatorIcEEE6assignI
> > PKcEENS_9enable_ifIXsr21__is_forward_
> > >
> > iteratorIT_EE5valueERS5_E4typeESA_SA_+360>
> > > 0x0000000010214aa0 <+188>: ld r27,16(r30)
> > > ---Type <return> to continue, or q <return> to quit---
> > > 0x0000000010214aa4 <+192>: lis r3,16383
> > > 0x0000000010214aa8 <+196>: ori r3,r3,65535
> > > 0x0000000010214aac <+200>: rldicr r3,r3,32,31
> > > 0x0000000010214ab0 <+204>: oris r3,r3,65535
> > > 0x0000000010214ab4 <+208>: ori r3,r3,65511
> > > 0x0000000010214ab8 <+212>: cmpld r23,r3
> > > 0x0000000010214abc <+216>: bge 0x10214b04
> > >
> > <._ZNSt3__112basic_stringIcNS_11char_traitsIcEENS_9allocatorIcEEE6assignI
> > PKcEENS_9enable_ifIXsr21__is_forward_
> > >
> > iteratorIT_EE5valueERS5_E4typeESA_SA_+288>
> > > 0x0000000010214ac0 <+220>: rldicr r3,r23,1,62
> > > 0x0000000010214ac4 <+224>: cmpld r24,r3
> > > 0x0000000010214ac8 <+228>: blt 0x10214ad0
> > >
> > <._ZNSt3__112basic_stringIcNS_11char_traitsIcEENS_9allocatorIcEEE6assignI
> > PKcEENS_9enable_ifIXsr21__is_forward_
> > >
> > iteratorIT_EE5valueERS5_E4typeESA_SA_+236>
> > > 0x0000000010214acc <+232>: mr r3,r24
> > > 0x0000000010214ad0 <+236>: li r26,23
> > > 0x0000000010214ad4 <+240>: cmpldi r3,23
> > > 0x0000000010214ad8 <+244>: blt 0x10214ae8
> > >
> > <._ZNSt3__112basic_stringIcNS_11char_traitsIcEENS_9allocatorIcEEE6assignI
> > PKcEENS_9enable_ifIXsr21__is_forward_
> > >
> > iteratorIT_EE5valueERS5_E4typeESA_SA_+260>
> > > 0x0000000010214adc <+248>: addi r3,r3,16
> > > 0x0000000010214ae0 <+252>: li r4,-16
> > > 0x0000000010214ae4 <+256>: and r26,r3,r4
> > > 0x0000000010214ae8 <+260>: mr r3,r26
> > > 0x0000000010214aec <+264>: bl 0x10178bdc
> > > 0x0000000010214af0 <+268>: ld r2,40(r1)
> > > 0x0000000010214af4 <+272>: mr r25,r3
> > > 0x0000000010214af8 <+276>: cmpldi r23,22
> > > 0x0000000010214afc <+280>: beq 0x10214b34
> > >
> > <._ZNSt3__112basic_stringIcNS_11char_traitsIcEENS_9allocatorIcEEE6assignI
> > PKcEENS_9enable_ifIXsr21__is_forward_
> > >
> > iteratorIT_EE5valueERS5_E4typeESA_SA_+336>
> > > 0x0000000010214b00 <+284>: b 0x10214b28
> > >
> > <._ZNSt3__112basic_stringIcNS_11char_traitsIcEENS_9allocatorIcEEE6assignI
> > PKcEENS_9enable_ifIXsr21__is_forward_
> > >
> > iteratorIT_EE5valueERS5_E4typeESA_SA_+324>
> > > 0x0000000010214b04 <+288>: lis r3,32767
> > > 0x0000000010214b08 <+292>: ori r3,r3,65535
> > > 0x0000000010214b0c <+296>: rldicr r3,r3,32,31
> > > 0x0000000010214b10 <+300>: oris r3,r3,65535
> > > 0x0000000010214b14 <+304>: ori r26,r3,65519
> > > 0x0000000010214b18 <+308>: mr r3,r26
> > > 0x0000000010214b1c <+312>: bl 0x10178bdc
> > > 0x0000000010214b20 <+316>: ld r2,40(r1)
> > > 0x0000000010214b24 <+320>: mr r25,r3
> > > 0x0000000010214b28 <+324>: mr r3,r27
> > > 0x0000000010214b2c <+328>: bl 0x101763b4
> > > 0x0000000010214b30 <+332>: ld r2,40(r1)
> > > 0x0000000010214b34 <+336>: li r3,1
> > > 0x0000000010214b38 <+340>: std r25,16(r30)
> > > 0x0000000010214b3c <+344>: rldicr r3,r3,63,0
> > > 0x0000000010214b40 <+348>: or r3,r26,r3
> > > 0x0000000010214b44 <+352>: std r3,0(r30)
> > > 0x0000000010214b48 <+356>: ld r3,16(r30)
> > > 0x0000000010214b4c <+360>: cmpld r28,r29
> > > 0x0000000010214b50 <+364>: beq 0x10214c20
> > >
> > <._ZNSt3__112basic_stringIcNS_11char_traitsIcEENS_9allocatorIcEEE6assignI
> > PKcEENS_9enable_ifIXsr21__is_forward_
> > >
> > iteratorIT_EE5valueERS5_E4typeESA_SA_+572>
> > > 0x0000000010214b54 <+368>: subf r4,r28,r29
> > > 0x0000000010214b58 <+372>: li r5,-16
> > > 0x0000000010214b5c <+376>: and. r7,r4,r5
> > > 0x0000000010214b60 <+380>: beq 0x10214b94
> > >
> > <._ZNSt3__112basic_stringIcNS_11char_traitsIcEENS_9allocatorIcEEE6assignI
> > PKcEENS_9enable_ifIXsr21__is_forward_
> > >
> > iteratorIT_EE5valueERS5_E4typeESA_SA_+432>
> > > 0x0000000010214b64 <+384>: addi r9,r29,-1
> > > 0x0000000010214b68 <+388>: li r8,0
> > > 0x0000000010214b6c <+392>: add r6,r28,r7
> > > ---Type <return> to continue, or q <return> to quit---
> > > 0x0000000010214b70 <+396>: add r5,r3,r7
> > > 0x0000000010214b74 <+400>: cmpld r3,r9
> > > 0x0000000010214b78 <+404>: bgt 0x10214ba4
> > >
> > <._ZNSt3__112basic_stringIcNS_11char_traitsIcEENS_9allocatorIcEEE6assignI
> > PKcEENS_9enable_ifIXsr21__is_forward_
> > >
> > iteratorIT_EE5valueERS5_E4typeESA_SA_+448>
> > > 0x0000000010214b7c <+408>: li r9,-1
> > > 0x0000000010214b80 <+412>: xor r9,r28,r9
> > > 0x0000000010214b84 <+416>: add r9,r29,r9
> > > 0x0000000010214b88 <+420>: add r9,r3,r9
> > > 0x0000000010214b8c <+424>: cmpld r9,r28
> > > 0x0000000010214b90 <+428>: blt 0x10214ba4
> > >
> > <._ZNSt3__112basic_stringIcNS_11char_traitsIcEENS_9allocatorIcEEE6assignI
> > PKcEENS_9enable_ifIXsr21__is_forward_
> > >
> > iteratorIT_EE5valueERS5_E4typeESA_SA_+448>
> > > 0x0000000010214b94 <+432>: mr r5,r3
> > > 0x0000000010214b98 <+436>: mr r6,r28
> > > 0x0000000010214b9c <+440>: li r7,0
> > > 0x0000000010214ba0 <+444>: b 0x10214bf4
> > >
> > <._ZNSt3__112basic_stringIcNS_11char_traitsIcEENS_9allocatorIcEEE6assignI
> > PKcEENS_9enable_ifIXsr21__is_forward_
> > >
> > iteratorIT_EE5valueERS5_E4typeESA_SA_+528>
> > > 0x0000000010214ba4 <+448>: add r9,r28,r8
> > > 0x0000000010214ba8 <+452>: li r10,15
> > > 0x0000000010214bac <+456>: lvsl v2,r28,r8
> > > 0x0000000010214bb0 <+460>: lvx v3,r28,r8
> > > 0x0000000010214bb4 <+464>: mr r12,r3
> > > 0x0000000010214bb8 <+468>: addi r11,r8,16
> > > 0x0000000010214bbc <+472>: lvx v4,r9,r10
> > > 0x0000000010214bc0 <+476>: addi r9,r1,112
> > > 0x0000000010214bc4 <+480>: cmpld r7,r11
> > > 0x0000000010214bc8 <+484>: vperm v2,v3,v4,v2
> > > => 0x0000000010214bcc <+488>: stvx v2,r0,r9
> > > 0x0000000010214bd0 <+492>: nop
> > > 0x0000000010214bd4 <+496>: nop
> > > 0x0000000010214bd8 <+500>: ld r23,112(r1)
> > > 0x0000000010214bdc <+504>: ld r9,8(r9)
> > > 0x0000000010214be0 <+508>: stdux r23,r12,r8
> > > 0x0000000010214be4 <+512>: li r8,8
> > > 0x0000000010214be8 <+516>: stdx r9,r12,r8
> > > 0x0000000010214bec <+520>: mr r8,r11
> > > 0x0000000010214bf0 <+524>: bne 0x10214ba4
> > >
> > <._ZNSt3__112basic_stringIcNS_11char_traitsIcEENS_9allocatorIcEEE6assignI
> > PKcEENS_9enable_ifIXsr21__is_forward_
> > >
> > iteratorIT_EE5valueERS5_E4typeESA_SA_+448>
> > > 0x0000000010214bf4 <+528>: cmpld r4,r7
> > > 0x0000000010214bf8 <+532>: beq 0x10214c1c
> > >
> > <._ZNSt3__112basic_stringIcNS_11char_traitsIcEENS_9allocatorIcEEE6assignI
> > PKcEENS_9enable_ifIXsr21__is_forward_
> > >
> > iteratorIT_EE5valueERS5_E4typeESA_SA_+568>
> > > 0x0000000010214bfc <+536>: subf r7,r6,r29
> > > 0x0000000010214c00 <+540>: mtctr r7
> > > 0x0000000010214c04 <+544>: lbz r7,0(r6)
> > > 0x0000000010214c08 <+548>: addi r8,r5,1
> > > 0x0000000010214c0c <+552>: addi r6,r6,1
> > > 0x0000000010214c10 <+556>: stb r7,0(r5)
> > > 0x0000000010214c14 <+560>: mr r5,r8
> > > 0x0000000010214c18 <+564>: bdnz 0x10214c04
> > >
> > <._ZNSt3__112basic_stringIcNS_11char_traitsIcEENS_9allocatorIcEEE6assignI
> > PKcEENS_9enable_ifIXsr21__is_forward_
> > >
> > iteratorIT_EE5valueERS5_E4typeESA_SA_+544>
> > > 0x0000000010214c1c <+568>: add r3,r3,r4
> > > 0x0000000010214c20 <+572>: li r4,0
> > > 0x0000000010214c24 <+576>: stb r4,0(r3)
> > > 0x0000000010214c28 <+580>: lbz r3,0(r30)
> > > 0x0000000010214c2c <+584>: extsb r3,r3
> > > 0x0000000010214c30 <+588>: cmpwi r3,-1
> > > 0x0000000010214c34 <+592>: ble 0x10214c40
> > >
> > <._ZNSt3__112basic_stringIcNS_11char_traitsIcEENS_9allocatorIcEEE6assignI
> > PKcEENS_9enable_ifIXsr21__is_forward_
> > >
> > iteratorIT_EE5valueERS5_E4typeESA_SA_+604>
> > > 0x0000000010214c38 <+596>: stb r24,0(r30)
> > > ---Type <return> to continue, or q <return> to quit---
> > > 0x0000000010214c3c <+600>: b 0x10214c44
> > >
> > <._ZNSt3__112basic_stringIcNS_11char_traitsIcEENS_9allocatorIcEEE6assignI
> > PKcEENS_9enable_ifIXsr21__is_forward_
> > >
> > iteratorIT_EE5valueERS5_E4typeESA_SA_+608>
> > > 0x0000000010214c40 <+604>: std r24,8(r30)
> > > 0x0000000010214c44 <+608>: mr r3,r30
> > > 0x0000000010214c48 <+612>: ld r30,192(r1)
> > > 0x0000000010214c4c <+616>: ld r29,184(r1)
> > > 0x0000000010214c50 <+620>: ld r28,176(r1)
> > > 0x0000000010214c54 <+624>: ld r27,168(r1)
> > > 0x0000000010214c58 <+628>: ld r26,160(r1)
> > > 0x0000000010214c5c <+632>: ld r25,152(r1)
> > > 0x0000000010214c60 <+636>: ld r24,144(r1)
> > > 0x0000000010214c64 <+640>: ld r23,136(r1)
> > > 0x0000000010214c68 <+644>: addi r1,r1,208
> > > 0x0000000010214c6c <+648>: ld r0,16(r1)
> > > 0x0000000010214c70 <+652>: mtlr r0
> > > 0x0000000010214c74 <+656>: blr
> > > 0x0000000010214c78 <+660>: mr r3,r30
> > > 0x0000000010214c7c <+664>: bl 0x1017a630
> > >
> > <._ZNKSt3__121__basic_string_commonILb1EE20__throw_length_errorEv>
> > > 0x0000000010214c80 <+668>: nop
> > > 0x0000000010214c84 <+672>: .long 0x0
> > > 0x0000000010214c88 <+676>: .long 0x0
> > > 0x0000000010214c8c <+680>: .long 0x0
> > > End of assembler dump.
> > >
> > > (gdb) info registers
> > > r0 0x10214af0 270617328
> > > r1 0xfffffffb4d0 17592186025168
> > > r2 0x11900068 294649960
> > > r3 0x11933de0 294862304
> > > r4 0x17 23
> > > r5 0x11933df0 294862320
> > > r6 0x1159480d 291063821
> > > r7 0x10 16
> > > r8 0x0 0
> > > r9 0xfffffffb540 17592186025280
> > > r10 0xf 15
> > > r11 0x10 16
> > > r12 0x11933de0 294862304
> > > r13 0xfffb80012d0 17590978089680
> > > r14 0x0 0
> > > r15 0x11905910 294672656
> > > r16 0x0 0
> > > r17 0x11904dd0 294669776
> > > r18 0x11905a20 294672928
> > > r19 0x800c 32780
> > > r20 0x0 0
> > > r21 0x0 0
> > > r22 0x11880068 294125672
> > > r23 0x16 22
> > > r24 0x17 23
> > > r25 0x11933de0 294862304
> > > r26 0x30 48
> > > r27 0x11933f39 294862649
> > > r28 0x115947fd 291063805
> > > r29 0x11594814 291063828
> > > r30 0x11933f38 294862648
> > > r31 0x11906c31 294677553
> > > pc 0x10214bcc 0x10214bcc
> > >
> > <._ZNSt3__112basic_stringIcNS_11char_traitsIcEENS_9allocatorIcEEE6assignI
> > PKcEENS_9enable_ifIXsr21__is_forward_iteratorIT_EE5valueERS5_E4typeES
> > A_SA_+488>
> > > msr 0x8002d000 2147667968
> > > cr 0x28080422 671613986
> > > lr 0x10214af0 0x10214af0
> > >
> > <._ZNSt3__112basic_stringIcNS_11char_traitsIcEENS_9allocatorIcEEE6assignI
> > PKcEENS_9enable_ifIXsr21__is_forward_iteratorIT_EE5valueERS5_E4typeES
> > A_SA_+268>
> > > ctr 0xfffb55c4a70 17590933801584
> > > xer 0x20000000 536870912
> > > orig_r3 0x7 7
> > > trap 0x700 1792
> > >
> > >
> >
> > --
> > Hal Finkel
> > Assistant Computational Scientist
> > Leadership Computing Facility
> > Argonne National Laboratory
>
--
Hal Finkel
Assistant Computational Scientist
Leadership Computing Facility
Argonne National Laboratory
More information about the llvm-bgq-discuss
mailing list