[Llvm-bgq-discuss] total view with clang bgq

[Hal Finkel]

----- Original Message -----
> From: "John A. Biddiscombe" <biddisco at cscs.ch>
> To: "Hal Finkel" <hfinkel at anl.gov>
> Cc: llvm-bgq-discuss at lists.alcf.anl.gov
> Sent: Friday, May 2, 2014 1:18:19 AM
> Subject: RE: [Llvm-bgq-discuss] total view with clang bgq
> 
> Hal
> 
> Q1: A : yes, the gcc 4.8.2 stuff works with totalview
> 
> > 
> > Oh, you're working on the I/O nodes (with your own MPI), right? So
> > maybe
> > you can't use the special files intended for use with CNK that are
> > normally
> > used by bgclang and also use total view? Are you using the bgclang
> > wrapper
> > script when you compile for the IONs?
> >
> 
> I use the bgclang wrapper for C compilation and bgclang++ or
> bgclang++11 for C++, but I do not use the bgclang MPI wrappers and I
> setup the MPI include and link paths/flags/libs myself using a bunch
> of cmake settings. The mpi used on the ION is an mvapich installed
> as part of the default system. (I do have trouble with performance
> of mpi programs, so am open to further experimentation there).
> 
> $echo $CC
> /gpfs/bbp.cscs.ch/home/biddisco/apps/clang/bgclang/bin/bgclang
> 
> $ echo $CXX
> /gpfs/bbp.cscs.ch/home/biddisco/apps/clang/bgclang/bin/bgclang++11

Because you're running on the IONs, I think you should try: bin/clang or bin/clang++ -mcpu=a2
(and, if you need libc++, then just add -std=gnu++11 -stdlib=libc++ and the include/library paths to libc++ manually). I'm guessing that total view for regular PPC/Linux does not like the older libc startup files, etc. used by the CNK-targeted toolchain.

 -Hal

> 
> the full verbose link command would expand out to this ....
> (NB, all the stuff which is in
> /gpfs/bbp.cscs.ch/home/biddisco/apps/clang like the log4cxx and
> boost libs is/are compiled by me using the same basic setup).
> 
> 
> clang version 3.5.0 (trunk)
> Target: powerpc64-bgq-linux
> Thread model: posix
> Found candidate GCC installation:
> /bgsys/drivers/V1R2M1/ppc64/gnu-linux-4.7.2/lib/gcc/powerpc64-bgq-linux/4.7.2
> Selected GCC installation:
> /bgsys/drivers/V1R2M1/ppc64/gnu-linux-4.7.2/lib/gcc/powerpc64-bgq-linux/4.7.2
> Candidate multilib: .;@m64
> Selected multilib: .;@m64
>  "/gpfs/bbp.cscs.ch/home/biddisco/apps/clang/bgclang/r205936-20140409/binutils/bin/ld"
>  -export-dynamic --hash-style=gnu --no-add-needed --build-id
>  --eh-frame-hdr -m elf64ppc -dynamic-linker /lib64/ld64.so.1 -o
>  ../../bin/hg_test_rpc
>  /bgsys/drivers/V1R2M1/ppc64/gnu-linux-4.7.2/powerpc64-bgq-linux/lib/crt1.o
>  /bgsys/drivers/V1R2M1/ppc64/gnu-linux-4.7.2/powerpc64-bgq-linux/lib/crti.o
>  /bgsys/drivers/V1R2M1/ppc64/gnu-linux-4.7.2/lib/gcc/powerpc64-bgq-linux/4.7.2/crtbegin.o
>  -L/gpfs/bbp.cscs.ch/home/biddisco/apps/clang/bgclang/r205936-20140409/libc++/lib
>  -L/bgsys/drivers/V1R2M1/ppc64/gnu-linux-4.7.2/powerpc64-bgq-linux/lib
>  -L/gpfs/bbp.cscs.ch/home/biddisco/apps/clang/boost_1_55_0/lib
>  -L/gpfs/bbp.cscs.ch/home/biddisco/apps/clang/bgclang/r205936-20140409/sleef/lib
>  -L/bgsys/drivers/V1R2M1/ppc64/gnu-linux-4.7.2/lib/gcc/powerpc64-bgq-linux/4.7.2
>  -L/bgsys/drivers/V1R2M1/ppc64/gnu-linux-4.7.2/lib/gcc/powerpc64-bgq-linux/4.7.2/../../../../lib64
>  -L/lib/../lib64 -L/usr/lib/../lib64
>  -L/bgsys/drivers/V1R2M1/ppc64/gnu-linux-4.7.2/lib/gcc/powerpc64-bgq-linux/4.7.2/../../../../powerpc64-bgq-linux/lib
>  -L/bgsys/drivers/V1R2M1/ppc64/gnu-linux-4.7.2/lib/gcc/powerpc64-bgq-linux/4.7.2/../../..
>  -L/gpfs/bbp.cscs.ch/home/biddisco/apps/clang/bgclang/r205936-20140409/bin/../lib
>  -L/lib -L/usr/lib -rpath
>  /gpfs/bbp.cscs.ch/home/biddisco/apps/clang/bgclang/r205936-20140409/libc++/lib
>  -rpath
>  /bgsys/drivers/V1R2M1/ppc64/gnu-linux-4.7.2/powerpc64-bgq-linux/lib
>  CMakeFiles/hg_test_rpc.dir/test_rpc.c.o ../../bin/libmercury_test.a
>  ../../bin/libmercury_debug.a ../../bin/libna_test.a
>  ../../bin/libmchecksum_debug.a ../../bin/libna_debug.a
>  ../../bin/librdma_lib.a
>  /gpfs/bbp.cscs.ch/home/biddisco/apps/clang/log4cxx-0.10.0/lib/liblog4cxx.so
>  /gpfs/bbp.cscs.ch/home/biddisco/apps/clang/apr-1.4.8/lib/libapr-1.so
>  /gpfs/bbp.cscs.ch/home/biddisco/apps/clang/apr-util-1.5.3/lib/libaprutil-1.so
>  /usr/lib64/libxml2.so.2
>  /gpfs/bbp.cscs.ch/home/biddisco/apps/clang/boost_1_55_0/lib/libboost_program_options-clang35-mt-d-1_55.so
>  /gpfs/bbp.cscs.ch/home/biddisco/apps/clang/boost_1_55_0/lib/libboost_system-clang35-mt-d-1_55.so
>  /gpfs/bbp.cscs.ch/home/biddisco/apps/clang/boost_1_55_0/lib/libboost_thread-clang35-mt-d-1_55.so
>  /gpfs/bbp.cscs.ch/home/biddisco/apps/clang/boost_1_55_0/lib/libboost_regex-clang35-mt-d-1_55.so
>  ../../bin/libmercury_util_debug.a -lrdmacm
>  /usr/lib64/mvapich2/lib/libmpich.so -libverbs
>  /usr/lib64/mvapich2/lib/libopa.so /usr/lib64/mvapich2/lib/libmpl.so
>  -lrt -lpthread -lpthread -lrt -rpath
>  /gpfs/bbp.cscs.ch/home/biddisco/apps/clang/boost_1_55_0/lib:/gpfs/bbp.cscs.ch/home/biddisco/apps/clang/log4cxx-0.10.0/lib:/gpfs/bbp.cscs.ch/home/biddisco/apps/clang/apr-1.4.8/lib:/gpfs/bbp.cscs.ch/home/biddisco/apps/clang/apr-util-1.5.3/lib:/usr/lib64/mvapich2/lib
>  -rpath
>  /gpfs/bbp.cscs.ch/home/biddisco/apps/clang/bgclang/r205936-20140409/sleef/lib
>  --as-needed -lsleef --no-as-needed -lc++ -lstdc++ -lm -lgcc_s -lgcc
>  -lc -lgcc_s -lgcc
>  /bgsys/drivers/V1R2M1/ppc64/gnu-linux-4.7.2/lib/gcc/powerpc64-bgq-linux/4.7.2/crtend.o
>  /bgsys/drivers/V1R2M1/ppc64/gnu-linux-4.7.2/powerpc64-bgq-linux/lib/crtn.o
> 
> 
> JB
> 
> 

-- 
Hal Finkel
Assistant Computational Scientist
Leadership Computing Facility
Argonne National Laboratory