[hpct] HPM: Critical: Cannot use hpm

[Vitali A. Morozov]

Dear HPCT Experts,

This is the most critical problem with the HPM part of HPCT: I cannot 
successfully run an instrumented Fortran or C/C++ code.

Here is what I am doing. A Fortran 77 code

=========The code=========
      program Mult
      implicit none

      integer SIZE
      parameter ( SIZE = 1024 )
      real(8) A(SIZE,SIZE), B(SIZE,SIZE), C(SIZE,SIZE)
      real(8) w, multiply

!      call f_hpm_init( 0, "Mult" )
!      call f_hpm_start_( 0, "BLAS" )
      w = multiply( SIZE, A, B, C )
!      call f_hpm_stop_( 0 )
!      call f_hpm_terminate( 0 )

      stop
      end

      real(8) function multiply( N, A, B, C )
      implicit none
      integer N
      real(8) A(1), B(1), C(1)

      call dgemm( 'N', 'N', N, N, N, 1d0, A, N, B, N, 0d0, C, N );

      multiply = C(1)

      return
      end
=======================

mpixlf77 -g -c hpct-hcpm.f
mpixlf77 -g -o hpct-hcpm hpct-hcpm.o

runs OK on 1 node.

Uncomment hpm calls.

1) I cannot build the code with previous instructions:

mpixlf77 -g -c hpct-hcpm.f
mpixlf77 -g -o hpct-hcpm hpct-hcpm.o -L/home/morozov/soft/hpct_bgp/lib/ 
-lhpm -llicense

/home/morozov/soft/hpct_bgp/lib//libhpm.a(hpm_error.o): In function 
`hpm_error':
utils/hpm_error.c:154: undefined reference to `dlerror'
/home/morozov/soft/hpct_bgp/lib//libhpm.a(hpm_dlfcn.o): In function 
`get_plugins':
utils/hpm_dlfcn.c:56: undefined reference to `dlopen'
utils/hpm_dlfcn.c:56: undefined reference to `dlopen'
utils/hpm_dlfcn.c:63: undefined reference to `dlsym'
utils/hpm_dlfcn.c:67: undefined reference to `dlsym'

If possible, we would like to keep the old build behavior:

mpixlf77 -g -c hpct-hcpm.f
mpixlf77 -g -o hpct-hcpm hpct-hcpm.o -L/home/morozov/soft/hpct_bgp/lib/ 
-lhpm -llicense

2) Adding libdl.a library allows to compile, but the executable does not 
run with core dumped.

mpixlf77 -g -o hpct-hcpm hpct-hcpm.o -L/home/morozov/soft/hpct_bgp/lib/ 
-lhpm -llicense 
-L/bgsys/drivers/ppcfloor/gnu-linux/powerpc-bgp-linux/lib -ldl

TASK=hpct-hcpm
sub -A Performance -q short -t 0:10:00 -n 1 --proccount 1 --mode smp -O 
$TASK \
--env 
LD_LIBRARY_PATH=$HOME/soft/hpct_bgp/lib:/bgsys/drivers/ppcfloor/gnu-linux/powerpc-bgp-linux/lib 
$TASK

=============
bgp_stack hpct-hcpm core.0

0x00000000
??
??:0

0x036b5828
??
??:0

0x011f9834
call_init
/bgsys/drivers/V1R2M0_200_2008-080513P/ppc/toolchain/gnu/glibc-2.4/elf/dl-init.c:70

0x011f99c8
_dl_init
/bgsys/drivers/V1R2M0_200_2008-080513P/ppc/toolchain/gnu/glibc-2.4/elf/dl-init.c:100

0x011d59dc
dl_open_worker
/bgsys/drivers/V1R2M0_200_2008-080513P/ppc/toolchain/gnu/glibc-2.4/elf/dl-open.c:470

0x011d3b04
_dl_catch_error
/bgsys/drivers/V1R2M0_200_2008-080513P/ppc/toolchain/gnu/glibc-2.4/elf/dl-error.c:178

0x011d5310
_dl_open
/bgsys/drivers/V1R2M0_200_2008-080513P/ppc/toolchain/gnu/glibc-2.4/elf/dl-open.c:550

0x011bc8e8
dlopen_doit
/bgsys/drivers/V1R2M0_200_2008-080513P/ppc/toolchain/gnu/glibc-2.4/dlfcn/dlopen.c:66

0x011d3b04
_dl_catch_error
/bgsys/drivers/V1R2M0_200_2008-080513P/ppc/toolchain/gnu/glibc-2.4/elf/dl-error.c:178

0x011bcc68
_dlerror_run
/bgsys/drivers/V1R2M0_200_2008-080513P/ppc/toolchain/gnu/glibc-2.4/dlfcn/dlerror.c:164

0x011bc860
__dlopen
/bgsys/drivers/V1R2M0_200_2008-080513P/ppc/toolchain/gnu/glibc-2.4/dlfcn/dlopen.c:89

0x01015528
dlopen
/bgsys/drivers/V1R2M0_200_2008-080513P/ppc/toolchain/gnu/glibc-2.4/dlfcn/dlopen.c:31

0x01013020
get_plugins
utils/hpm_dlfcn.c:56

0x01002314
_hpmInit_
/bgusr/grotius/bgusr/ihchung/hpct.branch/hpct/src/hpm/libhpm.c:443

0x01004a1c
f_hpm_init
/bgusr/grotius/bgusr/ihchung/hpct.branch/hpct/src/hpm/libhpm.c:1248

0x0100135c
mult
/gpfs/home/morozov/Work/HPCT-HCPM/TestSuite/009-F77-hpm/hpct-hcpm.f:11

0x0119ab70
generic_start_main
../csu/libc-start.c:231

0x0119ade4
__libc_start_main
../sysdeps/unix/sysv/linux/powerpc/libc-start.c:137

0xfffffffc
??
??:0
======================

Thanks,

Vitali Morozov