P4_GLOBMEMSIZE problem

Jean-Christophe Ducom jducom at nd.edu
Mon Nov 4 09:27:22 PST 2002


>
>
>You may set P4_GLOBMEMSIZE (a shell variable) to a larger value, but not
>bigger than your kernel predefined max shared memory value.  For example, I
>put following lines in my .bashrc file
>
>P4_GLOBMEMSIZE=33554432
>export P4_GLOBMEMSIZE
>  
>
I already did that.

*if setenv P4_GLOBMEMSIZE 16000000(or higher), then I get the error message:
p2_25612:  p4_error: interrupt SIGSEGV: 11
p4_22913:  p4_error: interrupt SIGSEGV: 11
Broken pipe
Broken pipe
bm_list_26381: (8.040565) wakeup_slave: unable to interrupt slave 0 pid 
26380

*if setenv P4_GLOBMEMSIZE 14000000, then:
p2_25887: (6.780981) xx_shmalloc: returning NULL; requested 13914960 bytes
p2_25887: (6.781052) p4_shmalloc returning NULL; request = 13914960 bytes
You can increase the amount of memory by setting the environment variable
P4_GLOBMEMSIZE (in bytes); the current size is 14000000
p2_25887:  p4_error: alloc_p4_msg failed: 0
Broken pipe
bm_list_14913: (7.010840) wakeup_slave: unable to interrupt slave 0 pid 
14912

Every node has 1GB of memory. The
# cat /proc/sys/kernel/shmmax ->536870912
Shoudl it be increased to 1GB?

The job submitted is an Amber (sander) job for 8nodes. The size.h has 
been modified as following:
--------------------------------------
      parameter (MAXREA=3800000)
      parameter (MAXINT=2750000)
      parameter (MAXHOL=1000000)
      parameter (MAXPR=5000000)
      parameter (MAXDUP=8000)
c
c  ---  allocate a "stack" space for temporary real variables:
c       (size depends on the problem: the maximum value used is reported
c        at the end of a calculation)
c
      integer MAX_RSTACK,MAX_ISTACK,MAX_STACK_PTRS,MAX_HEAP_PTRS
      parameter (MAX_RSTACK=1600000)
      parameter (MAX_ISTACK=100000)
      parameter (MAX_STACK_PTRS=100)
      parameter (MAX_HEAP_PTRS=100)
c
----------------------------------------

Any idea?
Thanks

                JC





More information about the Beowulf mailing list