Instructions for DPM sites in CMS

CMS recommendations for Sites running DPM

NOTE These instructions are intended for sites where CMS jobs are using the rfio protocol to access files on the DPM storage. If you have configured CMS jobs to access files on DPM using a different protocol (e.g. xrootd) you must remove all of the following workarounds from your CMS job environment. CMS recommends to switch to xrootd also for local file access.

All the following hints are only to be applied, if a site cannot switch to xrootd yet.

DPM/CMSSW compatibility workaround for glite3.2 sites

These instructions are aimed to DPM sites, in order to run 32 and 64 bit CMSSW releases in a glite3.2 environment. More informations about the various issues can be found:

• Globus library issue with DPM / rfio
• Issue with DPM and SL5 64bit CMSSW
• Frontier issue with CMSSW_3_11_0 (release deprecated)

Step1: copy from a sl4 machine the following libraries into a directory in the cms sw area, e.g. $VO_CMS_SW_DIR/mylib :

NB: these libraries are available here: http://polywww.in2p3.fr/~sartiran/mylib.tgz

/opt/lcg/lib/libCsec_plugin_GSI_thread.so
/opt/globus/lib/libglobus_gssapi_gsi_gcc32dbgpthr.so.0
/opt/globus/lib/libglobus_gss_assist_gcc32dbgpthr.so.0
/opt/glite/lib/libvomsapi_gcc32dbgpthr.so.0
/opt/glite/lib/libvomsc_gcc32dbgpthr.so.0
/opt/globus/lib/libglobus_gsi_proxy_core_gcc32dbgpthr.so.0
/opt/globus/lib/libglobus_gsi_credential_gcc32dbgpthr.so.0
/opt/globus/lib/libglobus_gsi_callback_gcc32dbgpthr.so.0
/opt/globus/lib/libglobus_oldgaa_gcc32dbgpthr.so.0
/opt/globus/lib/libglobus_gsi_sysconfig_gcc32dbgpthr.so.0
/opt/globus/lib/libglobus_gsi_cert_utils_gcc32dbgpthr.so.0
/opt/globus/lib/libglobus_openssl_gcc32dbgpthr.so.0
/opt/globus/lib/libglobus_openssl_error_gcc32dbgpthr.so.0
/opt/globus/lib/libglobus_proxy_ssl_gcc32dbgpthr.so.0
/opt/globus/lib/libglobus_common_gcc32dbgpthr.so.0
/opt/globus/lib/libssl_gcc32dbgpthr.so.0
/opt/globus/lib/libcrypto_gcc32dbgpthr.so.0
/opt/globus/lib/libltdl_gcc32dbgpthr.so.3
/opt/globus/lib/libglobus_callout_gcc32dbgpthr.so.0

Step 2: add the following lines to the CMS local job configuration file $VO_CMS_SW_DIR/SITECONF/local/JobConfig/cmsset_local.sh:

# DPM host definition for libdpm

export DPM_HOST=<your host>
export DPNS_HOST=<your host>

export RFIO_PORT=5001


export LD_PRELOAD=/opt/globus/lib/libglobus_gssapi_gsi_gcc64dbgpthr.so


if [ "$SCRAM_ARCH" == "slc5_ia32_gcc434" ]
     then
     unset LD_PRELOAD
     LD_LIBRARY_PATH=/opt/exp_soft/cms/mylib:$LD_LIBRARY_PATH
     export LD_LIBRARY_PATH
 fi

DPM/CMSSW compatibility workaround for emi-1 sites

if you are running emi-1 worker-nodes there are some additional DPM/CMSSW compatibility issues

• CMS on EMI WN

to fix such issues the same workaround of the previous section applies but Step 2 has to be modified as follows

Step 2 (emi version): add the following lines to the CMS local job configuration file $VO_CMS_SW_DIR/SITECONF/local/JobConfig/cmsset_local.sh:

# DPM host definition for libdpm

export DPM_HOST=<your host>
export DPNS_HOST=<your host>

export RFIO_PORT=5001

if [ -e /opt/glite/bin/glite-version ];
then
      export LD_PRELOAD=/opt/globus/lib/libglobus_gssapi_gsi_gcc64dbgpthr.so
else
      export LD_PRELOAD=/usr/lib64/liblcgdm.so
fi


if [ "$SCRAM_ARCH" == "slc5_ia32_gcc434" ]
     then
     unset LD_PRELOAD
     LD_LIBRARY_PATH=/opt/exp_soft/cms/mylib:$LD_LIBRARY_PATH
     export LD_LIBRARY_PATH
 fi

DPM/CMSSW compatibility workaround for emi-2 sites

EMI-2 WNs are available for SL5 and SL6, which unfortunately require slightly different handling. Main source of the difficulties are conflicts between OpenSSL libraries provides by the OS and those shipped by CMS. All CMSSW parts are built against the ones from CMS, while all Middleware components are built against the ones from the OS.

Common issue for SL5 and SL6 flavour: Missing RPM. Should be solved by next EMI-2 release. Still affected meta RPM emi-wn-2.0.0-1.sl6.x86_64 and emi-wn-2.0.0-1.sl5.x86_64. Fix by installing this RPM (as user root, with EMI repos properly configured and activated):

yum install dpm-devel

DPM/CMSSW compatibility workaround for emi-2 on SL5

Add the following lines to the CMS local job configuration file $VO_CMS_SW_DIR/SITECONF/local/JobConfig/cmsset_local.sh:

# DPM host definition for libdpm

export DPM_HOST=<your host>
export DPNS_HOST=<your host>

export RFIO_PORT=5001

if [ -e /opt/glite/bin/glite-version ];
then
      export LD_PRELOAD=/opt/globus/lib/libglobus_gssapi_gsi_gcc64dbgpthr.so
else
      export LD_PRELOAD=/usr/lib64/liblcgdm.so
fi

DPM/CMSSW compatibility workaround for emi-2 on SL6

Add the following lines to the CMS local job configuration file $VO_CMS_SW_DIR/SITECONF/local/JobConfig/cmsset_local.sh:

# DPM host definition for libdpm

export DPM_HOST=<your host>
export DPNS_HOST=<your host>

export RFIO_PORT=5001

if [ -e /opt/glite/bin/glite-version ];
then
      export LD_PRELOAD=/opt/globus/lib/libglobus_gssapi_gsi_gcc64dbgpthr.so
else
      export LD_PRELOAD=/usr/lib64/liblcgdm.so:/usr/lib64/libssl.so.10 
fi

-- GiuseppeBagliesi - 09-Jul-2012