The process of installing PBS Pro for Cray systems no longer utilizes the INSTALL script as it had previously. Administrators may now install PBS Pro using the RPM directly. Fresh install for CLE 5.2 and older: - Login to the boot node and create the /rr/current/software/pbspro directory if it is not present. - Copy the PBS Pro server RPM to the /rr/current/software/pbspro directory on the boot node. Ensure it is the only RPM file present in the directory. - Set the compute nodes to batch: boot# xtprocadmin -k m batch - Install the PBS Pro RPM by running the following command on the boot node. Adjust the value of PBS_SERVER to the name of the node where the scheduler/server/comm services will run. For a fresh install run: boot# xtopview -d /rr/current/software/pbspro -m "Installing PBS Pro" \ -e "PBS_SERVER=sdb rpm -i /mnt/pbspro-server-*.rpm" - Check to ensure PBS_SERVER is set correctly in /etc/pbs.conf and edit if necessary. All PBS Pro services should be disabled. boot# xtopview -e "cat /etc/pbs.conf" PBS_EXEC=/opt/pbs PBS_SERVER=sdb PBS_START_SERVER=0 PBS_START_SCHED=0 PBS_START_COMM=0 PBS_START_MOM=0 PBS_HOME=/var/spool/pbs PBS_CORE_LIMIT=unlimited PBS_SCP=/usr/bin/scp - Update /etc/pbs.conf for the login nodes. Set the value of PBS_START_MOM to 1. boot# xtopview -c login -e "xtspec /etc/pbs.conf" boot# xtopview -c login -e "vi /etc/pbs.conf" ***File /etc/pbs.conf was MODIFIED boot# xtopview -c login -e "cat /etc/pbs.conf" PBS_EXEC=/opt/pbs PBS_SERVER=sdb PBS_START_SERVER=0 PBS_START_SCHED=0 PBS_START_COMM=0 PBS_START_MOM=1 PBS_HOME=/var/spool/pbs PBS_CORE_LIMIT=unlimited PBS_SCP=/usr/bin/scp - Determine the NID of the node that will run the PBS Pro server and scheduler. In this example, the sdb node will be used. boot# ssh sdb cat /proc/cray_xt/nid 5 - Use the value returned as the argument to the -n parameter and update the /etc/pbs.conf settings for the PBS Pro server. The values of PBS_START_SERVER, PBS_START_SCHED, and PBS_START_COMM should all be set to 1. boot# xtopview -n 5 -e "xtspec /etc/pbs.conf" boot# xtopview -n 5 -e "vi /etc/pbs.conf" ***File /etc/pbs.conf was MODIFIED boot# xtopview -n 5 -e "cat /etc/pbs.conf" PBS_EXEC=/opt/pbs PBS_SERVER=sdb PBS_START_SERVER=1 PBS_START_SCHED=1 PBS_START_COMM=1 PBS_START_MOM=0 PBS_HOME=/var/spool/pbs PBS_CORE_LIMIT=unlimited PBS_SCP=/usr/bin/scp - The PBS Pro dataservice runs on the PBS Pro server node. The processes must be owned by an account other than root. (e.g. pbsdata, postgres, etc.) If you are performing these steps while upgrading a version of PBS Pro prior to 17, PBS_HOME already exists on the PBS Pro server node and the file PBS_HOME/server_priv/db_user is already populated with the name of the account. If this is a clean install, there are two options: 1. Create a user account named pbsdata on the PBS Pro server. That is the default account name used by the PBS Pro data service. boot# xtopview -n 5 -e "useradd -c 'PBS Pro Dataservice' \ -d /home/users/pbsdata -m pbsdata" boot# ssh sdb === Welcome to sdb === sdb# /etc/init.d/pbs start OR 2. Specify the data service account name when starting PBS Pro for the first time. In this example, the sdb node will be running the PBS Pro data service as the user postgres. The postgres account must already exist prior to starting PBS Pro for the first time. boot# ssh sdb === Welcome to sdb === sdb# PBS_DATA_SERVICE_USER=postgres /etc/init.d/pbs start - Start the PBS Pro service on each execution host. For example: sdb# ssh nid00030 /etc/init.d/pbs start - Enable flatuid on the server: sdb# qmgr -c "set server flatuid = true" - Install the approriate PBS Pro license. For the open source release, it is not necessary to configure a license. For the commercial release, define the pbs_license_info parameter via qmgr. For example: sdb# qmgr -c "set server pbs_license_info = 6200@licenseserver" - With licensing now configured, restart PBS Pro on the sdb node. sdb# /etc/init.d/pbs restart - Configure the execution hosts on the server. Create a node in PBS Pro for each login/service node that will be running pbs_mom. For example: sdb# qmgr -c "create node nid00030" - Installation is complete. ==================================================================== Overlay upgrade procedure when installed PBS Pro version is 17.0 or higher: The following instructions assume that the PBS Pro server is running on the SDB node and that the PBS Pro MoMs are running on the login nodes. Please adjust the commands accordingly per your local configuration. - Login to the boot node and create the /rr/current/software/pbspro directory if it is not present. - Copy the new PBS Pro server RPM to the /rr/current/software/pbspro on the boot node. - Drain the system of running jobs. Queued jobs will be retained. - Shut down PBS Pro on all login nodes. login# /etc/init.d/pbs stop - Shut down PBS Pro on the server. sdb# /etc/init.d/pbs stop - On the boot node, run: boot# xtopview -d /rr/current/software/pbspro -m "Upgrading PBS Pro" \ -e "rpm -U /mnt/pbspro-server-*.rpm" - Start the PBS Pro server. sdb# /etc/init.d/pbs start - Start the PBS Pro mom(s). login# /etc/init.d/pbs start ==================================================================== Overlay upgrade procedure when installed PBS Pro version is 13.0.40x or lower: Prior to version 17, PBS Pro used a script named INSTALL to install and configure the RPMs. The INSTALL script provided support for installing multiple versions simultaneously, using a symbolic link (/opt/pbs/default) to select the "active" version on the system. As of version 17, the INSTALL script is no longer supported. The new package allows the administrator to install and upgrade PBS Pro as they would any other RPM based package. Due to the significant packaging changes, it is recommended that the administrator uninstall the old version of PBS Pro prior to installing the new version. Uninstalling the old version after installing the new version will prevent PBS Pro from starting automatically at boot. The /etc/pbs.conf file and contents of the PBS_HOME directories will not be affected when PBS Pro is uninstalled. The following instructions assume that the PBS Pro server is running on the SDB node and that the PBS Pro MoMs are running on the login nodes. Please adjust the commands accordingly per your local configuration. - Drain the system of running jobs. Queued jobs will be retained. - Remove all existing vnodes sdb# qmgr -c "delete node @default" - Shutdown PBS Pro on all login nodes. login# /etc/init.d/pbs stop - Shutdown PBS Pro on the server. sdb# /etc/init.d/pbs stop - Determine the NID of the node that will run the PBS Pro server and scheduler. In this example, the sdb node will be used. boot# ssh sdb cat /proc/cray_xt/nid 5 - Remove specialization of the existing /etc/pbs.conf file. boot# xtopview -e "xtunspec -N /etc/pbs.conf" boot# xtopview -e "xtunspec -C /etc/pbs.conf" - There may be more than one version of PBS Pro installed. Obtain the list of all currently installed PBS Pro RPMs. boot# xtopview -e "rpm -qa" | grep pbs - Remove each installed version of PBS Pro. boot# xtopview -e "rpm -e pbspro-server" - Remove the /opt/pbs directory: boot# xtopview -e "rm -rf /opt/pbs" PBS Pro is now completely uninstalled, but the /etc/pbs.conf and PBS_HOME directories remain. Leave these files in place and follow the steps to perform a fresh install of PBS Pro.