...
1.1.3 Follow the fresh install instructions in the link below using pbsdata as the dataservice user.
...
"NOTE: /etc/pbs.conf and the PBS_HOME directory must be deleted manually".
1.1.3.1. Login to the boot node and create the /rr/current/software/pbspro directory if it is not present.
1.1.3.2. Copy the PBS Pro server RPM to the /rr/current/software/pbspro directory on the boot node. Ensure it is the only RPM file present in the directory.
1.1.3.3. Set the compute nodes to batch:
boot# xtprocadmin -k m batch
1.1.3.4. Install the PBS Pro RPM by running the following command on the boot node. Adjust the value of PBS_SERVER to the name of the node where the scheduler/server/comm services will run. For a fresh install run:
boot# xtopview -d /rr/current/software/pbspro -m "Installing PBS Pro" -e "PBS_SERVER=sdb rpm -i /mnt/pbspro-server-*.rpm"
1.1.3.5. Check to ensure PBS_SERVER is set correctly in /etc/pbs.conf and edit if necessary. All PBS Pro services should be disabled.
boot# xtopview -e "cat /etc/pbs.conf"
PBS_EXEC=/opt/pbs
PBS_SERVER=sdb
PBS_START_SERVER=0
PBS_START_SCHED=0
PBS_START_COMM=0
PBS_START_MOM=0
PBS_HOME=/var/spool/pbs
PBS_CORE_LIMIT=unlimited
PBS_SCP=/usr/bin/scp
1.1.3.6. Update /etc/pbs.conf for the login nodes. Set the value of PBS_START_MOM to 1.
boot# xtopview -c login -e "xtspec /etc/pbs.conf"
boot# xtopview -c login -e "vi /etc/pbs.conf"
***File /etc/pbs.conf was MODIFIED
boot# xtopview -c login -e "cat /etc/pbs.conf"
PBS_EXEC=/opt/pbs
PBS_SERVER=sdb
PBS_START_SERVER=0
PBS_START_SCHED=0
PBS_START_COMM=0
PBS_START_MOM=1
1.2 Optional: After installation of PBS MoMs add the line below to the PBS_HOME/mom_priv/config file of each MoM node:
$usecp *:/home /home
and HUP the MoM after changing PBS_HOME/mom_priv/config:
login# pkill -HUP pbs_mom
1.3 After installation, follow the steps in the POST UPGRADE section.
1.4. Submit jobs
Follow the job submission steps in JOBS section.
1.5. Cleanup
Uninstall PBS using steps in UNINSTALLATION section.
1.6. Repeat the steps 1.1.3 to 1.5 above using the user crayadm as the data service account.
In step 1.1.3 start PBS Pro for the first time by:
boot# ssh sdb
=== Welcome to sdb ===
sdb# PBS_DATA_SERVICE_USER=crayadm /etc/init.d/pbs start
2. UPGRADE
2.1. Install PBS Pro 17.x and then overlay upgrade to PBS Pro 17.y (where y > x).
Use pbsdata as the dataservice account.
2.1.1 Install PBS Pro 17.x using the installation procedure in section 1.1.
2.1.2 Follow the overlay upgrade instructions in the link below in the section "Overlay upgrade procedure when installed PBS Pro version is 17.0 or higher".
The message below should not be seen, and it is an error if the message comes up during upgrade:
"NOTE: /etc/pbs.conf and the PBS_HOME directory must be deleted manually".
2.1.3 After upgrade, login to the server and MoM nodes and:
2.1.3.1 Perform the checks in the POST UPGRADE section.
2.1.3.2 Check that PBS_HOME in /etc/pbs.conf is still /var/spool/pbs
sdb# grep PBS_HOME /etc/pbs.conf
login# grep PBS_HOME /etc/pbs.conf
2.1.3.3 Check that /var/spool/pbs exists and is populated, as root:
sdb# ls -R /var/spool/pbs
PBS_CORE_LIMIT=unlimited PBS_SCP=/usr/bin/scp login# ls -R /var/spool/pbs
12.1.3.7. Determine the NID of the node that will run the PBS Pro server and scheduler. In this example, the sdb node will be used.
boot# ssh sdb cat /proc/cray_xt/nid
5
14 Submit jobs as shown in JOBS section.
2.1.3.8. Use the value returned as the argument to the -n parameter and update the /etc/pbs.conf settings for the PBS Pro server.
The values of PBS_START_SERVER, PBS_START_SCHED, and PBS_START_COMM should all be set to 1.
boot# xtopview -n 5 -e "xtspec /etc/pbs.conf"
boot# xtopview -n 5 -e "vi /etc/pbs.conf"
***File /etc/pbs.conf was MODIFIED
boot# xtopview -n 5 -e "cat /etc/pbs.conf"
PBS_EXEC=/opt/pbs
PBS_SERVER=sdb
PBS_START_SERVER=1
PBS_START_SCHED=1
PBS_START_COMM=1
PBS_START_MOM=0
PBS_HOME=/var/spool/pbs
PBS_CORE_LIMIT=unlimited
PBS_SCP=/usr/bin/scp
1.1.3.9. The PBS Pro dataservice runs on the PBS Pro server node. The processes must be owned by an account other than root. (e.g.pbsdata, postgres, etc.).
Start PBS by:
boot# ssh sdb
=== Welcome to sdb ===
sdb# /etc/init.d/pbs start
1.1.3.10. Start the PBS Pro service on each execution host. In the below example we use nid00030. Use the appropriate login node where the PBS Pro Mom will be started.
sdb# ssh nid00030 /etc/init.d/pbs start
1.1.3.11. Enable flatuid on the server:
sdb# qmgr -c "set server flatuid = true"
1.1.3.12. Install the approriate PBS Pro license. For the open souce release, it is not necessary to configure a license.
For the commercial release, define the pbs_license_info parameter via qmgr. For example:
sdb# qmgr -c "set server pbs_license_info = 6200@licenseserver"
1.1.3.13. With licensing now configured, restart PBS Pro on the sdb node.
sdb# /etc/init.d/pbs restart
1.1.3.14. Configure the execution hosts on the server. Create a node in PBS Pro for each login/service node that will be running pbs_mom.
sdb# qmgr -c "create node nid00030"
Installation is complete.
1.2 Optional: After installation of PBS MoMs add the line below to the PBS_HOME/mom_priv/config file of each MoM node:
$usecp *:/home /home
and HUP the MoM after changing PBS_HOME/mom_priv/config:
login# pkill -HUP pbs_mom
1.3 After installation, follow the steps in the POST UPGRADE section.
1.4. Submit jobs
Follow the job submission steps in JOBS section.
1.5. Cleanup
Uninstall PBS using steps in UNINSTALLATION section.
1.6. Repeat the steps 1.1.3 to 1.5 above using the user crayadm as the data service account.
In step 1.1.3.9 start PBS Pro for the first time by:
boot# ssh sdb
=== Welcome to sdb ===
sdb# PBS_DATA_SERVICE_USER=crayadm /etc/init.d/pbs start
2. UPGRADE
2.1. Install PBS Pro 17.x and then overlay upgrade to PBS Pro 17.y (where y > x).
Use pbsdata as the dataservice account.
2.1.1 Install PBS Pro 17.x using the installation procedure in section 1.1.
2.1.2 Follow the overlay upgrade instructions below.
The message below should not be seen, and it is an error if the message comes up during upgrade:
"NOTE: /etc/pbs.conf and the PBS_HOME directory must be deleted manually".
2.1.2.1 Login to the boot node and create the /rr/current/software/pbspro
directory if it is not present.
2.1.2.2 Copy the new PBS Pro server RPM to the /rr/current/software/pbspro on the boot node. Ensure it is the only RPM file present in the directory.
2.1.2.3 Drain the system of running jobs. Queued jobs will be retained.
Prevent new jobs from starting.
sdb# qmgr -c "set server scheduling = false"
Wait until any jobs running have finished.
2.1.2.4 Shut down PBS Pro on all login nodes.
login# /etc/init.d/pbs stop
2.1.2.5 Shut down PBS Pro on the server.
sdb# /etc/init.d/pbs stop
2.1.2.6 On the boot node, run:
boot# xtopview -d /rr/current/software/pbspro -m "Upgrading PBS Pro" -e "rpm -U /mnt/pbspro-server-*.rpm"
2.1.2.7 Start the PBS Pro server.
sdb# /etc/init.d/pbs start
2.1.2.8 Start the PBS Pro mom(s).
login# /etc/init.d/pbs start
2.1.3 After upgrade, login to the server and MoM nodes and:
2.1.3.1 Perform the checks in the POST UPGRADE section.
2.1.3.2 Check that PBS_HOME in /etc/pbs.conf is still /var/spool/pbs
sdb# grep PBS_HOME /etc/pbs.conf
login# grep PBS_HOME /etc/pbs.conf
2.1.3.3 Check that /var/spool/pbs exists and is populated, as root:
sdb# ls -R /var/spool/pbs
login# ls -R /var/spool/pbs
2.1.3.4 Submit jobs as shown in JOBS section.
2.1.3.5 Clean up PBS installation using steps in UNINSTALLATION section.
2.2 Install PBS Pro 13.0.40x and then overlay upgrade to PBS Pro 17.x or higher.
Use crayadm as the dataservice account.
2.2.1 Install PBS Pro 13.0.40x using the installation procedure in the PBS Pro 13.0 Installation Guide.
Add the lines below to the PBS_HOME/mom_priv/config on each MoM node:
$alps_client /opt/cray/alps/default/bin/apbasil
$usecp *:/home /home → optional
and HUP the MoM after changing the PBS_HOME/mom_priv/config:
login# pkill -HUP pbs_mom
2.2.2 Follow the overlay upgrade instructions below.
The message below should not be seen, and it is an error if the message comes up during upgrade:
"NOTE: /etc/pbs.conf and the PBS_HOME directory must be deleted manually".
Prior to version 17, PBS Pro used a script named INSTALL to install and configure the RPMs.
As of version 17, the INSTALL script is no longer supported. The new package
allows the administrator to install and upgrade PBS Pro as they would any other RPM based package.
Due to the significant packaging changes, it is recommended that the administrator uninstall the old version of PBS Pro
prior to installing the new version. Uninstalling the old version after installing the new version will prevent PBS
Pro from starting automatically at boot.
2.2.2.1 Follow the steps in uninstallation section 5.1.
expected:
PBS Pro is now completely uninstalled, but the /etc/pbs.conf and PBS_HOME directories remain. Leave these files in place and follow
the steps to perform a fresh install of PBS Pro in section 1.7.5 Clean up PBS installation using steps in UNINSTALLATION section.
2.2 Install PBS Pro 13.0.40x and then overlay upgrade to PBS Pro 17.x or higher.
Use crayadm as the dataservice account.
2.2.1 Install PBS Pro 13.0.40x using the installation procedure in the PBS Pro 13.0 Installation Guide.
Add the lines below to the PBS_HOME/mom_priv/config on each MoM node:
$alps_client /opt/cray/alps/default/bin/apbasil
$usecp *:/home /home → optional
and HUP the MoM after changing the PBS_HOME/mom_priv/config:
login# pkill -HUP pbs_mom
2.2.2 Follow the overlay upgrade instructions in the link below in the section "Overlay upgrade procedure when installed PBS Pro version is 13.0.40x or lower".
The message below should not be seen, and it is an error if the message comes up during upgrade:
"NOTE: /etc/pbs.conf and the PBS_HOME directory must be deleted manually".
Prior to version 17, PBS Pro used a script named INSTALL to install and configure the RPMs.
As of version 17, the INSTALL script is no longer supported. The new package
allows the administrator to install and upgrade PBS Pro as they would any other RPM based package.
Due to the significant packaging changes, it is recommended that the administrator uninstall the old version of PBS Pro
prior to installing the new version. Uninstalling the old version after installing the new version will prevent PBS
Pro from starting automatically at boot.
2.2.3 After the upgrade, login to the server and MoM nodes and:
...