Page Properties | ||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
...
- server/
- qstat_B.out: output of "qstat -B"
- qstat_Bf.out: output of "qstat -Bf"
- qmgr_ps.out: output of "qmgr print server"
- server_priv/: a copy of the 'server_priv' directory inside PBS_HOME, may or may not include accounting logs (see the -L option under "Interface Documentation"), core files are not captured (see core_file_bt/).
- server_logs/ (optional): contains server logs from the PBS_HOME/server_logs directory for the number of days specified by -L option
- job/
- qstat.out: output of "qstat"
- qstat_f.out: output of "qstat -f"
- qstat_t.out: output of "qstat -t"
- qstat_tf.out: output of "qstat -tf"
- qstat_x.out: output of "qstat -x"
- qstat_xf.out: output of "qstat -xf"
- qstat_ns.out: output of "qstat -ns"
- qstat_fx_F_dsv.out: output of "qstat -fx -F dsv"
- qstat_f_F_dsv.out: output of "qstat -f -F dsv"
- node/
- pbsnodes_va.out: output of "pbsnodes -va"
- pbsnodes_a.out: output of "pbsnodes -a"
- pbsnodes_avSj.out: output of "pbsnodes -avSj"
- pbsnodes_aSj.out: output of "pbsnodes -aSj"
- pbsnodes_avS.out: output of "pbsnodes -avS"
- pbsnodes_aS.out: output of "pbsnodes -aS"
- pbsnodes_aFdsv.out: output of "pbsnodes -aFdsv"
- pbsnodes_avFdsv.out: output of "pbsnodes -avFdsv"
- qmgr_pn_default.out: output of "qmgr print node @default"
mom_priv/
Copies of the following files: 'config', 'prologue', 'epilogue', 'mom.lock'
config.d/: contains copy of all vnode def files from inside PBS_HOME/mom_priv/config.d/
- mom_logs/ (optional): contains mom logs from the PBS_HOME/mom_logs directory for the number of days specified by -L option
- comm/
- comm_logs/ (optional): contains comm logs from the PBS_HOME/comm_logs directory for the number of days specified by -L option
- queue/
- qstat_Q.out: output of "qstat -Q"
- qstat_Qf.out: output of "qstat -Qf"
- hook/
- qmgr_ph_default.out: output of "qmgr print hook @default"
- qmgr_lpbshook.out: output of "qmgr list pbshook"
- scheduler/
- qmgr_lsched.out: output of "qmgr list sched"
- sched_priv/: a copy of the 'sched_priv' directory inside PBS_HOME with all the files, core files are not captured (see core_file_bt/).
- sched_logs/ (optional): contains scheduler logs from the PBS_HOME/sched_logs directory for the number of days specified by -L option
- reservation/
- pbs_rstat_f.out: output of "pbs_rstat -f"
- pbs_rstat.out: output of "pbs_rstat"
- resource/
- qmgr_pr.out: output of "qmgr print resource"
- rscs_all (derived from the resourcedef file): Will list out built-in as well as custom resources in the following format:
Name: <resource name>
type = <resource type attribute>
flag = <resource flag attribute>Name: <resource name>
type = <resource type attribute>
flag = <resource flag attribute>...
...
datastore/
pg_log/: a copy of the "PBS_HOME/datastore/pg_log" directory
pbs/
pbs.conf: a copy of the pbs.conf file for the PBS system
pbs_probe_v.out: output of "pbs_probe -v"
- pbs_hostn_v.out: output of "pbs_hostn -v $(hostname)"
- pbs_environment: copy of PBS_HOME/pbs_environment file
core_file_bt/ (stack backtrace from core files)
sched_priv/: files containing the output of "thread apply all backtrace full" on all core files captured from PBS_HOME/sched_priv
- server_priv/: files containing the output of "thread apply all backtrace full" on all core files captured from PBS_HOME/server_priv
- mom_priv/: files containing the output of "thread apply all backtrace full" on all core files captured from PBS_HOME/mom_priv
- system/
- os_info: Information about the OS: version, flavour of linux etc. (output of "uname -a" and "cat /etc/*release*" for linux)
- process_info: List of processes running on the system when the snapshot was taken (output of "ps -ef | grep pbs | grep -v grep" for linux)
- lsof_pbs.out: output of "lsof | grep pbs | grep -v grep", only on linux systems
- ps_aux_pbs.out: output of "ps -aux | grep pbs | grep -v grep", only on linux systems
- etc_hosts: Copy of "/etc/hosts" file, only on linux systems.
- etc_nsswitch_conf: Copy of "/etc/nsswitch.conf" file, only on linux systems.
- vmstat.out: Output of the command 'vmstat', only on linux systems.
- df_h.out: Output of the command 'df -h', only on linux systems.
- dmesg.out: Output of the 'dmesg' command, only on linux systems.
- ctime: this will log the time (since epoch) when the snapshot was taken.
- pbs_snapshot.log: captures the logs generated by pbs_snapshot if the -l option is provided.
...
sudo pbs_snapshot [OPTION]
-d <pbs_diag>: diag directory to use as input
-H <hostname>: hostname to operate on. Defaults to the value of PBS_SERVER
...
-l <loglevel>: set log level to one of INFO, INFOCLI, INFOCLI2, DEBUG, DEBUG2,
...
WARNING, ERROR, FATAL
-o <dir>: output directory
--service-logs=<num days> number of days of service logs to collect
--accounting-logs=<num days> number of days of accounting logs to collect
--additional_hosts=<hostname>: capture additional logs from the hosts specified
...
'hostname' is a comma separated list of hosts to take logs from
--map=<file>: path to filename to store the mapping of obfuscated data
--obfuscate: obfuscates euser, egroup, project, account_name, hostnames,
...
IP Addressses, PBS dataservice username
...
Deletes mail endpoints, owner, managers, operators, variable_list
...
ACLs, group_list, job name, jobdir
--version: print version number and exit
sudo - Currently pbs_snapshot will need to be run as a user with sudo privileges because it needs to access protected PBS information (e.g - information inside the PBS_HOME/ _priv directories)
...
- Synopsis: Option to provide the hostname to PBS server
- Details:
- This option will make pbs_snapshot ignore the value of PBS_SERVER and instead use the one provided.
Interface: Option -L <num days>l <loglevel>
- Synopsis: Option to instruct set the desired log level for debugging pbs_snapshot to capture logs for the given number of days going back from the current day
- Details:
- This will capture sched_logs, server_logs and accounting logs. The value of <num days> should be >= 0.
- If the value is 0, only the logs for the current day are captured. If the value is 1, only the logs for the current day, and the day before will be captured
- The <loglevel> can be set to INFO, INFOCLI, INFOCLI2, DEBUG, DEBUG2, WARNING, ERROR or FATAL.
- The logging becomes more comprehensive going from FATAL to INFO.
- By default, the log level will be set to INFOCLI2.
- The generated logs will also be written out in the file 'pbs_snapshot.log' inside the snapshot directory.
Interface: Option -l <loglevel>o <dir>
- Synopsis: Option to set the desired log level for debugging pbs_snapshotspecify path to the output/snapshot directory
- Details:
- The <loglevel> can be set to INFO, INFOCLI, INFOCLI2, DEBUG, DEBUG2, WARNING, ERROR or FATAL.
- The logging becomes more comprehensive going from FATAL to INFO.
- By default, the log level will be set to INFOCLI2.
- The generated logs will also be written out in the file 'pbs_snapshot.log' inside the snapshot directory.
Interface: Option -o <dir>
- Synopsis: Option to specify path to the output/snapshot directory
- Details:
- By default, pbs_snapshot will generate the snapshot directory inside By default, pbs_snapshot will generate the snapshot directory inside /tmp/, and the snapshot directory will be named as "snapshot_<timestamp>"
- <timestamp> will be in the format: YYYYMMDD_HH_MM_SS
- If a directory <dir> already exists, pbs_snapshot will prompt the user to confirm whether to over-write it or not.
- By default, pbs_snapshot will generate the snapshot directory inside By default, pbs_snapshot will generate the snapshot directory inside /tmp/, and the snapshot directory will be named as "snapshot_<timestamp>"
Interface: Option --service-logs=<num days>
- Synopsis: Option to instruct pbs_snapshot to capture service logs for the given number of days going back from the current day
- Details:
- This will capture all the daemons' logs available on the host that's running PBS Server.
- If this option is not specified, a default of 5 days of logs will be collected.
- The value of <num days> should be >= 0.
- If the value is 0, only the logs for the current day are captured.
- If the value is 1, only the logs for the current day, and the day before will be captured.
Interface: Option --accounting-logs=<num days>
- Synopsis: Option to instruct pbs_snapshot to capture accounting logs for the given number of days going back from the current day
- Details:
- If this option is not specified, a default of 30 days of accounting logs will be collected.
- The value of <num days> should be >= 0.
- If the value is 0, only the logs for the current day are captured.
- If the value is 1, only the logs for the current day, and the day before will be captured.
Interface: Option --additional_hosts=<hostname>
...