Related to my previous ticket , in the midst of repeatedly testing provisioning I at one time found that the mom hook python file on a single compute node was corrupted. This node was one of many that was provisioned. I\'ve attached some files:
server log, you can ignore the lines about attribute resources_available.reboot (those are changes made by our provisioning process)
/var/log/messages (including pbs_mom logging) from the compute node with corrupt python file
normal/expected python file
After I found the cause of my job 1975 failing multiple times I restarted pbs_mom on node and PBS did the right thing, replacing the corrupt python file with a correct one.