2017-05-11 10:17:15,872 INFO input command: pbs_benchpress -f pbs_resc_used_single_node.py -o /mnt/hgfs/altair/PP-745_fixed.txt 2017-05-11 10:17:15,872 INFO param: None 2017-05-11 10:17:15,873 INFO ptl version: 1.0.0 2017-05-11 10:17:15,873 INFO platform: Linux centosvm 3.10.0-514.10.2.el7.x86_64 #1 SMP Fri Mar 3 00:04:05 UTC 2017 x86_64 x86_64 2017-05-11 10:17:15,873 INFO python version: 2.7.5 2017-05-11 10:17:15,873 INFO user: dilipk 2017-05-11 10:17:15,873 INFO -------------------------------------------------------------------------------- 2017-05-11 10:17:15,873 INFO Cleaning up temporary files 2017-05-11 10:17:15,881 INFO ====================================================================== 2017-05-11 10:17:15,881 INFO suite name: TestPbsPP745 2017-05-11 10:17:15,881 INFO ====================================================================== 2017-05-11 10:17:15,881 INFO ================================ 2017-05-11 10:17:15,881 INFO Entered TestPbsPP745 setUpClass 2017-05-11 10:17:15,881 INFO ================================ 2017-05-11 10:17:15,881 INFOCLI2 centosvm: id pbsuser 2017-05-11 10:17:15,886 INFOCLI2 centosvm: id pbsuser1 2017-05-11 10:17:15,890 INFOCLI2 centosvm: id pbsuser2 2017-05-11 10:17:15,893 INFOCLI2 centosvm: id pbsuser3 2017-05-11 10:17:15,907 INFO server centosvm: server operating mode set to cli 2017-05-11 10:17:15,907 INFOCLI centosvm: /opt/pbs/bin/qstat -Bf centosvm 2017-05-11 10:17:15,921 INFO server centosvm: version 14.0.1 2017-05-11 10:17:15,922 INFO expect action: created new action kicksched 2017-05-11 10:17:15,922 INFO expect action: added action kicksched to server centosvm 2017-05-11 10:17:15,944 INFOCLI2 centosvm: sudo -H /opt/pbs/sbin/pbsfs 2017-05-11 10:17:15,967 INFOCLI2 centosvm: sudo -H /usr/bin/cat /var/spool/pbs/sched_priv/resource_group 2017-05-11 10:17:15,978 INFOCLI centosvm: /opt/pbs/bin/qmgr -c list sched 2017-05-11 10:17:15,992 INFOCLI2 centosvm: sudo -H /usr/bin/cat /var/spool/pbs/sched_priv/holidays 2017-05-11 10:17:16,012 INFO server centosvm: server operating mode set to cli 2017-05-11 10:17:16,012 INFOCLI centosvm: /opt/pbs/bin/qstat -Bf centosvm 2017-05-11 10:17:16,026 INFO server centosvm: version 14.0.1 2017-05-11 10:17:16,038 INFO ================================= 2017-05-11 10:17:16,038 INFO Completed TestPbsPP745 setUpClass 2017-05-11 10:17:16,038 INFO ================================= 2017-05-11 10:17:16,039 INFO test name: test_epilogue_single_node (tests.functional.pbs_resc_used_single_node.TestPbsPP745)... 2017-05-11 10:17:16,039 INFO test start time: Thu May 11 10:17:16 2017 2017-05-11 10:17:16,039 INFO test docstring: Test accumulatinon of resources of a single node job from an exechost_epilogue hook. The string values specified are used by mom as is; that is, they're not converted into JSON format. 2017-05-11 10:17:16,039 INFO =========================== 2017-05-11 10:17:16,039 INFO Entered TestPbsPP745 setUp 2017-05-11 10:17:16,039 INFO =========================== 2017-05-11 10:17:16,040 INFOCLI centosvm: /opt/pbs/bin/qstat -Bf centosvm 2017-05-11 10:17:16,055 INFO status on centosvm: server 2017-05-11 10:17:16,055 INFOCLI centosvm: /opt/pbs/bin/qstat -Bf centosvm 2017-05-11 10:17:16,068 INFO manager on centosvm: set server {'managers': (3, 'dilipk@*')} 2017-05-11 10:17:16,069 INFOCLI centosvm: sudo -H /opt/pbs/bin/qmgr -c set server managers-=dilipk@* 2017-05-11 10:17:16,098 INFO manager on centosvm: set server {'managers': (2, 'dilipk@*')} 2017-05-11 10:17:16,098 INFOCLI centosvm: sudo -H /opt/pbs/bin/qmgr -c set server managers+=dilipk@* 2017-05-11 10:17:16,119 INFO server centosvm: reverting configuration to defaults 2017-05-11 10:17:16,119 INFOCLI centosvm: /opt/pbs/bin/qstat -Bf centosvm 2017-05-11 10:17:16,131 INFO select on centosvm: __ALL__ 2017-05-11 10:17:16,132 INFOCLI centosvm: /opt/pbs/bin/qselect -x 2017-05-11 10:17:16,144 INFO delete job on centosvm: 7.centosvm 2017-05-11 10:17:16,144 INFOCLI centosvm: /opt/pbs/bin/qdel -W force -x 7.centosvm 2017-05-11 10:17:16,163 INFOCLI centosvm: /opt/pbs/bin/qstat -f 7.centosvm 2017-05-11 10:17:16,183 INFOCLI centosvm: /opt/pbs/bin/qstat -f @centosvm 2017-05-11 10:17:16,194 INFO expect on server centosvm: job_state set 0 job ... OK 2017-05-11 10:17:16,194 INFOCLI centosvm: /opt/pbs/bin/pbs_rstat -f 2017-05-11 10:17:16,206 INFO manager on centosvm: unset server ['pbs_license_max', 'pbs_license_min', 'job_history_enable'] 2017-05-11 10:17:16,207 INFOCLI centosvm: /opt/pbs/bin/qmgr -c unset server pbs_license_max,pbs_license_min,job_history_enable 2017-05-11 10:17:16,224 INFOCLI centosvm: sudo -H /opt/pbs/bin/qmgr -c list hook 2017-05-11 10:17:16,251 INFO manager on centosvm: delete hook start,epi 2017-05-11 10:17:16,252 INFOCLI centosvm: sudo -H /opt/pbs/bin/qmgr -c delete hook start,epi 2017-05-11 10:17:16,278 INFOCLI centosvm: sudo -H /opt/pbs/bin/qmgr -c list hook start 2017-05-11 10:17:16,302 INFO expect on server centosvm: unset hook start ... OK 2017-05-11 10:17:16,302 INFOCLI centosvm: sudo -H /opt/pbs/bin/qmgr -c list hook epi 2017-05-11 10:17:16,325 INFO expect on server centosvm: unset hook epi ... OK 2017-05-11 10:17:16,325 INFOCLI centosvm: /opt/pbs/bin/qstat -Qf @centosvm 2017-05-11 10:17:16,338 INFO manager on centosvm: delete queue workq 2017-05-11 10:17:16,338 INFOCLI centosvm: /opt/pbs/bin/qmgr -c delete queue workq 2017-05-11 10:17:16,353 INFOCLI centosvm: /opt/pbs/bin/qstat -Qf workq@centosvm 2017-05-11 10:17:16,365 INFO expect on server centosvm: unset queue workq ... OK 2017-05-11 10:17:16,365 INFO manager on centosvm: create queue workq {'started': 'True', 'queue_type': 'Execution', 'enabled': 'True'} 2017-05-11 10:17:16,366 INFOCLI centosvm: /opt/pbs/bin/qmgr -c create queue workq started=True,queue_type=Execution,enabled=True 2017-05-11 10:17:16,380 INFOCLI centosvm: /opt/pbs/bin/qstat -Qf workq@centosvm 2017-05-11 10:17:16,393 INFO expect on server centosvm: started set True || queue_type set Execution || enabled set True queue workq ... OK 2017-05-11 10:17:16,393 INFO manager on centosvm: set server {'default_queue': 'workq'} 2017-05-11 10:17:16,393 INFOCLI centosvm: /opt/pbs/bin/qmgr -c set server default_queue=workq 2017-05-11 10:17:16,413 INFO status on centosvm: resource 2017-05-11 10:17:16,413 INFO manager on centosvm: list resource 2017-05-11 10:17:16,414 INFOCLI centosvm: /opt/pbs/bin/qmgr -c list resource 2017-05-11 10:17:16,425 INFO manager on centosvm: delete resource foo_i,stra,foo_str2,foo_f,foo_str 2017-05-11 10:17:16,426 INFOCLI centosvm: /opt/pbs/bin/qmgr -c delete resource foo_i,stra,foo_str2,foo_f,foo_str 2017-05-11 10:17:16,525 INFOCLI centosvm: /opt/pbs/bin/qmgr -c list resource foo_i 2017-05-11 10:17:16,553 INFO expect on server centosvm: unset resource foo_i ... OK 2017-05-11 10:17:16,554 INFOCLI centosvm: /opt/pbs/bin/qmgr -c list resource stra 2017-05-11 10:17:16,581 INFO expect on server centosvm: unset resource stra ... OK 2017-05-11 10:17:16,581 INFOCLI centosvm: /opt/pbs/bin/qmgr -c list resource foo_str2 2017-05-11 10:17:16,598 INFO expect on server centosvm: unset resource foo_str2 ... OK 2017-05-11 10:17:16,599 INFOCLI centosvm: /opt/pbs/bin/qmgr -c list resource foo_f 2017-05-11 10:17:16,614 INFO expect on server centosvm: unset resource foo_f ... OK 2017-05-11 10:17:16,615 INFOCLI centosvm: /opt/pbs/bin/qmgr -c list resource foo_str 2017-05-11 10:17:16,634 INFO expect on server centosvm: unset resource foo_str ... OK 2017-05-11 10:17:16,634 INFOCLI status on centosvm: server license_count 2017-05-11 10:17:16,634 INFOCLI centosvm: /opt/pbs/bin/qstat -Bf centosvm 2017-05-11 10:17:16,652 INFO server: centosvm licensed 2017-05-11 10:17:16,710 INFOCLI2 centosvm: sudo -H /usr/bin/cat /var/spool/pbs/server_priv/comm.lock 2017-05-11 10:17:16,760 INFOCLI2 centosvm: sudo -H /usr/bin/cat /var/spool/pbs/sched_priv/sched.lock 2017-05-11 10:17:16,776 INFO scheduler centosvm: reverting configuration to defaults 2017-05-11 10:17:16,776 INFO manager on centosvm: list sched 2017-05-11 10:17:16,776 INFOCLI centosvm: /opt/pbs/bin/qmgr -c list sched 2017-05-11 10:17:16,793 INFO manager on centosvm: unset sched ['sched_cycle_length'] 2017-05-11 10:17:16,794 INFOCLI centosvm: /opt/pbs/bin/qmgr -c unset sched sched_cycle_length 2017-05-11 10:17:16,819 INFOCLI2 centosvm: sudo -H /usr/bin/cat /var/spool/pbs/sched_priv/dedicated_time 2017-05-11 10:17:16,837 INFOCLI2 centosvm: cmp /opt/pbs/etc/pbs_resource_group /var/spool/pbs/sched_priv/resource_group 2017-05-11 10:17:16,842 ERROR err: ['cmp: /var/spool/pbs/sched_priv/resource_group: Permission denied'] 2017-05-11 10:17:16,842 INFOCLI2 centosvm: which cp 2017-05-11 10:17:16,847 INFOCLI2 centosvm: sudo -H /usr/bin/cp -p /opt/pbs/etc/pbs_resource_group /var/spool/pbs/sched_priv/resource_group 2017-05-11 10:17:16,866 INFOCLI2 centosvm: which chmod 2017-05-11 10:17:16,870 INFOCLI2 centosvm: sudo -H /usr/bin/chmod 0644 /var/spool/pbs/sched_priv/resource_group 2017-05-11 10:17:16,888 INFO scheduler centosvm: reverting holidays file to default 2017-05-11 10:17:16,889 INFOCLI2 centosvm: cmp /opt/pbs/etc/pbs_holidays /var/spool/pbs/sched_priv/holidays 2017-05-11 10:17:16,893 ERROR err: ['cmp: /var/spool/pbs/sched_priv/holidays: Permission denied'] 2017-05-11 10:17:16,894 INFOCLI2 centosvm: sudo -H /usr/bin/cp -p /opt/pbs/etc/pbs_holidays /var/spool/pbs/sched_priv/holidays 2017-05-11 10:17:16,908 INFOCLI2 centosvm: sudo -H /usr/bin/chmod 0644 /var/spool/pbs/sched_priv/holidays 2017-05-11 10:17:16,919 INFO scheduler centosvm: Parsing holidays file 2017-05-11 10:17:16,920 INFOCLI2 centosvm: sudo -H /usr/bin/cat /var/spool/pbs/sched_priv/holidays 2017-05-11 10:17:16,931 INFOCLI2 centosvm: cmp /opt/pbs/etc/pbs_sched_config /var/spool/pbs/sched_priv/sched_config 2017-05-11 10:17:16,937 ERROR err: ['cmp: /var/spool/pbs/sched_priv/sched_config: Permission denied'] 2017-05-11 10:17:16,937 INFOCLI2 centosvm: sudo -H /usr/bin/cp -p /opt/pbs/etc/pbs_sched_config /var/spool/pbs/sched_priv/sched_config 2017-05-11 10:17:16,950 INFOCLI2 centosvm: sudo -H /usr/bin/chmod 0644 /var/spool/pbs/sched_priv/sched_config 2017-05-11 10:17:16,965 INFO scheduler centosvm: sent signal -HUP 2017-05-11 10:17:16,965 INFOCLI2 centosvm: sudo -H kill -HUP 22893 2017-05-11 10:17:16,976 INFOCLI2 centosvm: which rm 2017-05-11 10:17:16,979 INFOCLI2 centosvm: sudo -H /usr/bin/rm /var/spool/pbs/sched_priv/usage 2017-05-11 10:17:16,998 ERROR err: ['/usr/bin/rm: cannot remove \xe2\x80\x98/var/spool/pbs/sched_priv/usage\xe2\x80\x99: No such file or directory'] 2017-05-11 10:17:17,027 INFOCLI2 centosvm: sudo -H /usr/bin/cat /var/spool/pbs/sched_priv/sched.lock 2017-05-11 10:17:17,040 INFOCLI2 centosvm: sudo -H cmp /opt/pbs/sbin/pbs_mom /opt/pbs/sbin/pbs_mom.cpuset 2017-05-11 10:17:17,068 INFOCLI2 centosvm: sudo -H /usr/bin/cat /var/spool/pbs/mom_priv/mom.lock 2017-05-11 10:17:17,082 INFOCLI2 centosvm: sudo -H /opt/pbs/sbin/pbs_mom --version 2017-05-11 10:17:17,096 INFO mom centosvm: reverting configuration to defaults 2017-05-11 10:17:17,097 INFOCLI2 centosvm: sudo -H /usr/bin/rm -f /var/spool/pbs/mom_priv/epilogue 2017-05-11 10:17:17,111 INFOCLI2 centosvm: sudo -H /usr/bin/rm -f /var/spool/pbs/mom_priv/prologue 2017-05-11 10:17:17,124 INFOCLI2 centosvm: sudo -H ls /var/spool/pbs/mom_priv/config.d 2017-05-11 10:17:17,138 INFOCLI2 centosvm: sudo -H /usr/bin/cp -p /tmp/PtlPbsURSjYx /var/spool/pbs/mom_priv/config 2017-05-11 10:17:17,150 INFOCLI2 centosvm: sudo -H /usr/bin/chmod 0644 /var/spool/pbs/mom_priv/config 2017-05-11 10:17:17,165 INFOCLI2 centosvm: which chown 2017-05-11 10:17:17,168 INFOCLI2 centosvm: sudo -H /usr/bin/chown root /var/spool/pbs/mom_priv/config 2017-05-11 10:17:17,180 INFOCLI2 centosvm: which chgrp 2017-05-11 10:17:17,183 INFOCLI2 centosvm: sudo -H /usr/bin/chgrp root /var/spool/pbs/mom_priv/config 2017-05-11 10:17:17,198 INFO mom centosvm: sent signal -HUP 2017-05-11 10:17:17,199 INFOCLI2 centosvm: sudo -H kill -HUP 36124 2017-05-11 10:17:17,226 INFOCLI2 centosvm: sudo -H /usr/bin/cat /var/spool/pbs/mom_priv/mom.lock 2017-05-11 10:17:17,242 INFOCLI centosvm: /opt/pbs/bin/pbsnodes -s centosvm -v -a 2017-05-11 10:17:17,260 INFO server centosvm: server operating mode set to cli 2017-05-11 10:17:17,260 INFOCLI centosvm: /opt/pbs/bin/qstat -Bf centosvm 2017-05-11 10:17:17,273 INFO server centosvm: version 14.0.1 2017-05-11 10:17:17,274 INFO status on centosvm: node centosvm 2017-05-11 10:17:17,274 INFOCLI centosvm: /opt/pbs/bin/pbsnodes -s centosvm -v centosvm 2017-05-11 10:17:17,285 INFOCLI centosvm: /opt/pbs/bin/pbsnodes -s centosvm -v centosvm 2017-05-11 10:17:17,302 INFO expect on server centosvm: state = free node centosvm ... OK 2017-05-11 10:17:17,302 INFO ============================ 2017-05-11 10:17:17,303 INFO Completed TestPbsPP745 setUp 2017-05-11 10:17:17,303 INFO ============================ 2017-05-11 10:17:17,303 INFO manager on centosvm as root: delete resource foo_str 2017-05-11 10:17:17,303 INFOCLI centosvm: sudo -H -u root /opt/pbs/bin/qmgr -c delete resource foo_str 2017-05-11 10:17:17,340 INFO manager on centosvm as root: delete resource foo_f 2017-05-11 10:17:17,340 INFOCLI centosvm: sudo -H -u root /opt/pbs/bin/qmgr -c delete resource foo_f 2017-05-11 10:17:17,377 INFO manager on centosvm as root: delete resource foo_i 2017-05-11 10:17:17,377 INFOCLI centosvm: sudo -H -u root /opt/pbs/bin/qmgr -c delete resource foo_i 2017-05-11 10:17:17,417 INFO manager on centosvm as root: delete resource foo_str2 2017-05-11 10:17:17,417 INFOCLI centosvm: sudo -H -u root /opt/pbs/bin/qmgr -c delete resource foo_str2 2017-05-11 10:17:17,458 INFO manager on centosvm as root: delete resource foo_str3 2017-05-11 10:17:17,458 INFOCLI centosvm: sudo -H -u root /opt/pbs/bin/qmgr -c delete resource foo_str3 2017-05-11 10:17:17,478 ERROR err: ['qmgr obj=foo_str3 svr=default: Unknown resource', 'qmgr: Error (15035) returned from server'] 2017-05-11 10:17:17,478 INFOCLI centosvm: /opt/pbs/bin/qstat -Bf centosvm 2017-05-11 10:17:17,494 INFO server centosvm: stopping Server on host centosvm 2017-05-11 10:17:17,494 INFOCLI2 centosvm: sudo -H /usr/bin/cat /var/spool/pbs/server_priv/server.lock 2017-05-11 10:17:17,506 INFOCLI2 centosvm: sudo -H kill -TERM 36110 2017-05-11 10:17:17,518 INFOCLI2 centosvm: sudo -H /usr/bin/cat /var/spool/pbs/server_priv/server.lock 2017-05-11 10:17:22,783 INFO service: starting pbs_server 2017-05-11 10:17:22,784 INFOCLI centosvm: sudo -H /opt/pbs/sbin/pbs_server 2017-05-11 10:17:30,869 INFOCLI2 centosvm: sudo -H /usr/bin/cat /var/spool/pbs/server_priv/server.lock 2017-05-11 10:17:30,936 INFOCLI centosvm: /opt/pbs/bin/qstat -Bf centosvm 2017-05-11 10:17:30,959 INFO mom centosvm: stopping MoM on host centosvm 2017-05-11 10:17:30,960 INFOCLI2 centosvm: sudo -H kill -TERM 36124 2017-05-11 10:17:30,988 INFOCLI2 centosvm: sudo -H /usr/bin/cat /var/spool/pbs/mom_priv/mom.lock 2017-05-11 10:17:31,039 INFO service: starting pbs_mom -d /var/spool/pbs 2017-05-11 10:17:31,039 INFOCLI centosvm: sudo -H /opt/pbs/sbin/pbs_mom -d /var/spool/pbs 2017-05-11 10:17:31,114 INFOCLI2 centosvm: sudo -H /usr/bin/cat /var/spool/pbs/mom_priv/mom.lock 2017-05-11 10:17:31,148 INFOCLI2 centosvm: sudo -H /usr/bin/rm -rf /var/spool/pbs/mom_priv/config.d 2017-05-11 10:17:31,161 INFO manager on centosvm: delete node 2017-05-11 10:17:31,161 INFOCLI centosvm: /opt/pbs/bin/qmgr -c delete node @default 2017-05-11 10:17:31,177 INFO manager on centosvm: create node centosvm 2017-05-11 10:17:31,177 INFOCLI centosvm: /opt/pbs/bin/qmgr -c create node centosvm 2017-05-11 10:17:31,200 INFOCLI centosvm: /opt/pbs/bin/pbsnodes -s centosvm -v centosvm 2017-05-11 10:17:31,214 INFO expect on server centosvm: state = free node centosvm got: state = state-unknown,down 2017-05-11 10:17:31,717 INFOCLI centosvm: /opt/pbs/bin/pbsnodes -s centosvm -v centosvm 2017-05-11 10:17:31,760 INFO expect on server centosvm: state = free node centosvm attempt: 2 got: state = state-unknown,down 2017-05-11 10:17:32,262 INFOCLI centosvm: /opt/pbs/bin/pbsnodes -s centosvm -v centosvm 2017-05-11 10:17:32,305 INFO expect on server centosvm: state = free node centosvm attempt: 3 got: state = state-unknown,down 2017-05-11 10:17:32,806 INFOCLI centosvm: /opt/pbs/bin/pbsnodes -s centosvm -v centosvm 2017-05-11 10:17:32,848 INFO expect on server centosvm: state = free node centosvm attempt: 4 got: state = state-unknown,down 2017-05-11 10:17:33,350 INFOCLI centosvm: /opt/pbs/bin/pbsnodes -s centosvm -v centosvm 2017-05-11 10:17:33,373 INFO expect on server centosvm: state = free node centosvm attempt: 5 got: state = initializing 2017-05-11 10:17:33,874 INFOCLI centosvm: /opt/pbs/bin/pbsnodes -s centosvm -v centosvm 2017-05-11 10:17:33,915 INFO expect on server centosvm: state = free node centosvm attempt: 6 ... OK 2017-05-11 10:17:33,916 INFO manager on centosvm: set server {'job_history_enable': 'True'} 2017-05-11 10:17:33,916 INFOCLI centosvm: /opt/pbs/bin/qmgr -c set server job_history_enable=True 2017-05-11 10:17:33,952 INFO manager on centosvm as root: create resource foo_str2 {'flag': 'h', 'type': 'string'} 2017-05-11 10:17:33,952 INFOCLI centosvm: sudo -H -u root /opt/pbs/bin/qmgr -c create resource foo_str2 flag=h,type=string 2017-05-11 10:17:34,009 INFO manager on centosvm as root: create resource foo_str3 {'flag': 'h', 'type': 'string'} 2017-05-11 10:17:34,009 INFOCLI centosvm: sudo -H -u root /opt/pbs/bin/qmgr -c create resource foo_str3 flag=h,type=string 2017-05-11 10:17:34,049 INFO manager on centosvm as root: create resource stra {'flag': 'h', 'type': 'string_array'} 2017-05-11 10:17:34,050 INFOCLI centosvm: sudo -H -u root /opt/pbs/bin/qmgr -c create resource stra flag=h,type=string_array 2017-05-11 10:17:34,084 INFO status on centosvm: hook 2017-05-11 10:17:34,084 INFO manager on centosvm: list hook 2017-05-11 10:17:34,084 INFOCLI centosvm: sudo -H /opt/pbs/bin/qmgr -c list hook 2017-05-11 10:17:34,105 INFO status on centosvm: hook 2017-05-11 10:17:34,105 INFO manager on centosvm: list hook 2017-05-11 10:17:34,105 INFOCLI centosvm: sudo -H /opt/pbs/bin/qmgr -c list hook 2017-05-11 10:17:34,127 INFO manager on centosvm: create hook start 2017-05-11 10:17:34,127 INFOCLI centosvm: sudo -H /opt/pbs/bin/qmgr -c create hook start 2017-05-11 10:17:34,156 INFO manager on centosvm: set hook start {'enabled': 'True', 'event': 'exechost_startup'} 2017-05-11 10:17:34,156 INFOCLI centosvm: sudo -H /opt/pbs/bin/qmgr -c set hook start enabled=True,event=exechost_startup 2017-05-11 10:17:34,180 INFOCLI centosvm: sudo -H /opt/pbs/bin/qmgr -c list hook start 2017-05-11 10:17:34,203 INFO expect on server centosvm: enabled set True || event set exechost_startup hook start ... OK 2017-05-11 10:17:34,204 INFO manager on centosvm: import hook start {'content-type': 'application/x-python', 'input-file': '/tmp/PtlPbs3tzofq', 'content-encoding': 'default'} 2017-05-11 10:17:34,204 INFOCLI centosvm: sudo -H /opt/pbs/bin/qmgr -c import hook start application/x-python default /tmp/PtlPbs3tzofq 2017-05-11 10:17:34,225 INFO server centosvm: imported hook body --- import pbs e=pbs.event() localnode=pbs.get_local_nodename() e.vnode_list[localnode].resources_available['foo_i'] = 7 e.vnode_list[localnode].resources_available['foo_f'] = 5.0 e.vnode_list[localnode].resources_available['foo_str'] = "seventyseven" e.vnode_list[localnode].resources_available['foo_str2'] = "seven" --- 2017-05-11 10:17:34,225 INFO mom centosvm: sent signal -HUP 2017-05-11 10:17:34,225 INFOCLI2 centosvm: sudo -H kill -HUP 37501 2017-05-11 10:17:34,240 INFO mom centosvm log match: searching for "resourcedef;copy hook-related file"... OK 2017-05-11 10:17:34,241 INFO test_epilogue_single_node 2017-05-11 10:17:34,241 INFO status on centosvm: hook 2017-05-11 10:17:34,241 INFO manager on centosvm: list hook 2017-05-11 10:17:34,241 INFOCLI centosvm: sudo -H /opt/pbs/bin/qmgr -c list hook 2017-05-11 10:17:34,262 INFO status on centosvm: hook 2017-05-11 10:17:34,263 INFO manager on centosvm: list hook 2017-05-11 10:17:34,263 INFOCLI centosvm: sudo -H /opt/pbs/bin/qmgr -c list hook 2017-05-11 10:17:34,285 INFO manager on centosvm: create hook epi 2017-05-11 10:17:34,286 INFOCLI centosvm: sudo -H /opt/pbs/bin/qmgr -c create hook epi 2017-05-11 10:17:34,325 INFO manager on centosvm: set hook epi {'enabled': 'True', 'event': 'execjob_epilogue'} 2017-05-11 10:17:34,325 INFOCLI centosvm: sudo -H /opt/pbs/bin/qmgr -c set hook epi enabled=True,event=execjob_epilogue 2017-05-11 10:17:34,349 INFOCLI centosvm: sudo -H /opt/pbs/bin/qmgr -c list hook epi 2017-05-11 10:17:34,371 INFO expect on server centosvm: enabled set True || event set execjob_epilogue hook epi ... OK 2017-05-11 10:17:34,372 INFO manager on centosvm: import hook epi {'content-type': 'application/x-python', 'input-file': '/tmp/PtlPbsCUdzlB', 'content-encoding': 'default'} 2017-05-11 10:17:34,372 INFOCLI centosvm: sudo -H /opt/pbs/bin/qmgr -c import hook epi application/x-python default /tmp/PtlPbsCUdzlB 2017-05-11 10:17:34,398 INFO server centosvm: imported hook body --- import pbs e=pbs.event() pbs.logmsg(pbs.LOG_DEBUG, "executed epilogue hook") e.job.resources_used["vmem"] = pbs.size("9gb") e.job.resources_used["foo_i"] = 9 e.job.resources_used["foo_f"] = 0.09 e.job.resources_used["foo_str"] = '{"seven":7}' e.job.resources_used["foo_str3"] = """{"a":6,"b":"some value #$%^&*@","c":54.4,"d":"32.5gb"}""" e.job.resources_used["foo_str2"] = "seven" e.job.resources_used["cput"] = 10 e.job.resources_used["stra"] = '"glad,elated","happy"' --- 2017-05-11 10:17:34,399 INFO job: executable set to /bin/sleep with arguments: 100 2017-05-11 10:17:34,400 INFO job: executable set to /bin/sleep with arguments: 10 2017-05-11 10:17:34,400 INFOCLI centosvm: sudo -H -u pbsuser /opt/pbs/bin/qsub -l place=scatter -l walltime=10 -l select=1:ncpus=1 -- /bin/sleep 10 2017-05-11 10:17:34,425 INFO submit to centosvm as pbsuser: job 8.centosvm OrderedDict([('Resource_List.place', 'scatter'), ('Resource_List.walltime', 10), ('Resource_List.select', '1:ncpus=1')]) 2017-05-11 10:17:34,425 INFO server centosvm: expect offset set to 10 2017-05-11 10:17:44,437 INFOCLI centosvm: /opt/pbs/bin/qstat -x -f 8.centosvm 2017-05-11 10:17:44,483 INFO expect on server centosvm: resources_used.stra = "glad,elated","happy" || resources_used.cput = 00:00:10 || resources_used.foo_i = 9 || resources_used.foo_str2 = seven || resources_used.ncpus = 1 || job_state = F || resources_used.foo_f = 0.09 || resources_used.foo_str = '{"seven": 7}' || resources_used.vmem = 9gb job 8.centosvm 2017-05-11 10:17:44,985 INFOCLI centosvm: /opt/pbs/bin/qmgr -c set server scheduling=True 2017-05-11 10:17:45,037 INFOCLI centosvm: /opt/pbs/bin/qstat -x -f 8.centosvm 2017-05-11 10:17:45,078 INFO expect on server centosvm: resources_used.stra = "glad,elated","happy" || resources_used.cput = 00:00:10 || resources_used.foo_i = 9 || resources_used.foo_str2 = seven || resources_used.ncpus = 1 || job_state = F || resources_used.foo_f = 0.09 || resources_used.foo_str = '{"seven": 7}' || resources_used.vmem = 9gb job 8.centosvm attempt: 2 ... OK 2017-05-11 10:17:45,115 INFO centosvm log match: searching for "E;8.centosvm;.*resources_used.foo_f=0.09.*" - using regular expression ... OK 2017-05-11 10:17:45,142 INFO centosvm log match: searching for "E;8.centosvm;.*resources_used.foo_i=9.*" - using regular expression ... OK 2017-05-11 10:17:45,165 INFO centosvm log match: searching for "E;8.centosvm;.*resources_used.foo_str='{"seven": 7}'.*" - using regular expression ... OK 2017-05-11 10:17:45,177 INFO centosvm log match: searching for "E;8.centosvm;.*resources_used.vmem=9gb.*" - using regular expression ... OK 2017-05-11 10:17:45,189 INFO centosvm log match: searching for "E;8.centosvm;.*resources_used.cput=00:00:10.*" - using regular expression ... OK 2017-05-11 10:17:45,203 INFO centosvm log match: searching for "E;8.centosvm;.*resources_used.foo_str2=seven.*" - using regular expression ... OK 2017-05-11 10:17:45,216 INFO centosvm log match: searching for "E;8.centosvm;.*resources_used.ncpus=1.*" - using regular expression ... OK 2017-05-11 10:17:45,232 INFO centosvm log match: searching for "E;8.centosvm;.*resources_used.foo_str3='{.*}'.*" - using regular expression ... OK 2017-05-11 10:17:45,244 INFO centosvm log match: searching for "E;8.centosvm;.*resources_used.stra="glad\,elated"\,"happy".*" - using regular expression ... OK 2017-05-11 10:17:45,244 INFO Set {'PBS_SERVER': 'centosvm'} in /etc/pbs.conf 2017-05-11 10:17:45,248 INFOCLI2 centosvm: sudo -H /usr/bin/chown root /tmp/PtlPbsgmRdsW 2017-05-11 10:17:45,259 INFOCLI2 centosvm: sudo -H /usr/bin/chgrp root /tmp/PtlPbsgmRdsW 2017-05-11 10:17:45,283 INFOCLI2 centosvm: sudo -H /usr/bin/rm /tmp/PtlPbsgmRdsW 2017-05-11 10:17:45,294 INFO ============================== 2017-05-11 10:17:45,294 INFO Entered TestPbsPP745 tearDown 2017-05-11 10:17:45,294 INFO ============================== 2017-05-11 10:17:45,295 INFO =============================== 2017-05-11 10:17:45,295 INFO Completed TestPbsPP745 tearDown 2017-05-11 10:17:45,295 INFO =============================== 2017-05-11 10:17:45,295 INFO manager on centosvm as root: delete resource foo_str 2017-05-11 10:17:45,295 INFOCLI centosvm: sudo -H -u root /opt/pbs/bin/qmgr -c delete resource foo_str 2017-05-11 10:17:45,335 INFO manager on centosvm as root: delete resource foo_f 2017-05-11 10:17:45,335 INFOCLI centosvm: sudo -H -u root /opt/pbs/bin/qmgr -c delete resource foo_f 2017-05-11 10:17:45,379 INFO manager on centosvm as root: delete resource foo_i 2017-05-11 10:17:45,379 INFOCLI centosvm: sudo -H -u root /opt/pbs/bin/qmgr -c delete resource foo_i 2017-05-11 10:17:45,419 INFO manager on centosvm as root: delete resource foo_str2 2017-05-11 10:17:45,419 INFOCLI centosvm: sudo -H -u root /opt/pbs/bin/qmgr -c delete resource foo_str2 2017-05-11 10:17:45,460 INFO manager on centosvm as root: delete resource foo_str3 2017-05-11 10:17:45,460 INFOCLI centosvm: sudo -H -u root /opt/pbs/bin/qmgr -c delete resource foo_str3 2017-05-11 10:17:45,500 INFOCLI centosvm: /opt/pbs/bin/qstat -Bf centosvm 2017-05-11 10:17:45,511 INFO server centosvm: stopping Server on host centosvm 2017-05-11 10:17:45,512 INFOCLI2 centosvm: sudo -H kill -TERM 37487 2017-05-11 10:17:45,528 INFOCLI2 centosvm: sudo -H /usr/bin/cat /var/spool/pbs/server_priv/server.lock 2017-05-11 10:17:50,800 INFO service: starting pbs_server 2017-05-11 10:17:50,801 INFOCLI centosvm: sudo -H /opt/pbs/sbin/pbs_server 2017-05-11 10:17:56,367 INFOCLI2 centosvm: sudo -H /usr/bin/cat /var/spool/pbs/server_priv/server.lock 2017-05-11 10:17:56,442 INFOCLI centosvm: /opt/pbs/bin/qstat -Bf centosvm 2017-05-11 10:17:56,482 INFO mom centosvm: stopping MoM on host centosvm 2017-05-11 10:17:56,483 INFOCLI2 centosvm: sudo -H kill -TERM 37501 2017-05-11 10:17:56,510 INFOCLI2 centosvm: sudo -H /usr/bin/cat /var/spool/pbs/mom_priv/mom.lock 2017-05-11 10:17:56,569 INFO service: starting pbs_mom -d /var/spool/pbs 2017-05-11 10:17:56,570 INFOCLI centosvm: sudo -H /opt/pbs/sbin/pbs_mom -d /var/spool/pbs 2017-05-11 10:17:56,664 INFOCLI2 centosvm: sudo -H /usr/bin/cat /var/spool/pbs/mom_priv/mom.lock 2017-05-11 10:17:56,713 INFO ok 2017-05-11 10:17:56,714 INFO ================================================================================ run: 1, succeeded: 1, failed: 0, errors: 0, skipped: 0, timedout: 0 Tests run in 0:00:40.833265 2017-05-11 10:17:56,714 INFO Cleaning up temporary files