race condition in log match for TestPbsHookAlarmLargeMultinodeJob.test_epi_hook

Description

It has been observed that on some machine job took longer to get killed and message appeared later.

2017-12-05 18:38:00,266 INFO mom x36-64-rhel6 log match: searching for "pbs_python;executing epilogue hook testhook" - using regular expression - No match
2017-12-05 18:38:05,281 INFO mom x36-64-rhel6 log match: searching for "pbs_python;executing epilogue hook testhook" - using regular expression - attempt 2
2017-12-05 18:38:10,296 INFO mom x36-64-rhel6 log match: searching for "pbs_python;executing epilogue hook testhook" - using regular expression - attempt 3
2017-12-05 18:38:15,311 INFO mom x36-64-rhel6 log match: searching for "pbs_python;executing epilogue hook testhook" - using regular expression - attempt 4
2017-12-05 18:38:20,324 INFO mom x36-64-rhel6 log match: searching for "pbs_python;executing epilogue hook testhook" - using regular expression - attempt 5

however the message appears at following:
12/05/2017 18:38:25;0008;pbs_mom;Job;1.x36-64-rhel6;walltime 26 exceeded limit 10
12/05/2017 18:38:25;0008;pbs_mom;Job;1.x36-64-rhel6;kill_job
..
12/05/2017 18:38:29;0006;pbs_python;Hook;pbs_python;executing epilogue hook testhook

Acceptance Criteria

None

Status

Assignee

Shilpa Kodli

Reporter

anamika upadhyay

Severity

2-Medium

OS

None

Start Date

None

Pull Request URL

None

Story Points

1

Components

Priority

High