Page Comparison

...

• • These lines should appear in PBS_HOME/mom_priv/config:
  •         $vnodedef_additive 0
  •         $alps_client <path to ALPS API>
  •         $usecp *:<Absolute path to /home directory>  <Absolute path to /home directory>
    
    Notes: $usecp setting above is used to enable local copy of job output of jobs that ran on compute nodes.
    $vnodedef_additive 0 will allow MoM to tell the server that there are vnodes missing, which the server will mark as stale.
    
    

...

• • PBS_HOME/sched_priv/sched_config will have 'vntype' in the resources line.

3) Server

...

• • Based on what is returned by the ALPS inventory :
    • vnodes representing the compute nodes will get created
    • the Cray-specific custom resources (e.g. PBScraynid, PBScrayhost, etc) will get created in PBS_HOME/server_priv/resourcedef.
    • the appropriate Cray-specific custom resources will be added to the vnodes.
    • since the mom config $vnode_per_numa_node is unset by default, there will be no PBScrayseg attribute on the vnodes representing the compute nodes.
  • Server settings :
    • flatuid = true

    • scheduling = true

    • the default queue is workq

...

• Visibility: Public
• Change Control: Stable
• Synopsis: Modifications to include initial MoM config settings for Cray.
  
• Standing of the interface : modified interface
  
• Details
  • if on real Cray or Cray ALPS simulator, then initialize the PBS_HOME/mom_priv/config to have these:

  • $vnodedef_additive 0

  • $alps_client <path to ALPS API>$usecp

  •                $usecp *:<Absolute path to /home directory>  <Absolute path to /home directory>

Interface:  Scheduler.revert_to_defaults() 

• Visibility: Public
• Change Control: Stable
• Synopsis: Modifications to include 'vntype' in sched_config out-of-box settings for Cray.
  
• Standing of the interface : modified interface
  
• Details
  • After copying the out-of-box scheduler configuration in PBS_EXEC/etc/pbs_sched_config to PBS_HOME/sched_priv/sched_config :
    • If platform is a real Cray or Cray ALPS simulator, then add "vntype" to resources line of PBS_HOME/sched_priv/sched_config.

Interface:   Server PBSTestSuite.revert_to_defaultsmom() 

• Visibility: Public
• Change Control:  StableStable
• Synopsis: Modifications to revert resources, vnodes, and hooks settings for Crayhave additional steps of deleting and creating nodes back, for retaining Cray specific resources.
• Standing of the interface : modified interface
• Detailsresources and vnodes
  
  As part of reverting resources, the PBS_HOME/server_priv/resourcedef file is removed.
  If on
  • If on a Cray or Cray ALPS simulator then perform below:
    • Delete all nodes and create them back.

Interface: Server.revert_to_defaults()

• Visibility: Public
• Change Control: Stable
• Synopsis: Modifications to hooks settings for Cray.
• Standing of the interface : modified interface
• Details
  
  • If on a Cray or Cray ALPS simulator
  , then recreate the out-of-box Cray-specific custom resources and vnodes,
  including the ones PBS creates from reading the ALPS inventory, by:Checking that $alps_client and its value exists in PBS_HOME/mom_priv/config, and if so:
  • delete all the vnodes: qmgr -c "delete node @default"
  • add back the MoMs: qmgr -c "create n <MoM hostname>"
  • check until such time that the MoM node has actually been added and the node state is free
  • if successful, then
    
    • the resourcedef file and the vnodes would have reverted to the out-of-box Cray configuration.
  If there is an error during one of the following:
  • checking if $alps_client is properly configured
  • deleting all vnodes
  • adding MoMs
  then raise an exception
  • then perform below:
    • Restore the default 'PBS_translate_mpp' hook by:
      • Copying PBS_EXEC/lib/python/altair/pbs_hooks/PBS_translate_mpp.HK to PBS_HOME/server_priv/hooks/PBS_translate_mpp.HK
        • In this way, the shipped version (i.e. default version) of the hook will be in PBS_HOME for any PTL test to enable if desired.