Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

    • These lines should appear in PBS_HOME/mom_priv/config:
    •         $vnodedef_additive 0
    •         $alps_client <path to ALPS API>
    •         $usecp *:<Absolute path to /home directory>  <Absolute path to /home directory>

      Notes: $usecp setting above is used to enable local copy of job output of jobs that ran on compute nodes.
      $vnodedef_additive 0 will allow MoM to tell the server that there are vnodes missing, which the server will mark as stale.

...

    • PBS_HOME/sched_priv/sched_config will have 'vntype' in the resources line.

3) Server

    • The hook PBS_HOME/server_priv/hooks/PBS_translate_mpp.HK is enabled.
    • Based on what is returned by the ALPS inventory :
      • vnodes representing the compute nodes will get created
      • the Cray-specific custom resources (e.g. PBScraynid, PBScrayhost, etc) will get created in PBS_HOME/server_priv/resourcedef.
      • the appropriate Cray-specific custom resources will be added to the vnodes.
      • since the mom config $vnode_per_numa_node is unset by default, there will be no PBScrayseg attribute on the vnodes representing the compute nodes.
    • Server settings :
      • flatuid = true
      • scheduling = true

      • the default queue is workq

...

  • Visibility: Public
  • Change Control: Stable
  • Synopsis: Modifications to include initial MoM config settings for Cray.
  • Standing of the interface : modified interface
  • Details
    • if on real Cray or Cray ALPS simulator, then initialize the PBS_HOME/mom_priv/config to have these:
    • $vnodedef_additive 0

    • $alps_client <path to ALPS API>$usecp

    •                $usecp *:<Absolute path to /home directory>  <Absolute path to /home directory>


Interface:  Scheduler.revert_to_defaults() 

  • Visibility: Public
  • Change Control: Stable
  • Synopsis: Modifications to include 'vntype' in sched_config out-of-box settings for Cray.
  • Standing of the interface : modified interface
  • Details
    • After copying the out-of-box scheduler configuration in PBS_EXEC/etc/pbs_sched_config to PBS_HOME/sched_priv/sched_config :
      • If platform is a real Cray or Cray ALPS simulator, then add "vntype" to resources line of PBS_HOME/sched_priv/sched_config.


Interface:   Server PBSTestSuite.revert_to_defaultsmom() 

  • Visibility: Public
  • Change Control:  StableStable
  • Synopsis: Modifications to revert resources, vnodes, and hooks settings for Crayhave additional steps of deleting and creating nodes back, for retaining Cray specific resources.
  • Standing of the interface : modified interface
  • Details
      resources and vnodes
        As part of reverting resources, the PBS_HOME/server_priv/resourcedef file is removed.
      • If on a Cray or Cray ALPS simulator
      • , then recreate the out-of-box Cray-specific custom resources and vnodes,
        including the ones PBS creates from reading the ALPS inventory, by:
        • Checking that $alps_client and its value exists in PBS_HOME/mom_priv/config, and if so:
          • delete all the vnodes: qmgr -c "delete node @default"
          • add back the MoMs: qmgr -c "create n <MoM hostname>"
          • check until such time that the MoM node has actually been added and the node state is free
          • if successful, then
            • the resourcedef file and the vnodes would have reverted to the out-of-box Cray configuration.
          • If there is an error during one of the following:
            • checking if $alps_client is properly configured
            • deleting all vnodes
            • adding MoMs
            then raise an exception.
      hooks
        As part of reverting hooks, all hooks, except built-in hooks, are disabled.
      • if on a Cray ALPS simulator, then enable the PBS_translate_mpp hook.
      • If there is an error during enabling of the PBS_translate_mpp hook, then raise an exception
      • then perform below:
        • Delete all nodes and create them back.


    Interface: Server.revert_to_defaults()

    • Visibility: Public
    • Change Control: Stable
    • Synopsis: Modifications to hooks settings for Cray.
    • Standing of the interface : modified interface
    • Details
      • If on a Cray or Cray ALPS simulator then perform below:
        • Restore the default 'PBS_translate_mpp' hook by:
          • Copying PBS_EXEC/lib/python/altair/pbs_hooks/PBS_translate_mpp.HK to PBS_HOME/server_priv/hooks/PBS_translate_mpp.HK
            • In this way, the shipped version (i.e. default version) of the hook will be in PBS_HOME for any PTL test to enable if desired.