It is referenced by the special name queue.
In its default form it contains a selection of parameters in the queue configuration as defined in queue_conf. The main purpose of the queue complex is to define how
these parameters are to be interpreted and to provide a container for further attributes which are intended to be available for all queues. The queue complex thus can be extended by user defined attributes.
If the queue complex is referenced in context with a particular queue, the
corresponding configuration values of the queue replace the attribute values (they
overwrite the value column) in the queue complex.
If, for example, the queue complex is setup for a queue called big, the value column for the queue complex attribute qname, which carries the default value unknown
(see figure 2-23 on page 89), is set to big.
This implicit value setting can be overwritten by using the complex_values
parameter in the queue configuration (see section Configuring Queues on page 75). This is usually done for so called Consumable Resources (see section Consumable Resources on page 96). For the virtual memory size limit, for example, the queue configuration value h_vmem would be used to limit the amount of total occupied
Chapter 2 Installation and Administration Guide 91919191
memory per job, while a corresponding entry in the complex_values list would
define the total available amount of virtual memory on a host or assigned to a queue.
If the administrator adds attributes to the queue complex, their value in association with a particular queue is either defined via the complex_values parameter of
that queue or the value column in the queue complex configuration is used by
default.
The Host Complex
It is referenced by the special name host and contains the characteristics definition
of all attributes which are intended to be managed on a host basis (figure 2-25 on page 92). The standard set of host related attributes consists of two categories, but it may be enhanced likewise the queue complex described above. The first category is built by several queue configuration attributes which are particularly suitable to be managed on a host basis. These attributes are:
■ slots ■ seven
■ h_vmem
■ s_fsize ■ h_fsize
(please refer to queue_conf for details).
Note Note Note
Note Defining these attributes in the host complex is no contradiction to having them also in the queue configuration. It allows maintaining the corresponding resources on a host level and at the same time on a queue level. Total virtual free memory (h_vmem) can be managed for a host, for example, and a subset of the total amount can be associated with a queue on that host.
The second attribute category in the standard host complex are the default load values. Every cod_execd periodically reports load to cod_qmaster. The reported
load values are either the standard Sun Grid Engine load values such as the CPU load average or load values defined by the Sun Grid Engine administration (see section Load Parameters on page 113). The characteristics definition for the standard load values is part of the default host complex, while administrator defined load values require extension of the host complex.
The host complex commonly is not only extended to include non-standard load parameters, but also to manage host related resources such as the number of software licenses being assigned to a host or the available disk space on a host local filesystem.
92 92 92
92 Sun Grid Engine July 2001
If the host complex is associated with a host or a queue on that host, a concrete value for a particular host complex attribute is determined by either
■ the queue configuration in the case of the queue configuration derived attributes, ■ a reported load value or
■ the explicit definition of a value in the complex_values entry of the
corresponding host configuration (see section Configuring Hosts on page 57). If none of the above is available (e.g. the value is supposed to be a load parameter, but cod_execddoes not report a load value for it), the value field in the host
complex configuration is used.
The total free virtual memory attribute h_vmem, for example, is defined in the queue
configuration as limit and is also reported as a standard load parameter. The total available amount of virtual memory on a host and attached to a queue on that host may be defined in the complex_values lists of that host and that queue
configuration. Together with defining h_vmem as consumable resource (see section
Consumable Resources on page 96) this allows to efficiently exploit memory of a machine without risking memory oversubscription often resulting in reduced system performance caused by swapping.
Note Note Note
Note Only the Shortcut,Value,Relation,Requestable,Consumable
and Default columns may be changed for the system default load attributes. No
default attributes should be deleted.
FIGURE 2-25 FIGURE 2-25 FIGURE 2-25
Chapter 2 Installation and Administration Guide 93939393
The Global Complex:
It is referenced by the special complex name global.
The entries configured in the global complex refer to cluster wide resource
attributes, such as available network bandwidth of a file server or the free disk space on a network wide available filesystem (figure 2-26 on page 93). Global resource attributes can also be associated with load reports, if the corresponding load report contains the GLOBAL identifier (see section Load Parameters on page 113). Global
load values can be reported from any host in the cluster. There are no global load values reported by Sun Grid Engine by default and hence there is no default global complex configuration.
Concrete values for global complex attributes are either determined by global load reports, by explicit definition in the complex_values parameter of the global
host configuration (see section Configuring Hosts on page 57) or in association with a particular host or queue and an explicit definition the corresponding
complex_values lists. If none of the above is the case (e.g. a load value has not yet
been reported), the value field in the global complex configuration is used.