NumProcessors
The number of processors to use to run the LLM generation.
This parameter has an effect only when Type is set to Transformer.
IMPORTANT: The value for NumProcessors applies to all your Transformer and GenerativeLLM models (see Generative Configuration Parameters). If you set this parameter in multiple sections, QMS uses the last value.
| Type: | Integer |
| Default: | the LLM uses all available processors |
| Required: | No |
| Configuration Section: | MyEmbedding |
| Example: | NumProcessors=1
|
| See Also: | Type
|