NumProcessors
The number of processors to use to run the LLM generation.
This parameter has an effect only when Type is set to GenerativeLLM.
IMPORTANT: The value for NumProcessors applies to all your GenerativeLLM and Transformer models (see Embeddings Configuration Parameters). If you set this parameter in multiple sections, QMS uses the last value.
| Type: | Integer |
| Default: | the LLM uses all available processors |
| Required: | No |
| Configuration Section: | MyGenerativeModel |
| Example: | NumProcessors=1
|
| See Also: | Type
|