NumProcessors
The number of processors to use to run the LLM generation.
This parameter has an effect only when Type is set to Transformer.
IMPORTANT: The value for NumProcessors applies to all your Transformer, GenerativeLLM, and ExtractiveQuestionAnsweringLLMmodels (see LLM Module Configuration Parameters). If you set this parameter in multiple sections, Answer Server uses the last value.
| Type: | Integer |
| Default: | the LLM uses all available processors |
| Required: | No |
| Configuration Section: | MyEmbedding |
| Example: | NumProcessors=1
|
| See Also: | Type
|