MaxQuestionSize
The maximum number of tokens that the question to Answer Server can contain. If a user question contains more than this number of tokens, Answer Server rejects the question and returns an error.
The token count for a question depends on the model that you use. To obtain an accurate token count for your model, you must provide a get_token_count function in the script that you use to call the LLM. See Create a RAG Script.
| Type: | Integer |
| Default: | 50 |
| Required: | No |
| Configuration Section: | MySystem |
| Example: | MaxQuestionSize=70
|
| See Also: |