GenAI Basics · Question 10 · Medium
What is an LLM's context window?
- The number of users who can query the model at once
- The time limit for a single request
- The maximum number of tokens the model can take into account at once, covering the prompt and the generated output
- The size of the model's training dataset
Answer and explanation
Answer: C. The maximum number of tokens the model can take into account at once, covering the prompt and the generated output
Explanation: The context window caps how many tokens (instructions, documents, conversation history and the response) the model can attend to in a single call.
Previous: Setting the sampling temperature of an LLM close to 0 typically makes its… · Next: A company's product price list changes every day, and its chatbot must answer…
Practise genai basics
Try a fresh set of genai basics questions with an explanation after every answer, free and without signing up: GenAI Basics practice. Or sit a full placement mock test.
More genai basics questions
- What is the cosine similarity between the vectors (3, 4) and (6, 8)?
- What does Retrieval-Augmented Generation (RAG) do?
- Setting the sampling temperature of an LLM close to 0 typically makes its…
- A company's product price list changes every day, and its chatbot must answer…
- In a transformer model, what does the self-attention mechanism do?
- Which order of steps is correct for answering a user question with a typical…
- A model has a context window of 8,000 tokens, shared by the input and the…
- What is the main pre-training objective of decoder-only (GPT-style) large…
- Asking an LLM to perform a task with only an instruction and no examples in…
- What mainly distinguishes generative AI from traditional predictive…
More technical & programming practice
Pseudo-code · C Programming · Java · Python · Data Structures · Algorithms · Object-Oriented Programming · DBMS
LogicWiz Exams home · All practice topics · Placement mock tests · Daily 10 challenge