GenAI Basics · Question 23 · Medium
Assume that, on average, one token corresponds to about 0.75 English words. Roughly how many tokens does a 3,000-word document use?
- 2,250
- 4,000
- 3,000
- 12,000
Answer and explanation
Answer: B. 4,000
Explanation: Tokens ≈ words / 0.75 = 3,000 / 0.75 = 4,000. Multiplying instead (3,000 × 0.75 = 2,250) is the common mistake.
Previous: What does top-p (nucleus) sampling do when choosing the next token? · Next: What is chain-of-thought prompting?
Practise genai basics
Try a fresh set of genai basics questions with an explanation after every answer, free and without signing up: GenAI Basics practice. Or sit a full placement mock test.
More genai basics questions
- A model that can accept both an image and a text question about that image…
- How do diffusion models, widely used for text-to-image generation, generate an…
- What does top-p (nucleus) sampling do when choosing the next token?
- What is chain-of-thought prompting?
- An AI email assistant summarises incoming emails. One email contains hidden…
- In a RAG system, what is the main purpose of a vector database?
- A query embedding is q = (1, 2, 2). Four document embeddings are: D1 = (2, 1…
- A model's two candidate next tokens have logits 2 and 0. With softmax at…
- In Reinforcement Learning from Human Feedback (RLHF), what is the reward model…
- Why do transformer models add positional encodings (or positional embeddings)…
More technical & programming practice
Pseudo-code · C Programming · Java · Python · Data Structures · Algorithms · Object-Oriented Programming · DBMS
LogicWiz Exams home · All practice topics · Placement mock tests · Daily 10 challenge