GenAI Basics · Question 28 · Hard
GenAI Basics question 28
A model's two candidate next tokens have logits 2 and 0. With softmax at temperature 1, the top token's probability is about 0.88. What is its probability at temperature 2?
- About 0.88
- About 0.98
- About 0.73
- Exactly 0.50
Answer and explanation
Answer: C. About 0.73
Explanation: Temperature divides the logits: 2/2 = 1 and 0/2 = 0. The probability is e^1 / (e^1 + e^0) = 2.718 / 3.718 ≈ 0.73. A higher temperature flattens the distribution; T = 0.5 would raise it to about 0.98.
Previous: A query embedding is q = (1, 2, 2). Four document embeddings are: D1 = (2, 1… · Next: In Reinforcement Learning from Human Feedback (RLHF), what is the reward model…
Practise genai basics
Try a fresh set of genai basics questions with an explanation after every answer, free and without signing up: GenAI Basics practice. Or sit a full placement mock test.
More genai basics questions
- An AI email assistant summarises incoming emails. One email contains hidden…
- In a RAG system, what is the main purpose of a vector database?
- A query embedding is q = (1, 2, 2). Four document embeddings are: D1 = (2, 1…
- In Reinforcement Learning from Human Feedback (RLHF), what is the reward model…
- Why do transformer models add positional encodings (or positional embeddings)…
More technical & programming practice
Pseudo-code · C Programming · Java · Python · Data Structures · Algorithms · Object-Oriented Programming · DBMS
LogicWiz Exams home · All practice topics · Placement mock tests · Daily 10 challenge