Chapter Summary: Probability

Key Concepts

• Probability Range: 0 ≤ P(E) ≤ 1
• Conditional Probability:
  • P(E|F) = P(E ∩ F) / P(F) (P(F) ≠ 0)
  • P(E'|F) = 1 - P(E|F)
• Addition Rule: P(E ∪ F | G) = P(E | G) + P(F | G) - P(E ∩ F | G)
• Multiplication Rule:
  • P(E ∩ F) = P(E) P(F|E) (P(E) ≠ 0)
  • P(E ∩ F) = P(F) P(E|F) (P(F) ≠ 0)
• Independence: If E and F are independent, then:
  • P(E ∩ F) = P(E) P(F)
  • P(E|F) = P(E)
  • P(F|E) = P(F)

Theorem of Total Probability

• For a partition {E₁, E₂, ..., Eₙ} of a sample space S:
  • P(A) = Σ P(Eᵢ) P(A|Eᵢ) for i = 1 to n

Bayes' Theorem

• For events E₁, E₂, ..., Eₙ that partition S:
  • P(Eᵢ | A) = [P(Eᵢ) P(A|Eᵢ)] / Σ [P(Eⱼ) P(A|Eⱼ)] for j = 1 to n

Examples

• Example of Conditional Probability: If a student is known to have an A grade, what is the probability they are a hostler?
• Example of Bayes' Theorem: Given a red ball drawn from a bag, find the probability it came from a specific bag.

Important Formulas

• Conditional Probability: P(A|B) = P(A ∩ B) / P(B)
• Total Probability: P(A) = Σ P(Eᵢ) P(A|Eᵢ)
• Bayes' Theorem: P(Eᵢ | A) = [P(Eᵢ) P(A|Eᵢ)] / Σ [P(Eⱼ) P(A|Eⱼ)]

Chapter 13: Probability

13.1 Introduction

• Probability as a measure of uncertainty in random experiments.
• Axiomatic approach by A.N. Kolmogorov.
• Equivalence between axiomatic and classical theories for equally likely outcomes.
• Topics covered:
  • Conditional probability
  • Bayes' theorem
  • Multiplication rule of probability
  • Independence of events
  • Random variables and their distributions
  • Mean and variance of probability distributions
  • Binomial distribution

13.2 Conditional Probability

• Definition: The probability of an event given that another event has occurred.
• Example: Tossing three fair coins.
  • Sample space: S = {HHH, HHT, HTH, THH, HTT, THT, TTH, TTT}

Key Concepts

• Conditional Probability Formula:
  P(E|F) = P(E ∩ F) / P(F), P(F) ≠ 0
• Independence: If E and F are independent, then:
  • P(E ∩ F) = P(E) * P(F)
  • P(E|F) = P(E)
  • P(F|E) = P(F)

Theorem of Total Probability

• For a partition {E₁, E₂, ..., Eₙ} of a sample space:
  • P(A) = Σ P(Eᵢ) * P(A|Eᵢ)

Bayes' Theorem

• For events E₁, E₂, ..., Eₙ that partition S:
  • P(Eᵢ|A) = [P(Eᵢ) * P(A|Eᵢ)] / Σ [P(Eⱼ) * P(A|Eⱼ)]

Examples

1. Example of Conditional Probability:
   • If a machine is correctly set up, it produces 90% acceptable items.
   • If incorrectly set up, it produces 40% acceptable items.
   • Given that 80% of setups are correct, find the probability of correct setup given 2 acceptable items produced.
2. Example of Bayes' Theorem:
   • Bag I: 3 red, 4 black balls; Bag II: 5 red, 6 black balls.
   • Find the probability that a red ball drawn came from Bag II.

Exercises

1. Calculate conditional probabilities based on various scenarios involving events A and B.
2. Apply Bayes' theorem to real-world problems involving medical tests and card draws.
3. Explore the implications of independence in probability events.

Common Mistakes and Exam Tips in Probability

Common Pitfalls

• Misunderstanding Conditional Probability: Students often confuse conditional probability with joint probability. Remember that P(A|B) is not the same as P(A and B).
• Ignoring Independence: When events are independent, P(A|B) = P(A). Failing to recognize this can lead to incorrect calculations.
• Incorrect Application of Bayes' Theorem: Ensure you correctly identify the prior probabilities and the likelihoods when applying Bayes' theorem.
• Assuming Events are Mutually Exclusive: Not all events are mutually exclusive. Be cautious when applying formulas that assume exclusivity.

Tips for Success

• Practice with Examples: Work through examples that involve conditional probability and Bayes' theorem to solidify your understanding.
• Draw Sample Spaces: For complex problems, drawing a sample space can help visualize the events and their relationships.
• Review Key Formulas: Familiarize yourself with key formulas such as the multiplication rule and the theorem of total probability.
• Check Your Work: Always double-check calculations, especially when dealing with fractions or percentages, to avoid simple arithmetic errors.