5. Sampling

Question 1

Suppose that we have the following distribution for a random variable \(X\) :

X -2 0 2
P[X] 0.25 0.50 0.25
  • (a) What is the mean of \(X\)?
  • (b) What is the variance of \(X\)?
  • (c) Suppose we observed 100 observations, each one independent of the other, from this distribution. What is the chance that the sample mean from this data is greater than 0.3?

Answer

  • (a) We have a symmetric distribution around zero so the mean is zero.
  • (b) For the variance, we have that:
    $$Var(X) = \sum x^2 P[X = x] = (-2)^2 \times 0.25 + 0^2 \times 0.50 + 2^2 \times 0.25 = 4 \times 0.25 + 0 + 4 \times 0.25 = 1 + 1 = 2$$
  • (c) By the central limit theorem, we have \(\bar{X} \sim^a N\left(0, \frac{2}{100}\right)\). Hence we would want to compute:
    $$P[\bar{X} > 0.3] = P[\bar{X} - 0 > 0.3 - 0]$$ $$= P\left[\frac{\bar{X} - 0}{\sqrt{2/100}} > \frac{0.3 - 0}{\sqrt{2/100}}\right]$$ $$= P\left[Z > \frac{0.3}{0.14142}\right]$$ $$\approx P[Z > 2.12]$$ $$= 0.0170$$ or about 1.7%.

Question 2

Suppose that we have the following distribution for a random variable \(X\) :

X -1 0 1
P[X] 0.2 0.6 0.2
  • (a) What is the mean of \(X\)?
  • (b) What is the variance of \(X\)?
  • (c) Suppose we observed 64 observations, each one independent of the other, from this distribution. What is the chance that the sample mean from this data is greater than 0.15?

Answer

  • (a) We have a symmetric distribution around zero so the mean is zero.
  • (b) For the variance, we have that:
    $$Var(X) = \sum x^2 P[X = x] = (-1)^2 \times 0.2 + 0^2 \times 0.6 + 1^2 \times 0.2 = 1 \times 0.2 + 0 + 1 \times 0.2 = 0.4$$
  • (c) By the central limit theorem, we have \(\bar{X} \sim^a N\left(0, \frac{0.4}{64}\right)\). Hence we would want to compute:
    $$P[\bar{X} > 0.15] = P[\bar{X} - 0 > 0.15 - 0]$$ $$= P\left[\frac{\bar{X} - 0}{\sqrt{0.4/64}} > \frac{0.15 - 0}{\sqrt{0.4/64}}\right]$$ $$= P\left[Z > \frac{0.15}{0.07906}\right]$$ $$\approx P[Z > 1.90]$$ $$= 0.0287$$ or just under 3%.

Question 3

Suppose that we have the following distribution for a random variable \(X\) :

X -3 0 3
P[X] 0.1 0.8 0.1
  • (a) What is the mean of \(X\)?
  • (b) What is the variance of \(X\)?
  • (c) Suppose we observed 100 observations, each one independent of the other, from this distribution. What is the chance that the sample mean from this data is greater than 0.4?

Answer

  • (a) We have a symmetric distribution around zero so the mean is zero.
  • (b) For the variance, we have that:
    $$Var(X) = \sum x^2 P[X = x] = (-3)^2 \times 0.1 + 0^2 \times 0.8 + 3^2 \times 0.1 = 9 \times 0.1 + 0 + 9 \times 0.1 = 1.8$$
  • (c) By the central limit theorem, we have \(\bar{X} \sim^a N\left(0, \frac{1.8}{100}\right)\). Hence we would want to compute:
    $$P[\bar{X} > 0.4] = P[\bar{X} - 0 > 0.4 - 0]$$ $$= P\left[\frac{\bar{X} - 0}{\sqrt{1.8/100}} > \frac{0.4 - 0}{\sqrt{1.8/100}}\right]$$ $$= P\left[Z > \frac{0.4}{0.13416}\right]$$ $$\approx P[Z > 2.98]$$ $$= 0.0014$$ or about 0.14%.

Question 4

A study of n = 64 graduates from an IT training program reports that students on average increase their annual salary by \$6,000. The standard deviation for individual students is \$16,000. A local news report questions the program's effectiveness by interviewing a former student who experienced $0 increase in earnings.

(a) What is the probability that any single, randomly chosen student had \$0 or less in earnings increase if the true mean gain is \$6,000?

(b) Assuming the true program effect is actually zero (mean gain = \$0), find the probability that a random sample of 64 students would yield a sample mean increase of \$6,000 or more.

(c) Are these results more supportive of the news report's narrative or the school's claim? Explain clearly.


Answer

(a) Single Student Probability:

For an individual student, standard deviation $\sigma = 16,000$ and mean $\mu = 6,000$.

$$Z = \frac{X - \mu}{\sigma} = \frac{0 - 6000}{16000} = -0.375$$

Using a standard normal distribution table, $P(Z \le -0.375) \approx 0.3538$ (or approximately 35.4%).

(b) Sample Mean Probability:

For a sample size of $n = 64$, the standard error is:

$$ \frac{\sigma}{\sqrt{n}} = \frac{16000}{\sqrt{64}} = \frac{16000}{8} = 2000$$

Assuming true mean $\mu = 0$:

$$Z = \frac{\bar{X} - \mu}{{\sigma}/\sqrt{n}} = \frac{6000 - 0}{2000} = 3.00$$

$$P(Z \ge 3.00) = 1 - 0.9987 = 0.0013 \text{ (or } 0.13\%\text{)}$$

(c) Explanation:

The results support the school's claim. Part (a) shows that finding a single student with no gain is quite common (about a 35% chance), so a single anecdotal testimonial does not disprove the program's success. On the other hand, part (b) shows that if the true effect were zero, observing a sample average gain of $6,000$ across 64 students would be extremely improbable (0.13%).


Question 5

A high school claims its test prep course increases student SAT scores by an average of 80 points. The standard deviation for individual students is 120 points. A group of n = 36 students took the course. A critical review blog post features one student who had no score improvement (0 point gain).

(a) What is the probability that a single student selected at random would see an improvement of 0 points or less if the true population mean improvement is 80 points?

(b) If the course actually has no effect (true mean gain = 0 points), what is the probability that a sample of 36 students would achieve a sample mean improvement of 80 points or more?

(c) Based on your calculations, does the single student's outcome undermine the school's claim? Explain.


Answer

(a)

For an individual student, standard deviation $\sigma = 120$ and mean $\mu = 80$.

$$Z = \frac{X - \mu}{\sigma} = \frac{0 - 80}{120} = -\frac{2}{3} \approx -0.67$$

$$P(Z \le -0.67) \approx 0.2514 \text{ (or approximately } \mathbf{25.1\%}\text{)}$$

(b)

For a sample size of $n = 36$, the standard error is:

$$SE = \frac{\sigma}{\sqrt{n}} = \frac{120}{\sqrt{36}} = \frac{120}{6} = 20$$

Assuming true mean $\mu = 0$:

$$Z = \frac{\bar{X} - \mu}{SE} = \frac{80 - 0}{20} = 4.00$$

$$P(Z \ge 4.00) \approx 0.00003 \text{ (or } \mathbf{0.003\%}\text{)}$$

(c)

The single student's outcome does not undermine the school's claim. Given the large variation in individual test scores ($\sigma = 120$), roughly 1 in 4 students will see no improvement even when the course works as advertised. However, obtaining a sample mean gain of 80 points across 36 students purely by chance (if the course were useless) is practically impossible ($Z = 4.00$).

Question 6

A Research Center poll found that 71% of adults in the U.S. use YouTube. The sample had 1,500 respondents and was a random sample among all adults. Suppose that the true population proportion is 69%.

(a) What is the chance of seeing a poll with between 67% and 71%?

(b) Is it likely that the truth is 69% when we see an outcome of the poll as in the Pew poll?

(c) If we obtained the same 71% with 3,000 observations, how would you answer (b)?


Answer

We have that the sampling distribution of the mean is $\bar{X} \sim N\left(0.69, \frac{0.69 \times 0.31}{1500}\right)$.

(a) We want to compute $P[0.67 < \bar{X} < 0.71]$, we have

$$P[0.67 < \bar{X} < 0.71] = P[0.67 - 0.69 < \bar{X} - 0.69 < 0.71 - 0.69]$$ $$= P\left[ \frac{0.67 - 0.69}{\sqrt{0.69 \times 0.31 / 1500}} < \frac{\bar{X} - 0.69}{\sqrt{0.69 \times 0.31 / 1500}} < \frac{0.71 - 0.69}{\sqrt{0.69 \times 0.31 / 1500}} \right]$$ $$\approx P[-1.676 < Z < 1.676]$$ $$= 90.62\%$$

(b) The chance of seeing 71% or more is about 4.69%, so this is borderline but somewhat unlikely.

(c) We can compute

$$P[\bar{X} > 0.71] = P[\bar{X} - 0.69 > 0.71 - 0.69]$$ $$= P\left[ \frac{\bar{X} - 0.69}{\sqrt{0.69 \times 0.31 / 3000}} > \frac{0.71 - 0.69}{\sqrt{0.69 \times 0.31 / 3000}} \right]$$ $$\approx P[Z > 2.3708]$$ $$= 0.89\%$$

Now the probability is quite small, at less than 1 in one hundred it is unlikely that the true mean is 0.69.


Question 7

A Gallup poll found that 45% of dog owners buy Christmas gifts for their pets. The sample had 1,000 respondents and was random among all pet owners. Suppose that the true proportion is 42%.

(a) What is the chance of seeing a poll with between 39% and 45%?

(b) Is it likely that the truth is 42% when we see an outcome of the poll as in the Gallup poll?

(c) If we obtained the same 45% with 2,000 observations, how would you answer (b)?


Answer

We have that the sampling distribution of the mean is $\bar{X} \sim N\left(0.42, \frac{0.42 \times 0.58}{1000}\right)$.

(a) We want to compute $P[0.39 < \bar{X} < 0.45]$, we have

$$P[0.39 < \bar{X} < 0.45] = P[0.39 - 0.42 < \bar{X} - 0.42 < 0.45 - 0.42]$$ $$= P\left[ \frac{0.39 - 0.42}{\sqrt{0.42 \times 0.58 / 1000}} < \frac{\bar{X} - 0.42}{\sqrt{0.42 \times 0.58 / 1000}} < \frac{0.45 - 0.42}{\sqrt{0.42 \times 0.58 / 1000}} \right]$$ $$\approx P[-1.921 < Z < 1.921]$$ $$= 94.52\%$$

(b) The chance of seeing 45% or more is about 2.74%, so this is fairly small. By chance we would see such numbers less than three times in a hundred, so it is hard to tell if this is too small or large enough to expect. Same as the previous question. Basically these calculations are either clear (really large or small) or borderline. We discuss how to think about this in Chapter 8.

(c) We can compute

$$P[\bar{X} > 0.45] = P[\bar{X} - 0.42 > 0.45 - 0.42]$$ $$= P\left[ \frac{\bar{X} - 0.42}{\sqrt{0.42 \times 0.58 / 2000}} > \frac{0.45 - 0.42}{\sqrt{0.42 \times 0.58 / 2000}} \right]$$ $$\approx P[Z > 2.7165]$$ $$= 0.33\%$$

Now the probability is quite small, at about 3 in one thousand it is unlikely that the true mean is 0.42.


Question 8

A Gallup poll found that 37% of respondents in a survey of 1,000 adults think that real estate is the best long-term investment a family can make.

(a) Suppose that the true proportion of adults holding this view is 33%. What is the chance of seeing a sample proportion of 37% or more in a survey of this size?

(b) Is it reasonable to claim that the true proportion is 33%?

(c) Suppose you want to conduct this poll with enough precision so that if the true proportion is 33%, a sample result of 37% or more should only happen 1% of the time or less. How large should the sample size be to ensure this?


Answer

We have $n = 1000$ and $\pi = 0.33$ from our theory. The central limit theorem is clearly appropriate since the sample size is very large.

(a) We want to compute $P[\bar{X} \ge 0.37]$, we have

$$P[\bar{X} \ge 0.37] = P[\bar{X} - 0.33 \ge 0.37 - 0.33]$$ $$= P\left[\frac{\bar{X} - 0.33}{\sqrt{0.33 \times 0.67 / 1000}} \ge \frac{0.37 - 0.33}{\sqrt{0.33 \times 0.67 / 1000}}\right]$$ $$\approx P[Z \ge \frac{0.04}{0.01487}]$$ $$\approx P[Z \ge 2.69]$$ $$= 0.0036$$

or about 0.36%.

(b) Not really, we would not see a sample average of 0.37 very often if the truth was 0.33, it is more likely that the true value is larger.

(c) For this we want to know the sample size such that $P[\bar{X} \ge 0.37] = 0.01$. So we want

$$P[\bar{X} \ge 0.37] = P[\bar{X} - 0.33 \ge 0.37 - 0.33]$$ $$= P\left[\frac{\bar{X} - 0.33}{\sqrt{0.33 \times 0.67 / n}} \ge \frac{0.37 - 0.33}{\sqrt{0.33 \times 0.67 / n}}\right]$$ $$= P\left[Z \ge \frac{0.37 - 0.33}{\sqrt{0.33 \times 0.67 / n}}\right]$$ $$= 0.01$$

so from the normal tables we have that $z_0$ for this is 2.33. So $\frac{0.37 - 0.33}{\sqrt{0.33 \times 0.67 / n}} = 2.33$

$$\sqrt{\frac{0.2211}{n}} = \frac{0.04}{2.33}$$ $$\frac{0.2211}{n} = 0.0002947$$

solves to 750.3, so we need about 751 observations for this.


Question 9

6. A Pew Research Center poll found that 56% of respondents in a survey of 1,200 U.S. adults favor the construction of additional nuclear power plants in the United States.

(a) Suppose that the true public support level is 52%. What is the chance of seeing a survey finding of 56% or more in favor?

(b) Is it reasonable to claim that the true proportion of public support is 52%?

(c) Suppose you want to design a new poll such that if the true support is 52%, a result of 56% or more should only happen 5% of the time or less. How big should the sample size be to ensure this?


Answer

We have $n = 1200$ and $\pi = 0.52$ from our theory. The central limit theorem is clearly appropriate since the sample is very large.

(a) We want to compute $P[\bar{X} \ge 0.56]$, we have

$$P[\bar{X} \ge 0.56] = P[\bar{X} - 0.52 \ge 0.56 - 0.52]$$ $$= P\left[\frac{\bar{X} - 0.52}{\sqrt{0.52 \times 0.48 / 1200}} \ge \frac{0.56 - 0.52}{\sqrt{0.52 \times 0.48 / 1200}}\right]$$ $$\approx P[Z \ge \frac{0.04}{0.01442}]$$ $$\approx P[Z \ge 2.77]$$ $$= 0.0028$$

or about 0.28%.

(b) Not really, we would not see a sample average of 0.56 very often if the truth was 0.52, it is much more likely that the true value is higher.

(c) For this we want to know the sample size such that $P[\bar{X} \ge 0.56] = 0.05$. So we want

$$P[\bar{X} \ge 0.56] = P[\bar{X} - 0.52 \ge 0.56 - 0.52]$$ $$= P\left[\frac{\bar{X} - 0.52}{\sqrt{0.52 \times 0.48 / n}} \ge \frac{0.56 - 0.52}{\sqrt{0.52 \times 0.48 / n}}\right]$$ $$= P\left[Z \ge \frac{0.56 - 0.52}{\sqrt{0.52 \times 0.48 / n}}\right]$$ $$= 0.05$$

so from the normal tables we have that $z_0$ for this is 1.645. So $\frac{0.56 - 0.52}{\sqrt{0.52 \times 0.48 / n}} = 1.645$

solves to 422.3, so we need about 423 observations for this.