PadhaikoAll subjects

Probability Distributions and Sampling Distribution (part 2: 2.5–2.7)

Probability and Statistics (ENSH 304)

Open in the Padhaiko app

2.5 Population and sample

Statistical inference bridges the gap between a small observed dataset and the wider system from which it was drawn. Understanding the distinction between a population and a sample—and how the sample is selected—is essential before applying any probability distribution to real data.

AspectPopulationSample
DefinitionThe complete set of all items, measurements, or individuals of interestA finite subset of elements selected from the population
Size Notation (finite population) or (infinite/conceptual process) ()
Summary QuantitiesParameters (fixed, usually unknown constants: )Statistics (random variables computed from sample data: )
Data CollectionCensus (expensive, destructive, or impossible for ongoing processes)Sampling (fast, economical, feasible even for destructive testing)

2.5.1 Sampling Techniques and Errors

A sample must be representative of the population to avoid systematic distortion (bias). Sampling methods fall into two broad categories:

Probability vs. Non-Probability Sampling Techniques
CategoryMethodMechanism and Engineering Use Case
Probability Sampling (known nonzero selection probability)Simple Random Sampling (SRS)Every subset of size has equal chance of selection; implemented with replacement (SRSWR) or without replacement (SRSWOR)
Probability SamplingStratified SamplingPopulation is partitioned into homogeneous strata (e.g., shifts or suppliers), and SRS is drawn proportionally from each stratum
Probability SamplingSystematic SamplingSelect a random start and then every -th item on a production line ()
Probability SamplingCluster SamplingDivide population into natural groups (e.g., boxes/batches), randomly pick clusters, and inspect all items inside selected clusters
Non-Probability SamplingConvenience / Purposive / QuotaItems selected by ease of access or expert judgment; cheap for exploratory checks, but cannot support valid probability error bounds
Example 2.4

2.4

A finite population consists of resistor tolerance deviations .

  1. Compute the population mean and population variance .
  2. List all possible samples of size drawn without replacement (SRSWOR) and construct the sampling distribution of .
  3. Verify that and .

Population parameters ():

Enumerate all SRSWOR samples of size :

Sample
Sample Mean

Each sample has probability , so the sampling distribution of is:

Verify mean and variance of :

Using the finite-population formula:

Answer:

, ; and , matching .


2.6 Sampling distribution of mean and proportion

A sampling distribution is the probability distribution of a sample statistic (such as or ) across all possible random samples of fixed size drawn from the same population. The standard deviation of a sampling distribution is called its standard error ().

2.6.1 Sampling Distribution of the Sample Mean ()

Theorem

Mean, Variance, and Distribution of the Sample Mean

Let be a random sample from a population with mean and variance :

  1. Infinite population or sampling with replacement (SRSWR):
  1. Finite population of size sampled without replacement (SRSWOR):

where is the Finite Population Correction (FPC) factor. (In practice, FPC is applied whenever the sampling fraction ; otherwise .)

  1. Exact distribution for a Normal population :
    • Known : , so for any sample size .
    • Unknown (estimated by sample SD ): (Student's -distribution with degrees of freedom).

2.6.2 Sampling Distribution of the Sample Proportion ()

When each sampled unit has a binary attribute (e.g., defective/non-defective) with population proportion , let be the count of successes in a random sample of size . The sample proportion is .

Theorem

Mean, Standard Error, and Normal Approximation of Sample Proportion

For a random sample of size from a population with true proportion ():

When and , is approximately normally distributed:

Example 2.5

2.5

A large production run of SMD resistors has a true defect proportion of . A quality inspector draws a random sample of resistors.

  1. Find the mean and standard error of the sample proportion .
  2. Find the approximate probability that more than of the sampled resistors are defective ().

Check normal-approximation conditions and compute and : Since and , the normal approximation applies:

Standardize and evaluate :

(Without rounding , .)

Answer:
  1. , ; 2. ().

2.7 Central limit theorem

The Central Limit Theorem (CLT) explains why the Normal distribution dominates engineering statistics: even when individual measurements follow a skewed, uniform, or discrete distribution, the average (or sum) of enough independent observations becomes approximately Normal.

Theorem

Central Limit Theorem (Lindberg–Lévy)

Let be independent and identically distributed (i.i.d.) random variables from any population distribution with finite mean and finite variance . As the sample size becomes large (), the standardized sample mean converges in distribution to the standard normal:

Equivalently, for sufficiently large :

2.7.1 Practical Guidelines and Engineering Significance

Example 2.6

2.6

The mass of individual machined aluminum brackets has a non-normal distribution with mean and standard deviation . A shipping crate holds a random sample of brackets. Using the Central Limit Theorem:

  1. Find the probability that the sample mean mass lies between and (, ).
  2. Find the probability that the total mass of the brackets exceeds ().

Apply the CLT (): For the sample mean :

So .

Part 1 — Compute :

Part 2 — Compute : The total mass has mean and standard deviation :

(Using exact gives .)

Answer:
  1. ; 2. ( with -decimal ).

Practice Exercises — Sampling Distributions & Central Limit Theorem

Question 1

Distinguish between a parameter and a statistic, and between sampling error and non-sampling error. Explain when the Finite Population Correction (FPC) factor is required and why it disappears as .

Parameter vs. Statistic & Errors:

  • A parameter is a fixed numerical summary of an entire population (), whereas a statistic is a random variable computed from a sample () whose value varies across samples.
  • Sampling error is the inherent chance difference arising from observing only a subset; non-sampling error arises from bias, instrument error, or flawed data recording.

Finite Population Correction (FPC): When sampling without replacement from a finite population of size , . The FPC matters when (sampling more than of the population). As for fixed , , recovering the infinite-population standard error .

Answer:

Parameters describe populations while statistics describe samples; sampling error is chance variation from partial observation while non-sampling error comes from bias or measurement flaws. FPC is used for SRSWOR when and approaches as .

Question 2

A finite population consists of the values . Samples of size are drawn at random.

  1. Compute the population mean and variance .
  2. Find the mean and standard error if sampling is done without replacement.
  3. Find if sampling is done with replacement.

Population parameters ():

Without replacement (SRSWOR, ):

With replacement (SRSWR, ):

Answer:
  1. , ; 2. Without replacement: , ; 3. With replacement: .
Question 3

A warehouse holds battery packs whose capacities have mean and standard deviation . A sample of packs is drawn without replacement.

  1. Determine using the finite population correction factor.
  2. Find the approximate probability that the sample mean exceeds ().

Check sampling fraction and compute : Since , apply the FPC:

Apply CLT to evaluate :

(Exact gives .)

Answer:
  1. ; 2. ( with ).
Question 4

In a large campus network, of traffic packets use IPv6 (). If a packet sniffer captures a random sample of packets, find the standard error of and the probability that the sample proportion lies between and ().

Verify normal condition and compute : and :

Standardize and find :

Answer:

and .

Question 5

The lifetime of an industrial sensor battery has mean and standard deviation (distribution shape unknown).

  1. For a random sample of batteries, use the Central Limit Theorem to find (given ).
  2. What minimum sample size is required so that (given )?

Part 1 — Sample mean probability for :

Part 2 — Minimum sample size for margin of error : We require , so :

Rounding up to the next integer gives .

Answer:
  1. ; 2. Minimum sample size .
← Probability Distributions and Sampling Distribution (part 1: 2.1–2.4)Statistical Inference (part 1: 3.1–3.3) →