Grade by Grade
C. Organization of Data for Analysis · Organization of Data for Analysis

Sampling Techniques

C2.2About 70 minutes
Learning goals
  • I can describe and carry out simple random, systematic, stratified, cluster and multistage sampling.
  • I can use random digits, a calculator or a spreadsheet to select a random sample.
  • I can calculate the sampling interval for a systematic sample and the stratum sizes for a proportional stratified sample.
  • I can identify convenience and voluntary-response samples and explain why they are unreliable.
  • I can choose an appropriate sampling technique for a situation and justify my choice.

Words to know

simple random sample (SRS)
A sample chosen so that every possible group of n individuals has the same chance of being the sample.
systematic sample
Choose a random starting point, then select every kth individual from a list, where k = N ÷ n is the sampling interval.
stratified sample
Divide the population into groups (strata) that share a characteristic, then take a random sample from each stratum, usually in proportion to its size.
cluster sample
Divide the population into groups (clusters), randomly choose some clusters, and include every individual in the chosen clusters.
multistage sample
A sample chosen in stages, with random selection at each stage (for example: random schools, then random classes, then random students).
convenience sample
A sample of individuals who are easy to reach. It is non-random and often biased.
voluntary-response sample
A sample made of people who choose to respond, such as an online poll or call-in show. It is non-random and usually biased.
sampling with / without replacement
With replacement, a chosen individual can be chosen again; without replacement, each individual can be chosen at most once. Surveys sample without replacement.

Stirring the soup properly

Last lesson you learned that a good sample must be random. But "random" can be done in several ways, each suited to a different situation. A polling company, a factory, a wildlife biologist and Statistics Canada all use random sampling, yet they choose their samples in quite different ways.

In this lesson you will learn five random (probability) sampling methods and two non-random methods that you should recognize and usually avoid.

1. Simple random sample (SRS)

Every individual, and every possible group of n individuals, has the same chance of being selected. To take an SRS:

  1. Number every member of the sampling frame from 1 to N.
  2. Generate random numbers in that range with a random-number table, the RanInt or Ran# key on many scientific calculators, or a spreadsheet formula such as =RANDBETWEEN(1, 840).
  3. Skip numbers outside the range and repeats, until you have n different individuals.

Strength: simple and unbiased. Weakness: you need a complete list, and by chance an SRS can under-represent a small group.

2. Systematic sample

Compute the sampling interval k = N ÷ n (round down to a whole number if needed). Choose a random start between 1 and k, then take every kth individual.

Strength: quick and easy, even without a full list (every 10th customer through a door). Weakness: biased if the list has a repeating pattern that lines up with k (for example, every 7th day of a list of dates is always the same weekday).

3. Stratified sample

Split the population into strata: groups whose members share a characteristic that might affect the results (grade, province, age group). Take a separate random sample from each stratum. In a proportional stratified sample, each stratum's sample size matches its share of the population:

stratum sample size = (stratum size ÷ population size) × total sample size.

Strength: guarantees every group is represented and often gives more precise results. Weakness: you must know each individual's stratum in advance.

4. Cluster sample

Split the population into clusters, usually natural groups such as homerooms, city blocks or boxes of product. Randomly choose some clusters and include everyone in them.

Strength: cheap and practical when individuals are spread out; no complete list of individuals is needed. Weakness: if clusters differ from one another, the result depends heavily on which clusters were chosen, so precision is lower.

5. Multistage sample

Select randomly in stages: randomly choose school boards, then schools within them, then classes, then students. Large national surveys use multistage designs because they are practical across a huge country.

Strata and clusters are easy to confuse. Stratify to make sure every group is in the sample (sample from every stratum). Cluster to save effort (take all of some clusters). Ideally, strata are different from each other and similar inside; clusters are similar to each other and mixed inside, like mini-populations.

Simple random12345678910111213141516171819202122232425262728293031323334353637383940Systematic (k = 5, start 3)12345678910111213141516171819202122232425262728293031323334353637383940Stratified (2 per row)12345678910111213141516171819202122232425262728293031323334353637383940Cluster (2 whole columns)12345678910111213141516171819202122232425262728293031323334353637383940
Four random methods choosing 8 of 40 units. Stratified: 2 random units from each row (stratum). Cluster: every unit in 2 randomly chosen columns (clusters).
0510152025303540+5+5+5+5+5+5+5
A systematic sample from 40 units with sampling interval k = 40 ÷ 8 = 5 and a random start of 3: units 3, 8, 13, 18, 23, 28, 33 and 38.

Non-random samples: recognize and avoid

  • Convenience sample: whoever is easiest to reach: your friends, people in the mall, the first 50 people in the cafeteria line. Quick, but the people you can reach easily are often different from the rest.
  • Voluntary-response sample: people choose themselves: online polls, call-in radio shows, comment cards. People with strong opinions (especially negative ones) are much more likely to respond.

Non-random samples can be useful for brainstorming questions or testing a questionnaire, but no reliable conclusion about the population can be drawn from them, no matter how big they are. You will look at the damage they do in the lesson Bias in Sampling and Surveys.

MethodHow it worksBest used whenWatch out for
Simple randomEvery group of n equally likelyYou have a full listSmall groups may be missed by chance
SystematicRandom start, then every kthIndividuals are in a list or a linePatterns in the list that match k
StratifiedRandom sample from each stratumGroups may differ and all must be representedNeed stratum information in advance
ClusterAll individuals in random clustersPopulation comes in natural groups; travel is costlyClusters that differ from each other
MultistageRandom selection in stagesLarge, spread-out populationsMore complex to analyse
Convenience / voluntaryEasy to reach / self-selectedPilot testing onlyBias: not representative
Sampling methods at a glance.
Worked example

Example 1: A simple random sample with random digits

Choose an SRS of 5 students from a class of 40 numbered 01 to 40, using this line of random digits: 19223 95034 05756 28713 96409 12531.

  1. Read the digits in pairs, because the labels have two digits: 19, 22, 39, 50, 34, 05, 75, 62, 87, 13, ...
  2. Keep pairs from 01 to 40; skip pairs above 40 (50, 75, 62, 87) and any repeats.
  3. Keepers in order: 19, 22, 39, 34, 05.

The sample is students 05, 19, 22, 34 and 39.

Worked example

Example 2: A systematic sample

A grocery store has a list of 840 loyalty-card members and wants a systematic sample of 60.

  1. Sampling interval: k = 840 ÷ 60 = 14.
  2. Choose a random start from 1 to 14 (for example with RanInt(1, 14)). Suppose it is 9.
  3. Select members 9, 23, 37, 51, ..., adding 14 each time.
  4. The 60th member chosen is 9 + 59 × 14 = 9 + 826 = 835, which is within the list. ✓

Members 9, 23, 37, ..., 835: 60 members, every 14th starting at 9.

School of 1200 students, sample of 120 (10% of each grade)Gr 9: 330studentssample 33Gr 10: 310studentssample 31Gr 11: 290studentssample 29Gr 12: 270studentssample 27
In a proportional stratified sample, each grade's share of the sample matches its share of the school.
Worked example

Example 3: A proportional stratified sample

A school has 330 Grade 9, 310 Grade 10, 290 Grade 11 and 270 Grade 12 students. The council wants a stratified sample of 120 students. How many should come from each grade?

  1. Total: 330 + 310 + 290 + 270 = 1200 students.
  2. Sampling fraction: 120 ÷ 1200 = 0.10, so take 10% of each grade.
  3. Grade 9: 0.10 × 330 = 33; Grade 10: 0.10 × 310 = 31; Grade 11: 0.10 × 290 = 29; Grade 12: 0.10 × 270 = 27.
  4. Check: 33 + 31 + 29 + 27 = 120. ✓ Then choose an SRS of the right size within each grade.

33, 31, 29 and 27 students from Grades 9, 10, 11 and 12.

Worked example

Example 4: Naming the method

Name the sampling method. (a) A board randomly picks 4 of its 20 high schools, then surveys every Grade 12 student in those 4 schools. (b) An inspector tests every 50th bottle from a production line, starting at bottle 17. (c) A radio host asks listeners to call in with their opinion. (d) A researcher randomly selects 50 people from each of Canada's provinces and territories. (e) A board randomly picks 4 schools, then 2 classes in each, then 5 students from each class.

  1. (a) Whole groups (schools) are chosen at random and everyone in them is surveyed: cluster.
  2. (b) Every 50th item from a start: systematic (the start should be random, from 1 to 50).
  3. (c) Listeners choose to respond: voluntary response (non-random).
  4. (d) A random sample from each group: stratified (but not proportional, since every province and territory gets 50 regardless of size).
  5. (e) Random selection at three stages: multistage.

(a) cluster, (b) systematic, (c) voluntary response, (d) stratified, (e) multistage.

Stratified samples that are not proportional

Sometimes a survey deliberately over-samples a small stratum (like Example 4(d), or extra interviews in a territory with a small population) so there is enough data to say something about it. When combining results for the whole country, each stratum's results are then weighted by its true share of the population. Large national surveys do this routinely.

Just for fun

A statistician's favourite card game? Go Fish, played with a stratified sample: you ask for exactly one card from every suit.

Hands-on activity

Sampling a deck of cards

You need: a standard 52-card deck (jokers removed), paper and a pencil.

The question: what proportion of the deck are face cards (jacks, queens, kings)? You know the answer is 12/52 ≈ 0.231, so you can judge each method.

  1. SRS: shuffle well and deal 8 cards. Record the proportion of face cards.
  2. Systematic: shuffle, then lay the deck face down. Roll a die (or pick a random number from 1 to 6) for a start s, and take cards s, s + 6, s + 12, ..., for 8 cards.
  3. Stratified: sort the deck into the four suits (strata). Shuffle each suit and deal 2 cards from each: 8 cards.
  4. Cluster: sort the deck into 13 clusters by rank (all four aces, all four 2s, ...). Randomly choose 2 ranks and take all 4 cards of each: 8 cards.
  5. Repeat each method three times. Make a table of the 12 proportions.

What to look for: SRS, systematic and stratified results scatter around 0.23. The cluster results jump between 0, 0.5 and 1, because each rank cluster is all face cards or none. Clusters that are alike inside make cluster sampling very imprecise; clusters should be mixed, like mini-decks.

Your turn

1

A list has 2400 names and you want a systematic sample of 80. What is k? What range should the random start come from?

2

A company has 450 office staff, 900 factory workers and 150 managers. Find the sizes of a proportional stratified sample of 60.

3

Name the method: a city randomly chooses 15 city blocks and surveys every household on those blocks.

4

Name the method: a reporter interviews the first 20 people leaving a hockey arena.

5

Using the digits 73 04 58 21 04 66 39 17, choose 4 labels from 01 to 60 without repeats.

6

What is the key difference between stratified and cluster sampling?

7

Why is an online poll on a news website not a reliable sample?

More practice: warm-up

1

In which method is every kth individual chosen?

2

What spreadsheet formula gives a random whole number from 1 to 500?

3

Name two non-random sampling methods.

4

What is k for N = 1000 and n = 50?

5

Do surveys usually sample with or without replacement?

More practice: on your own

1

A board has 12 000 students: 7200 in urban schools, 3600 in suburban schools and 1200 in rural schools. Find a proportional stratified sample of 400.

2

A list of 500 apartments is ordered by floor, with 10 apartments per floor, and apartment 1 on each floor is always the corner unit. Why could a systematic sample with k = 10 be biased?

3

Describe how to choose a multistage sample of Grade 12 students in Ontario.

4

A survey randomly selects 100 people from each of Ontario (about 16 million people) and Prince Edward Island (about 180 000). Explain why the combined results must be weighted.

5

A factory packs 24 cans per box. A quality inspector randomly chooses 5 boxes from the day's 400 and tests every can in them. Name the method and give one advantage and one risk.

Challenge

1

A population has N = 1234 and you want n = 50 by systematic sampling. k = 1234 ÷ 50 = 24.68. Explain two different ways to handle the non-whole interval, and the effect of each.

2

A school wants student opinions about the cafeteria. Students in different grades may feel differently, and Grade 12 students often eat off-campus. Design a sampling plan of 100 students and justify it.

3

Explain why a voluntary-response poll of 50 000 people can be less trustworthy than a simple random sample of 1000.

Check your understanding

Quiz

1.

A researcher randomly chooses 6 of a city's 60 neighbourhoods and surveys every household in those 6. This is:

2.

For a systematic sample of 40 from a list of 1600, the sampling interval is:

3.

A school has 500 junior and 300 senior students. In a proportional stratified sample of 80, how many seniors are chosen?

4.

Which method is guaranteed to include members of every group in the population?

5.

Why are voluntary-response samples usually biased?

6.

Which is the best way to choose a simple random sample of 30 from a list of 900 members?

7.

When is cluster sampling most precise?

For parents and teachers

Big idea (C2.2): there are several ways to choose a random sample: simple random, systematic, stratified, cluster and multistage. Convenience and voluntary-response samples are non-random and usually biased.

How to help: The card-deck activity takes about 20 minutes and shows clearly why method matters. Quiz your teen with everyday examples: "A TV show's text-in poll?" (voluntary response) "Checking every 10th car at a border crossing?" (systematic).

Common difficulties:

  • Mixing up stratified (sample from every group) and cluster (take all of some groups).
  • Forgetting that the start of a systematic sample must be random, between 1 and k.
  • Arithmetic in proportional stratified samples: find each stratum's fraction of the population, then multiply by the sample size, and check that the parts add to n.
  • Thinking a large voluntary sample is trustworthy because it is large.