Grade by Grade
E. Culminating Data Management Investigation · Culminating Data Management Investigation

Answering Questions and Defending Your Reasoning

E2.3About 60 minutes
Learning goals
  • I can predict the questions my audience is likely to ask about my method, analysis and conclusions.
  • I can answer questions by elaborating on my procedures and justifying my mathematical reasoning.
  • I can respond to a critique calmly, deciding whether it is right, partly right or mistaken, and explaining why.
  • I can admit a limitation honestly and explain how it affects my conclusions.
  • I can use claim, evidence and reasoning to structure an answer.

Words to know

critique
A careful evaluation of work that points out strengths and weaknesses, with reasons.
justify
To give mathematical reasons or evidence showing why a choice, calculation or conclusion is correct.
elaborate
To give more detail, for example about exactly how data were collected or a calculation was done.
claim, evidence, reasoning
A way to structure an answer: state your position (claim), give the facts or numbers that support it (evidence), and explain how the evidence supports the claim (reasoning).
concede
To agree openly that a criticism is valid, and explain what it means for your results.

The questions are part of the investigation

When you finish presenting, the audience asks questions. In university, every thesis defence, research talk and job interview works this way. Questions are not attacks: they test whether your conclusions hold up, and they often improve the work.

The curriculum asks you to answer questions about the culminating investigation and respond to critiques, for example by elaborating on the procedures and by justifying mathematical reasoning. This lesson shows how to prepare, and how to answer well when the question is hard or the critic is right.

Prepare: predict the questions

Most questions fall into a few families. Write two or three likely questions in each, and practise answers.

  • Data and sampling: How did you choose your sample? Why that size? Who did not respond?
  • Measurement: How exactly did you define and measure each variable? Could people answer dishonestly?
  • Analysis choices: Why the mean and not the median? Why s and not σ? Why did you exclude some responses? Why a linear model?
  • Strength of evidence: Could this be chance? How precise are your estimates?
  • Conclusions: Does this prove cause? Does it apply to other schools? What would you do differently?

Use the questions your family listeners wrote down during your rehearsal.

1. Listento the whole question2. Restate"So you are asking..."3. Answer with evidencenumbers, method, reasoning4. Check"Does that answer it?"If you do not know:say so, and say how you would find out.
A cycle for answering any question: listen, restate, answer with evidence, check. Saying "I don't know, but here is how I would find out" is a strong answer.

Answering well

  • Restate the question briefly. It confirms you understood, gives you a moment to think, and lets everyone hear it.
  • Answer with evidence: point to a specific number, graph, slide or step of your method.
  • Elaborate on procedures when the question is about how: describe exactly what you did and why.
  • Justify reasoning when the question is about why: explain the mathematical idea (for example, why a shuffle simulation tests chance, or why s divides by n − 1).
  • Concede when a critic is right, then explain how much it matters: "That's a fair point. It means... but it doesn't change..."
  • Keep answers short (30 to 60 seconds). Offer to show more detail afterwards.

A useful structure for difficult questions is claim, evidence, reasoning.

Question: "Isn't 40 students too few to conclude anything?"ClaimThe sample is large enough todetect this difference, but not toestimate it precisely.Evidence1.14 h difference ≈ 1.7 SD;0 of 10 000 shuffles that large;job-group % has ME ±19%.ReasoningBig effects need fewer data todetect; precision needs more.A larger sample is my follow-up.
Claim, evidence, reasoning applied to a common critique. The answer concedes what is true (precision is limited) and defends what the evidence supports (a difference this large is very unlikely to be chance).
Worked example

The model investigation, Stage 24: Amira's question period

Here are five questions Amira received after her presentation. Model a strong answer to each.

  1. Q1 (procedure): "How did you make sure the sample was random?" "I used systematic sampling from the office's alphabetical list of all 240 Grade 12 students: every 5th student, starting at position 3, chosen by rolling a die. Every student had the same 1-in-5 chance, and an alphabetical list has no pattern related to sleep or work."
  2. Q2 (reasoning): "Why did you throw out three surveys? Isn't that cherry-picking?" "I wrote my exclusion rules before entering any data: a blank sleep answer, a contradiction between Q2 and Q3, or school-night sleep over 13 hours. Three surveys met those rules. I list them in my report, and I didn't look at whether they helped my hypothesis. Even if all three had been included in the most unhelpful way, the difference of about 1.1 hours is far too big for three responses to erase."
  3. Q3 (critique, partly right): "People lie about sleep. Your data are meaningless." "You're right that self-reported sleep isn't exact, since recalled sleep can differ from measured sleep, and I list that as a limitation. But my question compares two groups who answered the same question the same way. Unless workers exaggerate differently from non-workers, the error affects both groups similarly, so the comparison is still meaningful. A sleep-diary study is my follow-up."
  4. Q4 (reasoning): "Your r is −0.62. Doesn't that mean 62% of sleep is explained by work?" "No: the percentage explained is r², which is about 0.39, so 39%. The value of r tells the direction and strength of the linear relationship; r² gives the share of variation in sleep explained by the line."
  5. Q5 (beyond the data): "Would this be true at other schools?" "I don't know: my sample only represents Grade 12 at Pinecrest. Schools with different job markets, transit or start times might differ. To find out, I'd need random samples from several schools, ideally stratified by job status."

Each answer restates or addresses the question directly, gives specific evidence or reasoning, concedes where the critic is right, and stays within what the data show.

When a critic is completely right

Sometimes a question reveals a real mistake (a calculation error, a mislabelled graph). Say so: "Thank you, you're right. I'll recalculate that." Then check whether the mistake changes your conclusion, and correct the report. Admitting and fixing an error shows strong understanding and is exactly what professional researchers do.

Just for fun

Q: How many statisticians does it take to answer a question? A: It depends on the sample size, the confidence level, and whether you meant the mean or the median.

Hands-on activity

Your investigation, step 12: question rehearsal

You need: your presentation, your report, index cards, and one or two family members or friends.

  1. Write 10 likely questions on index cards: two from each family in this lesson (data and sampling, measurement, analysis choices, strength of evidence, conclusions).
  2. Add the questions your family listeners asked during your rehearsal.
  3. Shuffle the cards. Have someone read them to you one at a time. Answer each in under 60 seconds using listen, restate, answer with evidence, check.
  4. Ask your listener to play a "tough critic" for three questions (for example, "Your sample is too small," "Correlation isn't causation," "Your graph is misleading"). Practise conceding what is fair and defending what is supported.
  5. For any question you could not answer, find the answer and add a sentence to your report or an extra "backup" slide.

What to look for: answers that point to specific numbers or steps, no defensiveness, and honest "I don't know, but..." answers when needed.

Your turn

1

A listener asks Amira, "Why did you use the sample standard deviation?" Write a short justification.

2

A critic says, "Correlation doesn't mean causation." How should Amira respond?

3

What does "elaborate on the procedures" mean? Give an example from Amira's study.

4

Why is it helpful to restate a question before answering?

5

A classmate asks a question about an area outside Amira's data (other provinces). What is an honest answer structure?

More practice: warm-up

1

Name the four steps of the answer cycle.

2

What does "concede" mean?

3

About how long should a typical answer be?

4

What are the three parts of claim, evidence, reasoning?

5

Is "I don't know" ever an acceptable answer?

More practice: on your own

1

A critic says, "Your scatter plot only has 22 points, so r means nothing." Write a balanced answer.

2

A listener asks how Amira chose the 8-hour benchmark. Elaborate on her procedure.

3

Someone says, "Your dice game result of 230 tickets doesn't match the expected 225, so your theory is wrong." Respond with reasoning.

4

Amira realizes during questions that a slide shows the job group's median as 7.75 instead of 7.5. What should she do?

5

Write a question that would test whether a presenter understands their margin of error.

Challenge

1

A critic argues: "Students without jobs might be younger, and younger students sleep more. That explains everything." Evaluate the critique using Amira's design.

2

Explain how to justify the shuffle simulation to someone who thinks it is "just making up data".

3

A listener says the 1.14-hour difference might be because "workers just round down." Propose a quick check Amira could do with her existing data.

Check your understanding

Quiz

1.

A critic correctly points out that sleep was self-reported. The best response is to:

2.

"Elaborating on the procedures" means:

3.

Someone asks, "Does r = −0.62 mean 62% of sleep is explained by work?" The correct reply is:

4.

Which is the best first step when you receive a question?

5.

If a question reveals a real calculation error, you should:

6.

Which answer stays within what the data can show?

For parents and teachers

Big idea (E2.3): a good researcher answers questions with specific evidence, explains procedures and reasoning clearly, and concedes valid criticisms without becoming defensive.

How to help: Play the friendly critic using the question cards. Ask at least one tough question ("Isn't your sample too small?") and one you suspect they can't answer. Praise honest "I don't know, but here's how I'd find out" answers. Keep the tone warm: the aim is confidence, not stress.

Common difficulties:

  • Getting defensive or treating questions as attacks.
  • Long, wandering answers; aim for under a minute.
  • Overclaiming to sound confident ("this proves...").
  • Not knowing why a method was used (for example, why s instead of σ): review the reasoning behind each choice.