Gathering Data Ethically and Efficiently
Two things quietly determine whether an investigation works: whether people were willing and able to answer honestly, and whether the data was recorded in a shape you can actually analyse.
You are asked to record, for thirty classmates, their year group, height and favourite sport. Sketch how you would lay the data out on paper or in a spreadsheet before reading on. Then ask yourself: if you later wanted the mean height of Year 9 students only, how much work would your layout require?
Ethical collection means the people supplying the data understood what they were agreeing to, could decline, and cannot be identified from what you publish. Efficient collection means recording it once, in a shape that answers questions you have not thought of yet. Neither can be added afterwards.
Consent · Privacy · Neutral wording · One row per subject, one column per variable
The organisational half has a standard shape worth knowing: one row per subject, one column per variable, one value per cell. Data in that form can be sorted, filtered and grouped without being retyped. Data in any other form usually has to be rebuilt before the first question can be answered.
Know
- What informed consent requires, and what anonymity and confidentiality mean
- The features of a neutral survey question
- The standard data layout: one row per subject, one column per variable
Understand
- Why the wording of a question is part of the measurement rather than presentation
- Why a small identifying detail can breach privacy even without a name
Can Do
- Identify and repair leading, loaded and double-barrelled questions
- Design a collection method that respects consent and privacy
- Organise raw data into a structure that can be sorted, filtered and grouped
Three things must be true before someone's data may be used.
They know what is being collected and why. "A survey for maths" is not enough. "How long you sleep each night for one week, to investigate whether sleep is related to test marks" is.
They can decline without consequence. If declining is awkward, embarrassing, or affects them in any way, the consent is not freely given.
They know what happens to the data. Who sees it, whether it is published, and whether it can be traced back to them.
Note the distinction between anonymous and confidential. Anonymous means even you cannot tell who gave which response. Confidential means you can, but undertake not to say. Both are legitimate; promising one while doing the other is not.
Deleting the name column does not make data anonymous. What identifies someone is any combination of details that only one person matches.
Consider a table with columns for year group, sport played and hours of part-time work. "Year 12, water polo, 22 hours" may describe exactly one student in the school, and everyone who knows the water polo team will be able to say who. The name was never needed.
Two practical defences:
Group the rare values. Report sport as "team sport" or "individual sport" rather than naming it, so no cell isolates one person.
Report totals, not rows. Publishing "the mean was 12.4 hours across 40 students" reveals nothing about any individual. Publishing the raw table often does.
Three faults account for most bad survey questions.
| Fault | Example | Repair |
|---|---|---|
| Leading | Do you agree the canteen should stock healthier food? | Should the canteen change what it stocks? If so, how? |
| Loaded | How much do you enjoy mathematics? | How do you feel about mathematics? (options from strongly dislike to strongly enjoy) |
| Double-barrelled | Is the canteen cheap and fast? | Two questions, one about price and one about speed |
The loaded example is the subtlest. "How much do you enjoy" assumes enjoyment and offers no way to express dislike, so a student who dislikes the subject must either misreport or skip the question. Either way the data is wrong, and it is wrong in a predictable direction, which is worse than being wrong at random.
The standard layout is one row per subject, one column per variable, one value per cell.
| Student | Year | Height (cm) | Sport |
|---|---|---|---|
| 1 | 9 | 162 | netball |
| 2 | 10 | 171 | soccer |
| 3 | 9 | 158 | none |
Three habits keep it usable. One value per cell: a cell reading "netball, soccer" cannot be counted, so use a second column or a second row. Consistent units and spelling: "162", "162 cm" and "1.62" in one column make the column unusable, and so do "Soccer", "soccer" and "footy". Record missing values as missing: an empty cell means "not collected"; typing $0$ means the value was zero, which is a different claim.
Laid out this way, the mean height of Year 9 students is a filter and a calculation. Laid out any other way, it is a retyping job.
Watch Me Solve It · 3 examples
-
1Question (i): leading"Don't you think" invites agreement and supplies the conclusion. Rewrite neutrally: "How would you describe the amount of homework you are set? (far too little / too little / about right / too much / far too much)".
-
2Question (ii): loadedIt assumes enjoyment and gives a student who dislikes sport nowhere honest to go. Rewrite: "How do you feel about sport?" with options from strongly dislike to strongly enjoy.
-
3Question (iii): double-barrelledSomeone who finds the library quiet but poorly stocked cannot answer. Split it into one question about noise and one about stock.
-
4Check each repair against the same testRead each rewritten question as a respondent who holds the opposite view to the one the original assumed. If they can answer honestly, the repair worked.
-
1Look for combinations that isolate one personSuburb is the risk. In a school drawing from many suburbs, one student may be the only respondent from theirs, and that row is then identified regardless of the missing name.
-
2Check the numerical column tooAn unusually high value, such as 25 hours a week, may itself be recognisable to anyone who knows the person, since extreme values are memorable.
-
3Apply the two defencesGroup suburb into a broader region, or drop the column if the inquiry does not need it. Group the hours into intervals such as 0, 1 to 5, 6 to 10, over 10.
-
4Prefer summaries to rowsIf the aim can be answered with means and counts, publish those. "The 12 students with jobs worked a mean of 8.4 hours" reveals nothing about any individual.
-
1One row per subject, one column per variableFour columns: student, year, height in cm, sport. Every row then has the same shape and the columns can be sorted or filtered.
-
2One value per cellAmy plays two sports, which cannot share a cell. Either add a second sport column, or use one row per student-sport pair. Which is better depends on whether the inquiry counts students or counts sports.
-
3Make units and spelling consistentRecord height as a bare number with the unit in the column heading, so "162cm" and "171" become $162$ and $171$. Fix any variation in the sport names before analysis, not during.
-
4Distinguish missing from zeroCara's height is unknown. Leave the cell empty and note it; entering $0$ would claim she has zero height and would drag any mean downwards.
Brain Trainer · 4 problems
Four quick problems. Work each one, then reveal the answer.
-
1 "Do you agree our uniform is uncomfortable?" What is wrong?
The wording supplies the conclusion and invites agreement.Leading -
2 "Is the bus cheap and reliable?" What is wrong?
Someone who finds it cheap but unreliable cannot answer.Double-barrelled -
3 A cell in the height column is empty because the student was absent. Enter $0$?
Zero is a measurement; absence is not.No, leave it missing -
4 Names have been deleted, but one row reads "Year 12, water polo, 22 hours". Anonymous?
The combination may match exactly one person.No
Multiple Choice · 5 questions
Consent to take part in a survey is informed only if the respondent:
Deleting the name column from a data set:
"Is the canteen cheap and fast?" is an example of a question that is:
The standard layout for a data set is:
A student was absent, so their height was not measured. The cell should contain:
Short Answer · 3 questions
1. "Don't you think the library should open longer?"
2. "How much do you like studying in the library? (1 to 5)"
3. "Is the library quiet and comfortable?"
(a) Name the fault in each question.
(b) Rewrite each one.
(c) Explain why a loaded question produces data that is wrong in a predictable direction, and why that is worse than random error.
(a) State two consent requirements they must satisfy before collecting.
(b) Explain why removing the name column would not be enough to make the published table anonymous.
(c) Describe two changes that would let them report their findings without breaching privacy.
(a) Redraw this in the standard layout.
(b) State three problems with the original record and how your layout fixes each.
(c) The student wants the mean height of Year 9 students. Explain what your layout makes possible that the original did not.
(a) Explain how this can happen if the two questions mean the same thing.
(b) A student concludes that survey data is worthless. Explain why this does not follow.
(c) Describe how you would design a survey to measure opinion on a contested issue at your school, given this effect.
Consent
Understood, freely given, and revocable
Privacy
A combination can identify, even with no name
Wording
Leading, loaded and double-barrelled all distort
Layout
One row per subject, one value per cell
Your Badges
0 of 6Mark lesson as complete
Tick when you've finished Learn, Practice and the Stretch. Earns +85 XP and +25 coins.