Practice Flashcards
Where does bias in a machine-learning model come from?
Track your progress — Sign up free to save your progress and get smart review reminders based on spaced repetition.
All Flashcards in Topic 4.4
Below are all 10 flashcards for this topic. Sign up free to track your progress and get personalized review schedules.
4.4.15 cards
Where does bias in a machine-learning model come from?
From training data that reflects the world as it was. A model learns the patterns in past decisions, so historical unfairness is reproduced at scale — and wearing the appearance of objectivity, which makes it harder to challenge.
Why does removing a sensitive field not remove bias?
Because other fields stand in for it — a postcode can imply background, a school can imply income — and the model finds those substitutes on its own.
Why must fairness be measured per group rather than overall?
A model can be 95% accurate overall and far worse for a small group, because that group barely affects the average. The headline number hides exactly the problem you are looking for.
What is the accountability problem with machine learning?
When a model causes harm it is unclear who answers for it — the developer, the organisation using it, or the operator. 'The system decided' gives the affected person nobody to appeal to.
Name three ethical concerns about machine learning beyond bias.
Transparency, since a complex model cannot easily explain its decision; privacy and consent, because data given for one purpose is used to train models; and environmental impact, since training large models uses very large amounts of energy and water.
4.4.25 cards
Why must ethical guidelines be continually reassessed?
Because they were written for the technology that existed at the time. Something genuinely new does not break the old rules — it sits outside them, doing something nobody thought to allow or forbid.
What four lenses can you apply to any new technology?
Individual rights: can a person refuse, and appeal? Privacy: what is collected, and did bystanders agree? Equity: who is left out or served worse? Society: what changes when everyone has it?
What is the ethical concern with quantum computing?
It would eventually break much of today's encryption. Because encrypted data can be stolen and stored now and decrypted later, the risk begins before the machines exist — so organisations need quantum-resistant encryption already.
Why is augmented reality a greater privacy concern than a fixed camera?
The glasses go everywhere the wearer goes, recording everyone they meet without any consent, and they can also alter what the wearer sees — which raises the question of who chooses that.
Why is pervasive AI a concern even when each individual system is defensible?
Because of the accumulation. When jobs, loans, healthcare and policing all involve models, large parts of a person's life are decided by systems they cannot see, question or appeal against.
Topic 4.4 study notes
Full notes & explanations for Ethical considerations
Computer Science exam skills
Paper structures, command terms & tips
Want smart review reminders?
Sign up free to track your progress. Our spaced repetition algorithm will tell you exactly which cards to review and when.
Start Free