To create a model, then, we make choices about what’s important enough to include, simplifying the world into a toy version that can be easily understood and from which we can infer important facts and actions. [..] A model’s blind spots reflect the judgments and priorities of its creators. [..] Models, despite their reputation for impartiality, reflect goals and ideology. When I removed the possibility of eating Pop-Tarts at every meal, I was imposing my ideology on the meals model. It’s something we do without a second thought. Our own values and desires influence our choices, from the data we choose to collect to the questions we ask. Models are opinions embedded in mathematics..
- From “Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy”
by Cathy O’Neil