Obviously the more transparency we have as auditors, the more we can get, but the main goal is to understand important characteristics about a black box algorithm without necessarily having to understand every single granular detail of the algorithm.

I would argue that one of the major problems with our blind trust in algorithms is that we can propagate discriminatory patterns without acknowledging any kind of intent.

Most people don't have any association in their minds with what they do and with ethics. They think they somehow moved past the questions of morality or values or ethics, and that's something that I've never imagined to be true.

The most important goal I had in mind was to convince people to stop blindly trusting algorithms and assuming that they are inherently fair and objective.

The NSA buys data from private companies, so the private companies are the source of all this stuff.

The training one receives when one becomes a technician, like a data scientist - we get trained in mathematics or computer science or statistics - is entirely separated from a discussion of ethics.

There's less of a connection for a lot of people between the technical decisions we make and the ethical ramifications we are responsible for.