30/05/2022
Ethics and Data Science
New technologies frequently pose new ethical concerns. The advent of nuclear weapons, for example, put a strain on the distinction between combatants and non-combatants that had been crucial to the just war theory since the Middle Ages. In the nuclear age, new theories were required to reinterpret the meaning of this differentiation. With the advent of new machine learning techniques and the ability to use algorithms to accomplish activities previously performed by humans, as well as to develop new knowledge, a new set of ethical problems has arisen.These concerns include not only the risk of harm from data misuse, but also how to protect privacy when sensitive data is involved, how to minimize bias in data selection, how to prevent data disruption and "hacking," and issues of transparency in data collecting, research, and dissemination. Many of these problems are rooted in a larger debate over who owns the data, who gets access to it, and under what conditions.
These questions presently have no agreed-upon answers. Nonetheless, confronting them and attempting to figure out shared ethical principles is critical. When consensus isn't attainable, it's critical to pay attention to conflicting values and to define the underlying assumptions that underpin different models. The dispute about fairness in models estimating the probability of recidivism among black and white defendants in Broward County, Florida, is an interesting example.Should a risk score be: equally accurate in predicting recidivism for members of diverse racial groups; presume that members of different groups have the same possibility of being incorrectly predicted to recidivate; or assume that failure to forecast recidivism occurs at the same rate across groups? According to recent research, completing all three criteria at the same time is unachievable in most cases; meeting two will result in failure to meet the third. As a result, we must determine which components of fairness are most critical.
Collaboration amongst programmers, statisticians, legal experts, and philosophers will be required to develop a shared framework.