PROFILE | How should automated profiling be regulated?

Summary
Profiling may threaten values that the law aims to protect, and undermine goals that the law aims to achieve. Profiling involves automated processing of personal or other data to develop profiles that can be used to make decisions about people. Profiling can be used in different contexts. For instance, (i) with retail price discrimination, online shops charge different consumers different prices for the same or similar products. (ii) Lenders use profiling to estimate a consumer’s creditworthiness. Lenders can adapt interest rates to certain consumers, or refuse to lend to them. (iii) Predictive policing refers to the use of profiling technology to predict criminal behaviour.However, profiling has drawbacks. For instance, profiling can discriminate unintentionally, when an algorithm learns from data reflecting biased human decisions. Additionally, profiling is opaque: people may not know why they are treated differently. Making profiling transparent is difficult, among other reasons because of the complexity and the possibly ever-changing nature of algorithms.
The project’s overarching research question is: considering the rationales for the rules in different sectors, is additional regulation needed, and if so: how should profiling be regulated? The project aims to develop guidelines for regulating profiling.
I examine profiling in three sectors: retail price discrimination, consumer credit, and predictive policing. For each case study, I analyse current rules that apply to profiling. Next, I analyse these rules’ rationales, which are partly different for each sector. A rule may, for example, aim to protect a human right, or express a legal principle, such as equality, contractual freedom, or the right to a fair trial. Rules may also have economic rationales, which are different for each sector. Drawing from the three case studies, I develop guidelines to regulate profiling. Policymakers, NGOs, and other stakeholders expressed great interest in the results.
Unfold all
/
Fold all
More information & hyperlinks
Web resources: https://cordis.europa.eu/project/id/748514
Start date: 01-01-2018
End date: 31-12-2019
Total budget - Public funding: 172 800,00 Euro - 172 800,00 Euro
Cordis data

Original description

Profiling may threaten values that the law aims to protect, and undermine goals that the law aims to achieve. Profiling involves automated processing of personal or other data to develop profiles that can be used to make decisions about people. Profiling can be used in different contexts. For instance, (i) with retail price discrimination, online shops charge different consumers different prices for the same or similar products. (ii) Lenders use profiling to estimate a consumer’s creditworthiness. Lenders can adapt interest rates to certain consumers, or refuse to lend to them. (iii) Predictive policing refers to the use of profiling technology to predict criminal behaviour.However, profiling has drawbacks. For instance, profiling can discriminate unintentionally, when an algorithm learns from data reflecting biased human decisions. Additionally, profiling is opaque: people may not know why they are treated differently. Making profiling transparent is difficult, among other reasons because of the complexity and the possibly ever-changing nature of algorithms.
The project’s overarching research question is: considering the rationales for the rules in different sectors, is additional regulation needed, and if so: how should profiling be regulated? The project aims to develop guidelines for regulating profiling.
I examine profiling in three sectors: retail price discrimination, consumer credit, and predictive policing. For each case study, I analyse current rules that apply to profiling. Next, I analyse these rules’ rationales, which are partly different for each sector. A rule may, for example, aim to protect a human right, or express a legal principle, such as equality, contractual freedom, or the right to a fair trial. Rules may also have economic rationales, which are different for each sector. Drawing from the three case studies, I develop guidelines to regulate profiling. Policymakers, NGOs, and other stakeholders expressed great interest in the results.

Status

CLOSED

Call topic

MSCA-IF-2016

Update Date

28-04-2024
Geographical location(s)
Structured mapping
Unfold all
/
Fold all
EU-Programme-Call
Horizon 2020
H2020-EU.1. EXCELLENT SCIENCE
H2020-EU.1.3. EXCELLENT SCIENCE - Marie Skłodowska-Curie Actions (MSCA)
H2020-EU.1.3.2. Nurturing excellence by means of cross-border and cross-sector mobility
H2020-MSCA-IF-2016
MSCA-IF-2016