Export control of cybersurveillance items in the new dual-use regulation: The challenges of applying human rights logic to export control external link

Computer Law & Security Review, vol. 48, 2023

Abstract

In 2021, the Recast Dual-Use Regulation entered into force. The regulation includes a heavily debated new provision on the export control of so-called cybersurveillance items. This provision departs from the traditional logic of export control rules in multiple ways. Most importantly, it positions human rights considerations as an important factor in the export control of a flexible range of technologies. This article explores the operation, implications and challenges of this new human rights-orientated approach to export control of digital surveillance technologies. Taking the definition of cybersurveillance items as a starting point of the analysis, the article draws on surveillance-related case law of the European Court of Human Rights and the Court of Justice of the European Union, to define the potential scope of application of the open-ended cybersurveillance concept of the Regulation. By exploring how this concept maps to technologies often connected with human rights infringements, such as facial recognition, location tracking and open-source intelligence, the article highlights the challenges of applying this new approach and underscores the need for its further development in practice.

cybersurveillance, Human rights, Regulation

Bibtex

Article{nokey, title = {Export control of cybersurveillance items in the new dual-use regulation: The challenges of applying human rights logic to export control}, author = {van Daalen, O. and van Hoboken, J. and Rucz, M.}, doi = {https://doi.org/10.1016/j.clsr.2022.105789}, year = {2023}, date = {2023-04-21}, journal = {Computer Law & Security Review}, volume = {48}, pages = {}, abstract = {In 2021, the Recast Dual-Use Regulation entered into force. The regulation includes a heavily debated new provision on the export control of so-called cybersurveillance items. This provision departs from the traditional logic of export control rules in multiple ways. Most importantly, it positions human rights considerations as an important factor in the export control of a flexible range of technologies. This article explores the operation, implications and challenges of this new human rights-orientated approach to export control of digital surveillance technologies. Taking the definition of cybersurveillance items as a starting point of the analysis, the article draws on surveillance-related case law of the European Court of Human Rights and the Court of Justice of the European Union, to define the potential scope of application of the open-ended cybersurveillance concept of the Regulation. By exploring how this concept maps to technologies often connected with human rights infringements, such as facial recognition, location tracking and open-source intelligence, the article highlights the challenges of applying this new approach and underscores the need for its further development in practice.}, keywords = {cybersurveillance, Human rights, Regulation}, }

Seeing what others are seeing: Studies in the regulation of transparency for social media recommender systems external link

Abstract

This dissertation asks how the law can shed light on social media recommender systems: the algorithmic tools which platforms use to rank and curate online content. Recommender systems fulfil an important gatekeeping function in social media governance, but their actions are poorly understood. Legal reforms are now underway in EU law to impose transparency rules on social media recommenders, and the goal of this dissertation is to interrogate the accountability relations implied by this regulatory project. What kinds of information is the law demanding about social media recommender systems? Who is included in these new models of accountability, and who is excluded? This dissertation critiques a dominant paradigm in recent law and policy focused on algorithmic explanations. Building on insights from critical transparency studies and algorithm studies, it argues that disclosure regulation should move from algorithmic transparency toward platform observability: approaching recommenders not as discrete algorithmic artifacts but as complex sociotechnical systems shaped in important ways by their users and operators. Before any attempt to ‘open the black box’ of algorithmic machine learning, therefore, regulating for observability invites us to ask how recommenders find uptake in practice; to demand basic data on recommender inputs, outputs and interventions; to ask what is being recommend, sooner than why. Several avenues for observability regulation are explored, including platform ad archives; notices for visibility restrictions (or ‘shadow bans’); and researcher APIs. Through solutions such as these, which render visible recommender outcomes, this dissertation outlines a vision for a more democratic media governance—one which supports informed and inclusive deliberation about, across and within social media’s personalised publics.

Bibtex

PhD Thesis{nokey, title = {Seeing what others are seeing: Studies in the regulation of transparency for social media recommender systems}, author = {Leerssen, P.}, url = {https://dare.uva.nl/search?identifier=18c6e9a0-1530-4e70-b9a6-35fb37873d13}, year = {2023}, date = {2023-04-21}, abstract = {This dissertation asks how the law can shed light on social media recommender systems: the algorithmic tools which platforms use to rank and curate online content. Recommender systems fulfil an important gatekeeping function in social media governance, but their actions are poorly understood. Legal reforms are now underway in EU law to impose transparency rules on social media recommenders, and the goal of this dissertation is to interrogate the accountability relations implied by this regulatory project. What kinds of information is the law demanding about social media recommender systems? Who is included in these new models of accountability, and who is excluded? This dissertation critiques a dominant paradigm in recent law and policy focused on algorithmic explanations. Building on insights from critical transparency studies and algorithm studies, it argues that disclosure regulation should move from algorithmic transparency toward platform observability: approaching recommenders not as discrete algorithmic artifacts but as complex sociotechnical systems shaped in important ways by their users and operators. Before any attempt to ‘open the black box’ of algorithmic machine learning, therefore, regulating for observability invites us to ask how recommenders find uptake in practice; to demand basic data on recommender inputs, outputs and interventions; to ask what is being recommend, sooner than why. Several avenues for observability regulation are explored, including platform ad archives; notices for visibility restrictions (or ‘shadow bans’); and researcher APIs. Through solutions such as these, which render visible recommender outcomes, this dissertation outlines a vision for a more democratic media governance—one which supports informed and inclusive deliberation about, across and within social media’s personalised publics.}, }

Money after money: Disassembling value/information infrastructures external link

Ferrari, V.
2023

Abstract

This manuscript is a journey through coexisting, emerging or speculated about, types of digital value transfer infrastructures. Using digital value transfer infrastructures as a central case study, this thesis is concerned with unpacking the negotiation processes that shape the governance, design and political purposes of digital infrastructures that are closely linked to the public interest and state sovereignty. In particular, the papers that are assembled in this manuscript identify and inspect three main socio-technical developments occurring in the domain of value transfer technologies: a) the privatization and platformization of digital payment infrastructures; b) the spread of blockchain-based digital value transfer infrastructures; c) the construction of digital value transfer infrastructures as public utilities, from the part of public institutions or organizations. Concerned with the relationship between law, discourse and technological development, the thesis explores four transversal issues that strike differences and peculiarities of these three scenarios: i) privacy; ii) the synergy and mutual influence of legal change and technological development in the construction of digital infrastructures; iii) the role of socio-technical imaginaries in policy-making concerned with digital infrastructures; iv) the geography and scale of digital infrastructures. The analyses lead to the argument that, in the co-development of legal systems and digital infrastructures that are core to public life, conflicts are productive. Negotiations, ruptures and exceptions are constitutive of the unending process of mutual reinforcement, and mutual containment, in which a plurality of agencies – expressed through legal institutions, symbolic systems, as well as information and media structures - are entangled.

Bibtex

PhD Thesis{nokey, title = {Money after money: Disassembling value/information infrastructures}, author = {Ferrari, V.}, url = {https://dare.uva.nl/search?identifier=30904422-2233-4400-bc5f-e7971b33f758}, year = {2023}, date = {2023-04-21}, abstract = {This manuscript is a journey through coexisting, emerging or speculated about, types of digital value transfer infrastructures. Using digital value transfer infrastructures as a central case study, this thesis is concerned with unpacking the negotiation processes that shape the governance, design and political purposes of digital infrastructures that are closely linked to the public interest and state sovereignty. In particular, the papers that are assembled in this manuscript identify and inspect three main socio-technical developments occurring in the domain of value transfer technologies: a) the privatization and platformization of digital payment infrastructures; b) the spread of blockchain-based digital value transfer infrastructures; c) the construction of digital value transfer infrastructures as public utilities, from the part of public institutions or organizations. Concerned with the relationship between law, discourse and technological development, the thesis explores four transversal issues that strike differences and peculiarities of these three scenarios: i) privacy; ii) the synergy and mutual influence of legal change and technological development in the construction of digital infrastructures; iii) the role of socio-technical imaginaries in policy-making concerned with digital infrastructures; iv) the geography and scale of digital infrastructures. The analyses lead to the argument that, in the co-development of legal systems and digital infrastructures that are core to public life, conflicts are productive. Negotiations, ruptures and exceptions are constitutive of the unending process of mutual reinforcement, and mutual containment, in which a plurality of agencies – expressed through legal institutions, symbolic systems, as well as information and media structures - are entangled.}, }

Annotatie bij Hoge Raad 18 oktober 2022 download

Nederlandse Jurisprudentie, iss. : 12, num: 118, pp: 2088-2090, 2023

Annotaties, Vrijheid van meningsuiting

Bibtex

Case note{nokey, title = {Annotatie bij Hoge Raad 18 oktober 2022}, author = {Dommering, E.}, url = {https://www.ivir.nl/publications/annotatie-bij-hoge-raad-18-oktober-2022/annotatie_nj_2023_118/}, year = {2023}, date = {2023-04-20}, journal = {Nederlandse Jurisprudentie}, issue = {12}, number = {118}, keywords = {Annotaties, Vrijheid van meningsuiting}, }

EU copyright law round up – first trimester of 2023 external link

Trapova, A. & Quintais, J.
Kluwer Copyright Blog, 2023

Abstract

Welcome to the first trimester of the 2023 round up of EU copyright law! In this edition, we report on an AG Opinion that came out late in 2022 and update you on what has happened in the first trimester of 2023 in EU copyright law. This includes Court of Justice (CJEU) and General Court judgments, Advocate Generals’ (AG) opinions, and important policy developments.

Copyright

Bibtex

Online publication{nokey, title = {EU copyright law round up – first trimester of 2023}, author = {Trapova, A. and Quintais, J.}, url = {https://copyrightblog.kluweriplaw.com/2023/04/13/eu-copyright-law-round-up-first-trimester-of-2023/}, year = {2023}, date = {2023-04-13}, journal = {Kluwer Copyright Blog}, abstract = {Welcome to the first trimester of the 2023 round up of EU copyright law! In this edition, we report on an AG Opinion that came out late in 2022 and update you on what has happened in the first trimester of 2023 in EU copyright law. This includes Court of Justice (CJEU) and General Court judgments, Advocate Generals’ (AG) opinions, and important policy developments.}, keywords = {Copyright}, }

An end to shadow banning? Transparency rights in the Digital Services Act between content moderation and curation download

Computer Law & Security Review, vol. 48, 2023

Abstract

This paper offers a legal perspective on the phenomenon of shadow banning: content moderation sanctions which are undetectable to those affected. Drawing on recent social science research, it connects current concerns about shadow banning to novel visibility management techniques in content moderation, such as delisting and demotion. Conventional moderation techniques such as outright content removal or account suspension can be observed by those affected, but these new visibility often cannot. This lends newfound significance to the legal question of moderation transparency rights. The EU Digital Services Act (DSA) is analysed in this light, as the first major legislation to regulate transparency of visibility remedies. In effect, its due process framework prohibits shadow banning with only limited exceptions. In doing so, the DSA surfaces tensions between two competing models for content moderation: as rule-bound administration or as adversarial security conflict. I discuss possible interpretations and trade-offs for this regime, and then turn to a more fundamental problem: how to define visibility reduction as a category of content moderation actions. The concept of visibility reduction or ‘demotions’ is central to both the shadow banning imaginary and to the DSA's safeguards, but its meaning is far from straightforward. Responding to claims that demotion is entirely relative, and therefore not actionable as a category of content moderation sanctions, I show how visibility reduction can still be regulated when defined as ex post adjustments to engagement-based relevance scores. Still, regulating demotion in this way will not cover all exercises of ranking power, since it manifests not only in individual cases of moderation but also through structural acts of content curation; not just by reducing visibility, but by producing visibility.

content curation, Content moderation, DSA, Online platforms, Transparency

Bibtex

Article{nokey, title = {An end to shadow banning? Transparency rights in the Digital Services Act between content moderation and curation}, author = {Leerssen, P.}, url = {https://www.ivir.nl/publications/comment-an-end-to-shadow-banning-transparency-rights-in-the-digital-services-act-between-content-moderation-and-curation/endtoshadowbanning/}, doi = {https://doi.org/10.1016/j.clsr.2023.105790}, year = {2023}, date = {2023-04-11}, journal = {Computer Law & Security Review}, volume = {48}, pages = {}, abstract = {This paper offers a legal perspective on the phenomenon of shadow banning: content moderation sanctions which are undetectable to those affected. Drawing on recent social science research, it connects current concerns about shadow banning to novel visibility management techniques in content moderation, such as delisting and demotion. Conventional moderation techniques such as outright content removal or account suspension can be observed by those affected, but these new visibility often cannot. This lends newfound significance to the legal question of moderation transparency rights. The EU Digital Services Act (DSA) is analysed in this light, as the first major legislation to regulate transparency of visibility remedies. In effect, its due process framework prohibits shadow banning with only limited exceptions. In doing so, the DSA surfaces tensions between two competing models for content moderation: as rule-bound administration or as adversarial security conflict. I discuss possible interpretations and trade-offs for this regime, and then turn to a more fundamental problem: how to define visibility reduction as a category of content moderation actions. The concept of visibility reduction or ‘demotions’ is central to both the shadow banning imaginary and to the DSA\'s safeguards, but its meaning is far from straightforward. Responding to claims that demotion is entirely relative, and therefore not actionable as a category of content moderation sanctions, I show how visibility reduction can still be regulated when defined as ex post adjustments to engagement-based relevance scores. Still, regulating demotion in this way will not cover all exercises of ranking power, since it manifests not only in individual cases of moderation but also through structural acts of content curation; not just by reducing visibility, but by producing visibility.}, keywords = {content curation, Content moderation, DSA, Online platforms, Transparency}, }

Copyright Content Moderation in the EU: Conclusions and Recommendations download

Quintais, J., Katzenbach, C., Schwemer, S., Dergacheva, D., Riis, T., Mezei, P. & Harkai, I.
2023

Abstract

This report is a deliverable in the reCreating Europe project. The report describes and summarizes the results of our research on the mapping of the EU legal framework and intermediaries’ practices on copyright content moderation and removal. In particular, this report summarizes the results of our previous deliverables and tasks, namely: (1) our Final Report on mapping of EU legal framework and intermediaries’ practices on copyright content moderation and removal; and (2) our Final Evaluation and Measuring Report - impact of moderation practices and technologies on access and diversity. Our previous reports contain a detailed description of the legal and empirical methodology underpinning our research and findings. This report focuses on bringing together these findings in a concise format and advancing policy recommendations.

Content moderation, Copyright, Digital services act, Digital Single Market, intermediaries, Online platforms, terms and conditions

Bibtex

Report{nokey, title = {Copyright Content Moderation in the EU: Conclusions and Recommendations}, author = {Quintais, J. and Katzenbach, C. and Schwemer, S. and Dergacheva, D. and Riis, T. and Mezei, P. and Harkai, I.}, url = {https://www.ivir.nl/publications/copyright-content-moderation-in-the-eu-conclusions-and-recommendations/ssrn-id4403423/}, year = {2023}, date = {2023-03-30}, abstract = {This report is a deliverable in the reCreating Europe project. The report describes and summarizes the results of our research on the mapping of the EU legal framework and intermediaries’ practices on copyright content moderation and removal. In particular, this report summarizes the results of our previous deliverables and tasks, namely: (1) our Final Report on mapping of EU legal framework and intermediaries’ practices on copyright content moderation and removal; and (2) our Final Evaluation and Measuring Report - impact of moderation practices and technologies on access and diversity. Our previous reports contain a detailed description of the legal and empirical methodology underpinning our research and findings. This report focuses on bringing together these findings in a concise format and advancing policy recommendations.}, keywords = {Content moderation, Copyright, Digital services act, Digital Single Market, intermediaries, Online platforms, terms and conditions}, }

Annotatie bij Hoge Raad 7 oktober 2022 (X / ROC-Nijmegen) download

Mediaforum, iss. : 1, num: 3, pp: 43-45, 2023

arbeidsrecht, Vrijheid van meningsuiting

Bibtex

Case note{nokey, title = {Annotatie bij Hoge Raad 7 oktober 2022 (X / ROC-Nijmegen)}, author = {Dommering, E.}, url = {https://www.ivir.nl/publications/annotatie-bij-hoge-raad-7-oktober-2022-x-roc-nijmegen/annotatie_mediaforum_2023_1/}, year = {2023}, date = {2023-03-30}, journal = {Mediaforum}, issue = {1}, number = {3}, keywords = {arbeidsrecht, Vrijheid van meningsuiting}, }

Remuneration rights and national treatment

Improving Intellectual Property: A Global Project, S. Frankel, M. Chon, G. Dinwoodie, B. Lauriat, J. Schovsbo (ed.), Edward Elgar Publishing, 2023, pp: 341-352

global policy goals, Intellectual property, international agreements, shifting boundaries

Bibtex

Chapter{nokey, title = {Remuneration rights and national treatment}, author = {Hugenholtz, P.}, doi = {https://doi.org/10.4337/9781035310869.00050}, year = {2023}, date = {2023-03-28}, keywords = {global policy goals, Intellectual property, international agreements, shifting boundaries}, }

FAIR, FRAND and open – The institutionalization of research data sharing under the EU data strategy

Improving Intellectual Property: A Global Project, S. Frankel, M. Chon, G. Dinwoodie, B. Lauriat, J. Schovsbo (ed.), Edward Elgar Publishing, 2023, pp: 319-329

global policy goals, Intellectual property, international agreements, shifting boundaries

Bibtex

Chapter{nokey, title = {FAIR, FRAND and open – The institutionalization of research data sharing under the EU data strategy}, author = {van Eechoud, M.}, doi = {https://doi.org/10.4337/9781035310869.00047}, year = {2023}, date = {2023-03-28}, keywords = {global policy goals, Intellectual property, international agreements, shifting boundaries}, }