2013 IEEE Third International Conference on Cloud and Green Computing
Towards Ethical Governance of Social Machines Mark Hartswood, Barbara Grimpe and Marina Jirotka Computer Science, University of Oxford Oxford, UK. mark.hartswood@cs.ox.ac.uk; barbara.grimpe@cs.ox.ac.uk; marina.jirotka@cs.ox.ac.uk
Abstract— We introduce the concept of Hybrid Diversity – Aware Collective Adaptive Systems (HDA-CAS) and their proposed role in addressing social problems associated with urban living, health, and financial markets. Our concern is for their responsible development and deployment, and to this end, we suggest perspectives on the governance of social machines and a framework from which to design governance regimes for HDACAS.
II.
Keywords—governance; ethical governance; social machines; collective adaptive systems.
I.
INTRODUCTION
1
The SmartSociety EU funded Integrating Project (IP) is exploring innovative ways of supporting urban life through Collective Adaptive Systems (CAS) to solve problems around exploiting shared resources including traffic congestion, access to care, and community safety. In SmartSociety, representations of city life garnered from human and sensor observations allow citizens to adapt their actions to achieve community goals (such as reduced congestion or increased prosperity) and personal goals (enriched life experiences, improved care). The sorts of CAS envisaged are hybrid – they aim to achieve a symbiosis of humans and machine capabilities, and diversity aware – they are able to accommodate and/or exploit the different goals, expertise and values of participating agents. In HDA-CAS data from an instrumented city will feed multiple cycles of learning and adaptation. One goal of this is to better target incentives to subpopulations and thereby align their behaviour with the broader social goals of the CAS.
Hybrid CAS aim to exploit the blend of human and machine capabilities made possible by Social Machines. SmartSociety envisages tapping into human creativity, imagination and judgment to make sense of data from an instrumented city via participation in a serious game. We contend that ethical governance for Social Machines, including serious games, has inward and outward facing aspects. Inwardly, the way that the Social Machine is constituted needs to reflect the ethos of the computations (e.g. meeting standards of authorship in Wikipedia [11]), to offer reciprocity for participation and discourage malicious forms of participation. Outwardly, the role that Social Machines play within a wider societal context is important, e.g. preventing social machines from being put to malicious purposes such as their use by spammers to circumventing Captchas, or in promulgating exploitative labour practices [12].
Apart from urban living, CAS are likely to be increasingly relevant in various domains such as, health and financial markets [1,2]. CAS need to be built based on multidisciplinary approaches, including the social sciences, and ethics in particular [3]. Triggered by a series of recent EU initiatives and research projects [4,5] our role is to bring Responsible Research and Innovation practices [6] to a range of technologies, including HDA-CAS, so as to shape their impact upon privacy and other social values. An important aspect of this is to devise a framework for the ethical governance of HDA-CAS. This paper draws out a series of ethical issues for CAS derived from their Adaptive, Hybrid, Diversity Aware characteristics and considers governance responses.
CAS that are diversity-aware aim to be sensitive to the mix of capabilities and values present within the collective, and able to stratify populations accordingly to effectively target incentives and recruit expertise. However, such an approach is open to undesirable forms of social sorting, identified by Lyon as the ways that surveillance technologies sift populations and thereby regulate entitlement or access to resources [13]. Similarly internet and call centre technologies afford tailoring service quality and priority according to customer profiles, where ‘good’ customers can be apportioned early response or greater bandwidth [14].
1
SmartSociety (FP7/2007-2013) Grant agreement n. 600854. http://www.smart-society-project.eu/
978-0-7695-5114-2/13 $26.00 © 2013 IEEE DOI 10.1109/CGC.2013.73
ETHICS OF HDA-CAS
Adaptivity can have negative as well as positive connotations. Internet search (one of the commonest, most palpable encounters we have with a CAS-like social machine) is increasingly ethically and politically charged due to its powerful role in ordering our experience of the virtual world and its physical world referents. Attention has recently been drawn to how cultural assumptions can be covertly embedded within the mechanisms for ranking search results in ways that are opaque to users [7]. Moreover, searching contributes to everybody's search experience through subtle incremental adjustments to ranking algorithms resulting in ‘imprints’ that can be read as dominant cultural preferences. These can reflect negative sentiments including racial biases or prejudices [8]. Prior work examining the ethical principles important for developing and deploying algorithms embedded in computer models may prove a useful starting point for unpicking these issues, including relationships of responsibility between algorithm developers and their ultimate users [9], and the need for algorithms and embedded values to be made visible [10].
426