Tragedy of the Commons - A Critical Study of Data Quality and Validity Issues in Crowd Work-Based Research

2022 | HICSS | Citations: 0

Authors: Xia, Huichuan

Abstract: Academic scholars have leveraged crowd work platforms such as MTurk to conduct r ... Expand

Abstract: Academic scholars have leveraged crowd work platforms such as MTurk to conduct research and collect data. Though prior studies have discussed data quality and validity issues in crowd work via surveys and experiments, they kind of neglected to explore the scholars’ and particularly the IRB’s ethical concerns in these respects. In this study, we interviewed 17 scholars from six disciplines and 15 IRB directors and analysts in the U.S. to fill this research gap. We identified common themes among our respondents but also discovered distinctive and even opposing views regarding the approval rate, rejection, internal and external research validity. Based on the findings, we discussed a potential Tragedy of the Commons regarding the data quality deterioration and the disciplinary differences regarding validity in crowd work-based research. Finally, we advocated that the IRB’s ethical concerns in crowd work-based research should be heard and respected further. Collapse

Topics: crowdsourcing data quality spamming privacy data protection

Methods: qualitative interview qualitative content analysis personal interview

Theories: theory of the commons

Finance 4.0: Design Principles for a value-sensitive Cryptoeconomic System to address sustainability

2021 | European Conference On Information Systems | Citations: 0

Authors: Ballandies, Mark Christopher; Dapp, Marcus Manfred; Degenhart, Benjamin; Helbing, Dirk

Abstract: ... Expand

Abstract: Collapse

Topics: cryptoeconomics financial information system Ethereum usability blockchain

Methods: design principle design artifact design science survey design process

Theories: unified theory of acceptance and use of technology theory of the commons

Debate Section Editorial Note: Reconsidering Counting Articles in Ranked Venues (CARV) as the Appropriate Evaluation Criteria for the Advancement of Democratic Discourse in the IS Field

2019 | Communications of the Association for Information Systems | Citations: 0

Authors: Kautz, Karlheinz (Karl)

Abstract: ... Expand

Abstract: Collapse

Topics: open access

Theories: theory of the commons

Enabling openness of valuable information resources: Curbing data subtractability and exclusion

2019 | Information Systems Journal | Citations: 10

Authors: Vassilakopoulou, Polyxeni; Skorve, Espen; Aanestad, Margunn

Abstract: In this paper we investigate how data openness can be made possible in communal ... Expand

Abstract: In this paper we investigate how data openness can be made possible in communal settings. We adopt a utility perspective that foregrounds the use value of data, conceptualizing them as “goods.” On the basis of this conceptualization we explore 2 key goods' attributes: subtractability and exclusion. Our theoretical basis is built upon concepts from the theory of the commons, power theorizing, and notions related to data and information. Empirically, we investigate openness in the genetics domain through a longitudinal study of the evolving communal infrastructure for data related to 2 genes influencing women's susceptibility to breast and ovarian cancer (BRCA1 and BRCA2). We follow the continuously shifting “topology” of the BRCA information infrastructure and trace the multiple repositories that are put in place and the different arrangements for data collection, curation/quality assurance, access, and control that are tried out. In our analysis, we illustrate the actors' strategies for curbing the subtractability and exclusion attributes of data. We then propose a theoretically informed and empirically grounded framework that can guide understanding and action taking to enable data openness. Collapse

Topics: open data database system data governance user interface usability

Methods: design artifact qualitative interview longitudinal research archival research theory development

Theories: theory of the commons

Debate Section Editorial Note: Reviews, Reviewers, and Reviewing: The “Tragedy of the Commons” in the Scientific Publication Process

2018 | Communications of the Association for Information Systems | Citations: 0

Authors: Kautz, Karlheinz

Abstract: ... Expand

Abstract: Collapse

Theories: theory of the commons

The Sustainability of Polycentric Information Commons

2018 | Management Information Systems Quarterly | Citations: 89

Authors: Mindel, Vitali; Mathiassen, Lars; Rai, Arun

Abstract: The article presents a study on the sustainability of polycentric information co ... Expand

Abstract: The article presents a study on the sustainability of polycentric information commons such as blogging, crowdsourcing, and social media. Topics include the tendency for user engagement and overall activity to decline in most online information systems over time, and the use of Hardin's theory of the tragedy of the commons and Ostrom's theory of polycentric governance to introduce a theory of polycentric information commons and explain how polycentric governance principles counterbalance sustainability threats. Collapse

Topics: crowdsourcing online community open access wiki Wikipedia

Methods: theory development literature study conceptual modelling netnography case study

Theories: theory of the commons information systems theory

Embracing the Golden Rule of Reviewing: A Response to the Tragedy of the Scientific Commons

2018 | Communications of the Association for Information Systems | Citations: 0

Authors: Petter, Stacie

Abstract: Many papers and discussions have identified potential structural or institutiona ... Expand

Abstract: Many papers and discussions have identified potential structural or institutional changes to address issues associated with the peer-review process in the information systems field. In this paper, I take an individual-level approach that empowers each of us to do our part to address the tragedy of the scientific commons. My answer to the tragedy of the science commons is simple in concept but challenging in application: the Golden Rule of Reviewing: “Do unto others as you would have reviewer two do unto you”. Collapse

Topics: innovation management

Theories: theory of the commons

Rejoined and Regenerated: Response to Responses to “Reviews, Reviewers, and Reviewing: The ‘Tragedy of the Commons’ in the Scientific Publication Process”

2018 | Communications of the Association for Information Systems | Citations: 0

Authors: Stafford, Thomas F.

Abstract: The joy of writing critiques about the editorial process is doubly enhanced when ... Expand

Abstract: The joy of writing critiques about the editorial process is doubly enhanced when engaged in debates such as this one wherein I find the most fascinating views, points, and counterpoints in correspondence to my own. I am simply pleased to say that the sterling colleagues who have chosen to respond to and rejoin my initial essays are highly skilled and insightful editors in their own right, and we all benefit from the colloquy that ensues in such discussions about how to improve peer reviews in our field of science. Collapse

Topics: blockchain

Theories: theory of the commons

Mitigating the Tragedy of the Commons in Scientific Publishing: Creating a Market for Information Systems Articles

2015 | European Conference On Information Systems | Citations: 0

Authors: Avital, Michel; Damsgaard, Jan; Gregor, Shirley; Te'eni, Dov; Tuunainen, Virpi; Willcocks, Leslie P.

Abstract: Academic discourse relies on journal articles as the main vehicle of knowledge ... Expand

Abstract: Academic discourse relies on journal articles as the main vehicle of knowledge exchange and dissemination. Quality control of the articles is managed via a peer review process that is considered essential for the development of a cumulative body of knowledge that is valid and consistent. In recent years, it seems that the review capacity in the IS field has decreased and it gets harder to retain a sufficient number of qualified reviewers who can handle the ever-growing flow of submissions. As stewards of digital technology in business and sociality, we should consider its untapped potential contribution to our publishing practices. In this panel, we will explore and debate the potential institutional, organizational, and technological approaches to mitigating the review process bottleneck and enhancing the efficiency and effectiveness of publishing in the IS field. In particular, we will revisit a ten years old proposal to adopt a market mechanism as a way to facilitate journal articles selection and appropriation. Collapse

Topics: IS discipline

Theories: theory of the commons

Yes we can: Improving performance in dynamic tasks

2014 | Decision Support Systems | Citations: 0

Authors: Qudrat-Ullah, Hassan

Abstract: Facilitation, a special kind of decisional aid, is all forms of information, str ... Expand

Abstract: Facilitation, a special kind of decisional aid, is all forms of information, strategies, and heuristics delivered by a facilitator to aid decision makers in dynamic decision environments. It is assumed that facilitation has profound effects on decision making, but these effects are understudied and empirically unproven. By incorporating the three levels of facilitation, pre-task, combined pre-task and in-task, and combined pre-task, in-task, and post-task, in the design of a simulation-based interactive learning environment (ILE), this study provides an empirical, laboratory-experiment-based evaluation of the effectiveness of facilitation on performance in dynamic tasks. We develop and use a comprehensive model consisting of four evaluation criteria: task performance, structural knowledge, heuristics knowledge, and transfer learning. We find that the subjects provided with combined pre-task, in-task, and post-task facilitation performed the best, followed by those provided with combined pre-task and in-task facilitation. Contrary to the hypothesis, subjects provided with pre-task facilitation performed poorly. Collapse

Topics: task productivity decision making decision support evaluation criteria decision support system

Methods: simulation experiment experimental group survey multivariate analysis of variance

Theories: theory of the commons