Human–Artificial Intelligence Collaboration in Prediction: A Field Experiment in the Retail Industry

2023 | Journal of Management Information Systems | Citations: 0

Authors: Revilla, Elena; Saenz, Maria Jesus; Seifter, Matthias; Ma, Ye

Abstract: This study investigates the role of human intervention in artificial intelligenc ... Expand

Abstract: This study investigates the role of human intervention in artificial intelligence/machine learning (AIML)-driven predictions. By doing so, we distinguish between three different types of human-AIML collaboration: automation, adjustable automation, and augmentation. We theorize that prediction uncertainty and time horizon represent two critical determinants of forecast accuracy. Based on a field experiment involving AIML-driven demand forecasts approximately 1,888 stock-keeping units in the retail industry, we rely on a multivalued treatment effect methodology to measure the effects of human-AIML collaboration on forecast accuracy. Our findings show that human intervention complements AIML-driven forecasts most effectively (augmentation) in predictions with long time horizons and low uncertainty. However human intervention is least likely to contribute to the effectiveness of AIML predictions (automation) in environments with short time horizons and high uncertainty. We discuss implications for extant theory and propose a framework outlining the conditions in which human intervention is most likely to add predictive value to human-AIML collaborations. Collapse

Topics: artificial intelligence human computer interaction human AI collaboration decision making task uncertainty

Methods: machine learning computational algorithm field experiment experiment regression analysis method

The dualistic view of challenge-hindrance technostress in accounting information systems: Technological antecedents and coping responses

2023 | International Journal of Information Management | Citations: 0

Authors: Zhu, Zhangyao; Zhao, Man; Wu, Xuanjin; Shi, Si; Leung, Wilson K.S.

Abstract: Owing to the pervasive use of accounting information systems (AIS), financial wo ... Expand

Abstract: Owing to the pervasive use of accounting information systems (AIS), financial workers are experiencing increased levels of technostress. While technostress has been conceptualized as overwhelmingly harmful in the IS literature, the challenge–hindrance stressor model suggests that employees can also experience “good stress”. This study instantiates the challenge–hindrance stressor model and coping theory in the AIS context using a twostep mixed-method approach. A qualitative study was first conducted to conceptualize the AIS characteristics associated with technostress appraisals. This study then builds a research model that posits perceived challenge and hindrance technostressors and coping responses as key mechanisms linking AIS characteristics and job burnout. The model was tested by collecting longitudinal data from 285 accountants. The results revealed that several AIS characteristics are associated with technostressor appraisals, and such appraisals lead to proactive and reactive coping responses, which further influence job burnout. The theoretical and practical implications are also discussed. Collapse

Topics: technostress accounting electronic surveillance usability accounting information system

Methods: qualitative interview mixed method qualitative coding literature study personal interview

Hyperopic Search: Organizations Learning About Managers Learning About Strategies

2020 | Organization Science | Citations: 0

Authors: Ganz, Scott C.

Abstract: Early-stage experiments are central to the design-thinking approach to organizat ... Expand

Abstract: Early-stage experiments are central to the design-thinking approach to organizational innovation, and they are also a core practice in evidence-based management. Organizations use experiments to test new strategies in a low-stakes setting before escalating their commitment to a new initiative. Yet organizations also use experiments to evaluate managers who will implement these strategies in a high-stakes setting. I develop a formal model to demonstrate that these two types of evaluations are fundamentally incompatible. Managers who fear replacement in response to a poor experimental outcome pervert their experiments to maximize the likelihood that they succeed. This saps early experiments of much of their informational value. I show that if an organization can observe a manager's experimental strategies and the experiment’s outcomes and can commit ahead of time to an evaluation and replacement rubric, then it can resolve this agency problem. However, if a manager's experimental strategy cannot be credibly communicated, the organization will either replace good managers to induce a desirable experimental strategy or retain bad managers to alleviate the fear of replacement. I show that in low-uncertainty environments, the control exerted by the former replacement regime offers the best results, whereas, in high-uncertainty environments, commitment to retention regardless of experimental outcomes is best. Collapse

Topics: IT career task uncertainty organization learning interorganizational relationship organizational commitment

Methods: experiment triangulation genetic optimization optimization model stochastic model

Theories: organizational theory lemon market theory

Resource Utilization Uncertainty Reduction in Hospitals: The Role of Digital Capability and Governance Structure

2020 | International Conference on Information Systems | Citations: 0

Authors: Xing, Qidi; Miranda, Shaila M; Singh, Rajendra

Abstract: The COVID-19 pandemic spotlights resource utilization uncertainty as a critical ... Expand

Abstract: The COVID-19 pandemic spotlights resource utilization uncertainty as a critical problem for hospitals. This study examines how health IT and governance structure can mitigate this problem. Drawing on organizational uncertainty and information processing theories, we hypothesize that internal digital capability enabled by electronic health records, external digital capability enabled by health information exchanges, and a differentiated governance structure enhance resource utilization uncertainty reduction. Further, we hypothesize that a centralized governance structure enhances resource utilization uncertainty reduction when hospitals have a strong internal or external digital capability. Based on the 2017 American Hospital Association dataset, our results support main effects of digital capability and a differentiated governance structure, but not the posited interaction effects. These findings contribute to health IT literature by highlighting the impact of such technologies in combination with operational and strategic decisions on hospital performance. The study has relevance for hospital managers struggling to mitigate resource utilization uncertainty. Collapse

Topics: information technology capability health information system healthcare data task uncertainty IT workforce

Methods: survey statistical hypothesis test descriptive statistic ordinary least square theory development

Theories: information processing theory theory of information

Effectiveness of standards consortia: Social network perspectives

2019 | Information Systems Frontiers | Citations: 1

Authors: Choi, Beomjin; Raghu, T. S.; Vinzé, Ajay; Dooley, Kevin J.

Abstract: With the rapid assimilation of e-business capabilities into generally accepted b ... Expand

Abstract: With the rapid assimilation of e-business capabilities into generally accepted business practices, there has been a rush to ensure standards exist to allow for seamless integration and interfaces between all the concerned parties. While standards consortia have grown in number and importance in the private sector over the past decade, little is known about how effective standards consortia are in addressing the needs for developing e-business standards. The current study examines the relationships between task characteristics of e-business standards and group effectiveness of standards consortia in terms of group centralization, group cohesiveness, and group diversity. We took a case study approach and analyze email archives from the ebXML standards efforts using social network analysis techniques. The findings of the study indicate that the expanding nature of e-business standards and a broader participation of IT vendor and users must be considered in order to improve group effectiveness of standards consortia. Managerial implications of the findings are discussed. Collapse

Topics: electronic business electronic mail business process management task characteristic team productivity

Methods: case study social network analysis data transformation factor analysis network analysis

Managing the Crowds: The Effect of Prize Guarantees and in-Process Feedback on Participation in Crowdsourcing Contests

2019 | Management Information Systems Quarterly | Citations: 0

Authors: Jian, Lian; Yang, Sha; Ba, Sulin; Lu, Li; Jiang, Li Crystal

Abstract: Crowdsourcing contests are contests by which organizations tap into the wisdom o ... Expand

Abstract: Crowdsourcing contests are contests by which organizations tap into the wisdom of crowds by outsourcing tasks to large groups of people on the Internet. In an online environment often characterized by anonymity and lack of trust, there are inherent uncertainties for participants of such contests. This study focuses on crowdsourcing contests with winner-take-all prizes. During these contests, submissions are made sequentially and contest hosts can provide public in-process feedback to the submissions as soon as they are received. Drawing on the uncertainty literature, we examine how the use of prize guarantees (guaranteeing that a winner will be picked and paid) and in-process feedback (numeric ratings to individual designs and public textual comments during the contest) can help attract more submissions by influencing the various uncertainties faced by the contestants. We find that guaranteeing the prize increases submissions. The volume of in-process feedback (both numeric reviews and textual comments) has a positive effect on the number of submissions, and such an effect is bigger in contests without prize guarantees. In addition, providing highly positive or extremely negative feedback discourages overall future submissions, and the negative effect of highly positive feedback is mitigated in guaranteed contests. Collapse

Topics: crowdsourcing task uncertainty word of mouth decision making web page

Methods: longitudinal research robustness check propensity score method descriptive statistic cross sectional research

Understanding User Uncertainty during the Implementation of Self-Service Business Intelligence: A Thematic Analysis

2019 | HICSS | Citations: 0

Authors: Weiler, Severin; Matt, Christian; Hess, Thomas

Abstract: Owing to Self-Service Business Intelligence (SSBI) systems’ transformative power ... Expand

Abstract: Owing to Self-Service Business Intelligence (SSBI) systems’ transformative power for organizations, substantial user uncertainties often blight their potential. Although these uncertainties pose a significant threat to effective SSBI implementation, their sources and determinants remain unclear. We conducted semi-structured interviews with 15 current users of a recently implemented SSBI system to empirically explore the relevant factors of user uncertainty. We undertook a rigorous thematic analysis of the collected data, thereafter developing a thematic map to visualize user uncertainties. This map uncovered three unexplored important factors (work routine change, social dynamics and fear of AI) for future research. Our findings show that users are not only perturbed by “hard” factors (e.g. a lack of technical understanding), but also by “soft” factors (social dynamics, fear of AI and nontransparency). Practitioners can use the thematic map to identify and observe potential uncertainties and to develop adequate procedures. Collapse

Topics: artificial intelligence environmental uncertainty systems implementation task uncertainty information system use

Methods: qualitative interview qualitative content analysis personal interview single case study literature study

Reputation Control and Theoretical Innovation in Two Academic Cultures

2019 | Americas Conference on Information Systems | Citations: 0

Authors: Wynn, Eleanor; Hult, Helena Vallo

Abstract: A meta-review of the history of qualitative and critical theory in Information ... Expand

Abstract: A meta-review of the history of qualitative and critical theory in Information Systems (IS) and Human Computer Interaction (HCI) illustrates how source disciplines and publication outlets can filter reputation and affect methodological diversity. An academic cultures framework allows us to compare disciplines and explain different timelines for methods and theories. IS has many publication outlets, while HCI reputations depend on publication in the ACM Conference on Computer-Human Interaction (CHI). The fields deal with similar topics but are shaped by different institutional contexts. Qualitative research and critical theory arose in Information Systems during the 1980s and 1990s, while a search of HCI literature shows no critical theory until the 2000s. An open field of journals may create affordances for new approaches, whereas filtering reputation through a core conference may constrain them. The rise of platforms may blur domain distinctions through a common focus on AI, privacy and information integrity. Collapse

Topics: usability human computer interaction task uncertainty database system technology adoption

Methods: literature study meta analysis bibliometric analysis co-citation analysis

A Commentary on: “The role of transaction cost economics in information technology outsourcing research: A meta-analysis of the choice of contract type”

2016 | Journal of Strategic Information Systems | Citations: 0

Authors: Aubert, Benoit A.; Rivard, Suzanne

Abstract: We thank the Editor-in-Chief of The Journal of Strategic Information Systems fo ... Expand

Abstract: We thank the Editor-in-Chief of The Journal of Strategic Information Systems for inviting us to comment on Schermann et al. 's (2016) article that addresses the question of the appropriateness of Transaction Cost Theory (TCT) for explaining firms' choices about information technology (IT) outsourcing; here the choice of contract type. In brief, the article addresses the question of whether mixed results obtained by IS researchers who have used TCT to explain the choice of contract type are due to a misappropriation of the theory -more precisely the operationalization of task uncertainty -or to the unsuitability of TCT to some aspects of the IT outsourcing phenomenon.Before we offer our comments, a preamble is necessary. Although we have used TCT -and other theories from the field of Industrial Organization, such as Agency Theory -in our research on IT outsourcing (e.g., Aubert et al., 2012), our aim is not to defend the relevance or appropriateness of TCT. Neither do we aim to discourage researchers from developing theories indigenous to the domain of IT outsourcing. On the contrary! As one of the authors of this commentary has advocated elsewhere, theory development is much needed in the IS field (Rivard, 2014). We deem it essential, however, to warn researchers from rejecting a theory based on mistaken motives. On theory borrowingOne of the hallmarks of IS research is its theoretical anchoring in its reference disciplines (King et al., 2010). Put simply, this means that IS researchers have traditionally borrowed theories from other fields to explain their phenomena of interest. As revealed by discussions in other management fields, such as Marketing (Murray et al., 1995) and Organization Studies (Whetten et al., 2009), the IS field is not unique in this practice of theory borrowing.Theory borrowing is deemed important for emerging fields of study, as it helps them ''develop credibility as a legitimate form of scholarly inquiry" (Whetten et al., 2009, p. 538) and contributes to developing and enriching the field (Murray et al., 1995). When researchers aim at explaining a phenomenon that resembles phenomena about which strong theory exists in another field, theory borrowing also means avoiding reinventing the wheel and allows researchers to jump-start knowledge production on the phenomenon of interest in the emerging field. It also facilitates conversations with neighboring disciplines. IS researchers have used TCT to study IT outsourcing decisions because these are indeed make-or-buy decisions. Because TCT had been used to study make or buy decisions in many fields, it was deemed a ''good candidate" to explain IT outsourcing. Alternate theories, such as Pfeffer's (1981) political model, have also been considered as ''good candidates" to explain IT decisions (Lacity and Hirschheim, 1993).Theory borrowing, however, has been a shun-upon practice when it is a mere application of ''high-level reference theory in the form of mid-level abstractions involving generic and atheoretical information technology (IT) components" (Grover and Lyytinen, 2015, p. 271). In the same vein, when researchers are not faithful to assumptions of their borrowed theory, the results they obtain can be misleading (Murray et al., 1995). Collapse

Topics: outsourcing marketing management task uncertainty reference discipline

Methods: theory development longitudinal research

Theories: agency theory transaction cost economics

CONTEXTUAL FACTORS INFLUENCING THE PURPOSEFUL ALLOCATION OF BUSINESS INTELLIGENCE COSTS

2016 | European Conference On Information Systems | Citations: 0

Authors: Epple, Johannes

Abstract: Today, business intelligence (BI) systems are recognized as a prerequisite for o ... Expand

Abstract: Today, business intelligence (BI) systems are recognized as a prerequisite for organizational success by providing management with decision-supportive information. Along with the pervasion of BI in organizations and its prospective benefits, BI has become widely established from a technological perspective, but remains challenging from an organizational view. Because BI causes a high monolithic cost block within an organization, effective BI cost management mechanisms need to be implemented. This study focusses on the different design situations of BI cost allocations since a one-size-fits-all approach is not supposed to be purposeful, but different situational requirements need to be considered. The design situations are characterized by relevant contextual factors, which we identify and thoroughly analyze. A set of relevant contextual factors is derived from an extensive review of prior work as well as from a focus group study with subject-matter experts. The contextual factors are synthesized in a classification scheme according to the dimensions objectives, technology-, organization-, and environment-related. Further, we discuss the characteristics of contextual factors and the impacts on cost allocation configurations in three archetypes of companies. Therefore, this publication delivers valuable insights for consideration in practice and stimulates further research on context-specific BI cost management. Collapse

Topics: cost accounting IS management IT investment top management support innovation management

Methods: literature study synthesis focus group design science structured literature research