Why it Remains Challenging to Assess Artificial Intelligence

2023 | HICSS | Citations: 0

Authors: Brecker, Kathrin; Lins, Sebastian; Sunyaev, Ali

Abstract: Artificial Intelligence (AI) assessment to mitigate risks arising from biased, u ... Expand

Abstract: Artificial Intelligence (AI) assessment to mitigate risks arising from biased, unreliable, or regulatory non-compliant systems remains an open challenge for researchers, policymakers, and organizations across industries. Due to the scattered nature of research on AI across disciplines, there is a lack of overview on the challenges that need to be overcome to move AI assessment forward. In this study, we synthesize existing research on AI assessment applying a descriptive literature review. Our study reveals seven challenges along three main categories: ethical implications, regulatory gaps, and technical limitations. This study contributes to a better understanding of the challenges in AI assessment so that AI researchers and practitioners can resolve these challenges to move AI assessment forward. Collapse

Topics: artificial intelligence societal evaluation criteria IS impact systems design problem solving

Methods: literature study literature sample qualitative content analysis computational algorithm

Augmenting the Framework for Design Science Research Goals and Evaluation Criteria with Aspects of Society 5.0

2023 | Americas Conference on Information Systems | Citations: 0

Authors: Greinacher, Janick; Nerlich, Jan-Christoph; Schäffer, Thomas

Abstract: In the field of information systems, new technologies are giving rise to a wide ... Expand

Abstract: In the field of information systems, new technologies are giving rise to a wide range of new research topics that present researchers with new challenges. Innovations, such as artificial intelligence, have an enormous impact on society, in addition to technological progress towards automation, above all or precisely because of this. In this context, Society 5.0 was initiated to establish criteria for research and its artifacts. In this paper, evaluation criteria of a Society 5.0 are identified, which should be considered for Design Science Research artifacts in the future. Through a comprehensive literature review, 14 evaluation criteria and a new DSR goal were identified and integrated into the existing framework of Hevner et al. (2018). The paper provides researchers with an augmented DSR evaluation framework with aspects of Society 5.0. Collapse

Topics: evaluation criteria industry 4.0 artificial intelligence societal evaluation criteria

Methods: literature study design artifact design science qualitative content analysis synthesis

A multivocal literature review of decentralized finance: Current knowledge and future research avenues

2023 | Electronic Markets | Citations: 2

Authors: Gramlich, Vincent; Guggenberger, Tobias; Principato, Marc; Schellinger, Benjamin; Urbach, Nils

Abstract: While decentralized finance (DeFi) has the potential to emulate and, indeed, out ... Expand

Abstract: While decentralized finance (DeFi) has the potential to emulate and, indeed, outperform existing financial systems, it remains a complex phenomenon yet to be extensively researched. To make the most of this potential, its practitioners must gain a rigorous understanding of its intricacies, as must information systems (IS) researchers. Against this background, this study uses a multivocal literature review to capture the state of research in DeFi. Thereby, we (1) present a consolidating definition of DeFi as we (2) analyze, synthesize, and discuss the current state of knowledge in the field of DeFi. We do so while adapting the blockchain research framework proposed by (Risius and Spohrer, Business & Information Systems Engineering 59:385–409, 2017). Furthermore, we (3) identify gaps in the literature and indicate future research directions in DeFi. Even though our findings highlight several shortcomings in DeFi that have prevented its widespread adoption, our literature review shows a large consensus on DeFi’s many promising features and potential to complement the traditional financial system. To that end, this paper is presented to encourage further research to mitigate the current risks of DeFi, the payoff of which will be an enriched financial ecosystem. Collapse

Topics: decentralized finance financial information system blockchain database system Ethereum

Methods: literature study literature sample structured literature research synthesis

Theories: organizational theory

MANTRA: A Topic Modeling-Based Tool to Support Automated Trend Analysis on Unstructured Social Media Data

2023 | International Conference on Information Systems | Citations: 0

Authors: Konadl, Daniel; Wörner, Janik; Schmid, Isabel; Leist, Susanne

Abstract: ... Expand

Abstract: Collapse

Topics: marketing management social media new product development social media analytics spreadsheet

Methods: topic model machine learning design theory survey kernel theory

Theories: innovation theory

An evaluation of the critical success factors impacting artificial intelligence implementation

2023 | International Journal of Information Management | Citations: 0

Authors: Merhi, Mohammad I.

Abstract: AI systems offer organizations great benefits causing decision-makers to invest ... Expand

Abstract: AI systems offer organizations great benefits causing decision-makers to invest more in these systems. The ad­ vantages of AI cannot be achieved without successful implementation. Thus, it is crucial to recognize the factors impacting the successful implementation of AI. It is also important to assess and rank these factors by their importance to assist decision-makers in implementing these systems and increasing the success rate. Due to its importance, scholars called for studies to expand our knowledge in this critical area. This paper identifies, ex­ tracts, and assesses the most critical factors that influence the implementation of AI systems. This study identifies nineteen factors and categorizes them into four categories: organization, technology, process, and environment. The analytical hierarchy process is used to evaluate the factors and the categories. The analysis offers two types of results, at the category level and the level of the factors. The results indicate that technology is the most significant of the four categories. The results also suggest that ethics is the most crucial factor among all nineteen factors. The order of all factors and discussions of the implications of the findings for practice and research are presented in the paper. Collapse

Topics: artificial intelligence top management support critical success factor organizational culture systems implementation

Methods: trade-off analysis method analytic hierarchy process

ARTIFICIAL INTELLIGENCE IN AUGMENTATIVE AND ALTERNATIVE COMMUNICATION SYSTEMS - A LITERATURE-BASED ASSESSMENT AND IMPLICATIONS OF DIFFERENT CONVERSATION PHASES AND CONTEXTS

2023 | European Conference On Information Systems | Citations: 0

Authors: Konadl, Daniel; Wörner, Janik; Luttner, Lucas; Leist, Susanne

Abstract: ... Expand

Abstract: Collapse

Topics: artificial intelligence database system

Methods: literature study literature sample structured literature research qualitative content analysis deep learning

Factors Enabling and Hindering Value Co-Creation in Continuous Service Development: A Systematic Literature Review

2022 | HICSS | Citations: 0

Authors: Elo, Jenny; Lumivalo, Juuli; Tuunanen, Tuure; Salo, Markus

Abstract: This paper presents a systematic literature review (SLR) investigating the facto ... Expand

Abstract: This paper presents a systematic literature review (SLR) investigating the factors that enable and hinder value co-creation in organizations’ continuous service development processes. Employing the lens of servicedominant (S-D) logic, we classify the identified factors into three interrelated dimensions: institutions, resources, and service exchange. Our systematic findings may inform organizations’ efforts to support the emergence of positive rather than negative value outcomes when implementing continuous practices in their service development. In addition, we outline avenues for further research in this emerging topic area. Collapse

Topics: participatory design database system devops innovation management systems development

Methods: structured literature research design methodology literature sample literature study synthesis

Theories: service-dominant logic

A Literature Review on the Risks and Potentials of Tracking and Monitoring eHealth Technologies in the Context of Occupational Health Management

2022 | International Conference on Business Informatics | Citations: 0

Authors: Hall, Kristina; Oesterle, Severin; Watkowski, Laura; Liebel, Sabrina

Abstract: Employee health is increasingly important, as is the use of eHealth technologies ... Expand

Abstract: Employee health is increasingly important, as is the use of eHealth technologies in the private and the organizational context. This paper examines which existing eHealth technologies that support monitoring and tracking of health are applied in occupational health management (OHM) and investigates the advantages and disadvantages of their application. To pursue this intention, we analyze the current state of research with a structured literature review and provide a comprehensive overview of relevant works. The results point out advantages and disadvantages that provide the groundwork to discuss success factors for tracking and monitoring eHealth technologies in OHM. The derived success factors aim at operational, technological, operational/technological aspects of eHealth tracking and monitoring usage. Thereby, favorable outcomes such as an increase in employee health can be achieved, and participation in OHM measures can be increased. However, it can also lead to adverse outcomes such as a reduced work-life balance. Collapse

Topics: electronic health database system mobile health mobile system user experience

Methods: literature study wearables based research structured literature research mixed method

A nascent design theory for explainable intelligent systems

2022 | Electronic Markets | Citations: 3

Authors: Herm, Lukas-Valentin; Steinbach, Theresa; Wanner, Jonas; Janiesch, Christian

Abstract: Due to computational advances in the past decades, so-called intelligent systems ... Expand

Abstract: Due to computational advances in the past decades, so-called intelligent systems can learn from increasingly complex data, analyze situations, and support users in their decision-making to address them. However, in practice, the complexity of these intelligent systems renders the user hardly able to comprehend the inherent decision logic of the underlying machine learning model. As a result, the adoption of this technology, especially for high-stake scenarios, is hampered. In this context, explainable artificial intelligence offers numerous starting points for making the inherent logic explainable to people. While research manifests the necessity for incorporating explainable artificial intelligence into intelligent systems, there is still a lack of knowledge about how to socio-technically design these systems to address acceptance barriers among different user groups. In response, we have derived and evaluated a nascent design theory for explainable intelligent systems based on a structured literature review, two qualitative expert studies, a real-world use case application, and quantitative research. Our design theory includes design requirements, design principles, and design features covering the topics of global explainability, local explainability, personalized interface design, as well as psychological/emotional factors. Collapse

Topics: explainable artificial intelligence artificial intelligence usability human computer interaction decision support

Methods: design theory design principle design science design requirement qualitative interview

Customer models for artificial intelligence-based decision support in fashion online retail supply chains

2022 | Decision Support Systems | Citations: 0

Authors: Pereira, Artur M.; Moura, J. Antão B.; Costa, Evandro De B.; Vieira, Thales; Landim, André R.D.B.; Bazaki, Eirini; Wanick, Vanissa

Abstract: Fashion is a global, multi-trillion dollar industry devoted to producing and sel ... Expand

Abstract: Fashion is a global, multi-trillion dollar industry devoted to producing and selling clothing, footwear, and ac­ cessories to individuals or groups of people. Its sheer numbers, together with social and environmental sus­ tainability concerns, and the move towards digitalization of customer-centric operations, make the fashion business a prime target for Decision Support Systems (DSSs). On the other hand, decision support in fashion retail is particularly problematic and embraces all major supply chain domains. Decisions in an online fashion retail supply chain (FRSC) are highly dependent on time-varying customers' preferences and product availability, often leading to a combinatorial explosion. To address such a problem, DSSs could greatly benefit from high-quality information stored in customer models (CMs), constructed by using Artificial Intelligence techniques, allowing informed decisions on how to personalize (adapt) to match the customer's needs and preferences. Combinations of CMs with recommender systems (RSs) have been increasingly utilized in fashion e-commerce to provide personalized product recommendations. Nevertheless, works on enhancing CMs for e-commerce or other decision-making chain domains are scanty. This paper offers a systematic review of the literature on fashion CMs with applications to decision-making in FRSCs, mining topics for a research agenda. Research on the theme is relevant and urgent for the fashion business, which is still in its infancy. Work on the agenda topics could benefit distinct fashion stakeholders, not just customers, and produce well-grounded decision-making in varied FRSC contexts and dynamics. Collapse

Topics: artificial intelligence decision support decision making recommender system database system

Methods: structured literature research computational algorithm literature study machine learning literature sample