Results

Found 94 articles

Clear filters

Explain AI-Based Essay Scorings without XAI - Empirical Investigation of an User-Centered UI Design for AI-Based AES Systems

2023 | Americas Conference on Information Systems | Citations: 0
Authors: Hartmann, Philipp; Hobert, Sebastian

Abstract: The lack of understandability of AI-based decisions is increasingly posing trus ... Expand

Abstract: The lack of understandability of AI-based decisions is increasingly posing trust-related and regulatory problems. This also applies to the educational sector, where AI is a central element of modern automated essay scoring (AES) systems. However, current research on explainable AI primarily focuses on complex technical approaches. These explanations usually show a lack of understandability by the actual users, who often have no knowledge of AI. Based on an experiment with 245 students at a German university, we were able to show that even the basic principles of user interface design can improve understandability and hereby trustworthiness. Thus, the use of visual elements promotes understandability even when only little information is provided. Especially when providing further AI-specific information on the scoring of AES systems, however, it must be considered that in combination with visual elements an information congruency can be observed, leading to a cognitive overload in the worst case. Collapse

Semantic filters: cognitive load theory

Topics: artificial intelligence user interface usability explainable artificial intelligence shapley additive explanation

Methods: survey mediation analysis descriptive statistic data transformation confirmatory factor analysis

Theories: cognitive load theory
Chatbot commerce—How contextual factors affect Chatbot effectiveness
PDF
2023 | Electronic Markets | Citations: 0
Authors: Hsu, Pei-Fang; Nguyen, Tuan (Kellan); Wang, Chen-Ya; Huang, Pei-Ju

Abstract: The emergence of Chatbots has attracted many firms to sell their merchandise via ... Expand

Abstract: The emergence of Chatbots has attracted many firms to sell their merchandise via chats and bots. Although Chatbots have received tremendous interest, little is understood about how different usage contexts affect Chatbots’ effectiveness in mobile commerce. Due to differences in their nature, not all shopping contexts are suitable for Chatbots. To address this research gap, this study examines how contextual factors (i.e., intrinsic task complexity that embraces shopping task attributes and group shopping environment, and extrinsic task complexity that entails information intensity) affect user perceptions and adoption intentions of Chatbots as recommendation agents in mobile commerce. Applying the lenses of cognitive load theory (CLT) and common ground theory (CGT), we perform an experiment and apply quantitative analytical approaches. The results show that Chatbots are more suitable in the context of one-attribute, information-light, and group-buying tasks, whereas traditional Apps are suitable for multi-attribute, information-intensive, and single-buying scenarios. These findings make important theoretical contributions to the IT adoption literature as well as to CLT and CGT theory by contextualizing the evolving state of Chatbot commerce and providing guidelines for designing better Chatbot user experiences, thereby enhancing user perceptions and adoption intentions. Collapse

Semantic filters: cognitive load theory

Topics: mobile application task complexity electronic commerce technology adoption recommender system

Methods: chatbot experiment qualitative interview chi squared test survey

Theories: cognitive load theory
Empowering Users with Narratives: Examining the Efficacy of Narratives for Understanding Data-Oriented Conceptual Models
PDF
2023 | Information Systems Research | Citations: 0
Authors: Hvalshagen, Merete; Lukyanenko, Roman; Samuel, Binny M.

Abstract: With the ongoing digitalization of human society, regular employees (e.g., nonin ... Expand

Abstract: With the ongoing digitalization of human society, regular employees (e.g., noninformation technology experts) become increasingly autonomous and proactive in using organizational data and information technologies to facilitate data-driven actions and insights. This growing autonomy of regular employees (dubbed here, empowered users) in using information technologies creates new challenges. As most empowered users lack sophisticated information technology skills, they struggle to find and access relevant data, understand their meaning, and extract and adapt them to meet their needs. We propose a powerful way to support empowered users with a combination of conceptual models and narratives. A data narrative is a descriptive and textual representation of one or more aspects of data in a domain that is organized and presented as a connected sequence of sentences in a natural language. We assess the efficacy of narrative representations for conceptual modeling cardinality constraints, which are an essential part of understanding data. We conducted two laboratory experiments and found a positive and strong effect for narratives: cardinality constraints that were described in the narratives were better understood than constraints only represented in the model (i.e., script). This effect was robust across cardinalities, measures, script complexities, and familiarity levels with the conceptual modeling grammar. History: Manju Ahuja, Senior Editor; Choon-Ling Sia, Associate Editor. Supplemental Material: The online appendices are available at https://doi.org/10.1287/isre.2022.1141. Collapse

Semantic filters: cognitive load theory

Topics: data management data literacy database system IT workforce analytical information system

Methods: conceptual modelling experiment entity relationship modeling design science parametric test

Theories: cognitive load theory
Designing an Augmented Reality Authoring Tool to Support Complex Tasks. A Design Science Study Using Cognitive Load Theory
PDF
2023 | DESRIST | Citations: 0
Authors: Hönemann, Kay; Konopka, Björn; Wiesche, Manuel

Abstract: Despite the potential of augmented reality (AR) to support and guide complex ind ... Expand

Abstract: Despite the potential of augmented reality (AR) to support and guide complex industrial tasks, the technology is still not broadly applied. One possible reason for this is that the creation of AR content is highly complex and requires programming skills and deep spatial knowledge. AR authoring tools can help address this complexity by enabling non-developers to create self-sufficient AR content. Therefore, this paper proposes a theory-driven design for AR authoring tools that allows non-developers to create self-sufficient AR-based instructions to support complex tasks. Based on ten interviews with experts working with AR authoring tools and a following focus group with eight participants, we propose three design principles for future AR authoring tools in the engineering context. These design principles are instantiated in two prototypes of different richness and evaluated in an experiment with 23 students. Our study shows that the cognitive load is slightly increased when using the extensive AR authoring tool, but it also shows that significantly better results can be achieved with the extensive AR authoring tool. We contribute by providing design principles for AR authoring tools for creating AR-based instructions, which extend the existing AR authoring research in the industrial context. Collapse

Semantic filters: cognitive load theory

Topics: ease of use augmented reality task productivity smart device tablet

Methods: design artifact design principle experiment descriptive statistic design science

Theories: cognitive load theory
Bringing Light into the Dark - Improving Students’ Black-Box Testing Competencies using Game-Design Elements

2023 | International Conference on Information Systems | Citations: 0
Authors: Jokisch, Christine; Hobert, Sebastian; Schumann, Matthias

Abstract: As software becomes increasingly complex, there is a growing need to enhance qu ... Expand

Abstract: As software becomes increasingly complex, there is a growing need to enhance quality assurance in software engineering. However, the lack of qualified human resources is a barrier to performing software testing activities in software companies. At the same time, software testing can be considered a tedious task and is often not done at the necessary level of detail, e.g., designing test cases. However, it is crucial for novice programmers and testers to acquire and improve their testing competencies, and to utilize testing techniques, e.g., black-box testing. Teaching software testing is often based on theoretical instructions, resulting in limited practical experience. As a result, students may not develop the necessary testing mindset, highlighting the need for more extensive software testing education. To address this issue, this paper utilizes a design science research approach to implement a gamified learning system that promotes black-box testing competencies with empirical insights from a field test. Collapse

Semantic filters: cognitive load theory

Topics: online learning system usability perceived usefulness gamification web application

Methods: design artifact testing descriptive statistic correlation analysis design science survey

Theories: self determination theory cognitive load theory
A DEVOPS PERSPECTIVE: THE IMPACT OF ROLE TRANSITIONS ON SOFTWARE SECURITY CONTINUITY

2023 | European Conference On Information Systems | Citations: 0
Authors: Kam, Hwee-Joo; D’Arcy, John

Abstract: Prior studies have claimed that, with evolving technologies, continuity process ... Expand

Abstract: Prior studies have claimed that, with evolving technologies, continuity processes in Development and Operations (DevOps) needs to be re-evaluated consistently. In this context, this study examines a relatively new continuity process --continuous software security. With regulatory compliance and ubiquitous cyberattacks, it becomes increasingly important to integrate security into DevOps. Presently, DevOps developers assume the role of systems operators and software developers to facilitate Continuous Integration/Continuous Deployment (CI/CD). Assuming multiple roles involves role transitioning that requires developers to psychologically disengage from their current role and engage in another. Gradually, this may cause mental exhaustion. Therefore, implementing continuous security may add more complexity to DevOps, instigating more stress to software developers. Given this concern, we draw on Role Transition Theory and Cognitive Load Theory to examine whether integrating security into DevOps would aggravate developers' job burnout, which would eventually undermine continuous security practices. Collapse

Semantic filters: cognitive load theory

Topics: devops software developer IT security information security practice systems development

Methods: theory development literature study

Theories: cognitive load theory
A Design Theory for Certification Presentations
PDF
2023 | ACM SIGMIS Database | Citations: 0
Authors: Lins, Sebastian; Becker, Jan-Michael; Lyytinen, Kalle; Sunyaev, Ali

Abstract: Prior information system research remains inconsistent of the effects of system ... Expand

Abstract: Prior information system research remains inconsistent of the effects of system certifications. In their current use, certifications are often reduced to graphical seals. This approach fails to incorporate detailed assurance information emanating from the certification process. To address this gap, we adopt a design science approach and deploy a four-phase research design to clarify how to design impactful IS certification presentations. First, we identify sources of users' limited understanding of seals and formulate a design proposal for a certification presentation by drawing upon the elaboration likelihood model. In the second phase, we formulate and validate a set of design meta-requirements and guidelines to improve certification presentation, using cognitive load theory and Toulmin's model of argumentation as kernel theories. In the third phase, new certification presentations that comply with the proposed guidelines are developed and evaluated for their effectiveness. We show that presentations that augment seal-based certification presentations with richer assurance information improve certification effectiveness. This increases users' assurance and trust perceptions when the presentations align with the users' cognitive information processing needs in ways that reduce their cognitive load and enhance argument quality of assurance information. Collapse

Semantic filters: cognitive load theory

Topics: cloud computing website information privacy concern cloud storage data quality

Methods: experiment design guideline experimental group survey design artifact

Theories: argumentation theory dual-system theory cognitive load theory elaboration likelihood model
Exploring Future Personalization Opportunities in Technologies used by Older Adults with Mild to Moderate Dementia

2023 | HICSS | Citations: 0
Authors: Wood, Rachel; Dixon, Emma; Elsayed-Ali, Salma; Shokeen, Ekta; Lazar, Amanda; Lazar, Jonathan

Abstract: Technologies for aging are a growing market. These technologies have significant ... Expand

Abstract: Technologies for aging are a growing market. These technologies have significant potential to support individuals whose cognitive changes can make everyday activities challenging. However, the adoption and use of these technologies by people with dementia (PwD) remain poor, indicating potential accessibility and usability issues. Such barriers limit PwD’s ability to contribute to the digital economy and fully engage with society. Personalization, which aligns technology with someone’s unique needs and preferences, may address these issues. We used mixed methods with ten people with mild to moderate dementia to explore how previous ways to personalize (i.e., Windows OS built-in features and settings) and newer personalization applications (i.e., Morphic) might reveal future opportunities for personalization features in technology for aging. This study contributes fifteen design considerations, which, if implemented, may increase the involvement of PwD in the digital economy and society. Collapse

Semantic filters: cognitive load theory

Topics: usability personalization information system use user experience Microsoft Windows

Methods: design science usability testing personal interview experiment cognitive walkthrough

Theories: cognitive load theory
How Deep is your Work? The Day-to-Day Effects of Information and Communication Technology Use on Deep Work of Employees

2022 | International Conference on Information Systems | Citations: 0
Authors: Brust, Leona; Hartwich, Nicole; Breidbach, Christoph; Antons, David

Abstract: Prior empirical work provides contradictory findings on the consequences of inf ... Expand

Abstract: Prior empirical work provides contradictory findings on the consequences of information and communication technologies (ICT) use at work, indicating both positive and negative consequences for employees. Integrating insights from the deep work framework with flow literature and cognitive load theory, we build and test a dynamic theoretical model to explain these contradictory findings. We move the research perspectives of ICT use and deep work to a dynamic perspective and investigate day-to-day changes in ICT use and deep work on the within-person level. The results of our quantitative diary study (n=387) provide evidence that technical ICT use has a positive effect on deep work whereas social ICT use has an inverted U-shaped relationship with deep work. The effects of social and technical ICT use on deep work depend on workplace telepressure, work experience, and knowledge intensity of work. Collapse

Semantic filters: cognitive load theory

Topics: information system use anonymity knowledge work individual characteristic communication service infrastructure

Methods: diary study survey descriptive statistic theory development regression analysis method

Theories: cognitive load theory
Explanation Interfaces for Sales Forecasting

2022 | European Conference On Information Systems | Citations: 1
Authors: Fahse, Tobias; Blohm, Ivo; Hruby, Richard; Giffen, Benjamin van

Abstract: Algorithmic forecasts outperform human forecasts in many tasks. State-of-the-ar ... Expand

Abstract: Algorithmic forecasts outperform human forecasts in many tasks. State-of-the-art machine learning (ML) algorithms have even widened that gap. Since sales forecasting plays a key role in business profitability, ML based sales forecasting can have significant advantages. However, individuals are resistant to use algorithmic forecasts. To overcome this algorithm aversion, explainable AI (XAI), where an explanation interface (XI) provides model predictions and explanations to the user, can help. However, current XAI techniques are incomprehensible for laymen. Despite the economic relevance of sales forecasting, there is no significant research effort towards aiding non-expert users make better decisions using ML forecasting systems by designing appropriate XI. We contribute to this research gap by designing a model-agnostic XI for laymen. We propose a design theory for XIs, instantiate our theory and report initial formative evaluation results. A real-world evaluation context is used: A medium-sized Swiss bakery chain provides past sales data and human forecasts. Collapse

Semantic filters: cognitive load theory

Topics: decision quality explainable artificial intelligence artificial intelligence organizational value data literacy

Methods: design theory design principle design requirement design artifact longitudinal research

Theories: cognitive load theory theory of abduction

Page 1 of 10 Next

AIS11

Journals

Conferences

Semantic Filter

Found 94 articles

Explain AI-Based Essay Scorings without XAI - Empirical Investigation of an User-Centered UI Design for AI-Based AES Systems

Chatbot commerce—How contextual factors affect Chatbot effectiveness

Empowering Users with Narratives: Examining the Efficacy of Narratives for Understanding Data-Oriented Conceptual Models

Designing an Augmented Reality Authoring Tool to Support Complex Tasks. A Design Science Study Using Cognitive Load Theory

Bringing Light into the Dark - Improving Students’ Black-Box Testing Competencies using Game-Design Elements

A DEVOPS PERSPECTIVE: THE IMPACT OF ROLE TRANSITIONS ON SOFTWARE SECURITY CONTINUITY

A Design Theory for Certification Presentations

Exploring Future Personalization Opportunities in Technologies used by Older Adults with Mild to Moderate Dementia

How Deep is your Work? The Day-to-Day Effects of Information and Communication Technology Use on Deep Work of Employees

Explanation Interfaces for Sales Forecasting