When Learning Turns To Surveillance -Using Pedagogical Agents in Organizations

2023 | HICSS | Citations: 0

Authors: Bucher, A.; Schenk, B.; Schwabe, G.

Abstract: Workplace learning is often used to train employees systematically. New in this ... Expand

Abstract: Workplace learning is often used to train employees systematically. New in this context is workplace learning with the help of a pedagogical agent (PA). Following Actions Design Research (ADR), this paper describes organizational training for telephone service using such PA. To develop the training, existing employee telephone service problems were analyzed, and the content of the learning program was determined based on this analysis. Subsequently, a PA was developed, implemented, and used in three municipalities. The evaluation of the learning outcome shows promising results but also yields some challenges: even though the employees improved in various aspects of the learning, they also developed a perception of surveillance. This research concludes with the formulation of design principles and suggestions for the organizational embedding of a PA in a workplace setting. Collapse

Topics: telephone human computer interaction usability Java user centered design

Methods: survey design principle design artifact design science natural language processing

Governance of Digital Health Data on Cooperatively Organized Platforms – a Design Thinking Approach

2023 | HICSS | Citations: 0

Authors: Burmann, Anja; Langer, Henrike; Bosompem, Jennifer; Clemens, Timo; Herten, Benjamin; Kerstan, Leah; Lauer, Romy; Naeve, Peter; Geller, Simon; Huhnt, Jönne; Merkel, Sebastian

Abstract: More and more stakeholders are collecting data for improving their services: fro ... Expand

Abstract: More and more stakeholders are collecting data for improving their services: from scientific research over public administration to commercial enterprises. Existing data management services offer few rights of co-determination for their users. Data cooperatives aim to provide a democratic alternative to this. Through such a platform cooperative members are supposed to be enabled to share their data in a self-determined way. In this paper, we present a design thinking-based user research with stakeholders of data cooperatives in a health-data context. We provide an overview of motivations, expectations, and interfaces between a cooperative and individuals as cooperative members, organizations, representatives from research, and policy makers. In an iterative process, 34 interviews were conducted with different stakeholder groups, from which 7 personas were subsequently derived. For these, 4 prototypes were developed and tested with potential users. Our results show that all interviewed groups were very interested in the concept of data cooperatives. At the same time, it proves challenging to reconcile the conflicting internal and external requirements and to implement attractive value propositions for all stakeholders. Collapse

Topics: design thinking healthcare data user centered design value creation organization structure

Methods: qualitative interview design methodology design artifact literature sample literature study

Artificial Intelligence (AI) Student Assistants in the Classroom: Designing Chatbots to Support Student Success

2023 | Information Systems Frontiers | Citations: 1

Authors: Chen, Yu; Jensen, Scott; Albert, Leslie J.; Gupta, Sambhav; Lee, Terri

Abstract: In higher education, low teacher-student ratios can make it difficult for studen ... Expand

Abstract: In higher education, low teacher-student ratios can make it difficult for students to receive immediate and interactive help. Chatbots, increasingly used in various scenarios such as customer service, work productivity, and healthcare, might be one way of helping instructors better meet student needs. However, few empirical studies in the field of Information Systems (IS) have investigated pedagogical chatbot efficacy in higher education and fewer still discuss their potential challenges and drawbacks. In this research we address this gap in the IS literature by exploring the opportunities, challenges, efficacy, and ethical concerns of using chatbots as pedagogical tools in business education. In this two study project, we conducted a chatbot-guided interview with 215 undergraduate students to understand student attitudes regarding the potential benefits and challenges of using chatbots as intelligent student assistants. Our findings revealed the potential for chatbots to help students learn basic content in a responsive, interactive, and confidential way. Findings also provided insights into student learning needs which we then used to design and develop a new, experimental chatbot assistant to teach basic AI concepts to 195 students. Results of this second study suggest chatbots can be engaging and responsive conversational learning tools for teaching basic concepts and for providing educational resources. Herein, we provide the results of both studies and discuss possible promising opportunities and ethical implications of using chatbots to support inclusive learning. Collapse

Topics: artificial intelligence IT career anonymity user experience accounting

Methods: chatbot survey qualitative interview personal interview machine learning

Designing Emerging Social Determinants of Health Apps for Novice Digital Health Users

2023 | Americas Conference on Information Systems | Citations: 0

Authors: Diaz Campo, Maria; LeRouge, Cynthia; Li, Kayla; Stefano, Troy; Ghansah, Hilary; Torres, Gabriela; Brown, David

Abstract: This paper investigates the design considerations for health information techno ... Expand

Abstract: This paper investigates the design considerations for health information technologies (HITs) that are aimed at supporting lower socioeconomic status (SES) individuals in addressing social determinants of health (SDOH) needs. While emerging technologies offer new opportunities for improving quality of life outcomes, many lower SES individuals may be novice users of digital health technologies, including SDOH technologies. To address this gap, we conducted qualitative research using user-centered design tools during the development of an app designed to help individuals address SDOH needs. Our findings provide insight into the unique characteristics, needs, and preferences of lower SES digital novices, and highlight multiple aspects of their eHealth literacy. We discuss the implications of these findings for designing and implementing HITs for novice users. Collapse

Topics: health information system user centered design information system use mobile application electronic health

Methods: design methodology qualitative interview field study focus group qualitative coding

Leveraging Low Code Development of Smart Personal Assistants: An Integrated Design Approach with the SPADE Method

2023 | Journal of Management Information Systems | Citations: 1

Authors: Elshan, Edona; Ebel, Philipp; Söllner, Matthias; Leimeister, Jan Marco

Abstract: Smart personal assistants (SPAs), such as Alexa for example, promise individuali ... Expand

Abstract: Smart personal assistants (SPAs), such as Alexa for example, promise individualized user interactions owing to their varying interaction possibilities, knowledgeability, and human-like behaviors. To support the widespread adoption and use of SPAs, organizations such as Google or Amazon provide low code environments that support the development of SPAs (e.g., for Google Home or Amazon's Alexa). These so-called low code platforms enable domain experts (e.g., business users without programming skills or experience) to develop SPAs for their purposes. However, using these platforms alone does not guarantee a useful and good conversation with novel SPAs due to non-intuitive design choices. Following a design science research approach, we propose the Smart Personal Assistant for Domain Experts (SPADE) method to address the missing link. This method supports domain experts in the development and contextualization of sophisticated SPAs for various application scenarios and focuses especially on conversational and anthropomorphic design steps. Our proof of concept and proof of value results show that SPADE is useful for supporting domain experts to create effective SPAs in different domains beyond private set-ups. Collapse

Topics: conversational agent low code development platform smart home end user development software developer

Methods: qualitative interview design artifact design science usability testing qualitative content analysis

IMPACT OF EXPLAINABLE AI ON COGNITIVE LOAD: INSIGHTS FROM AN EMPIRICAL STUDY

2023 | European Conference On Information Systems | Citations: 0

Authors: Herm, Lukas-Valentin

Abstract: While the emerging research field of explainable artificial intelligence (XAI) ... Expand

Abstract: While the emerging research field of explainable artificial intelligence (XAI) claims to address the lack of explainability in high-performance machine learning models, in practice, XAI targets developers rather than actual end-users. Unsurprisingly, end-users are often unwilling to use XAI-based decision support systems. Similarly, there is limited interdisciplinary research on end-users' behavior during XAI explanations usage, rendering it unknown how explanations may impact cognitive load and further affect end-user performance. Therefore, we conducted an empirical study with 271 prospective physicians, measuring their cognitive load, task performance, and task time for distinct implementationindependent XAI explanation types using a COVID-19 use case. We found that these explanation types strongly influence end-users' cognitive load, task performance, and task time. Further, we contextualized a mental efficiency metric, ranking local XAI explanation types best, to provide recommendations for future applications and implications for sociotechnical XAI research. Collapse

Topics: explainable artificial intelligence task productivity artificial intelligence decision support system shapley additive explanation

Methods: descriptive statistic statistical hypothesis test literature study machine learning survey

Theories: theory of abduction

Uncovering Drivers for the Integration of Dark Patterns in Conversational Agents

2023 | International Conference on Business Informatics | Citations: 0

Authors: Kollmer, Tim; Hauser, Alessa; Oberhofer, Viviana; Blossey, Gregor; Eckhardt, Andreas

Abstract: Today, organizations increasingly utilize conversational agents (CAs), which ar ... Expand

Abstract: Today, organizations increasingly utilize conversational agents (CAs), which are smart technologies that converse in a human-to-human interaction style. CAs are very effective in guiding users through digital environments. However, this makes them natural targets for dark patterns, which are user interface design elements that infringe on user autonomy by fostering uninformed decisions. Integrating dark patterns in CAs has tremendous impacts on supposedly free user choices in the digital space. Thus, we conducted a qualitative study consisting of semi-structured interviews with developers to investigate drivers of dark patterns in CAs. Our findings reveal that six drivers for the implementation of dark patterns exist. The technical drivers include heavy guidance of CAs during the conversation and the CAs' data collection potential. Additionally, organizational drivers are assertive stakeholder dominance and time pressure during the development process. Team drivers incorporate a deficient user understanding and an inexperienced team. Collapse

Topics: user experience IT development project marketing management systems development website

Methods: qualitative interview qualitative coding personal interview survey synthesis

Changebots - Designing Chatbots to Support Blood Donor Behaviour Change

2023 | International Conference on Information Systems | Citations: 0

Authors: Müller, Helena; Reuter-Oppermann, Melanie

Abstract: Even though blood products cannot be produced artificially, but are important f ... Expand

Abstract: Even though blood products cannot be produced artificially, but are important for many surgeries and treatments, less than 1 % of the population donates blood in countries like South Africa or Ghana. Therefore, efficient and successful blood donor mobilisation and management are important. We argue that a chatbot offers easy access to information for all types of donors and can support the transition of non-, first-time or lapsed donors to regular donors. By applying the design science research methodology, we have developed a chatbot for all donor types in South Africa and Ghana. We performed two design cycles, collaborating with experts from three blood services and grounding our research on existing and derived behavioural change models. The chatbot was positively evaluated in two workshops that included focus group discussions and online surveys. Collapse

Topics: Google+ website usability mobile application conversational agent

Methods: chatbot survey design science design artifact design principle

Theories: behavioral theory

Digitalising Social Protection Systems for Achieving the Sustainable Development Goals: Insights from Zimbabwe

2023 | Communications of the Association for Information Systems | Citations: 0

Authors: Ncube, Tomy; Murray, Una; Dennehy, Denis

Abstract: Social protection systems, a target of the United Nation's (UN) Sustainable Dev ... Expand

Abstract: Social protection systems, a target of the United Nation's (UN) Sustainable Development Goals (SDGs), are intended to reduce extreme poverty, build human capital, and protect against risks to sustainable livelihoods and well-being. As social protection systems are by their nature inherently complex, multi-faceted, and socially embedded, it is inevitable that tensions will emerge between their design and implementation, representing design-reality gaps. These tensions present an excellent opportunity for cross-disciplinary research, by understanding how best to bridge these designreality gaps. In this qualitative, interpretivist case study, we situate our work on the ground with the actors involved in the design, implementation, and use of a social protection system in Zimbabwe. We find interaction failures amongst some users; design-reality gaps around network access and ICT policy implementation; as well as mixed views regarding transparency and accountability of ICT. Our findings provide rich insights from ICT users in the global south and underscore the importance of the co-creation of IS interventions together with communities to ensure technologies consider social, political, economic, and network realities. We conclude by providing directions for future research. Collapse

Topics: user centered design IT policy innovation management climate change Sustainable Development Goal

Methods: qualitative interview case study design methodology personal interview qualitative content analysis

Augmented Reality Technology to Facilitate Proficiency in Emergency Medical Procedures

2023 | HICSS | Citations: 0

Authors: O'Connor, Laurel; Zamani, Sepahrad; Porter, Liam; Mcgeorge, Nicolette; Latiff, Susan; Boardman, Timothy; Loconte, Matthew; Weiner, Michael; Mcgarry, Eileen; Pina, Felipe; Acevedo Herman, Jorge; Milsten, Andrew; Reznek, Martin; Broach, John

Abstract: Background: Augmented reality (AR) conveys an experience during which the user’s ... Expand

Abstract: Background: Augmented reality (AR) conveys an experience during which the user’s real-time environment is enhanced by computer-generated perceptual information; it is being investigated as a solution to enhance medical education and clinical practice. There is little literature on its utility for teaching emergency procedures. Methods: A within-subjects trial was performed comparing traditional training to AR guidance for two emergency procedures. Lay-subjects and emergency medical technicians received video training and AR guidance for performing bag-valve-mask ventilation and needle-decompression. Subjects performed both procedures in a simulation setting after each training modality. Subject performance, acceptability and usability were analyzed. Results: There was no difference in procedural performance between lay or EMT subjects for AR training, and no difference in subject-reported usefulness between the AR and control training. Conclusion: AR mediated guidance for emergency medical procedures is feasible and efficacious. Subject performance after AR training was statistically undistinguishable from a didactic educational modality. Collapse

Topics: usability smart device augmented reality lean manufacturing smart glass

Methods: simulation survey post-hoc analysis design artifact parametric test