Results

Found 24 articles

Clear filters

Beyond Dashboards? Designing Data Stories for Effective Use in Business Intelligence and Analytics

2023 | European Conference On Information Systems | Citations: 0
Authors: Gunklach, Jonas; Jacob, Katharina; Michalczyk, Sven

Abstract: With the proliferation of Business Intelligence and Analytics, data storytellin ... Expand

Abstract: With the proliferation of Business Intelligence and Analytics, data storytelling has gained increasing importance to improve communicating analytical insights to business users and support decision-making. While conceptual research on data storytelling suggests that these techniques can help improve decisionmaking, there is a lack of prescriptive knowledge on how to design data stories in Business Intelligence and Analytics. Moreover, it is not understood how data stories can facilitate effective use and support decision-making of business users. To address this challenge, we conduct a Design Science Research (DSR) project. Drawing on the theory of effective use and data storytelling techniques, we propose three design principles that we instantiate in a prototype. The results of two focus groups indicate that enhancing dashboards with data storytelling techniques increases transparent interaction and representational fidelity. Our DSR project contributes novel design knowledge for data stories that facilitate effective use. Collapse

Semantic filters: theory of effective use

Topics: digital dashboard data visualization analytical information system database system decision making

Methods: literature study focus group qualitative interview literature sample design principle

Theories: theory of effective use
Beyond effective use: Integrating wise reasoning in machine learning development
PDF
2023 | International Journal of Information Management | Citations: 0
Authors: Namvar, Morteza; Intezari, Ali; Akhlaghpour, Saeed; Brienza, Justin P.

Abstract: The introduction of machine learning (ML), as the engine of many artificial inte ... Expand

Abstract: The introduction of machine learning (ML), as the engine of many artificial intelligence (AI)-enabled systems in organizations, comes with the claim that ML models provide automated decisions or help domain experts improve their decision-making. Such a claim gives rise to the need to keep domain experts in the loop. Hence, data scientists, as those who develop ML models and infuse them with human intelligence during ML devel opment, interact with various ML stakeholders and reflect their views within ML models. This interaction comes with (often conflicting) demands from various ML stakeholders and potential tensions. Building on the theories of effective use and wise reasoning, this mixed method study proposes a model to better understand how data scientists can use wisdom for managing these tensions when they develop ML models. In Study 1, through interviewing 41 analytics and ML experts, we investigate the dimensions of wise reasoning in the context of ML development. In Study 2, we test the overall model using a sample of 249 data scientists. Our results confirm that to develop effective ML models, data scientists need to not only use ML systems effectively, but also practice wise reasoning in their interactions with domain experts. We discuss the implications of these findings for research and practice. Collapse

Semantic filters: theory of effective use

Topics: decision making human in the loop human computer interaction mobile system internet of things

Methods: conceptual modelling qualitative interview survey partial least squares path modeling descriptive statistic

Theories: big five model theory of effective use
Designing Conversational Dashboards for Effective Use in Crisis Response
PDF
2023 | Journal of the Association for Information Systems | Citations: 0
Authors: Ruoff, Marcel; Gnewuch, Ulrich; Maedche, Alexander; Scheibehenne, Benjamin

Abstract: Governments and health organizations are increasingly using dashboards to provi ... Expand

Abstract: Governments and health organizations are increasingly using dashboards to provide real-time information during natural disasters and pandemics. Although these dashboards aim to make crisisrelated information accessible to the general public, the average user can have a hard time interacting with them and finding the information needed to make everyday decisions. To address this challenge, we draw on the theory of effective use to propose a theory-driven design for conversational dashboards intended for crisis response that can improve users' transparent interaction with these dashboards and facilitate access to crisis-related information during crises. We instantiate our proposed design in a conversational dashboard for the COVID-19 pandemic that enables natural language interaction in spoken or written form and helps users familiarize themselves with the use of natural language through conversational onboarding. The evaluation of our artifact shows that being able to use natural language improves users' interaction with the dashboard and ultimately increases their efficiency and effectiveness in finding information. This positive effect is amplified when users complete the onboarding before interacting with the dashboard, particularly when they can use both natural language and mouse interaction. Our findings contribute to research on dashboard design, both in general and in the specific context of crisis response, by providing prescriptive knowledge for extending crisis response dashboards with natural language interaction capabilities. In addition, our work contributes to the democratization of data science by proposing design guidelines for making information on crisis response dashboards more accessible to the general public.Marcel Ruoff is a PhD student at Karlsruhe Institute of Technology, Germany. His research focuses on the intersection between information systems and human-computer interaction by designing and developing the next generation of user interfaces for end users with limited knowledge of the systems they use. In particular, he investigates how to utilize natural language to support end users in effectively using dashboards for their data exploration and analysis and how to enable these end users to effectively teach the conversational user interfaces how to perform new natural language inputs. Collapse

Semantic filters: theory of effective use

Topics: digital dashboard usability human computer interaction pandemic data visualization

Methods: experiment natural language processing design theory design artifact kernel theory

Theories: theory of affordance theory of effective use information systems theory
Towards Designing Smart Home Energy Applications for Effective Use
PDF
2022 | DESRIST | Citations: 1
Authors: Bluhm, Saskia; Staudt, Philipp; Weinhardt, Christof

Abstract: To reduce climate change, considerable behavioral changes are required from priv ... Expand

Abstract: To reduce climate change, considerable behavioral changes are required from private households, who often have a low energy literacy and are therefore unaware of the necessary behavioral change. Collapse

Semantic filters: theory of effective use

Topics: smart home energy information system data visualization frequency of use user centered design

Methods: survey design artifact design science literature study qualitative interview

Theories: theory of effective use
The Impact of Conversational Assistance on the Effective Use of Forecasting Support Systems: A Framed Field Experiment

2022 | International Conference on Information Systems | Citations: 0
Authors: Haug, Saskia; Ruoff, Marcel; Gnewuch, Ulrich

Abstract: Forecasting support systems (FSSs) support demand planners in important forecas ... Expand

Abstract: Forecasting support systems (FSSs) support demand planners in important forecasting decisions by offering statistical forecasts. However, planners often rely on their judgment more than on system-based advice which can be detrimental to forecast accuracy. This is caused by a lack of understanding and subsequent lack of trust in the FSS and its advice. To address this problem, we explore the potential of extending the traditional static assistance (e.g., manuals, tooltips) with conversational assistance provided by a conversational assistant that answers planners' questions. Drawing on the theory of effective use, we aim to conduct a framed field experiment to investigate whether conversational (vs. static) assistance better supports planners in learning the FSS, increases their trust, and ultimately helps them make more accurate forecasting decisions. With our findings, we aim to contribute to research on FSS design and the body of knowledge on the theory of effective use. Collapse

Semantic filters: theory of effective use

Topics: conversational agent

Methods: field experiment experiment structural equation modeling experimental task experimental group

Theories: theory of effective use
Applying and Extending the Theory of Effective Use in a Business Intelligence Context

2022 | Management Information Systems Quarterly | Citations: 6
Authors: Trieu, Van-Hau; Burton-Jones, Andrew; Green, Peter; Cockcroft, Sophie

Abstract: The benefits that organizations accrue from information systems depend on how ef ... Expand

Abstract: The benefits that organizations accrue from information systems depend on how effectively the systems are used. Yet despite the importance of knowing what it takes to use information systems effectively, little theory on the topic exists. One recent and largely untested exception is the theory of effective use (TEU). We report on a contextualization, extension, and test of TEU in the business intelligence (BI) context, a context of considerable importance in which researchers have called for such studies. We used a mixed methods, three-phase approach involving instrument development (n = 218), a two-wave cross-sectional survey (n = 437), and three sets of follow-up interviews (n = 33). The paper contributes by (1) showing how TEU can be contextualized, operationalized, and extended, (2) demonstrating that many of TEU’s predictions hold in the BI context while also revealing ways to improve the theory, and (3) offering practical insights that executives can draw on to improve the use of BI in their organizations. Collapse

Semantic filters: theory of effective use

Topics: data integration decision making system quality data quality decision support system

Methods: qualitative interview survey mixed method literature sample data transformation

Theories: representation theory theory of effective use
Timeliness, Trustworthiness, and Situational Awareness: Three Design Goals for Warning with Emergency Apps

2021 | International Conference on Information Systems | Citations: 0
Authors: Bonaretti, Dario; Fischer-Pressler, Diana

Abstract: Emergency warning apps are critical to alert the population during emergencies, ... Expand

Abstract: Emergency warning apps are critical to alert the population during emergencies, but are countries using them effectively? There is little theoretical understanding of what it means to use warning apps effectively. As a result, there is also little knowledge about how to design them. Drawing on the Theory of Effective Use (TEU) (Burton-Jones and Grange, 2013), this research proposes three principles to design emergency apps: 1) Designing for timeliness; 2) Designing for trustworthiness; 3) Designing for situational awareness. We derived these principles from studying how different dimensions of use interact with each other by looking at users' feedback (online reviews) about two German mobile warning apps: NINA and Katwarn. Collapse

Semantic filters: theory of effective use

Topics: mobile application online review emergency warning system situational awareness emergency management

Methods: theory development kernel theory design requirement design principle qualitative content analysis

Theories: theory of effective use representation theory
Understanding IT Value at the Managerial Level: Managerial Ambidexterity, Seizing Opportunities, and the Moderating Role of Information Systems Use
PDF
2021 | ACM SIGMIS Database | Citations: 0
Authors: Roberts, Nicholas; Qahri-Saremi, Hamed; Vijayasarathy, Leo R.

Abstract: Managerial ambidexterity is an important precursor to managerial seizing ability ... Expand

Abstract: Managerial ambidexterity is an important precursor to managerial seizing ability. However, ambidexterity can impose substantial costs. Yet information systems may help reduce these costs. We develop a model that includes an inverted U-shaped relationship between managerial ambidexterity and seizing ability. We propose that a manager's effective use of management support systems will mitigate the decline in seizing ability at higher levels of ambidexterity. We test our model with data collected over two time periods from 172 managers. Our results support our model, thereby generating implications for research and practice in IT value, managerial ambidexterity, and dynamic managerial capabilities. Collapse

Semantic filters: theory of effective use

Topics: information system use IS value top management support organizational innovation value creation

Methods: survey ordered probit regression statistical hypothesis test descriptive statistic survey design

Theories: theory of effective use dynamic capabilities theory
Designing Conversational Dashboards for Effective Use in Crisis Response

2021 | European Conference On Information Systems | Citations: 4
Authors: Ruoff, Marcel; Gnewuch, Ulrich

Abstract: ... Expand

Abstract: Collapse

Semantic filters: theory of effective use

Topics: digital dashboard pandemic Microsoft Power BI business intelligence usability

Methods: design principle experiment survey qualitative interview literature study

Theories: theory of effective use
Designing Multimodal BI&A Systems for Co-Located Team Interactions

2021 | European Conference On Information Systems | Citations: 0
Authors: Ruoff, Marcel; Gnewuch, Ulrich

Abstract: Teams are crucial for organizations in making data-driven decisions. However, c ... Expand

Abstract: Teams are crucial for organizations in making data-driven decisions. However, current business intelligence & analytics (BI&A) systems are primarily designed to support individuals and, therefore, cannot be used effectively in co-located team interactions. To address this challenge, we conduct a design science research (DSR) project to design a multimodal BI&A system providing touch and speech interactions that can be used effectively by teams. Drawing on the theory of effective use and existing guidelines for multimodal user interfaces, we propose three design principles and instantiate them in a software artifact. The results of a focus group evaluation indicate that enhancing the BI&A system with multimodal capabilities increases transparent interaction and facilitates effective use of the system in co-located team interactions. Our DSR project contributes novel design knowledge for multimodal BI&A systems with touch and speech modalities that facilitate effective use in co-located team interactions. Collapse

Semantic filters: theory of effective use

Topics: analytical information system co-located work user experience accounting affordance

Methods: design principle focus group design artifact literature study design science

Theories: theory of effective use theory of affordance

Page 1 of 3 Next

AIS11

Journals

Conferences

Semantic Filter

Found 24 articles

Beyond Dashboards? Designing Data Stories for Effective Use in Business Intelligence and Analytics

Beyond effective use: Integrating wise reasoning in machine learning development

Designing Conversational Dashboards for Effective Use in Crisis Response

Towards Designing Smart Home Energy Applications for Effective Use

The Impact of Conversational Assistance on the Effective Use of Forecasting Support Systems: A Framed Field Experiment

Applying and Extending the Theory of Effective Use in a Business Intelligence Context

Timeliness, Trustworthiness, and Situational Awareness: Three Design Goals for Warning with Emergency Apps

Understanding IT Value at the Managerial Level: Managerial Ambidexterity, Seizing Opportunities, and the Moderating Role of Information Systems Use

Designing Conversational Dashboards for Effective Use in Crisis Response

Designing Multimodal BI&A Systems for Co-Located Team Interactions