scispace - formally typeset
Search or ask a question
Dissertation•DOI•

Measuring the speed and efficacy of clinical decision-making when comparing two different data visualizations for medications

Andrew H. Hutson
01 Jan 2016-
TL;DR: This chapter describes the development of the method and some of the basic principles that went into its development.
Abstract: ....................................................................................................................... viii CHAPTER 1: BACKGROUND OF THE STUDY ........................................................................

Summary (1 min read)

Jump to:  and [Summary]

Summary

  • The percentage of patients with polypharmacy needs is increasing among a growing patient population.
  • As a result, the amount of time health care professionals require to make clinical decisions based on current and past medications is increasing.
  • The goal of this study is to demonstrate how modifying the data visualization for patient medication histories will change decision making speed or efficacy.
  • The authors compared two groups across five randomized blocks.
  • Group 1 responded to questions based on the control data visualizations derived from an existing electronic health record.
  • Block 1 asks the participant to identify current prescriptions.
  • Block 4 asks the participant to identify all new prescriptions in a given time interval.
  • Each block holds two questions, identical in wording, differing only on the visualization presented to the participant.
  • The survey is configured to randomly present one question from each block to each participant.
  • Regardless of the question presented, the authors additionally track the response time for each block measured as the last click on the survey page before the "submit" or "next" button is clicked.
  • A total of 112 observations were collected across five randomized blocks.

Did you find this useful? Give us your feedback

Content maybe subject to copyright    Report

Public Abstract
First Name:Andrew
Middle Name:Hargrove
Last Name:Hutson
Adviser's First Name:Suzanne
Adviser's Last Name:Boren
Co-Adviser's First Name:
Co-Adviser's Last Name:
Graduation Term:SP 2016
Department:Informatics
Degree:PhD
Title:Measuring the Speed and Efficacy of Clinical Decision-Making When Comparing Two Different Data
Visualizations for Medications
Background: The percentage of patients with polypharmacy needs is increasing among a growing patient
population. As a result, the amount of time health care professionals require to make clinical decisions
based on current and past medications is increasing. Health care professionals need methods for
increasing the speed of clinical decision making without sacrificing the quality of care. The goal of this
study is to demonstrate how modifying the data visualization for patient medication histories will change
decision making speed or efficacy.
Methods: We compared two groups across five randomized blocks. Group 1 responded to questions based
on the control data visualizations derived from an existing electronic health record. Group 2 responded to
questions based on the experimental data visualization based on a medication history developed by a team
led by Dr. Jeffrey Belden. All medical information presented to both groups is identical.
Each block represents a core clinical task associated with leveraging the medication history for a clinical
decision extrapolated from anecdotal scenarios in primary care. Block 1 asks the participant to identify
current prescriptions. Block 2 asks the participant to identify past prescriptions. Block 3 asks the participant
to identify the length of time a patient has been prescribed a specific drug. Block 4 asks the participant to
identify all new prescriptions in a given time interval. Block 5 asks the participant to identify a dosage
change for any prescription in a given time interval.
Each block holds two questions, identical in wording, differing only on the visualization presented to the
participant. The survey is configured to randomly present one question from each block to each participant.
Regardless of the question presented, we additionally track the response time for each block measured as
the last click on the survey page before the “submit” or “next” button is clicked. Participants are shown only
one question per page to increase the relevance of time tracking.
Results: Twenty-three participants enrolled in the study. A total of 112 observations were collected across
five randomized blocks. The average task time for control was 1366.3+/-10.35 and the average response
time for treatment 1773.23+/-10.4; however, the T-value was -1.313, thus the results were not statistically
significant. The average task correctness for control was 30.61% and the average task correctness for
treatment was 66.67% with a p-value of 0.000502.
Conclusions: Task correctness saw a significant increase in the probability for a correct response when
using the treatment visualization versus the control visualization. Additional research is required to
determine the effect of the treatment visualization on task time. The findings may have a significant impact
on how medication histories are presented to care provided through the electronic health record.
Citations
More filters
Journal Article•DOI•
The Visual Display of Quantitative Information

[...]

B. Marx
01 Mar 1985-Journal of Modern Optics

1,778 citations

Journal Article•DOI•
Visual explanations: Images and quantities, evidence and narrative

[...]

Howard Margolis1•
University of Chicago1
01 Jun 1998-Journal of Policy Analysis and Management

312 citations

Journal Article•
Comparative Evaluation of an Interactive Time-Series Visualization that Combines Quantitative Data w

[...]

Wolfgang Aigner, Alexander Rind, Stephan Hofmann
01 Jan 2012-Computer Graphics Forum
TL;DR: A controlled experiment is reported on a controlled experiment that compares this technique with another visualization method used in the well‐known KNAVE‐II framework, both of which integrate quantitative data with qualitative abstractions.
Abstract: In many application areas, analysts have to make sense of large volumes of multivariate time‐series data. Explorative analysis of this kind of data is often difficult and overwhelming at the level of raw data. Temporal data abstraction reduces data complexity by deriving qualitative statements that reflect domain‐specific key characteristics. Visual representations of abstractions and raw data together with appropriate interaction methods can support analysts in making their data easier to understand. Such a visualization technique that applies smooth semantic zooming has been developed in the context of patient data analysis. However, no empirical evidence on its effectiveness and efficiency is available. In this paper, we aim to fill this gap by reporting on a controlled experiment that compares this technique with another visualization method used in the well‐known KNAVE‐II framework. Both methods integrate quantitative data with qualitative abstractions whereas the first one uses a composite representation with color‐coding to display the qualitative data and spatial position coding for the quantitative data. The second technique uses juxtaposed representations for quantitative and qualitative data with spatial position coding for both. Results show that the test persons using the composite representation were generally faster, particularly for more complex tasks that involve quantitative values as well as qualitative abstractions.

32 citations

Dissertation•
Comment améliorer l'usage du Dossier Patient Informatisé dans un hôpital ?

[...]

David Morquin
27 May 2019
TL;DR: In this paper, the Dossier Patient Informatise (DPI) is used as a model for the formalisation of a processus d'affaires and a systeme d'entreprise.
Abstract: L’objet principal de cette these concerne le Dossier Patient Informatise (DPI) dans les hopitaux, et plus particulierement les difficultes d’usage apres la phase d’implementation. Notre demarche visait a concevoir, a partir des connaissances academiques en Systeme d’Information, une methode permettant aux acteurs de terrain d’agir sur une problematique specifique. Concretement nous cherchions a savoir comment ameliorer les situations de « misfit », c’est a dire les situations dans lesquelles les professionnels de sante considerent l’usage du DPI comme inadapte a leur metier. Pour ce faire, nous avons cherche a comprendre le bilan mitige du DPI dans la litterature en utilisant les travaux d’Adler & Borys (1996) sur le caractere dual de la formalisation du travail induite par la technologie (habilitante ou coercitive). Une technologie habilitante permet de positionner un utilisateur comme source de solutions, alors qu’une technologie coercitive tend a le considerer comme source de problemes. Dans le premier manuscrit portant sur l’autonomie des professionnels de sante face au systeme d’information hospitalier, nous avons conclu sur la necessite d’une formalisation de type habilitante pour ameliorer l’usage du DPI. Dans le deuxieme manuscrit, nous avons montre que dans les exemples d’experiences negatives du Dossier Patient Informatise rapportes dans la litterature, il etait possible de mettre en evidence les differents aspects d’une formalisation coercitive. Pour argumenter sur le caractere dual de la formalisation du travail induite par le DPI, nous avons rapporte dans le troisieme manuscrit une etude empirique illustrative. Nos donnees montrent que pour un meme DPI, dans un meme hopital, il peut exister des ilots de formalisation habilitante. En sortant du seul domaine d’application de la sante, nous avons approfondi les travaux sur la conceptualisation du misfit entre processus d’affaires et Systeme d’Entreprise (SE) de Strong & Volkoff de 2010, en utilisant les concepts d’affordance et d’actualisation d’affordance utilises par les memes auteurs en 2013 et 2014. Le quatrieme manuscrit presente donc un modele original permettant d’analyser l’usage des technologies de l’information pour un processus d’affaires donne sous la forme d’une combinaison d’actualisations, de non-actualisation ou d’actualisations partielles de multiples affordances du systeme d’entreprise par de multiples acteurs. Dans une perspective realiste critique, le misfit est alors la perception par un individu ou un groupe d’individus que cette combinaison ne repond pas a l’ensemble ou a une partie des objectifs du processus de facon satisfaisante. Nous rapportons ensuite comment, dans le cadre d’une recherche-action, nous avons utilise ce modele pour ameliorer l’usage d’un DPI en post-implementation dans un hopital. L’analyse d’une situation de misfit selon notre methode permet une recombinaison, en recherchant une suite coherente d’ajustements techniques et organisationnels acceptables pour toutes les parties prenantes et dont l’agencement permet bien la disparition du misfit initial, mais aussi de l’ensemble des misfits reveles pendant l’analyse. Cette recombinaison aboutit alors a une formalisation du travail presentant toutes les caracteristiques d’une formalisation habilitante. La discussion de la these aborde les conditions du succes de la methode, le choix des situations sur lesquelles l’appliquer et les perspectives de recherche qui en decoulent.

10 citations

Journal Article•DOI•
Résistance légitime sans technophobie : analyse des impacts de l'informatisation du dossier du patient sur le cœur du métier médical

[...]

D. Morquin
01 Sep 2020-Revue de Médecine Interne
TL;DR: In this article, the authors highlight the difficulties encountered by medical doctors in the daily use of EMR and propose to analyze this so-called "resistance" in relation to the formalization of medical work induced by EMR.
Abstract: The objective of this short narrative literature review is to highlight the different difficulties encountered by medical doctor in the daily use of EMR. We show that these are not simple transitional phenomena related to a "resistance to change", but rather the fact of a deeper and unfinished transformation. Beyond the "perception of misfit with work processes" or the threat of a loss of autonomy, we propose to analyze this so-called "resistance" in relation to the formalization of medical work induced by EMR. Our question concerns the compatibility of the multiple objectives of EMR, the potential influence of computerization on the steps of entering and consulting medical information, the impact on the clinical reasoning, the reality of assistance to medical "performance". The question is not so much what EMRs do less well than the paper record, but to provide insights into how tomorrow's EMRs will do better than today's.

5 citations

References
More filters
Journal Article•DOI•
Graphical summary of patient status

[...]

Seth M. Powsner1, Edward R. Tufte•
Yale University1
06 Aug 1994-The Lancet

223 citations

Book•
Interactive Information Visualization to Explore and Query Electronic Health Records

[...]

Alexander Rind1, Taowei David Wang2, Wolfgang Aigner1, Silvia Miksch1, Krist Wongsuphasawat2, Catherine Plaisant2, Ben Shneiderman2 •
Vienna University of Technology1, University of Maryland, College Park2
27 Feb 2013
TL;DR: This monograph is written for both scientific researchers and designers of future user interfaces for EHRs to help them understand this vital domain and appreciate the features and virtues of existing systems, so they can create still more advanced systems.
Abstract: Physicians are confronted with increasingly complex patient histories based on which they must make life-critical treatment decisions. At the same time, clinical researchers are eager to study the growing databases of patient histories to detect unknown patterns, ensure quality control, and discover surprising outcomes. Designers of Electronic Health Record systems (EHRs) have great potential to apply innovative visual methods to support clinical decision-making and research. This work surveys the state-of-the-art of information visualization systems for exploring and querying EHRs, as described in the scientific literature. We examine how systems differ in their features and highlight how these differences are related to their design and the medical scenarios they tackle. The systems are compared on a set of criteria: (1) data types covered, (2) multivariate analysis support, (3) number of patient records used (one or multiple), and (4) user intents addressed. Based on our survey and evidence gained from evaluation studies, we believe that effective information visualization can facilitate analysis of EHRs for patient treatment and clinical research. Thus, we encourage the information visualization community to study the application of their systems in health care. Our monograph is written for both scientific researchers and designers of future user interfaces for EHRs. We hope it will help them understand this vital domain and appreciate the features and virtues of existing systems, so they can create still more advanced systems. We identify potential future research topics in interactive support for data abstraction, in systems for intermittent users, such as patients, and in more detailed evaluations.

212 citations

"Measuring the speed and efficacy of..." refers background in this paper

  • ...[18] Qualitative responses to 4 open ended questions....

    [...]

Journal Article•DOI•
Innovative information visualization of electronic health record data: a systematic review

[...]

Vivian West1, David Borland2, W. Ed Hammond1•
Duke University1, University of North Carolina at Chapel Hill2
01 Mar 2015-Journal of the American Medical Informatics Association
TL;DR: This study investigates the use of visualization techniques reported between 1996 and 2013 and evaluates innovative approaches to information visualization of electronic health record (EHR) data for knowledge discovery.

202 citations

"Measuring the speed and efficacy of..." refers background in this paper

  • ...9 visualization, did not include empirical findings, was a position paper, was a literature review, or discussed prototype / conceptual model.([32])...

    [...]

Journal Article•
Defining medical error.

[...]

Ethan D. Grober1, John M.A. Bohnen•
University Health Network1
01 Feb 2005-Canadian Journal of Surgery
TL;DR: The primary objective of this review is to highlight the need for a clear, comprehensive and universally accepted definition of medical error that explicitly includes the key domains of error causation and captures the faulty processes that cause errors, irrespective of outcome.
Abstract: Medical errors represent a serious public health problem and pose a threat to patient safety. As health care institutions establish "error" as a clinical and research priority, the answer to perhaps the most fundamental question remains elusive: What is a medical error? To reduce medical error, accurate measurements of its incidence, based on clear and consistent definitions, are essential prerequisites for effective action. Despite a growing body of literature and research on error in medicine, few studies have defined or measured "medical error" directly. Instead, researchers have adopted surrogate measures of error that largely depend on adverse patient outcomes or injury (i.e., are outcome-dependent). A lack of standardized nomenclature and the use of multiple and overlapping definitions of medical error have hindered data synthesis, analysis, collaborative work and evaluation of the impact of changes in health care delivery. The primary objective of this review is to highlight the need for a clear, comprehensive and universally accepted definition of medical error that explicitly includes the key domains of error causation and captures the faulty processes that cause errors, irrespective of outcome.

179 citations

"Measuring the speed and efficacy of..." refers background in this paper

  • ...Medical Error – An act of omission or commission in planning or execution that contributes or could contribute to an unintended result.([28]) Phenome – Set of all expressed phenotypes([29]) Polypharmacy – “The use of multiple medications....

    [...]

Journal Article•DOI•
Medication errors in elderly people: contributing factors and future perspectives

[...]

Daniela Fialová1, Graziano Onder1•
Catholic University of the Sacred Heart1
01 Jun 2009-British Journal of Clinical Pharmacology
TL;DR: There are gaps in research and clinical practice that lead to frequent medication errors in older adults, which must be solved by future studies and by regulatory measures in order to support errorless and appropriate use medications in these people.
Abstract: 1. Older people have substantial interindividual variability in health, disability, age-related changes, polymorbidity, and associated polypharmacy, making generalization of prescribing recommendations difficult. 2. Medication use in older adults is often inappropriate and erroneous, partly because of the complexities of prescribing and partly because of many patient, provider, and health system factors that substantially influence the therapeutic value of medications in aged people. 3. A high prevalence of medication errors in older adults results on the one hand from accumulation of factors that contribute to medication errors in all age groups, such as polypharmacy, polymorbidity, enrollment in several disease-management programmes, and fragmentation of care. On the other hand, specific geriatric aspects play a role in these medication errors; these include age-related pharmacological changes, lack of specific evidence on the efficacy and safety of medications, underuse of comprehensive geriatric assessment, less availability of drug formulations offering geriatric doses, and inadequate harmonization of geriatric recommendations across Europe. 4. The dearth of geriatric clinical pharmacology and clinical pharmacy services compounds the difficulties. 5. There are gaps in research and clinical practice that lead to frequent medication errors in older adults, which must be solved by future studies and by regulatory measures in order to support errorless and appropriate use medications in these people.

178 citations

"Measuring the speed and efficacy of..." refers background in this paper

  • ...The given environment, combined with an increasing high frequency of polypharmacy patients, lead to mismanagement and medication errors.([9-11])...

    [...]