PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of capmcAbout manuscripts / A propos des manuscritsSubmit manuscript / soumettre un manuscrit
 
Inform Prim Care. Author manuscript; available in PMC 2010 May 30.
Published in final edited form as:
PMCID: PMC2878612
CAMSID: CAMS799

Many family physicians will not manually update PDA software: an observational study

Roland Grad, MDCM MSc CCFP FCFP, Associate Professor, Pierre Pluye, MD PhD, Associate Professor, Vera Granikov, MLIS, Information Technology Primary Care Research Group, and Janique Johnson-Lafleur, MSC, Information Technology Primary Care Research Group

Abstract

Background

In a prospective study to explore connections between clinical information delivery and information retrieval, 41 Canadian family physicians searched an Electronic Knowledge Resource as needed for practice. Research software, called the Information Assessment Method prompted family physicians to report on the situational relevance, perceived cognitive impact, and application of their retrieved information hits. Both the Information Assessment Method and the Electronic Knowledge Resource needed periodic updating to properly address our research questions.

Objective

To determine the frequency of software updates when manual or semi-automatic approaches are used by family physicians.

Methods

Each family physician received a handheld computer (PDA) that ran the Windows Mobile 6 operating system. For technical reasons, the Information Assessment Method and the Electronic Knowledge Resource were accessed offline on PDA. To update the Electronic Knowledge Resource and the Information Assessment Method, family physicians were asked to synchronize their PDA to their PC. Updating the Information Assessment Method was a manual process, whereas updating the Electronic Knowledge Resource was semi-automatic.

Results

We found: (1) about 25% of family physicians never or rarely updated PDA software on their own (2) a large number of software updates were never installed, and (3) the semi-automatic method was associated with a small increase in the proportion of installed software updates (58.9% versus 48.6% for the manual method).

Conclusions

When a wireless Internet connection is not used to update PDA software, sociotechnical issues complicate mobile data collection and data transfer.

Keywords: Computers handheld, software, family practice

“The only problem is software updating. I hate synchronizing my PDA to my computer, even more I find updating a daunting process.”

Quote from one participant, received July 29 2008.

Introduction

Implicit in any move towards evidence based practice is awareness of and access to current evidence. Electronic Knowledge Resources on mobile computer (PDA) are increasingly used by health professionals, with much variability among the types and methods of implementation and resulting effectiveness.1 Given our changing knowledge base, Electronic Knowledge Resources are dynamic and periodically updated. Methods for updating Electronic Knowledge Resources on PDA can be classified as manual, semi-automatic or wireless. Manual updates are initiated by the user. Semi-automatic approaches prompt users to update their PDA software upon synchronizing to a personal computer. Wireless installation allows end users to install new applications or update already installed PDA software without physically connecting to a computer. 2

While numerous empirical studies describe the use of Electronic Knowledge Resources and PDAs in clinical practice, none scrutinizes the frequency of PDA software updating. In this paper, we describe how often family physicians updated PDA software, and compare manual vs. semi automatic updating methods. Our findings are relevant to information providers and researchers considering mobile data collection, medical educators involved in e-learning projects and designers of clinical computing projects.

Materials and Methods

Design

In a prospective observational study, a cohort of 41 family physicians searched an Electronic Knowledge Resource as needed for clinical information. They were asked to update two inter-related pieces of software on their PDA3. Our research objectives were to (1) examine to what extent family physicians retrieved clinical information they previously received on email, (2) compare ratings of clinical information received on email (push) versus retrieved on PDA (pull), and (3) explore whether family physicians purposefully or by serendipity, retrieved clinical information previously received on email. The study was approved by the McGill University Faculty of Medicine Institutional Review Board.

Our study software, the Information Assessment Method hooked into a commercial Electronic Knowledge Resource (Essential Evidence Plus, http://www.essentialevidenceplus.com) to allow rating information such as synopses of clinical research retrieved to address practice-based questions. The Information Assessment Method prompted participants to rate the situational relevance, perceived cognitive impact, and any application to practice of these information hits. The Information Assessment Method is the product of an 8-year research and development program4, summarized at http://iam2009.pbworks.com.

PUSH

We emailed new synopses of published clinical research to family physicians, as they were released by the publisher.

PULL

At roughly two month intervals, the publisher released Electronic Knowledge Resource updates containing these new synopses, which family physicians could then retrieve as needed for practice. Since we wished to examine how push influenced pull through the retrieval of synopses that were previously read on email, family physicians were asked to use the most recently released versions of the Electronic Knowledge Resource and the Information Assessment Method. Failure to update the Electronic Knowledge Resource left family physicians without PDA access to recently released synopses. Failure to update the Information Assessment Method prevented evaluation of new synopses.

Participants

41 family physicians from nine of 10 Canadian provinces consented to the study. 36 were certificants of the College of Family Physicians of Canada. There were 24 men and 17 women, ranging in age from 28–70 years (median 44). All were in active practice. One family physician had no Internet access in their main patient setting, 37 (90.2%) reported high speed access, and three did not know what type of connection they had. In terms of computer self-efficacy, eight (19.5%) rated their level of skill as advanced, 32 (78.1%) as intermediate, and one as beginner. Early on, one participant dropped out before updating any software.

Data collection

All participants were offered an HTC Touch Smartphone. However, 17 chose a device with no phone (the hp iPAQ 110). Both devices were Wi-Fi enabled, and used Windows Mobile 6. We performed the initial software installation. Family physicians were trained to synchronize their PDA to their PC for software updating and data transfer to our study server. Thus, no wireless connection was used and study software residedon the PDA. Upon synchronization of PDA with partner PC, an updater application automatically reminded participants to install Electronic Knowledge Resource updates.

Software to implement the Information Assessment Method on PDA was developed and pilot-tested with guidance from a private firm. By email and telephone, we reminded participants to install Information Assessment Method updates, released alongside each Electronic Knowledge Resource update. No updater application was available for the Information Assessment Method on the partner PC. Thus, updating the Information Assessment Method was a manual process requiring synchronization with a partner PC to reinstall six components (e.g., Microsoft SQL Mobile 2005).

Entry into the study began December 2007 and continued until May 2008. Data collection ended September 8, 2008.

Data analysis

From December 2007 to September 2008, six Electronic Knowledge Resource and five Information Assessment Method updates were released. We counted the number of updates installed by each participant in a time window spanning their start date until the end of data collection. We classified updates as either unassisted or assisted. Unassisted updates were defined as updates done by the participant without our help. For each participant, we compared the number of unassisted updates with the number of available updates for both the Electronic Knowledge Resource and the Information Assessment Method. We also counted assisted updates, defined as updates requiring the assistance of our research team. In the assisted situation, for each participant we calculated proportions for the number of updates done divided by the number of updates available.

Results

Between December 10 2007, and September 8 2008, we received 1,374 rated searches containing 2,634 rated hits. Most family physicians (n=28, 70%) reported at least one sociotechnical problem, such as: (1) problems with synchronization software (2) trouble synchronizing at work due to lack of administrative rights, and (3) changes in PC operating system. On 19 occasions, these problems led us to recall PDAs to the research centre to update study software.

Unassisted updating

The variable start date created different numbers of updates available for each family physician. Figures 1 and and22 reveal the number of Electronic Knowledge Resource and Information Assessment Method updates made unassisted by each family physician (without help from the research team). In both figures, the number of installed updates is represented by the black bars, and ranked from least to most. We observed (1) about 25% of participants never or rarely updated on their own, (2) a large number of updates were never installed (light grey bars), and (3) the semi-automatic method was associated with a 10% increase in the proportion of installed software updates (n= 123/209, (58.9%) versus 83/171 (48.6%)).

Figure 1
Electronic Knowledge Resource: Number of installed and uninstalled updates (unassisted)
Figure 2
The Information Assessment Method: Number of installed and uninstalled updates (unassisted)

Assisted updating

On at least one occasion, eight of 40 participants needed assistance to update their Electronic Knowledge Resource (table 1). Eleven of 40 needed help to update the Information Assessment Method. With assistance, all participants updated at least once. After multiple email reminders and our ongoing support, 26 participants (65%) succeeded in downloading 60% or more of all Electronic Knowledge Resource updates. Only nine of 40 participants (22.5%) installed the final Information Assessment Method update in the last 30 days of data collection.

Table 1
Number of participants needing assistance to update PDA software

Discussion

Principal findings

Some experts believe few physicians will manually update PDA software5. Our results support this belief. In this observational study, many participants did not update their PDA software, even though they consented and were trained to do so. The semi-automatic updating method was not much better than the manual method, perhaps because any potential advantage of semi-automatic updating can be realized only when personal and organizational factors are aligned. For example, a motivated family physician may not be permitted to install software in the workplace.

Implications of the findings

Sociotechnical approaches to IT implementation in health care consider the importance of learning how people, technologies and the process of care interact6. From an organizational perspective, IT problems can be ‘controlled at the source’ by restricting administrative rights to members of a technical support team. This approach to network security was one obstacle to mobile data transfer in our study.

From an individual perspective, the task of updating software for research is outside normal workflow. To optimize mobile data collection and data transfer for research, a wireless connection7 should be used. While some PDA software vendors now provide wireless mobile access to frequently updated content, this was not an option for us, as the Electronic Knowledge Resource we used was available offline only.

Limitations of the method

One limitation concerns generalizability, as our study sample was chosen by convenience. A sub-group of family physicians with high computer skills may have high rates of software updating on PDA. Secondly, the use of PDAs for research data collection cannot be understood in isolation from the organizational context. Our method of software updating was workable in our hands, but not in the hands of many participants within different organizations.

Comparison with the literature

In searching bibliographic databases for studies reporting on frequency of PDA software updating (search strategy available on request), we found no empirical primary care studies on this topic. However, a growing body of literature describes the use of Electronic Knowledge Resources in health care, or the use of PDAs in clinical practice8,9,10,11,12,13. Many articles examine sociotechnical issues and how theoretical models are relevant to technology acceptance 14,15,16.

Call for further development

Our results suggest better methods are needed for PDA data collection in evaluation and research. The capacity for wireless updating of medical software on PDA seems essential.

Conclusion

In this paper, we observed how often family physicians updated two types of PDA software when a wireless connection is not used. In this context, sociotechnical issues complicate mobile data collection and data transfer, requiring frequent assistance. Our findings will hopefully alert researchers and developers to seek better solutions to software updating given the work context of health professionals17.

What this paper adds?

  • Manual or semi automatic methods of updating medical software on PDA were barriers for many family physicians, supporting a need for wireless updating technology

Acknowledgments

We thank Dr. Scott Strayer for reviewing and commenting on an earlier version of the manuscript.

Footnotes

Authors declare no conflict of interest with respect to any of the commercial products listed in this paper.

Contributor Information

Roland Grad, Family Medicine, McGill University, 3755 Cote Ste Catherine Road Montreal Quebec H3T 1E2.

Pierre Pluye, Family Medicine, McGill University, 517 Pine Avenue West, Montreal Quebec H2W 1S4.

Vera Granikov, Information Science, Herzl Family Practice Centre, 3755 Cote Ste Catherine Road Montreal, Quebec H3T 1E2.

Janique Johnson-Lafleur, Family Medicine, McGill University, 3755 Cote Ste Catherine Road Montreal, Quebec H3T 1E2.

Reference List

1. Bryan C, Austin Boren S. The use and effectiveness of electronic clinical decision support tools in the ambulatory/primary care setting: a systematic review of the literature. Informatics in Primary Care. 2008:1679–91. [PubMed]
2. Over-the-Air Installation of PEPID for Palm Users. 2008. http://www.doctorsgadgets.com/over-the-air-installation-of-pepid-for-palm-users.html/
3. Grad RM, Pluye P, Beauchamp ME, Hanley J, Marlow B, Shulha M, et al. Validation of a Method to Assess the Impact of Electronic Knowledge Resources on Clinicians. e Service Journal. 2007;5(2):e113.
4. Pluye P, Grad RM, Repchinsky C, Farrell B, Johnson-Lafleur J, Bambrick T, et al. Information Assessment Method: A Comprehensive and Systematic Information Assessment Method for Electronic Knowledge Resources. In: Dwivedi A, editor. Handbook of Research on Information Technology Management and Clinical Data Administration in Healthcare. Hull: IGI Global; 2009. pp. 521–548.
5. Bates DW, Kuperman GJ, Wang S, Gandhi T, Kittler A, Volk L, et al. Ten Commandments for Effective Clinical Decision Support: Making the Practice of Evidence-based Medicine a Reality. J Am Med Inform Assoc. 2003 Nov;10(6):523–30. [PMC free article] [PubMed]
6. Aarts J, Gorman P. IT in Health Care: Sociotechnical Approaches “To Err is System” Int J Med Inf. 2007:76SS1–S3. [PubMed]
7. Lu YC, Xiao Y, Sears A, Jacko JA. A review and a framework of handheld computer adoption in healthcare. Int J Med Inf. 2005 Jun;74(5):409–422. [PubMed]
8. Crawford MA, Harrington TM, Russell TV, Franklin FA, Lorish CD, Turner TJ, et al. Practice Extenders and PDA-Based Counseling for Smoking and Unhealthy Diet. Annals of Family Medicine. 2005 Jul 1;3(suppl_2):S41–S43. [PubMed]
9. Heim SW, Nadkarni M, Rollins LK, Schorling JB, Waters DB, Hauck FR, et al. Modular Lifestyle Intervention Tool: A Handheld Tool to Assist Clinicians in Providing Patient-Tailored Counseling. Annals of Family Medicine. 2005 Jul 1;3(suppl_2):S65–S67. [PubMed]
10. Clauson KA, Polen HH, Marsh WA. Clinical Decision Support Tools: Performance of Personal Digital Assistant versus Online Drug Information Databases. Pharmacotherapy. 2008;2007(12):1651–1658. [PubMed]
11. Rothschild JM, Fang E, Liu V, Litvak I, Yoon C, Bates DW. Use and Perceived Benefits of Handheld Computer-based Clinical References. J Am Med Inform Assoc. 2006 Nov 1;13(6):619–626. [PMC free article] [PubMed]
12. McAlearney AS, Schweikhart SB, Medow MA. Doctors’ experience with handheld computers in clinical practice: qualitative study. BMJ. 2004;328(7449):1162–0. [PMC free article] [PubMed]
13. Campbell R, Ash J. An evaluation of five bedside information products using a user-centered, task-oriented approach. J Med Libr Assoc. 2006;94(4):435–441. [PMC free article] [PubMed]
14. Berg M, Aarts J, van der Lei J. ICT in Health Care: Sociotechnical Approaches. Methods Inf Med. 2003;42(4):297–301. [PubMed]
15. de Lusignan S, Aarts J. UK’s National Programme for IT welcomes recommendation for a more sociotechnical approach to evaluation: a commentary on the Greenhalgh evaluation of the summary care record. Informatics in Primary Care. 2008;16(2):75–77. [PubMed]
16. Park Y, Chen JV. Acceptance and adoption of the innovative use of smartphone. Industrial Management and Data Systems. 2007;107(9):1349–1365.
17. Larkin M. Can handheld computers improve the quality of care? Lancet. 2001;358:1438. [PubMed]