Search tips
Search criteria 


Logo of nihpaAbout Author manuscriptsSubmit a manuscriptHHS Public Access; Author Manuscript; Accepted for publication in peer reviewed journal;
J Pediatr Hematol Oncol. Author manuscript; available in PMC 2013 April 1.
Published in final edited form as:
PMCID: PMC3311776

Feasibility of Web-based Technology to Assess Adherence to Clinic Appointments in Youth with Sickle Cell Disease

Avani C. Modi, Ph.D., Lori E. Crosby, Psy.D., Janelle Hines, Ph.D., Dennis Drotar, Ph.D., and Monica J. Mitchell, Ph.D.


Web-based tools to improve clinic attendance have been effectively used in pediatric conditions but have not been tested in pediatric sickle cell disease (SCD). The goal of this pilot study was to assess barriers to clinic attendance and the feasibility of a web-based assessment tool to promote problem-solving around clinic appointments. Study participants included 30 youth with SCD (M=11.7±3.5 years; 57% male; 60% HbSS; 20% HbSC; 17% HB+Thal) and their primary caregivers. Medical chart review indicated that 61% of participants attended at least two SCD clinic appointments in the past year. The primary barrier to clinic attendance was inability to take off from work/school (33%). Regarding feasibility and acceptability, the computerized program was well-received by patients and caregivers, with youth and caregivers reporting a high degree of usefulness and preference for computerized assessment. Results suggest that this innovative approach shows promise and should be tested on a larger sample of youth with SCD.

Keywords: innovation, compliance, disease management, technology, pediatric


Practice guidelines for the management of sickle cell disease (SCD) recommend that patients attend routine clinic appointments every 6 months, and more frequently if the patient has frequent pain episodes, hospitalizations, or recurrent complications (e.g., acute chest syndrome) [1]. In addition, flu shots and other immunizations, which occur at routine appointments, are given as standard of care to prevent infections [2]. Thus, to effectively manage sickle cell disease, patients must attend routine follow-up visits with physicians who prescribe and refill medications (e.g., hydroxyurea) and monitor symptoms and medication side-effects. “Nonadherence with regularly scheduled clinic appointments represents one of the most costly problems in outpatient care, both in terms of economical and human resources spent” [3].

Research examining nonadherence to clinic appointments for youth with SCD is sparse. A meta-analytic review regarding adherence to pediatric healthcare appointments suggested rates of approximately 60% [4]. However, adherence rates for routine clinic appointments in SCD ranged from 46-77% [5, 6]. Parent and adolescent-perceived barriers to clinical appointments include competing activities, health status, patient-provider relationships, adverse clinical experiences, and forgetting [7]. Interventions to improve adherence to clinic appointments or even treatment in pediatric SCD have been limited [8], with only two studies focused on improving adherence to penicillin with educational interventions [9, 10].

Systematic assessment and intervention approaches to improve treatment adherence and clinic attendance using newer technologies (e.g., computer-based, text messaging) have been effectively used in many diseases, including diabetes [11, 12], asthma (Stop Asthma Clinical System [13]) and adults with hypertension [14]. Use of new web-based technologies may provide a vehicle for delivering effective, standardized, and cost-effective assessment and intervention. These types of interventions may also appeal to this generation of patients (e.g., adolescents and young adults) who are highly engaged in media-based social networking and seeking health information [15] through technological mediums. Furthermore, despite disparities in access, African American youth are increasingly accessing information through a multitude of technologies, including computers, internet, and personal electronic devices [16]. These data suggest that web-based assessment and interventions may be promising for youth with SCD.

In light of the gaps in the SCD literature related to treatment adherence to clinic appointments, and the web-based interventions emerging in other pediatric populations, the goal of this pilot study was to assess: 1) clinic attendance, barriers to clinic attendance, and possible solutions to improve clinic attendance, and 2) the feasibility of a web-based, voice-automated computerized assessment tool to identify barriers and to promote problem-solving for adherence to clinic appointments in youth with SCD and their caregivers. We anticipated that a majority of participants would know the recommendations regarding clinic appointments and that barriers would include forgetting, competing activities, and the health of the child/teen. It was also hypothesized that the computer-based tool would be rated as feasible, user-friendly, and beneficial by patients with SCD and their families.

Materials and Method

Participants and procedure

All youth with SCD (6-21 years) and their caregivers seen in an urban, Midwestern comprehensive sickle cell clinic at a pediatric hospital were invited to participate in a research and education event [17]. Of the 150 youth seen in the sickle cell clinic that were eligible and able to be contacted for the event, approximately 69 youth attended the event. Notably, patients could participate in one of three studies: one focused on child/adolescent self-concept and coping style (n=14), one focused on adolescent spirituality (n=30) and/or the current study (n=30). Of the 41 youth and caregivers eligible for this study, 30 (73%) agreed to participate. Reasons for study declines included lack of time, both the child and/or caregiver dyad were not present, or participation in the other study. Dyads completed a module of the web-based Disease Management Interview- SCD (WDMI) and then a subset of dyads (n=14), based on a convenience sample, answered questions about the module’s user-friendliness, format, and potential for use in clinic. The WDMI module began with the introduction of the web-based avatar, “ROGER,” which is an acronym for Remembering appointments and Being On time; Getting medication and taking it Everyday equals Responsibility (Figure 1). The WDMI module included 28 questions regarding patient’s clinic attendance, barriers to clinic attendance and possible solutions to improve clinic attendance. Medical chart review was also conducted to ascertain clinic attendance in the past year.

Figure 1
ROGER Avatar

To assess feasibility and usability, participants were asked to complete a 5-item survey (see Table 1) about the module. Items were either on a 10-point Likert scale, with 0 being low (e.g., not useful/honest at all) and 10 being high (e.g. very useful/honest) or yes or no responses. Patients and caregivers viewed the program together but were instructed to complete the survey individually. For child participants, trained research staff were available to assist with completion of the questions, as needed. The study was approved by the Institutional Review Board. Descriptive data was analyzed using SPSS version 19.0.

Table I
Ratings of Feasibility, Acceptability, and Usability



Study participants included 30 youth with SCD (M=11.7±3.5 years; 57% male; 60% HbSS; 20% HbSC; 17% HB+Thal) and their primary caregivers. This sample is similar to our larger SCD clinic population (M=10.6 years; 48% male; 50% HbSS; 28% HbSC).

WDMI module data

The module took approximately 15-20 minutes to complete. Medical chart review indicated that 60.7% of participants attended at least two SCD clinic appointments in the past year. Based on dyad report, approximately 75% of patients and their caregivers understood that their SCD providers recommend clinic appointments at least twice a year. Eighty-three percent of patients indicated their mother schedules and keeps track of their appointments. Forty percent of participants indicted no barriers to clinic attendance while some participants chose multiple barriers. Of those participants (60%) who identified barriers to clinic attendance, the following were identified: forgetting (7%), inability to take off from work/school (33%), competing activities (e.g., sports; 3%), transportation difficulties (13%), feeling sick (3%), feeling well (3%), feel it is unnecessary (3%). Participants were asked to rate potential solutions on a 4-point Likert scale from “Wouldn’t work at all” to “Would work very well.” When the “would work well” and “would work very well” categories were aggregated, 70% reported that having the child/teen use a calendar was beneficial. Eighty-nine percent felt that having a cell phone reminder would work well, while 94% felt that having the parent take over appointment-making/tracking would be beneficial.

Module Format

Ninety-two percent of youth and 100% of caregivers indicated that they would prefer the computer format versus paper/pencil. They also reported they would be more honest using a computer relative to a paper/pencil format.

Clinic Utility

Overall, clinical utility was rated favorably (See Table 1). The majority of participants and caregivers felt the module would be useful in clinic and 92% indicated that the information collected would be useful for clinic staff.


Top-rated characteristics participants felt would increase the user-friendliness of the module were: using a touch screen instead of a mouse, being able to log-on from home and see a graph, and using a relatable avatar for youth.


Patients and caregivers agreed that a number of domains should be addressed in the module: Physical Health/Challenges (92% youth, 92% caregivers); Medications/Associated Challenges (84% youth, 100% caregivers); Emotions and Coping (92% youth and caregivers); Friends/Social Life (85% youth, 100% caregivers); School/Grades (84% youth, 92% caregivers); Family/Home Life (92% youth and caregivers).


This pilot study examined the potential for using web-based technology to provide a standardized assessment of adherence to clinic appointments for youth with SCD. Initial chart review findings indicated that 61% of participants attended at least two routine clinic visits in the past year. However, a larger percentage of families (75%) indicated that they understood that their SCD providers recommended clinic appointments at least twice a year. Barriers to clinic attendance were similar to those reported in our prior work [7], with inability to take off from work or school (e.g., competing activities) being the primary barrier for this cohort. Interestingly, participants felt that several suggested strategies would work well/very well to improve clinic attendance, including text reminders and parents taking over the scheduling/tracking. These data are consistent with recent research indicating that caregivers with SCD are primarily responsible for remembering/tracking clinic appointments [18]. While these approaches are likely useful for younger children with SCD, shifting responsibility to caregivers is counter to the pediatric chronic illness transition literature suggesting that adolescents should be assessed for transition readiness and guided into taking more responsibility for their own disease management [19]. As such, SCD providers may need to work closely with families regarding when to transition SCD management from the caregiver to the patient, with the knowledge that supervision is critical during this time period [20].

Regarding feasibility and acceptability, the computerized ROGER program was well-received by patients and caregivers, with youth and caregivers reporting a high degree of usefulness and preference for computerized assessment. In addition, participants reported that touch screen technology, completion of surveys with their parent/child, completion of the assessment at home, use of an Avatar, and feedback on their progress would be useful. Based on data from the current study, we have improved upon the ROGER program by adding touch screen technology, audio-recordings that read the screen information to patients, and use of both a male and female Avatar. The improved ROGER program is currently being tested to improve clinic attendance during routine clinic visits with youth with SCD. The initial cost to develop the ROGER program was $8000, with a yearly maintenance cost of approximately $2000.

Participants also indicated that the module should focus on assessing challenges related to physical health and medications and that a report would be useful to them and to clinic staff. This is consistent with the larger literature indicating that good patient-provider communication positively correlates with adherence to treatment and clinic appointments [21-24]. If youth with SCD and their caregivers feel supported by their healthcare team as a result of discussing and problem-solving ways to improve clinic attendance, this may potentially improve adherence to other aspects of the SCD regimen and the ROGER program could be beneficial on multiple levels.

To our knowledge, this is the first study to test the feasibility of a web-based program to assess and problem-solve around barriers to attending clinic appointments. However, several limitations are noted. First, participants represent a small convenience sample of patients with SCD and their families attending a sickle cell research event; thus, results may not be generalizable to all youth with SCD. However, barriers reported in the current study were similar to those reported in prior studies of youth with SCD [7]. Second, the study relied solely on questionnaires rather than a combination of other qualitative research methods (e.g. focus groups), which may have provided additional insights into module format or content. Finally, the data presented is descriptive in nature and further work needs to be conducted to prospectively assess the relations between module utility, clinic attendance, and health outcomes (e.g. health utilization, quality of life).

Overall, this study represents an important first step in integrating technology in clinical care, improving parent-child-staff communication, and optimizing adherence to appointments and treatments. It also has implications for clinical practice. The use of web-based programs, such as ROGER, could improve the treatment adherence of eligible patients thereby increasing the likelihood that they will be offered these types of treatment. We are currently testing the efficacy of the ROGER program to improve both clinic attendance and adherence to oral medications, including hydroxyurea, deferasirox, and/or penicillin.


This work was supported by the National Institutes of Health: National Heart, Lung, And Blood Institute Award Number (U54HL07087). We would like to extend our deepest appreciation to the patients and caregivers who participated in this study, as well as the research assistants, volunteers, residents, post-doctoral fellows, and healthcare providers who helped collect data and contributed to the success of Sickle Cell Research and Education Day. In addition, we would like to thank Kara Loo for assisting with designing the avatar ROGER.

Funding: This work was supported by the National Institutes of Health: National Heart, Lung, And Blood Institute Award Number (U54HL07087).


The authors have no disclosures or conflicts of interest.

This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.


1. National Institutes of Health: National Heart Lung, and Blood Institute The management of sickle cell disease. 2002.
2. Wong W. Prevention and management of infection in children with sickle cell anaemia. Paediatric Drugs. 2001;3(11):793–801. [PubMed]
3. Dunbar-Jacob J, Erlen JA, Schlenk EA, Ryan CM, Sereika SM, Doswell WM. Adherence in chronic disease. Annu Rev Nurs Res. 2000;18:48–90. [PubMed]
4. Macharia WM, Leon G, Rowe BH, Stephenson BJ, Haynes RB. An overview of interventions to improve compliance with appointment keeping for medical services. JAMA. 1992;267(13):1813–1817. [PubMed]
5. Robinson N, Huber H, Jenkins P, Partin-Welch P, Calderon K, Van Loon A, Boyd P, Joiner C. Improving Access to Medical Care for Children with Sickle Cell Disease. 29th Annual Meeting of the National Sickle Cell Disease Program; Memphis, TN. 2006.
6. Thornburg CD, Calatroni A, Telen M, Kemper AR. Adherence to hydroxyurea therapy in children with sickle cell anemia. The Journal of pediatrics. 2010;156(3):415–419. [PMC free article] [PubMed]
7. Crosby LE, Modi AC, Lemanek KL, Guilfoyle SM, Kalinyak KA, Mitchell MJ. Perceived barriers to clinic appointments for adolescents with sickle cell disease. J Pediatr Hematol Oncol. 2009;31(8):571–576. [PMC free article] [PubMed]
8. Chen E, Cole SW, Kato PM. A review of empirically supported psychosocial interventions for pain and adherence outcomes in sickle cell disease. Journal of pediatric psychology. 2004;29(3):197–209. [PubMed]
9. Berkovitch M, Papadouris D, Shaw D, Onuaha N, Dias C, Olivieri NF. Trying to improve compliance with prophylactic penicillin therapy in children with sickle cell disease. Br J Clin Pharmacol. 1998;45(6):605–607. [PMC free article] [PubMed]
10. Day S, Brunson G, Wang W. A successful education program for parents of infants with newly diagnosed sickle cell disease. J Pediatr Nurs. 1992;7(1):52–57. [PubMed]
11. Hunt DL, Haynes RB, Hayward RS, Pim MA, Horsman J. Patient-specific evidence-based care recommendations for diabetes mellitus: development and initial clinic experience with a computerized decision support system. Int J Med Inform. 1998;51(2-3):127–135. [PubMed]
12. Walker EA, Molitch M, Kramer MK, Kahn S, Ma Y, Edelstein S, Smith K, Johnson MK, Kitabchi A, Crandall J. Adherence to Preventive Medications: Predictors and outcomes in the Diabetes Prevention Program. Diabetes Care. 2006;29(9):1997–2002. [PMC free article] [PubMed]
13. Shegog R, Bartholomew LK, Sockrider MM, Czyzewski DI, Pilney S, Mullen PD, Abramson SL. Computer-based decision support for pediatric asthma management: description and feasibility of the Stop Asthma Clinical System. Health Informatics J. 2006;12(4):259–273. [PubMed]
14. Bosworth HB, Olsen MK, Gentry P, Orr M, Dudley T, McCant F, Oddone EZ. Nurse administered telephone intervention for blood pressure control: a patient-tailored multifactorial intervention. Patient Educ Couns. 2005;57(1):5–14. [PubMed]
15. Skinner H, Biscope S, Poland B, Goldberg E. How adolescents use technology for health information: implications for health professionals from focus group studies. J Med Internet Res. 2003;5(4):e32. [PMC free article] [PubMed]
16. Roberts DF. Media and youth: access, exposure, and privatization. J Adolesc Health. 2000;27(2 Suppl):8–14. [PubMed]
17. Hines J, Mitchell MJ, Crosby LE, Johnson A, Valenzuela JM, Kalinyak KA, Joiner C. Engaging patients with sickle cell disease and their families in disease education, research, and community awareness. Journal of Prevention and Intervention in the Community. 2011;39(3):256–272. [PubMed]
18. Oliver-Carpenter G, Barach I, Crosby LE, Valenzuela J, Mitchell MJ. Disease management, coping, and functional disability in pediatric sickle cell disease. J Natl Med Assoc. 2011;103(2):131–137. [PubMed]
19. Pai AL, Schwartz LA. Introduction to the special section: Health care transitions of adolescents and young adults with pediatric chronic conditions. Journal of pediatric psychology. 2011;36(2):129–133. [PubMed]
20. Modi AC, Marciel KK, Slater SK, Drotar D, Quittner AL. The influence of parental supervision on medical adherence in pre and late-adolescents with cystic fibrosis: Developmental shifts from early to late adolescence. Children’s Health Care. 2008;37(1):78–92.
21. Beach MC, Keruly J, Moore RD. Is the Quality of the Patient Provider Relationship Associated with Better Adherence and Health Outcomes for Patients with HIV? Journal of general internal medicine. 2006;21(6):661–665. [PMC free article] [PubMed]
22. Ciechanowski PS, Katon WJ, Russo JE, Walker EA. The patient-provider relationship: attachment theory and adherence to treatment in diabetes. American Journal of Psychiatry. 2001;158(1):29. [PubMed]
23. Maddigan SL, Majumdar SR, Johnson JA. Understanding the complex associations between patient–provider relationships, self-care behaviours, and health-related quality of life in type 2 diabetes: A structural equation modeling approach. Quality of life research. 2005;14(6):1489–1500. [PubMed]
24. Vermeire E, Hearnshaw H, Van Royen P, Denekens J. Patient adherence to treatment: three decades of research. A comprehensive review. Journal of clinical pharmacy and therapeutics. 2001;26(5):331–342. [PubMed]