Feasibility, Acceptability, and Usability of Web-Based Data Collection in Parents of Children With Cancer

Kimberly A. Pyke-Grimm

Katherine P. Kelly

Janet L. Stewart

Jane Meza

children, web-based surveys
ONF 2011, 38(4), 428-435. DOI: 10.1188/11.ONF.428-435

Purpose/Objectives: To determine the feasibility of Web-based, multisite data collection using electronic instruments and the feasibility, acceptability, and usability of that data collection method to parents of children with cancer.

Design: Prototype development and feasibility study.

Setting Three Children's Oncology Group centers in the United States.

Sample: 20 parents of children with cancer who made a treatment decision within the previous six months.

Methods: Eight instruments were translated from print to electronic format and deployed using a secure Web-based server. Parents completed printed versions of two of the instruments to assess comparability of the two formats. A post-survey interview focused on parents' computer experiences and the acceptability and ease of use of the instruments.

Main Research Variables: Time to orient parent to Web site, time to complete instruments, investigators' field notes, and postsurvey questionnaire.

Findings: Eighty percent of parents preferred the Web-based data collection and found it at least as easy as completing paper-and-pencil instruments. All parents, regardless of their computer expertise, were comfortable with the electronic data collection system. Statistical analysis demonstrated no evidence of systematic or clinically significant bias.

Conclusions: The Web-based data collection was feasible, reliable, and preferred by most study participants. The authors will use this strategy in future intervention trials of parents making treatment decisions.

Implications for Nursing: Web-based data entry is feasible and acceptable to parents of children with cancer. Future multicenter collaborative studies should develop and test nursing interventions to support parents making treatment decisions.

Jump to a section


    Ahern, N.R. (2005). Using the Internet to conduct research. Nurse Researcher, 13(2), 55-70.
    Anderson, L.A., & Dedrick, R.F. (1990). Development of the Trust in Physician Scale: A measure to assess interpersonal trust in patient-physician relationships. Psychological Reports, 67(3, Pt. 2), 1091-1100.
    Berry, D.L., Trigg, L.J., Lober, W.B., Karras, B.T., Galligan, M.L., Austin-Seymour, M., & Martin, S. (2004). Computerized symptom and quality-of-life assessment for patients with cancer part I: Development and pilot testing [Online exclusive]. Oncology Nursing Forum, 31, E75-E83. doi:10.1188/04.ONF.E75-E83
    Berry, D.L., Wolpin, S.E., Lober, W.B., Ellis, W.J., Russell, K.J., & Davison, B.J. (2006). Actual use and perceived usefulness of a Web-based, decision support program for men with prostate cancer. Studies in Health Technology and Informatics, 122, 781-782.
    Birnbaum, M.H. (2004). Human research and data collection via the Internet. Annual Review of Psychology, 55, 803-832.
    Bland, J.M., & Altman, D.G. (1986). Statistical methods for assessing agreement between two methods of clinical measurement. Lancet, 1, 307-310. doi:10.1016/S0140-6736(86)90837-8
    Bliven, B.D., Kaufman, S.E., & Spertus, J.A. (2001). Electronic collection of health-related quality of life data: Validity, time benefits, and patient preference. Quality of Life Research, 10, 15-22.
    Burns, D.S., Robb, S.L., & Haase, J.E. (2009). Exploring the feasibility of a therapeutic music video intervention in adolescents and young adults during stem-cell transplantation. Cancer Nursing, 32, E8-E16. doi: 10.1097/NCC.0b013e3181a4802c
    Cantrell, M.A., & Lupinacci, P. (2007). Methodological issues in online data collection. Journal of Advanced Nursing, 60, 544-549. doi:10.1111/j.1365-648.2007.04448.x
    Coombs, C.H. (1964). A theory of data. New York, NY: John Wiley and Sons.
    Cronk, B.C., & West, J.L. (2002). Personality research on the Internet: A comparison of Web-based and traditional instruments in take-home and in-class settings. Behavior Research Methods, Instruments, and Computers, 34, 177-180. doi:10.3758/BF03195440
    De Leo, G., Krishna, S., Boren, S., Fato, M., Porro, I., & Balas, E.A. (2005). Web and computer telephone-based diabetes education: Lessons learnt from the development and use of a call center. Journal of Medical Systems, 29, 343-355. doi:10.1007/s10916-005-5894-x
    Gulliksen, H., & Tukey, J. (1958). Reliability for the law of comparative judgment. Psychometrika, 23, 95-110. doi:10.1007/BF02289008
    Gwaltney, C.J., Shields, A.L., & Shiffman, S. (2008). Equivalence of electronic and paper-and-pencil administration of patient-reported outcome measures: A meta-analytic review. Value Health, 11, 322-333. doi:10.1111/j.1524-4733.2007.00231.x
    Hester, R.K., Delaney, H.D., Campbell, W., & Handmaker, N. (2009). A Web application for moderation training: Initial results of a randomized clinical trial. Journal of Substance Abuse Treatment, 37, 266-276. doi:10.1016/j.jsat.2009.03.001
    Holmes-Rovner, M., Kroll, J., Schmitt, N., Rovner, D.R., Breer, M.L., Rothert, M.L., … Talarczyk, G. (1996). Patient satisfaction with health care decisions: The satisfaction with decision scale. Medical Decision Making, 16, 58-64. doi:10.1177/0272989X9601600114
    Kelly, K., Pyke-Grimm, K., Stewart, J., & Meza, J. (2007). Parent decision making: Web-based data collection pilot. Paper presented at the 9th National Conference on Cancer Nursing Research, Hollywood, CA.
    Krantz, J., & Dalal, R. (2000). Validity of Web-based psychological research. In M.H. Birnbaum (Ed.), Psychological experiments on the Internet (pp. 35-60). San Diego, CA: Academic Press.
    Landis, J.R., & Koch, G.G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159-174. doi:10.2307/2529310
    Mishel, M.H. (1983). Parents' perceptions of uncertainty concerning their hospitalized child. Nursing Research, 32, 324-330. doi:10.1097/00006199-198311000-00002
    Mullen, K.H., Berry, D.L., & Zierler, B.K. (2004). Computerized symptom and quality-of-life assessment for patients with cancer part II: Acceptability and usability [Online exclusive]. Oncology Nursing Forum, 31, E84-E89. doi:10.1188/04.ONF.E84-E89
    National Cancer Institute. (2008). National Cancer Institute fact sheet: Childhood cancers. Retrieved from
    O'Connor, A.M. (1997). Decisional conflict (specify). In G. McFarland & E. McFarlane (Eds.), Nursing diagnosis and intervention: Planning for patient care (vol. 3, pp. 486-496). St. Louis, MO: Mosby.
    Olechnowicz, J.Q., Eder, M., Simon, C., Zyzanski, S., & Kodish, E. (2002). Assent observed: Children's involvement in leukemia treatment and research discussions. Pediatrics, 109, 806-814.
    Pasveer, K.A., & Ellard, J.H. (1998). The making of a personality inventory: Help from the WWW. Behavior Research Methods, Instruments, and Computers, 30, 309-313. doi:10.3758/BF03200659
    Pettit, F.A. (2002). A comparison of World-Wide Web and paper-and-pencil personality questionnaires. Behavior Research Methods, Instruments, and Computers, 34, 50-54. doi:10.3758/BF03195423
    Pyke-Grimm, K.A., Degner, L., Small, A., & Mueller, B. (1999). Preferences for participation in treatment decision making and information needs of parents of children with cancer: A pilot study. Journal of Pediatric Oncology Nursing, 16, 13-24. doi:10.1177/104345429901600103
    Reaman, G.H. (2004). Pediatric cancer research from past successes through collaboration to future transdisciplinary research. Journal of Pediatric Oncology Nursing, 21, 123-127.
    Ruccione, K.S., Hinds, P.S., Wallace, J.D., & Kelly, K.P. (2005). Creating a novel structure for nursing research in a cooperative clinical trials group: The Children's Oncology Group experience. Seminars in Oncology Nursing, 21, 79-88.
    Stewart, J.L., Pyke-Grimm, K.A., & Kelly, K.P. (2005). Parental treatment decision making in pediatric oncology. Seminars in Oncology Nursing, 21, 89-97. doi:10.1016/j.soncn.2004.12.003
    Thom, D.H., Ribisl, K.M., Stewart, A.L., & Luke, D.A. (1999). Further validation and reliability testing of the Trust in Physician Scale. The Stanford Trust Study Physicians. Medical Care, 37, 510-517. doi:10.1097/00005650-199905000-00010
    Truell, A.D., Bartlett, J.E., II, & Alexander, M.W. (2002). Response rate, speed, and completeness: A comparison of Internet-based and mail surveys. Behavior Research Methods, Instruments, and Computers, 34, 46-49. doi:10.3758/BF03195422
    Van Voorhees, B.W., Fogel, J., Reinecke, M.A., Gladstone, T., Stuart, S., Gollan, J., … Bell, C. (2009). Randomized clinical trial of an Internet-based depression prevention program for adolescents (Project CATCH-IT) in primary care: 12-week outcomes. Journal of Developmental and Behavioral Pediatrics, 30(1), 23-37. doi: 10.1097/DBP.0b013e3181966c2a
    Vispoel, W.P., Boo, J., & Bleiler, T. (2001). Computerized and paper-and-pencil versions of the Rosenberg Self-Esteem Scale: A comparison of psychometric features and respondent preferences. Educational and Psychological Measurement, 61, 461-474. doi:10.1177/00131640121971329
    Weber, B.A., Yarandi, H., Rowe, M.A., & Weber, J.P. (2005). A comparison study: Paper-based versus Web-based data collection and management. Applied Nursing Research, 18, 182-185. doi: 10.1016/j.apnr.2004.11.003
    Wolpin, S., Berry, D., Austin-Seymour, M., Bush, N., Fann, J.R., Halpenny, B., … McCorkle, R. (2008). Acceptability of an Electronic Self-Report Assessment Program for patients with cancer. Computers, Informatics, Nursing, 26, 332-338. doi:10.1097/01.NCN.0000336464.79692.6a
    Young-Saleme, T.K., & Prevatt, F.F. (2001). Brief report: Psychometric evaluation of the severity of illness scale in a pediatric oncology sample. Journal of Pediatric Psychology, 26(1), 55-60. doi:10.1093/jpepsy/26.1.55