FEATURED ABSTRACT & PRESENTATION
A Pilot Study of Information Systems
Use among Ohio Registered Nurses:
Testing Validity and Reliability
Amany Abdrbo, RN MSN PhD Candidate,
Christine A. Hudak, RN PhD
Mary K. Anthony, RN PhD
View PPT as PDF
15 slides, 634 kb
Health care organizations spend approximately 4.6 per cent of their health care budgets on information technology. Nursing services constitute more than 50 per cent of hospital operating budgets, and they are urged to use information technologies to improve patient safety and quality. It is important to evaluate the benefits and satisfaction derived from those technologies from the nurse’s perspective. Additionally, the new field of nursing informatics needs to establish its instruments to ascertain unique psychometrics for nursing informatics research.
This pilot study examined validity and reliability of informatics instruments administered to a sample of nurses within a larger study. This study was guided by the outcomes model for health care research that derived from Donabedian’s quality assessment model. The model asserted that good structure should promote good process, and good process, in turn, should promote good outcome. The researchers employed descriptive correlation design and survey methodology. The convenience sample of 62 nurses were all working in hospitals, enrolled in advanced nursing courses, spent at least 50 per cent of their time in direct patient care, and used at least one information system (IS).
The sample nurses were an average of 33.14 (SD= 8.91) years old and were employed an average of 4 (SD= 3.93) years. Eighty-two percent were female; 72.6 per cent had a baccalaureate degree (n= 45), and 66 per cent worked full time. The sample nurses worked 32 hours/week, had 4.5 (SD 1.3) years of computer experience, and 50 per cent of them worked in critical care units. Validity was assessed by testing the hypothesized relationships and construct validity.
The study hypotheses include:
* user involvement in implementation and management support (inputs) will have a direct relationship with nurses’ IS use (process);
* nurses’ IS use (process) have a direct relationship with their benefits and satisfaction from IS use (outcomes).
As hypothesized, significant correlations were found between user involvement, management support, and IS use (r =.25 and .32, p = 0.05 respectively); and IS use, and benefits and satisfaction (r = .38 and .46, p = 0.01 respectively). The study results indicate positive significant relationships among the examined variables (inputs and process and process and outcomes). The internal consistency reliabilities of the scales were high (Cronbach’s alpha coefficients ranged from .85 to .97).
Findings indicated that for this preliminary study in nursing informatics, some instruments showed strong psychometric evidence, while others demonstrated low to moderate correlations (validity) such as user involvement and management support. Testing among different samples is required to affirm their validity. Furthermore, continued refinement of these instruments and measures will be useful in investigating IS use, benefits and satisfaction.
Calisir, F., & Calisir, F. (2004). The relation of interface usability characteristics, perceived usefulness, and perceived ease of use to end-user satisfaction with enterprise resource planning (ERP) systems. Computers in Human Behavior, 20, 505–515.
Carmines, E. G., & Zeller, R. A. (1979). Reliability and validity assessment. Beverly Hills. California: Sage Publications.
Doll, W., & Torkzadch, G. (1990). The measurment of End-User software involvement. Omega, 18(4), 399-406.
Donabedian, A. (1966). Evaluating the quality of medical care. Milbank Memorial Fund Q, 44(3), Suppl:166-206.
Donabedian, A. (1988a). Quality assessment and assurance: unity of purpose, diversity of means. Inquiry, 25(1), 173-192.
Donabedian, A. (1988b). The quality of care. How can it be assessed? JAMA : The Journal of the American Medical Association, 260(12), 1743-1748.
Donabedian, A. (1996). The quality of care. How can it be assessed? In Schmele, J. Quality Management in Nursing and Health Care (pp. 52-65). Albany: Delmar Publisher.
Holzemer, W., & Reilly, C. (1995). Variables, variability, and variations research: implications for medical informatics. Journal of the American Medical Informatics Association: JAMIA, 2(3), 183-190.
Igbaria, M. (1990). End user computing effectiveness: a structural equation model. Omega, 18, 637-652.
Knapp, T., & Brown, J. (1995). Ten Measurements That Often Should Be Taken. Research in Nursing & Health, 18, 465-469.
A Pilot Study of Information Systems Use among Ohio Registered Nurses: Testing Validity and Reliability
Authors: Amany Abdrbo, RN MSN PhD Candidate, Christine A. Hudak, RN PhD, Mary K. Anthony, RN PhD
Affiliation: Case Western Reserve University, Ohio
Submitted: May 2006
Accepted: August 2006
Editor: Loretta Secco, RN PhD
Amany, A., Hudak, C. & Anthony, M. (2006). A pilot study of Information Systems use among Ohio Registered Nurses:Testing validity and reliability (abstract, PPT). Canadian Journal of Nursing Informatics, 1(2). http://cjni.net/journal/?p=312