A Pilot Study of Information Systems Use among Ohio Registered Nurses: Testing Validity and Reliability

FEATURED ABSTRACT & PRESENTATION

Amany Abdrbo, RN MSN PhD Candidate,

Christine A. Hudak, RN PhD

Mary K. Anthony, RN PhD

View PPT as PDF

15 slides, 634 kb

ABSTRACT

Health care organizations spend approximately 4.6 per cent of their health care budgets on information technology. Nursing services constitute more than 50 per cent of hospital operating budgets, and they are urged to use information technologies to improve patient safety and quality. It is important to evaluate the benefits and satisfaction derived from those technologies from the nurse’s perspective. Additionally, the new field of nursing informatics needs to establish its instruments to ascertain unique psychometrics for nursing informatics research.

Methodology

This pilot study examined validity and reliability of informatics instruments administered to a sample of nurses within a larger study. This study was guided by the outcomes model for health care research that derived from Donabedian’s quality assessment model. The model asserted that good structure should promote good process, and good process, in turn, should promote good outcome. The researchers employed descriptive correlation design and survey methodology. The convenience sample of 62 nurses were all working in hospitals, enrolled in advanced nursing courses, spent at least 50 per cent of their time in direct patient care, and used at least one information system (IS).

Sample

The sample nurses were an average of 33.14 (SD= 8.91) years old and were employed an average of 4 (SD= 3.93) years. Eighty-two percent were female; 72.6 per cent had a baccalaureate degree (n= 45), and 66 per cent worked full time. The sample nurses worked 32 hours/week, had 4.5 (SD 1.3) years of computer experience, and 50 per cent of them worked in critical care units. Validity was assessed by testing the hypothesized relationships and construct validity.

Hypotheses

The study hypotheses include:

* user involvement in implementation and management support (inputs) will have a direct relationship with nurses’ IS use (process);

* nurses’ IS use (process) have a direct relationship with their benefits and satisfaction from IS use (outcomes).

Analysis

As hypothesized, significant correlations were found between user involvement, management support, and IS use (r =.25 and .32, p = 0.05 respectively); and IS use, and benefits and satisfaction (r = .38 and .46, p = 0.01 respectively). The study results indicate positive significant relationships among the examined variables (inputs and process and process and outcomes). The internal consistency reliabilities of the scales were high (Cronbach’s alpha coefficients ranged from .85 to .97).

Findings

Findings indicated that for this preliminary study in nursing informatics, some instruments showed strong psychometric evidence, while others demonstrated low to moderate correlations (validity) such as user involvement and management support. Testing among different samples is required to affirm their validity. Furthermore, continued refinement of these instruments and measures will be useful in investigating IS use, benefits and satisfaction.

References

Calisir, F., & Calisir, F. (2004). The relation of interface usability characteristics, perceived usefulness, and perceived ease of use to end-user satisfaction with enterprise resource planning (ERP) systems. Computers in Human Behavior, 20, 505–515.

Carmines, E. G., & Zeller, R. A. (1979). Reliability and validity assessment. Beverly Hills. California: Sage Publications.

Doll, W., & Torkzadch, G. (1990). The measurment of End-User software involvement. Omega, 18(4), 399-406.

Donabedian, A. (1966). Evaluating the quality of medical care. Milbank Memorial Fund Q, 44(3), Suppl:166-206.

Donabedian, A. (1988a). Quality assessment and assurance: unity of purpose, diversity of means. Inquiry, 25(1), 173-192.

Donabedian, A. (1988b). The quality of care. How can it be assessed? JAMA : The Journal of the American Medical Association, 260(12), 1743-1748.

Donabedian, A. (1996). The quality of care. How can it be assessed? In Schmele, J. Quality Management in Nursing and Health Care (pp. 52-65). Albany: Delmar Publisher.

Holzemer, W., & Reilly, C. (1995). Variables, variability, and variations research: implications for medical informatics. Journal of the American Medical Informatics Association: JAMIA, 2(3), 183-190.

Igbaria, M. (1990). End user computing effectiveness: a structural equation model. Omega, 18, 637-652.

Knapp, T., & Brown, J. (1995). Ten Measurements That Often Should Be Taken. Research in Nursing & Health, 18, 465-469.

Title:

A Pilot Study of Information Systems Use among Ohio Registered Nurses: Testing Validity and Reliability

Authors: Amany Abdrbo, RN MSN PhD Candidate, Christine A. Hudak, RN PhD, Mary K. Anthony, RN PhD

E-mail: aaa16@case.edu

Affiliation:  Case Western Reserve University, Ohio

Submitted: May 2006

Accepted: August 2006

Editor: Loretta Secco, RN PhD

APA Reference:

Amany, A., Hudak, C. & Anthony, M. (2006). A pilot study of Information Systems use among Ohio Registered Nurses:Testing validity and reliability (abstract, PPT). Canadian Journal of Nursing Informatics, 1(2). https://cjni.net/journal/?p=312