Assessment 3 Instructions: Evaluation of an Information System Change
Write a 3 page evaluation report analyzing the frameworks for evaluating the impact of an information system and system change. Create an Excel or Word table evaluation plan for the project. Write a short summary to explain your plan to stakeholders.
Note: Each assessment in this course builds on the work you completed in the previous assessment. Therefore, you must complete the assessments in this course in the order in which they are presented.
With any new or changed system, you should be working to ensure that the information system has functionality in the form of interoperability and integration of information. As part of the evaluation process, you should assess the interoperability and integration of system information. You will present these findings for the stakeholders to acknowledge and confirm.
As part of your work as the nursing informatics specialist, you have developed and implemented an information system change in your organization. Now it is time to design an evaluation report about the change and to put into place a consistent method for a system evaluation plan.
Note: Complete the assessments in this course in the order in which they are presented.
Your submission will include three parts. The first part will be a written 3 page evaluation report, in which you will analyze the frameworks for evaluating the impact of an information system and system change. The second part will be a single page evaluation plan table. The third part will be an overview discussion for stakeholders.
Part 1: Evaluation Report
For this part of your submission, you will define the three types of framework components. One is related to quality of information that is generated by the information system change, the second relates to the effects on outcomes of quality care due to the system change, and the third is the structural quality of the system with the change (Garcia-Dia, 2019, p. 376).
One way to organize this report is as follows:
- When defining the quality of information framework include:
- The development of completeness or correctness of data.
- User satisfaction with the system.
- Patient privacy that is incorporated into the system’s information.
- Patient satisfaction with the system.
- When defining outcomes of quality care framework include:
- Efficiency with the use of the system.
- Appropriateness of care with the use of the system.
- When defining the structural quality framework include:
- Organizational support given to the system.
- Effectiveness of hardware for the use of the system.
- Effectiveness of software when using the system.
- Overall functionality of the system.
Part 2: Evaluation Plan Table
For this part of your submission, you will design an evaluation plan to monitor the system changes (Garcia-Dia, 2019, p. 379). You will use the goals that you defined as part of your implementation plan as a starting point for constructing your table.
One way to organize your table is as follows:
- First Column:
- Goals from the implementation plan.
- Second Column
- Framework component or components (defined in Part 1) that best fit each goal.
- Third Column
- Define at least two measurements for each goal.
- Fourth Column
- Define the frequency of measurement.
- Fifth Column
- Briefly explain why you are using the chosen measures related to the outcomes that you want to achieve with the new system change.
Part 3: Overview Discussion with Stakeholders
For this part of your submission, you will write a summary discussion of highlights from your evaluation report and evaluation plan for stakeholders (including the implementation team). Include the following in your summary:
- Brief introduction to the project.
- Discussion of the evaluation report that provides a brief overview of how the system is currently functioning from several perspectives related to the framework components.
- Discussion of the evaluation plan that provides the stakeholders information about:
- What will you monitor ongoing with the system?
- How will you accomplish the monitoring?
- When will you monitor?
- Why are you monitoring these specific data points?
- Brief conclusion to provide stakeholders with the one or two most cogent talking points.
- Evaluation Report Length: 3 pages in length, not including the title and reference page.
- APA Style and Format: Use APA formatting with a title page, running head, title on the first page of text, level 1 headings, and a reference list.
- Number of References: Include 5 scholarly sources used as parenthetical citations and in a reference list.
- Evaluation Plan: Create a 1-page Excel or Word table to illustrate your evaluation plan.
- If you use a Word table, include it at the end of your evaluation report and designate the evaluation plan table using the appropriate APA style headings.
- Overview with Stakeholders summary
- Competencies Measured
By successfully completing this assessment, you will demonstrate your proficiency in the following course competencies and assessment criteria:
- Competency 1: Evaluate strengths and liabilities of health information systems.
- Define three evaluation framework components that are relevant and appropriate for an organizational information system change project.
- Create a comprehensive evaluation plan for an organizational information system change project that lays out framework components, measurements, frequency of measurements, and rationale for measurements as aligned to specific project goals.
- Competency 2: Incorporate project management principles into nursing informatics.
- Summarize the evidence-based rationale and specific actions that will be undertaken as part of the evaluation of an organizational information system change project for stakeholders.
- Competency 4: Communicate as a practitioner-scholar, consistent with the expectations of a nursing professional.
- Appropriately address all components of the assignment prompt, using the assignment description to structure text.
- Support main points, assertions, arguments, conclusions, or recommendations with relevant and credible evidence.
- Communicate orally in a clear and concise manner, which helps to clarify key information and expectations for stakeholders in a presentation of 3 or fewer minutes.
To learn more about key topics related to this assessment, read:
Garcia-Dia, M. J. (Ed.). (2019). Project management in nursing informatics. Springer Publishing Company.
Chapter 12, “Project Monitoring and Controlling in Program Management.”
To learn about how project managers work to ensure smooth implementation and adoption of a new or changed system, as well as look for early warning signs that could derail a project, read this chapter.
Chapter 13, “Project Closing: Evaluation of an Information Technology Implementation—Using the Project Development Life Cycle and the Role of the Nursing Informatics Specialist.”
To learn about evaluation tools and closeout processes that benefit practitioners and organizations, read this chapter. You can use the evaluation frameworks presented in this chapter in your assessment, so pay attention to them.
Chapter 14, “Project Data and Reports.”
To learn about data planning and data output using reports in informatics project management, read this chapter.
Chapter 15, “Project Management and Nursing Informatics: An Educator Perspective.”
To learn about strategies to help others understand informatics concepts, read this chapter.
Chapter 16, “Future Direction.”
To learn about some of the projected trends in healthcare-related information systems, and how they might impact long-term project sustainability, read this chapter.