National Academies Press: OpenBook

Evaluation of the Lovell Federal Health Care Center Merger: Findings, Conclusions, and Recommendations (2012)

Chapter: Appendix B: Framework for Evaluating Department of Veterans Affairs/Department of Defense Health Care Collaborations

« Previous: Appendix A: Biographical Sketches of Committee Members and Staff
Suggested Citation:"Appendix B: Framework for Evaluating Department of Veterans Affairs/Department of Defense Health Care Collaborations." Institute of Medicine. 2012. Evaluation of the Lovell Federal Health Care Center Merger: Findings, Conclusions, and Recommendations. Washington, DC: The National Academies Press. doi: 10.17226/13482.
×

Appendix B

Framework for Evaluating Department of Veterans Affairs/Department of Defense Health Care Collaborations

In the process of its deliberations, the committee created a framework (Table B-1) to guide its evaluation of the Lovell Federal Health Care Center (FHCC) merger that may prove useful to assess future collaborations between the Departments of Defense (DoD) and Veterans Affairs (VA), whether these take the form of shared service arrangements, joint ventures, or partial or full mergers. The five major categories for consideration include (1) national and local contexts, (2) organizational capabilities and readiness, (3) implementation initiatives, (4) intermediate outcomes, and (5) long-term impact. Each of these is discussed in turn.

NATIONAL AND LOCAL CONTEXTS

Whether various forms of continued or expanded collaboration between DoD and VA medical facilities make sense will depend to a large degree on the national and local contexts within which such collaborations might be realized. Among the most important of these are the current DoD and VA departmental policies, goals, and objectives. The Lovell FHCC “integration,” for example, was inherently constrained by the need to conform to many divergent DoD and VA policies. In some respects, the degree of success of the integration was achieved through major “workarounds” of current national VA and DoD policies and business processes. In the extreme, one could imagine a fully merged “Federal Health Service” that would totally absorb and integrate current DoD and VA health care policies and institutions. For a variety of reasons, this may not be feasible in the near future. In the meantime, any future collaborations must recog-

Suggested Citation:"Appendix B: Framework for Evaluating Department of Veterans Affairs/Department of Defense Health Care Collaborations." Institute of Medicine. 2012. Evaluation of the Lovell Federal Health Care Center Merger: Findings, Conclusions, and Recommendations. Washington, DC: The National Academies Press. doi: 10.17226/13482.
×

TABLE B-1 Framework for Evaluating Department of Veterans Affairs and Department of Defense Health Care Collaborations*

National and Local Contexts Organizational Capabilities and Readiness Implementation Initiatives Intermediate Outcomes First 2 Years Long-Term Impact 3–5 Years

•  Department of Veterans Affairs and Department of Defense (DoD) policies, goals, objectives

•  Number and location of facilities

•  Size and number of people served

•  Local health care market—public and private sectors

•  Local labor market

•  Other

•  Shared vision

•  History of working together

•  Culture

•  Leadership

•  Information technology capabilities

•  Care management

•  Care improvement

•  Performance measurement

•  Training and human resources development

•  Financial reserves

•  Other

•  Combining departments and services

•  Transferring personnel

•  Orienting employees

•  Communication/education

•  Developing policies

•  Developing shared electronic health records

•  Other

•  Increased operational readiness for recruits

•  Expanding patient volume to critical mass to maintain competency

•  More in-house surgery—added posttraumatic stress disorder unit

•  Increased professional opportunities for staff

•  Residency opportunities • Healthcare Effectiveness Data and Information Set, DoD, Joint Commission benchmark measures

•  Employee satisfaction

•  Patient experience measures

•  Other

•  Operating efficiencies

•  Costs per patient

•  Patient functional health status measures

•  Increased market share in local area

•  Other

* It is important to evaluate shared services, joint ventures, and partial and full mergers, etc., against their own stated goals and objectives in addition to those expected by external parties, including accreditation bodies, payers, and others.

Suggested Citation:"Appendix B: Framework for Evaluating Department of Veterans Affairs/Department of Defense Health Care Collaborations." Institute of Medicine. 2012. Evaluation of the Lovell Federal Health Care Center Merger: Findings, Conclusions, and Recommendations. Washington, DC: The National Academies Press. doi: 10.17226/13482.
×

nize the constraints imposed by the existence of separate executive branch departments with differing missions, statutory requirements, departmental policies, administrative procedures, organizational cultures, performance standards, and reporting requirements.

Other important contextual factors include the current degree of interdependence among DoD and VA facilities relative to collocation, current sharing of services, various informal arrangements, opportunities for medical and health professional education and research, and related factors. Other additional factors include the number of people served by the entities involved, their demographic characteristics and health needs, and the characteristics of the local private-sector health care marketplace. Further considerations include the strength of the local economy, the availability of workforce, and related resources. Relationships with medical and affiliated health professions schools are also an important consideration.

Despite the national policy challenges, the local context was quite favorable for the Lovell FHCC integration. For instance, the Navy and the VA facilities were located very close together, allowing the VA to accommodate Navy beneficiaries and improve the capacity of its medical facility and the Navy to save money by not having to replace its obsolete inpatient facility. In addition, the VA patient population offered a more varied and complex health care treatment mix to allow Navy clinical personnel to keep up their skills, while the overall increase in the number of patients created some economies of scale and staffing efficiencies. For the VA, in addition to increasing use, the larger and more varied patient base, including women and children, provided increased training and potential research opportunities for medical students and residents.

Into the future, changes in demand for both DoD and VA facilities will be an important consideration for the success of collaborative activities. The veteran population enrollment for VA health care services is projected to decline over the next decade, and immediate indicators suggest a reduced future demand. Another factor to be considered is the difference between the requirements of more standard health care operations as opposed to recruit training sites, such as that found in the Lovell FHCC merger.

The country’s slow economic recovery, the burden of debt, and related factors may also affect how the nation chooses to provide health care to its military personnel and veterans.

ORGANIZATIONAL CAPABILITIES AND READINESS

The second key component in considering future collaborations is a rigorous realistic assessment of the capabilities and readiness of the involved parties. While there are many important factors to consider, among the most critical are the governance and the stability of leadership of the

Suggested Citation:"Appendix B: Framework for Evaluating Department of Veterans Affairs/Department of Defense Health Care Collaborations." Institute of Medicine. 2012. Evaluation of the Lovell Federal Health Care Center Merger: Findings, Conclusions, and Recommendations. Washington, DC: The National Academies Press. doi: 10.17226/13482.
×

involved entities; the budget authorities and restrictions; the electronic health record (EHR) system and information technology infrastructure capabilities; the human resource systems, capabilities, and personnel resources; and the care processes and management/improvement/performance measurement systems (including outcomes that can be compared against external benchmarks).

The single biggest barrier for the more complete clinical implementation of the Lovell FHCC was the incompatibility of the DoD and the VA EHR systems and the resultant technical challenges and barriers. The time necessary to integrate various features of the two systems was seriously underestimated, resulting in delays and incremental “one-off” workarounds. The problem of having to reconcile two different human resources systems was solved by the decision to move all the Navy civilians into the VA personnel system, although the active duty servicemembers could not be moved. A great deal of time and energy had to be spent addressing cultural differences between the Navy and the VA, which would also be expected from potential mergers between the VA and other branches of the services that have their own distinct cultures. Chapter 3 gives a more detailed description of the implementation process.

DoD and VA entities considering further collaborative opportunities also need to assess their current care management and quality improvement processes, and their ability to generate performance measures. To their credit, the Lovell FHCC leaders developed a set of standardized performance measures in the areas of patient access, quality of care, patient satisfaction, provider satisfaction, and mission readiness that are tracked on a regular basis.

Finally, the financial resources available to implement further collaborations must be assessed relative to the challenges of implementation. Because of its status as the first demonstration of an integrated VA/DoD health care facility, the Lovell FHCC received substantial resources from the departments that might not be available to future integration efforts and, if provided, would significantly increase the cost side of the cost-benefit equation.

IMPLEMENTATION INITIATIVES

An accurate documentation of the actual changes made at the Lovell FHCC is critical to evaluating the successes and failures in North Chicago to inform other collaborations between DoD and VA facilities. The central question involves change. Specifically, what changes are made by whom, with whom, and with what results? Examples include the acculturation of shared mission and vision through the establishment of joint governance

Suggested Citation:"Appendix B: Framework for Evaluating Department of Veterans Affairs/Department of Defense Health Care Collaborations." Institute of Medicine. 2012. Evaluation of the Lovell Federal Health Care Center Merger: Findings, Conclusions, and Recommendations. Washington, DC: The National Academies Press. doi: 10.17226/13482.
×

and leadership structures (see Organizational Capabilities and Readiness), joint business offices and a joint strategic planning process, development of multidisciplinary teams and ongoing and continuous communication mechanisms, the combining of departments and services, the transferring of personnel, staff orientation, shared EHR system implementation, and many other such changes.

INTERMEDIATE OUTCOMES

Intermediate outcomes can be categorized in terms of cost and efficiency, clinical processes and outcomes, patient experience, and education and research. Cost and efficiency measures include various measures of productivity as well as cost per patient. Clinical process measures would include the Healthcare Effectiveness Data and Information Set, the DoD, and the Joint Commission benchmark measures. They might also include patient and staff satisfaction measures. Research and education measures could include the amount of research funding generated but also the number of articles published in peer-reviewed journals, particularly articles jointly authored by DoD and VA researchers.

Each potential collaboration should also be evaluated on intermediate outcomes based on its unique organizational mission, strategic goals, and objectives. Some examples at the Lovell FHCC included developing in-house surgical capacity, upgrading the emergency department, extending the range of specialty services provided onsite, increasing professional opportunities for staff, improving the operational readiness of the recruits and other active duty servicemembers, and increasing the clinical competence of Navy providers.

LONG-TERM IMPACT

While intermediate outcomes can usually be observed within a year or 2 of implementing an expanded collaboration, it is also important to examine the longer-term impact that emerges over a 3- to 5-year period. The impact can be measured by responses to key questions. For example, are the initial positive outcomes sustained over time (e.g., in the areas of health care value and efficiency, access, patient clinical outcomes, patient functional health status outcomes, patient experience measures, and related metrics)? Is there growth in the patient population served, admissions, and other indicators of service use? These data should be compared with comparable data available from private-sector institutions to better examine the overall nature of a DoD/VA health service impact in a given geographic area. Finally, it should be asked what additional innovations in

Suggested Citation:"Appendix B: Framework for Evaluating Department of Veterans Affairs/Department of Defense Health Care Collaborations." Institute of Medicine. 2012. Evaluation of the Lovell Federal Health Care Center Merger: Findings, Conclusions, and Recommendations. Washington, DC: The National Academies Press. doi: 10.17226/13482.
×

new program development have taken place as a result of the collaborative activity established several years earlier.

While the committee’s framework can be used retrospectively to assess the Lovell FHCC experience, its greater potential is as a template for evaluating and learning from future collaborations between the DoD and the VA. It can be used both by an external entity to provide an independent assessment of collaborative activity as well as by the collaborating institutions themselves to assess their ongoing progress.

Suggested Citation:"Appendix B: Framework for Evaluating Department of Veterans Affairs/Department of Defense Health Care Collaborations." Institute of Medicine. 2012. Evaluation of the Lovell Federal Health Care Center Merger: Findings, Conclusions, and Recommendations. Washington, DC: The National Academies Press. doi: 10.17226/13482.
×
Page 193
Suggested Citation:"Appendix B: Framework for Evaluating Department of Veterans Affairs/Department of Defense Health Care Collaborations." Institute of Medicine. 2012. Evaluation of the Lovell Federal Health Care Center Merger: Findings, Conclusions, and Recommendations. Washington, DC: The National Academies Press. doi: 10.17226/13482.
×
Page 194
Suggested Citation:"Appendix B: Framework for Evaluating Department of Veterans Affairs/Department of Defense Health Care Collaborations." Institute of Medicine. 2012. Evaluation of the Lovell Federal Health Care Center Merger: Findings, Conclusions, and Recommendations. Washington, DC: The National Academies Press. doi: 10.17226/13482.
×
Page 195
Suggested Citation:"Appendix B: Framework for Evaluating Department of Veterans Affairs/Department of Defense Health Care Collaborations." Institute of Medicine. 2012. Evaluation of the Lovell Federal Health Care Center Merger: Findings, Conclusions, and Recommendations. Washington, DC: The National Academies Press. doi: 10.17226/13482.
×
Page 196
Suggested Citation:"Appendix B: Framework for Evaluating Department of Veterans Affairs/Department of Defense Health Care Collaborations." Institute of Medicine. 2012. Evaluation of the Lovell Federal Health Care Center Merger: Findings, Conclusions, and Recommendations. Washington, DC: The National Academies Press. doi: 10.17226/13482.
×
Page 197
Suggested Citation:"Appendix B: Framework for Evaluating Department of Veterans Affairs/Department of Defense Health Care Collaborations." Institute of Medicine. 2012. Evaluation of the Lovell Federal Health Care Center Merger: Findings, Conclusions, and Recommendations. Washington, DC: The National Academies Press. doi: 10.17226/13482.
×
Page 198
Next: Appendix C: Department of Veterans Affairs/Department of Defense Joint Ventures: Brief Histories and Lessons Learned »
Evaluation of the Lovell Federal Health Care Center Merger: Findings, Conclusions, and Recommendations Get This Book
×
Buy Paperback | $54.00 Buy Ebook | $43.99
MyNAP members save 10% online.
Login or Register to save!
Download Free PDF

The 2010 opening of the Captain James A. Lovell Federal Health Care Center (FHCC) created a joint entity between the Department of Defense (DoD) and the Department of Veterans Affairs (VA) that replaced two separate centers in North Chicago. VA and DoD leaders envisioned a state-of-the-art facility that would deliver health care to both DoD and VA beneficiaries from northern Illinois to southern Wisconsin, providing service members and veterans seamless access to an expanded array of medical services. Unprecedented for the military and the VA, the Lovell FHCC would integrate clinical and administrative services under a single line of authority.

The DoD asked the IOM to evaluate whether the Lovell FHCC has improved health care access, quality, and cost for the DoD and the VA, compared with operating separate facilities, and to examine whether patients and health care providers are satisfied with joint VA/DoD delivery of health care.

Evaluation of the Lovell Federal Health Care Center Merger: Findings, conclusions, and Recommendations finds that initial implementation of the Lovell FHCC has provided important lessons about how to integrate VA and DoD health care services and has identified remaining obstacles that the departments could overcome to make such mergers more effective and less costly to implement. The IOM recommends that the VA and the DoD develop a comprehensive evaluation plan to objectively judge its success or failure, with measurable criteria, that would provide essential knowledge for both the Lovell FHCC and future endeavors.

  1. ×

    Welcome to OpenBook!

    You're looking at OpenBook, NAP.edu's online reading room since 1999. Based on feedback from you, our users, we've made some improvements that make it easier than ever to read thousands of publications on our website.

    Do you want to take a quick tour of the OpenBook's features?

    No Thanks Take a Tour »
  2. ×

    Show this book's table of contents, where you can jump to any chapter by name.

    « Back Next »
  3. ×

    ...or use these buttons to go back to the previous chapter or skip to the next one.

    « Back Next »
  4. ×

    Jump up to the previous page or down to the next one. Also, you can type in a page number and press Enter to go directly to that page in the book.

    « Back Next »
  5. ×

    Switch between the Original Pages, where you can read the report as it appeared in print, and Text Pages for the web version, where you can highlight and search the text.

    « Back Next »
  6. ×

    To search the entire text of this book, type in your search term here and press Enter.

    « Back Next »
  7. ×

    Share a link to this book page on your preferred social network or via email.

    « Back Next »
  8. ×

    View our suggested citation for this chapter.

    « Back Next »
  9. ×

    Ready to take your reading offline? Click here to buy this book in print or download it as a free PDF, if available.

    « Back Next »
Stay Connected!