National Academies Press: OpenBook

Taking Action to Reduce Tobacco Use (1998)

Chapter: Monitor Performance in Relation to Public Health Goals

« Previous: Support State and Local Tobacco Control Efforts
Suggested Citation:"Monitor Performance in Relation to Public Health Goals." Institute of Medicine and National Research Council. 1998. Taking Action to Reduce Tobacco Use. Washington, DC: The National Academies Press. doi: 10.17226/6060.
×

differentiation in function. As a universal program, it is logical to shift responsibility to the nation's public health agency, CDC. This would entail a significant scaling-up of current efforts. Yet expansion of the CDC effort should not detract from further progress. Tobacco control efforts will be expanding in Alaska, Arizona, Hawaii, Maine, Oregon, Utah, Wisconsin, and other states. The ASSIST program has shown that a more intense intervention produces results, but it does not clearly show which elements are most powerful, and ASSIST states could not test counteradvertising, public education, or other interventions at the level possible in California and Massachusetts. An expanded commitment to tobacco control increases the importance of knowing which interventions matter most, requiring demonstrations at sufficient dose and duration to enable credible evaluation. That is, many questions remain for research, high-intensity demonstrations, and rigorous program evaluation. This is no time to retrench from research or to stop testing even larger-scale demonstrations. The goal for the next decade should be to achieve tobacco control rivaling that in California and Massachusetts, through the use of a combination of state, local, and federal funds and any payments resulting from a national settlement, and to improve the programs in all states through research, demonstrations, and program evaluation.

Congress must repeal the federal preemption of state and local regulation of advertising and promotion.

The most successful efforts to curb tobacco use have grown from mobilization at the state and community levels and have entailed collaborations among private health organizations and federal, state, and local governments. Federal legislation currently prohibits state and local governments from regulating any form of advertising and promotional activities based on smoking and health, even if the activity occurs exclusively within states' jurisdictional borders. The opportunity for innovation at the state and local levels would be enhanced if this federal impediment were removed, as recommended in the 1994 IOM report.

MONITOR PERFORMANCE IN RELATION TO PUBLIC HEALTH GOALS

The federal government must establish a system for performance monitoring in collaboration with other levels of government and private organizations.

No matter what the final settlements about federal policy prove to be, federal action alone is insufficient to achieve tobacco control. Regardless of which tobacco control measures are put in place, both local and national capacities must be in place to translate goals into actions, to measure progress, and to provide feedback for subsequent policy decisions. The massive national effort that went into Healthy People 2000 is a good place to start a discussion of public health goals.24Healthy People 2000 devoted a chapter to tobacco use, specifying national goals on a timetable; the goals for reducing tobacco use among youths, however, are further from achievement than they were even a few years ago.

Suggested Citation:"Monitor Performance in Relation to Public Health Goals." Institute of Medicine and National Research Council. 1998. Taking Action to Reduce Tobacco Use. Washington, DC: The National Academies Press. doi: 10.17226/6060.
×

A recent IOM report, Improving Health in the Community,25 proposes ways of bridging the gap between national goals and community action and identifying specific organizations or groups at the community level accountable for making progress toward those goals. The general approach discussed in the report is embodied in the Community Health Improvement Process (CHIP). CHIP applies the tools used to monitor performance. To promote the achievement of health improvement goals, the approach entails (a) specifying goals, (b) developing a strategy to achieve them, (c) identifying and implementing local interventions that can be monitored by quantitative indicators, and then (d) collecting and assessing performance data for the specific accountable entities at the community level to evaluate the effectiveness of the intervention strategy and the contributions of the specific accountable entities in the community. The accountable entities will vary among communities, as will the relative priorities of the goals and the resources available to attain those goals.

The CHIP approach might be adapted for use at the national level as well. National health improvement goals might be translated into intervention strategies that federal agencies and a variety of national organizations might be expected to act on and for which performance indicators might be developed and monitored. Such activities at the national level might help shape related efforts at the state and local levels. The approach is described at greater length, with its theoretical underpinning and with specific consideration of tobacco control issues, in a separate background paper prepared for the board by Michael Stoto and Jane Durch of IOM (available on-line at http://www2.nas.edu/cancerbd/226e.html).

Three elements are central to the IOM CHIP model: (1) a broad view of health as a product of the interaction of many factors; (2) recognition that protecting and improving health is a shared responsibility of many entities, each of which needs to be accountable for its activities; and (3) a performance monitoring framework, in which sets of actionable measures are tied to specific entities that can help to ensure the necessary accountability. Accountability is a concern because responsibility diffused among many entities can easily be ignored or abandoned. This approach also points to the importance of interventions that focus not only on individuals but also on collective actions such as the adoption of policies to limit smoking in workplaces or restaurants or the enforcement of laws prohibiting the sale of tobacco products to persons under age 18. In extending the CHIP concept to the national level, there may be opportunities to focus on interventions that target communities and organizations rather than individuals.

A well-chosen set of performance measures could help to reinforce a balanced national and local tobacco control effort. The CHIP approach calls for the use of sets of indicators to make meaningful assessments of overall performance because health issues have many dimensions and can be addressed by various sectors. These sets of indicators should cover critical features of a health improvement effort. They should, however, remain selective; too many details can obscure the broader picture. Indicators must be carefully selected to provide insight into the progress that has been achieved. For an issue such as tobacco control, for which changes in health outcomes such as a reduction in lung cancer deaths will not be observable in the near term, the set of indicators should balance measures of shorter-term gains (e.g., reductions in smoking prevalence or sales of tobacco products to minors) and more fundamental longer-term changes in health (e.g., reductions

Suggested Citation:"Monitor Performance in Relation to Public Health Goals." Institute of Medicine and National Research Council. 1998. Taking Action to Reduce Tobacco Use. Washington, DC: The National Academies Press. doi: 10.17226/6060.
×

in the incidence of lung cancer or lung cancer mortality). The approach is perhaps best explained by way of an illustration, showing some possible national and local performance measures (see table, page 14).

The objectives in Healthy People 2000 are an essential reference point for developing performance measures at the national or the community level. The proposed FDA regulations that mandate restrictions on the sale of tobacco products to youths will be an appropriate focus for performance monitoring, even if other FDA provisions are not implemented. The proposed settlement also stipulates specific goals for reductions in the rate of smoking among youths that could guide the development of performance indicators. Likewise, the recommendations made by the Koop-Kessler Advisory Committee on Tobacco and Public Health suggest a variety of performance measures that might be used to monitor progress.

Without an overall monitoring plan, there is real danger of focusing on one or a few measures to the exclusion of others. The proposed settlement, for example, stipulates extra payments from tobacco firms if smoking measures for youths do not improve. The trigger is the level of daily smoking reported in surveys of youths conducted by the University of Michigan. This measure, part of the larger Monitoring the Future study, could change, even without real changes in the rate of initiation.26 Initiation of tobacco use often begins well before high school and often progresses over two to three years. A more sensitive indicator, such as whether tobacco products were used in the previous 30 days, could also be used (with differential weight) earlier in the process to monitor tobacco use among those in younger age groups. These measures hinge on how students, excluding those not attending school, recall and report their smoking behavior. These measures are useful, but they should be balanced with other independent measures, such as smoking rates among those in the youngest age categories of the National Health Interview Survey, as suggested in the proposed performance measures (see tables). Otherwise, the high stakes create strong incentives to "game" a single indicator without changing the underlying behavior. Self-report measures are notoriously subject to interpretation and recall bias. The point is not that levels of smoking among youths reported in one survey or another are inaccurate or misleading—all measures are limited in one way or another—but rather that caution must be taken against relying on a single measure to monitor performance.

Some fraction of any additional revenues that become available should be devoted to getting better measures more frequently and to making them publicly available. Credible brand-specific penalties or tax increases as recommended above, for example, would require firm data the government could rely on when assessing the payments or taxes. At present the public health monitoring process is slow and coarse compared to the data available to individual tobacco firms.

Reducing tobacco use will require a broader set of measures, reflecting not only the initiation of tobacco use among youths but also the cessation of tobacco use among individuals in all age groups and the attainment of policy objectives. It will also require assessment at the community level as well as in national measures. The performance measures in the table mentioned above are merely first rough cuts to illustrate the possibilities of performance monitoring. The specific measures and objectives can surely be refined, but any long-term strategy for tobacco control must confront the problem: Broader and more robust ways of promoting and monitoring progress and evaluating the relative success of different interventions in diverse communities are needed.

Suggested Citation:"Monitor Performance in Relation to Public Health Goals." Institute of Medicine and National Research Council. 1998. Taking Action to Reduce Tobacco Use. Washington, DC: The National Academies Press. doi: 10.17226/6060.
×

National and Local Performance Measures to Monitor Tobacco Control Efforts

Issue/National Performance Measure

Stakeholders/ Responsible Entities

Possible Corresponding Community Indicators

Possible Stakeholders/ Responsible Entities

Smoking-related mortality

 

 

 

• Number of deaths nationally due to lung cancer, cardiovascular disease, emphysema, chronic bronchitis, respiratory infections; percentage of these deaths attributable to smoking

• National health care organizations, federal government, business, national organizations, general public

• Number of deaths in the community due to lung cancer, cardiovascular disease, emphysema, chronic bronchitis, respiratory infections; percentage of these deaths attributable to smoking

• Health care providers and plans, state and local health agencies, business, community organizations, special health-risk groups, general public

Adult smoking

 

 

 

• Percentage of the adult population, ages 18 and older, who smoke regularly

 

• Percentage of the adult population, ages 18 and older, who smoke regularly

• State and local health agencies, business, community organizations, general public

Initiation of tobacco use

 

 

 

• Percentage of 8th, 10th, and 12th graders who have used cigarettes or smokeless tobacco in past 30 days

• Percentage of 8th, 10th, and 12th graders who use cigarettes or smokeless tobacco daily

• Percentage of those ages 20-24 who smoke regularly

• Percentage of males ages 12-24 who use smokeless tobacco regularly

• Federal government, national voluntary organizations, general public

 

• State and local health agencies, schools, community organizations, general public

Access of children and adolescents to tobacco

 

 

 

• Development of national regulations regarding youth access

• Implementation of regulations by manufacturers (minimum package size; limits on self-service displays, mail orders sales and coupons, free samples)

• Food and Drug Administration(FDA), Congress

• Manufacturers

• Effectiveness of local enforcement of laws prohibiting tobacco sales to youths (minimum age, minimum package size; limits on vending machines, self-service displays, free samples)

• State and local health agencies, local government, business, industry, general public

Suggested Citation:"Monitor Performance in Relation to Public Health Goals." Institute of Medicine and National Research Council. 1998. Taking Action to Reduce Tobacco Use. Washington, DC: The National Academies Press. doi: 10.17226/6060.
×

Reduce appeal of tobacco to youths

 

• Development of national regulations regarding advertising directed at youths

• Implementation of regulations by manufacturers (text-only format, sponsorship of events, sales/distribution of nontobacco items)

• FDA, Congress

• Manufacturers

• Implementation of regulations by manufacturers (no billboards near schools and playgrounds

• Extent to which tobacco use prevention is incorporated into school curricula and activities

• Local health agencies, local government, schools

Reduce exposure to environmental tobacco smoke (ETS)

 

• Development of model ETS regulations

• Prevalence of ETS regulations in federal government facilities

• Federal government, national businesses, national voluntary organizations

• State and local regulation of smoking in workplaces and enclosed public places

• Enforcement of existing ETS regulations

• State and local health agencies, local government, business, industry

Promote cessation of tobacco use

 

• Federal funding for development and evaluation of smoking cessation programs

• Cessation attempts among the adult population, ages 18 and older, who smoke regularly

• Federal government, national health care plans, national voluntary organizations, national business organizations

• Availability of smoking cessation programs

• Cessation attempts among the adult population, ages 18 and older, who smoke regularly

• Health care providers/plans, business, community organizations, general public

Smoking during pregnancy

 

• Federal funding for development and evaluation of smoking cessation programs for pregnant women

• Cessation among pregnant women who smoke regularly

• Federal government, national health care plans, national voluntary organizations, national business organizations

• Availability of smoking cessation programs for pregnant women

• Cessation among pregnant women who smoke regularly

• Health care providers/plans, business, community organizations, general public

Suggested Citation:"Monitor Performance in Relation to Public Health Goals." Institute of Medicine and National Research Council. 1998. Taking Action to Reduce Tobacco Use. Washington, DC: The National Academies Press. doi: 10.17226/6060.
×

Issue/National Performance Measure

Stakeholders/ Responsible Entities

Possible Corresponding Community Indicators

Possible Stakeholders/ Responsible Entities

Health care system efforts to reduce tobacco use

 

• Percentage of smokers whose health care providers ask about smoking, provide cessation counseling, and assist with cessation efforts

• Proportion of nonsmoking youths counseled not to begin tobacco use

• Percentage of health care-plan-covered lives with coverage for tobacco cessation programs

• Proportion of health plans or national professional organizations that have adopted policies or recommendations that during appropriate health care visits clinicians should identify patients who use tobacco, provide cessation counseling, and assist in cessation efforts

• Proportion of academic health centers that include training in cessation counseling in undergraduate and continuing education curricula for health professionals (including physicians, nurses, dentists, physicians' assistants, etc.)

• Federal government, national health care plans, national voluntary organizations, national business organizations

For each health care plan:

• Percentage of smokers whose health care providers ask about smoking, provide cessation counseling, and assist with cessation efforts

• Proportion of nonsmoking youths counseled not to begin tobacco use

• Percentage of health care-plan-covered lives with coverage for tobacco cessation programs

• Health care providers/plans, business, community organizations, general public

Suggested Citation:"Monitor Performance in Relation to Public Health Goals." Institute of Medicine and National Research Council. 1998. Taking Action to Reduce Tobacco Use. Washington, DC: The National Academies Press. doi: 10.17226/6060.
×

Community-based programs to change social norms

• Federal funding for development and evaluation of community-based programs to change social norms and reduce tobacco use

• Federal government, national businesses, national voluntary organizations

• Existence of community-based antitobacco coalitions

• Number of smoking cessation programs available and their use and success rate

• Extent to which tobacco use prevention is incorporated into school curricula and activities

• Proportion of students who associate physical or psychological harm with and who perceive social disapproval of regular use of tobacco

 

• State and local health agencies, schools, community organizations, general public

Tobacco excise tax

• Federal excise tax per pack of cigarettes

• Federal government, manufacturers, smokers, general public

• State excise tax per pack of cigarettes

• State government, manufacturers, smokers, general public

Suggested Citation:"Monitor Performance in Relation to Public Health Goals." Institute of Medicine and National Research Council. 1998. Taking Action to Reduce Tobacco Use. Washington, DC: The National Academies Press. doi: 10.17226/6060.
×
Page 11
Suggested Citation:"Monitor Performance in Relation to Public Health Goals." Institute of Medicine and National Research Council. 1998. Taking Action to Reduce Tobacco Use. Washington, DC: The National Academies Press. doi: 10.17226/6060.
×
Page 12
Suggested Citation:"Monitor Performance in Relation to Public Health Goals." Institute of Medicine and National Research Council. 1998. Taking Action to Reduce Tobacco Use. Washington, DC: The National Academies Press. doi: 10.17226/6060.
×
Page 13
Suggested Citation:"Monitor Performance in Relation to Public Health Goals." Institute of Medicine and National Research Council. 1998. Taking Action to Reduce Tobacco Use. Washington, DC: The National Academies Press. doi: 10.17226/6060.
×
Page 14
Suggested Citation:"Monitor Performance in Relation to Public Health Goals." Institute of Medicine and National Research Council. 1998. Taking Action to Reduce Tobacco Use. Washington, DC: The National Academies Press. doi: 10.17226/6060.
×
Page 15
Suggested Citation:"Monitor Performance in Relation to Public Health Goals." Institute of Medicine and National Research Council. 1998. Taking Action to Reduce Tobacco Use. Washington, DC: The National Academies Press. doi: 10.17226/6060.
×
Page 16
Suggested Citation:"Monitor Performance in Relation to Public Health Goals." Institute of Medicine and National Research Council. 1998. Taking Action to Reduce Tobacco Use. Washington, DC: The National Academies Press. doi: 10.17226/6060.
×
Page 17
Next: Help Current Users Quit »
Taking Action to Reduce Tobacco Use Get This Book
×
 Taking Action to Reduce Tobacco Use
Buy Paperback | $21.00
MyNAP members save 10% online.
Login or Register to save!
Download Free PDF

READ FREE ONLINE

  1. ×

    Welcome to OpenBook!

    You're looking at OpenBook, NAP.edu's online reading room since 1999. Based on feedback from you, our users, we've made some improvements that make it easier than ever to read thousands of publications on our website.

    Do you want to take a quick tour of the OpenBook's features?

    No Thanks Take a Tour »
  2. ×

    Show this book's table of contents, where you can jump to any chapter by name.

    « Back Next »
  3. ×

    ...or use these buttons to go back to the previous chapter or skip to the next one.

    « Back Next »
  4. ×

    Jump up to the previous page or down to the next one. Also, you can type in a page number and press Enter to go directly to that page in the book.

    « Back Next »
  5. ×

    Switch between the Original Pages, where you can read the report as it appeared in print, and Text Pages for the web version, where you can highlight and search the text.

    « Back Next »
  6. ×

    To search the entire text of this book, type in your search term here and press Enter.

    « Back Next »
  7. ×

    Share a link to this book page on your preferred social network or via email.

    « Back Next »
  8. ×

    View our suggested citation for this chapter.

    « Back Next »
  9. ×

    Ready to take your reading offline? Click here to buy this book in print or download it as a free PDF, if available.

    « Back Next »
Stay Connected!