National Academies Press: OpenBook
« Previous: References
Suggested Citation:"Appendix A Panel Data-Gathering Activities." National Research Council. 2008. Understanding American Agriculture: Challenges for the Agricultural Resource Management Survey. Washington, DC: The National Academies Press. doi: 10.17226/11990.
×

Appendix A
Panel Data-Gathering Activities

The panel conducted the bulk of its business in open forum, eliciting input from staff of the Economic Research Service (ERS) and the National Agricultural Statistics Service (NASS) as well as key data users, policy makers, and additional technical experts. The panel’s public sessions included a workshop on statistical methodology, June 8-9, 2006; a session for data users at the annual meeting of the American Agricultural Economics Association, July 24, 2006; a workshop on concepts and measurement, September 28-29, 2006; a workshop on inference, December 7-8, 2006; and an open discussion of cost-of-production issues, January 18, 2007.

At the panel’s introductory meeting in February 2006, Katherine Smith, then associate director of ERS, and Carol House, associate director of NASS, set the stage for the work of the panel. They discussed the purpose of the study from their perspective, and the charge to the panel. Their frank and open exposition on the need for a review of the survey were instrumental in focusing our attention on key issues to be addressed in the study and in enhancing our understanding of the partnership between these agencies that directs and sustains the survey. In Carol House’s presentation, the panel was challenged to consider not only the question of whether the agencies were doing the right things in terms of content, but also whether they are doing things correctly in terms of approach and methodology. Katherine Smith emphasized the critical importance of the survey as the main source of information on farm economics, production, and structure.

These presentations were supported and elaborated by a thorough discussion of the state of the survey by Robert Bass and Mary Bohman, who

Suggested Citation:"Appendix A Panel Data-Gathering Activities." National Research Council. 2008. Understanding American Agriculture: Challenges for the Agricultural Resource Management Survey. Washington, DC: The National Academies Press. doi: 10.17226/11990.
×

addressed issues arising from the complexity of the Agricultural Resource Management Survey (ARMS): the complicated survey form, the problem of missing observations and nonresponse, the lack of comparability of measures across subsamples, and the difficulties in analysis imposed by the complex estimation and other procedures, among other topics.

At our second meeting, the panel focused on issues of statistical methodology and heard mainly from staff of NASS and ERS with responsibility for various aspects of survey design and data collection, estimation, and processing. In the discussion of questionnaire content, the panel learned from Doug Kleweno, Jim Johnson, Carol Jones, and Bill McBride about the determinants of the content of ARMS from the perspective of resource use, farm business performance, farm household well-being, and commodities, respectively. Two presentations were made on the process of turning concepts into questions, as well as the methods of testing and implementing the questionnaires by Danna Moore of the University of Washington, and Kathy Ott of NASS. Collection methodology and other statistical aspects of the survey were discussed by Bob Bass, Bill Iwig, Alix Riley, Richard Barton, and Chadd Crouse. In the final session, Phillip Kott, Bob Dubman, and Nigel Key introduced the challenging topic of methods of imputation and analysis of the ARMS data. The panel revisited the difficult issues involved in imputation with a complex survey design in our fourth meeting.

At the annual meeting of the American Agricultural Economics Association (AAEA) in August 2006, several panel members met informally with a large group of frequent ARMS data users to discuss accessibility of the data and data dissemination. The users also introduced issues regarding response rates, survey design, content, classification, editing and imputation, coding, cross-survey comparisons, and ongoing user forums. A summary of the discussion was reported to the entire panel at our third meeting.

The third meeting focused on the needs of major public- and private-sector data users and on data dissemination. Useful insights on data needs by major federal users were provided by Jim Langley, Joseph Cooper, and Joseph Glauber, representing the perspective of the Congressional Budget Office, the Council of Economic Advisers, and the Office of the Chief Economist, U.S. Department of Agriculture (USDA), respectively. Bob Young discussed the data needs of the general interest U.S. American Farm Bureau Federation, and Gary Adams laid out the requirements of the statistics program of the National Cotton Council, one of the major commodity-oriented interest groups. Discussing concepts and measures for understanding environmental analysis, commodities, and farm household well-being were Timothy Kiely and Arthur Grube, U.S. Environmental Protection Administration; Jeff Goebel, National Resources Conservation Service, USDA; and Roger Claasen, Bill McBride, Carol Jones, and Jim Johnson, ERS.

Suggested Citation:"Appendix A Panel Data-Gathering Activities." National Research Council. 2008. Understanding American Agriculture: Challenges for the Agricultural Resource Management Survey. Washington, DC: The National Academies Press. doi: 10.17226/11990.
×

The panel conducted a lively discussion of issues involved in dissemination of survey data, particularly to users of individual record data for research purposes, supported by presentations by Mitch Morehart, ERS, and Ron Jarmin, U.S. Census Bureau.

Two substantive topics were revisited in the fourth and fifth panel meetings, which otherwise were largely focused on report preparation and discussion of potential recommendations. The panel delved more deeply into the problem of data analysis for complex surveys, with presentations by William Greene, New York University, who served as a consultant to the panel, Phillip Kott, and Jim MacDonald, ERS, who elaborated earlier presentations.

Bill McBride rejoined the panel to add detail to prior discussions of the treatment of commodities in ARMS, with a focus on the implementation of recommendations by a special AAEA panel on cost of production.

Agendas of the panel’s data-gathering meetings appear below.

MEETING AGENDAS

First Meeting

February 2-3, 2006


Goals for the first meeting:

Introduce panel members to each other and to the supporting staff.

Conduct the bias and conflict of interest discussion.

Hold an open session with representatives of the sponsoring agency and other experts to discuss the charge to the panel and to learn more about the Agricultural Resource Management Survey.

Organize the approach to the task.

Set dates for future meetings.


Thursday, February 2

12:00 – 1:00 p.m.

Welcome and Panel Introductions

Bruce Gardner, Chair

 

Michael Feuer, Executive Director, Division of Behavioral and Social Sciences and Education

 

Constance Citro, Director, Committee on National Statistics

Suggested Citation:"Appendix A Panel Data-Gathering Activities." National Research Council. 2008. Understanding American Agriculture: Challenges for the Agricultural Resource Management Survey. Washington, DC: The National Academies Press. doi: 10.17226/11990.
×

1:00 – 1:45 p.m.

Overview of the Agenda

Bruce Gardner, Chair

 

Begin Discussion of the Statement of Work

Panel Discussion

1:45 – 2:00 p.m.

Break

2:00 – 3:00 p.m.

Charge to the Panel

 

Kitty Smith, Associate Director, Economic Research Service

 

Carol House, Associate Director, National Agricultural Research Service

3:00 – 4:30 p.m.

Status of the Agricultural Resource

Management Survey/Issues to Be Addressed

 

Mary Bohman, Director, Resource Economics Division, ERS

 

Robert Bass, Director, Census and Survey Division, NASS

4:30 – 5:00 p.m.

Bias and Conflict of Interest Discussion

Kirsten Sampson-Snyder

5:00 – 5:45 p.m.

Discussion of ARMS Program Issues

Bruce Gardner, Chair

5:45 p.m.

Adjourn for the Day

Friday, February 3

8:30 – 10:00 a.m.

Working Session

 

  • Review information sharing exercise from prior day; identify needed adjustments to approach

  • Discuss issues to be examined; develop plans to address each; assign panel responsibilities

  • Develop plans for follow-on activities

Suggested Citation:"Appendix A Panel Data-Gathering Activities." National Research Council. 2008. Understanding American Agriculture: Challenges for the Agricultural Resource Management Survey. Washington, DC: The National Academies Press. doi: 10.17226/11990.
×

10:00 – 10:15 a.m.

Break

10:15 a.m. – 12:00 p.m.

Working Session Continues

12:00 – 1:00 p.m.

Lunch

1:00 – 3:00 p.m.

Working Session

 

  • Revisit adequacy of panel expertise

  • Determine if consultant assistance is needed

  • Discuss audience for final report

  • Develop outline of final report

  • Develop plans for future meetings

3:00 p.m.

Adjourn

SECOND MEETING

June 8-9, 2006


Goals for the statistical methodology workshop:

To discuss statistical methodology issues in the ARMS program.

To plan for the upcoming Concepts and Measurements workshop.

To develop an outline for the final report.


Thursday, June 8

8:30 – 9:00 a.m.

Panel Business

Bruce Gardner, Chair

 

Bias and Conflict of Interest Discussion

Kirsten Sampson-Snyder

9:00 – 9:15 a.m.

Welcome and Overview of the Agenda

Bruce Gardner, Chair

9:15 – 10:00 a.m.

Interagency Interaction on Issues of Statistical Methodology

Suggested Citation:"Appendix A Panel Data-Gathering Activities." National Research Council. 2008. Understanding American Agriculture: Challenges for the Agricultural Resource Management Survey. Washington, DC: The National Academies Press. doi: 10.17226/11990.
×

 

Robert Bass, Director, Census and Survey Division, NASS

 

Mary Bohman, Director, Resource Economics Division, ERS

10:00 – 10:15 a.m.

Break

10:15 a.m. – 12:00 p.m.

Survey Management and Data Collection Issues and Statistical Methodology Issues: Questionnaire Content

 

Cynthia Clark, Moderator

 

Information on Resource Use and

 

Allocation at the Field Level

 

Doug Kleweno, NASS

 

Information on Farm Business

 

Performance: Resources, Environment,

 

Other Enterprise Information

 

Jim Johnson, ERS

 

Information on the Farm Household:

 

Economic Well-Being

 

Carol Jones, ERS

 

Information on Commodities

 

Bill McBride, ERS

12:00 – 1:00 p.m.

Lunch

1:00 – 5:30 p.m.

Survey Management and Data Collection Issues and Statistical Methodology Issues

 

Fred Conrad, Moderator

 

Questionnaire Design

 

TBA

 

Questionnaire Development

 

Kathy Ott, NASS

 

Collection Methodology—Current and Options (CATI, CAPI, web-based);

 

Recruiting and Training of Interviewers

 

Bob Bass, NASS

5:30 p.m.

Adjourn for the Day

Suggested Citation:"Appendix A Panel Data-Gathering Activities." National Research Council. 2008. Understanding American Agriculture: Challenges for the Agricultural Resource Management Survey. Washington, DC: The National Academies Press. doi: 10.17226/11990.
×

Friday, June 9

8:30 – 10:00 a.m.

Survey Management and Data Collection Issues and Statistical Methodology Issues

 

Arthur Kennickell, Moderator

 

Sample Design and Frame (list and area)

 

Bill Iwig, NASS

 

Nonresponse (unit and item)

 

Alix Riley, NASS

 

Estimation and Imputation

 

Richard Barton, NASS

 

Nonresponse and Calibration

 

Chadd Crouse, NASS

10:00 – 10:15 a.m.

Break

10:15 a.m. – 12:00 p.m.

Survey Management and Data Collection Issues and Statistical Methodology Issues: Methods for Analysis

 

David Binder, Moderator

 

Complex Design; Jackknife

 

Phil Kott, NASS

 

ERS Procedures for Statistical Analysis

 

Bob Dubman, ERS

 

Scientific Uses in Research

 

Nigel Key, ERS

 

Review of Statistical Packages for Improving Analysis

 

TBA

12:00 – 1:00 p.m.

Lunch

1:00 – 3:00 p.m.

Working Session

 

  • Review information gathered during workshop

  • Develop outline of final report

  • Develop plans for upcoming concepts and methods workshop

3:00 p.m.

Adjourn

Suggested Citation:"Appendix A Panel Data-Gathering Activities." National Research Council. 2008. Understanding American Agriculture: Challenges for the Agricultural Resource Management Survey. Washington, DC: The National Academies Press. doi: 10.17226/11990.
×

THIRD MEETING

September 28-29, 2006


Goals for the concepts and measurements workshop:

To discuss conceptual and measurement issues in the ARMS program.

To explore the needs of data users.

To consider possible improvements in data dissemination, particularly for protected dissemination of sensitive individual records for research purposes.

To explore issues regarding tests of inference for regression analysis using ARMS data.

To further refine the outline for the final report and make plans for the upcoming meeting on December 7-8, 2006.


Thursday, September 28

8:30 – 9:00 a.m.

Panel Business

Bruce Gardner, Chair

9:00 – 9:15 a.m.

Welcome and Overview of the Agenda

Bruce Gardner, Chair

9:15 – 10:00 a.m.

Report on the AAEA Data Users Forum

Bruce Gardner, Panel Members

10:00 – 10:15 a.m.

Break

10:15 a.m. – 12:00 p.m.

Data Uses and Users

12:00 – 1:00 p.m.

Lunch

1:00 – 5:30 p.m.

Concepts and Measures

5:30 p.m.

Adjourn for the Day

Friday, September 29

8:30 – 10:00 a.m.

Tests of Inference for Regression Analysis

10:00 – 10:15 a.m.

Break

Suggested Citation:"Appendix A Panel Data-Gathering Activities." National Research Council. 2008. Understanding American Agriculture: Challenges for the Agricultural Resource Management Survey. Washington, DC: The National Academies Press. doi: 10.17226/11990.
×

10:15 a.m. – 12:00 p.m.

Discussion of Methods of Analysis Issues

David Binder, Moderator

12:00 – 1:00 p.m.

Lunch

1:00 – 3:00 p.m.

Working Session

 

  • Review information gathered during workshop

  • Develop outline of final report

  • Develop plans for upcoming December 7-8 meeting

3:00 p.m.

Adjourn

FOURTH MEETING

December 7-8, 2006


Goals for the inference workshop:

To discuss issues regarding tests of inference for data analysis using ARMS data.

To further refine the outline for the final report.

To discuss preliminary findings and recommendations.

To make assignments for tasks for completing the final report.

To make plans for the upcoming meeting on January 18-19, 2007.


Thursday, December 7

8:30 – 8:45 a.m.

Introduction to Problem of Inference and Summary of Prior Discussion on the Topic

 

Bruce Gardner, Chair

8:45 – 9:30 a.m.

Issues in Data Analysis for Complex Surveys

 

William Greene, New York University (Consultant)

9:30 – 10:00 a.m.

Alternatives to Current Methods of Estimation and Variance Computation

 

David Binder, Discussion Leader

Suggested Citation:"Appendix A Panel Data-Gathering Activities." National Research Council. 2008. Understanding American Agriculture: Challenges for the Agricultural Resource Management Survey. Washington, DC: The National Academies Press. doi: 10.17226/11990.
×

10:00 – 10:15 a.m.

Break

10:15 – 10:45 a.m.

Practical Issues in Applying Methods of Inference to Complex Data Sets

 

Bill Greene, Discussion Leader

10:45 – 11:00 a.m.

Summary of Issues in Complex Data Analysis

 

Bruce Gardner, Chair

11:00 a.m. – 12:00 p.m.

General Discussion of ARMS Issues

 

Bruce Gardner, Chair

12:00 – 1:00 p.m.

Lunch

1:00 – 5:30 p.m.

Working Session

 

Panel discussion of issues

5:30 p.m.

Adjourn for the Day

Friday, December 8

8:30 – 10:00 a.m.

Working Session

 

Review of information gathered

Refine outline for final report

10:00 – 10:15 a.m.

Break

10:15 a.m. – 12:00 p.m.

Working Session

 

Assignments for preparation of final report

12:00 – 1:00 p.m.

Lunch

1:00 – 3:00 p.m.

Working Session

 

  • Plans for meeting on January 18-19, 2007

3:00 p.m.

Adjourn

Suggested Citation:"Appendix A Panel Data-Gathering Activities." National Research Council. 2008. Understanding American Agriculture: Challenges for the Agricultural Resource Management Survey. Washington, DC: The National Academies Press. doi: 10.17226/11990.
×

FIFTH MEETING

January 18-19, 2007


Goals for the meeting:

To discuss issues regarding cost of production estimates from the ARMS survey with ERS/NASS staff.

To further refine the final report.

To further develop sections written since the December meeting.

To make additional assignments for tasks for completing the final report.

To validate initial findings and recommendations.

To make plans for the upcoming meeting in March 2007.


Thursday, January 18

8:30 – 9:00 a.m.

Discussion of Approach to this Meeting

 

Bruce Gardner, Chair

9:00 – 11:00 a.m.

Discussion of AAEA Cost of Production Report and Status of Implementation of Recommendations in ARMS

 

Bill McBride, ERS

11:00 a.m. – 12:00 p.m.

General Discussion of ARMS Issues with Department of Agriculture Staff

 

Bruce Gardner, Chair

12:00 – 1:00 p.m.

Lunch

1:00 – 2:30 p.m.

Break-out Working Sessions

2:30 – 5:30 p.m.

Panel Discussion of Issues

5:30 p.m.

Adjourn for the Day

Friday, January 19

8:30 – 10:00 a.m.

Working Session

 

Refine Final Report

Suggested Citation:"Appendix A Panel Data-Gathering Activities." National Research Council. 2008. Understanding American Agriculture: Challenges for the Agricultural Resource Management Survey. Washington, DC: The National Academies Press. doi: 10.17226/11990.
×

10:00 – 10:15 a.m.

Break

10:15 a.m. – 12:00 p.m.

Working Session:

 

Assignments for Final Report

12:00 – 1:00 p.m.

Lunch

1:00 – 3:00 p.m.

Working Session

 

Plans for Meeting in March

3:00 p.m.

Adjourn

Suggested Citation:"Appendix A Panel Data-Gathering Activities." National Research Council. 2008. Understanding American Agriculture: Challenges for the Agricultural Resource Management Survey. Washington, DC: The National Academies Press. doi: 10.17226/11990.
×
Page 177
Suggested Citation:"Appendix A Panel Data-Gathering Activities." National Research Council. 2008. Understanding American Agriculture: Challenges for the Agricultural Resource Management Survey. Washington, DC: The National Academies Press. doi: 10.17226/11990.
×
Page 178
Suggested Citation:"Appendix A Panel Data-Gathering Activities." National Research Council. 2008. Understanding American Agriculture: Challenges for the Agricultural Resource Management Survey. Washington, DC: The National Academies Press. doi: 10.17226/11990.
×
Page 179
Suggested Citation:"Appendix A Panel Data-Gathering Activities." National Research Council. 2008. Understanding American Agriculture: Challenges for the Agricultural Resource Management Survey. Washington, DC: The National Academies Press. doi: 10.17226/11990.
×
Page 180
Suggested Citation:"Appendix A Panel Data-Gathering Activities." National Research Council. 2008. Understanding American Agriculture: Challenges for the Agricultural Resource Management Survey. Washington, DC: The National Academies Press. doi: 10.17226/11990.
×
Page 181
Suggested Citation:"Appendix A Panel Data-Gathering Activities." National Research Council. 2008. Understanding American Agriculture: Challenges for the Agricultural Resource Management Survey. Washington, DC: The National Academies Press. doi: 10.17226/11990.
×
Page 182
Suggested Citation:"Appendix A Panel Data-Gathering Activities." National Research Council. 2008. Understanding American Agriculture: Challenges for the Agricultural Resource Management Survey. Washington, DC: The National Academies Press. doi: 10.17226/11990.
×
Page 183
Suggested Citation:"Appendix A Panel Data-Gathering Activities." National Research Council. 2008. Understanding American Agriculture: Challenges for the Agricultural Resource Management Survey. Washington, DC: The National Academies Press. doi: 10.17226/11990.
×
Page 184
Suggested Citation:"Appendix A Panel Data-Gathering Activities." National Research Council. 2008. Understanding American Agriculture: Challenges for the Agricultural Resource Management Survey. Washington, DC: The National Academies Press. doi: 10.17226/11990.
×
Page 185
Suggested Citation:"Appendix A Panel Data-Gathering Activities." National Research Council. 2008. Understanding American Agriculture: Challenges for the Agricultural Resource Management Survey. Washington, DC: The National Academies Press. doi: 10.17226/11990.
×
Page 186
Suggested Citation:"Appendix A Panel Data-Gathering Activities." National Research Council. 2008. Understanding American Agriculture: Challenges for the Agricultural Resource Management Survey. Washington, DC: The National Academies Press. doi: 10.17226/11990.
×
Page 187
Suggested Citation:"Appendix A Panel Data-Gathering Activities." National Research Council. 2008. Understanding American Agriculture: Challenges for the Agricultural Resource Management Survey. Washington, DC: The National Academies Press. doi: 10.17226/11990.
×
Page 188
Next: Appendix B Biographical Sketches of Panel Members and Staff »
Understanding American Agriculture: Challenges for the Agricultural Resource Management Survey Get This Book
×
Buy Paperback | $68.00 Buy Ebook | $54.99
MyNAP members save 10% online.
Login or Register to save!
Download Free PDF

The Agricultural Resource Management Survey (ARMS) is the federal government's primary source of information on the financial condition, production practices, and resource use on farms, as well as the economic well-being of America's farm households. ARMS data are important to the U.S. Department of Agriculture (USDA) and to congressional, administration, and industry decision makers when they must weigh alternative policies and programs that touch the farm sector or affect farm families.

ARMS is unique in several respects. As a multiple-purpose survey with an agricultural focus, ARMS is the only representative national source of observations of farm-level production practices, the economics of the farm businesses operating the field (or dairy herd, greenhouse, nursery, poultry house, etc.), and the characteristics of the American farm household (age, education, occupation, farm and off-farm work, types of employment, family living expenses, etc.). No other data source is able to match the range and depth of ARMS in these areas. American agriculture is changing, and the science of statistical measurement is changing as well. As with every major governmental data collection with such far-reaching and important uses, it is critical to periodically ensure that the survey is grounded in relevant concepts, applying the most up-to-date statistical methodology, and invested with the necessary design, estimation, and analytical techniques to ensure a quality product.
ARMS is a complex undertaking. From its start as a melding of data collected from the field, the farm, and the household in a multiphase, multiframe, and multiple mode survey design, it has increased in complexity over the decade of its existence as more sophisticated demands for its outputs have been made. Today, the survey faces difficult choices and challenges, including a need for a thorough review of its methods, practices, and procedures. Understanding American Agriculture : Challenges for the Agricultural Resource Management Survey summarizes the recommendations of the committee who wrote the survey.
  1. ×

    Welcome to OpenBook!

    You're looking at OpenBook, NAP.edu's online reading room since 1999. Based on feedback from you, our users, we've made some improvements that make it easier than ever to read thousands of publications on our website.

    Do you want to take a quick tour of the OpenBook's features?

    No Thanks Take a Tour »
  2. ×

    Show this book's table of contents, where you can jump to any chapter by name.

    « Back Next »
  3. ×

    ...or use these buttons to go back to the previous chapter or skip to the next one.

    « Back Next »
  4. ×

    Jump up to the previous page or down to the next one. Also, you can type in a page number and press Enter to go directly to that page in the book.

    « Back Next »
  5. ×

    Switch between the Original Pages, where you can read the report as it appeared in print, and Text Pages for the web version, where you can highlight and search the text.

    « Back Next »
  6. ×

    To search the entire text of this book, type in your search term here and press Enter.

    « Back Next »
  7. ×

    Share a link to this book page on your preferred social network or via email.

    « Back Next »
  8. ×

    View our suggested citation for this chapter.

    « Back Next »
  9. ×

    Ready to take your reading offline? Click here to buy this book in print or download it as a free PDF, if available.

    « Back Next »
Stay Connected!