Review of the Disability Evaluation Study Design Third Interim Report (1999) / Chapter Skim
Currently Skimming:
3 Committee Reactions
3 Committee Reactions
Pages 12-21
The Chapter Skim interface presents what we've algorithmically identified as the most significant single chunk of text within every page in the chapter.
Select key terms on the right to highlight them within pages of the chapter.
From page 12... ...
The committee has reviewed the reports prepared by Westat on the survey procedures, the design of the DES (including that of the pilot study) , and the strategies to maximize response rates.
|
From page 13... ...
. The schedule developed for the conduct of the various phases of the survey and the time allotted to absorb and retool for the main survey will not permit deliberate and rigorous decisions about revisions of the design, procedures, or questionnaire content.
|
From page 14... ...
14 REVIEW OF DISABILIIYEVALUATION STUD Y DESIGN TABLE 3-~. Timeline for Survey Activities Proposed by Westat Time Schedule Survey Activity OMB Approval Received Pilot Study Print survey instruments Conduct listing activities and administer initial screener Conduct interviewing and medical exam activities, including targeted referrals Obtain medical records Ongoing data preparation and processing Data analysis and preparation of simulated case folders Methodological Report 1: Evaluation of Pilot Study Methods Submit protocol revisions to OMB Methodological Report 2: Instruments and Procedures for the DES Main Study Main Study Print revised survey instruments Conduct listing activities and administer initial screener Conduct interviewing and medical exam activities, including targeted referrals Obtain medical records Ongoing data preparation and processing Data analysis and preparation of simulated case folders Descriptive Report 1: Disability Profile of Working-Age Americans: Preliminary Data from the DES Descriptive Report 2: Employment Profile of Working-Age Americans: Preliminary Data from the DES Descriptive Report 3+: other reports as specified Analytic Report I: Estimates of Trends in SSDT and SST Analytic Report 2: Relationships Between Disability and Work Analytic Report 3: Evaluation of Disability Data Collection Questions and Procedures Analytic Report 4: The Effects of Disability on Retirement Analytic Report 5: Disability Decision Process Final project report NOTE: LIMB = Office of Management and Budget.
|
From page 15... ...
Even if analysis of the initial screener could begin earlier in the analysis phase of the DES pilot study, additional time will be needed to examine the implications and plausibility of several different "adjustments" that might need to be made as a result of the analysis; to examine the specific effects of attrition on the screening phase of the DES; and to seek the best available national data on the distribution of the four groups that is needed to establish post screening rates of disproportionate subsampling. In the committee's judgment, the addition of several months to the period between the end of data collection in the pilot study and the start of data collection for the main study will allow the screening and attrition findings of the pilot study to be more carefully considered and used to ensure that sample size targets for the four groups are met.
|
From page 16... ...
As noted in the previous chapter, Westat plans to expend significant effort in testing and experimenting with different options related to the efficiency of processes and methods before and during the pilot study. The committee commends Westat's plans but does not think Westat can appropriately conduct these needed tests, analyze the results, test alternatives, and make the necessary modifications within the current timeframe.
|
From page 17... ...
For example, proxy responses in the initial screener interview may lead Westat to classify the person as severely impaired, whereas the respondent may be found to be mildly or moderateIv impaired during the follow-up screener and medical examination.
|
From page 18... ...
The committee is pleased to note that Westat's plans include field testing and cognitive testing, followed later by a larger pretest and then a large pilot test. Westat's detailed plans for testing and experimentation also should include the applicability of the NHANES mode of medical examination for people with severe disabilities and functional assessment instruments.
|
From page 19... ...
IS unable to prescribe specific time needs, a number of plausible scenarios may provide some guidance to SSA on the amount of additional time that may be required for the DES timeline. One possibility is an inability to meet response rate targets set for the screening, interview, and examination phases of data gathering under each of the data collection options and incentive levels proposed by Westat.
|
From page 20... ...
Finally, planned quantitative assessments of examination instruments may reveal unacceptably low levels of reliability and validity. This situation would demand 4-5 additional months for another round of instrument redesign and field testing before SSA could comfortably implement this phase of data gathering in the national study.
|
From page 21... ...
Perceived disability Comprehensive Survey Interview: To be conducted in person with each subject in the sample. · Health behaviors Medical history Access to health, educational, and vocational services Social and community living Work status, history, and environment Program knowledge Economic resources Medical Examination: To be conducted in person with each subject in the sample.
|
Key Terms
This material may be derived from roughly machine-read images, and so is provided only to facilitate research.
More
information on Chapter Skim is available.