Filter results by
Search HelpKeyword(s)
Subject
Author(s)
Results
All (10)
All (10) ((10 results))
- Articles and reports: 12-001-X200900211045Description:
In analysis of sample survey data, degrees-of-freedom quantities are often used to assess the stability of design-based variance estimators. For example, these degrees-of-freedom values are used in construction of confidence intervals based on t distribution approximations; and of related t tests. In addition, a small degrees-of-freedom term provides a qualitative indication of the possible limitations of a given variance estimator in a specific application. Degrees-of-freedom calculations sometimes are based on forms of the Satterthwaite approximation. These Satterthwaite-based calculations depend primarily on the relative magnitudes of stratum-level variances. However, for designs involving a small number of primary units selected per stratum, standard stratum-level variance estimators provide limited information on the true stratum variances. For such cases, customary Satterthwaite-based calculations can be problematic, especially in analyses for subpopulations that are concentrated in a relatively small number of strata. To address this problem, this paper uses estimated within-primary-sample-unit (within PSU) variances to provide auxiliary information regarding the relative magnitudes of the overall stratum-level variances. Analytic results indicate that the resulting degrees-of-freedom estimator will be better than modified Satterthwaite-type estimators provided: (a) the overall stratum-level variances are approximately proportional to the corresponding within-stratum variances; and (b) the variances of the within-PSU variance estimators are relatively small. In addition, this paper develops errors-in-variables methods that can be used to check conditions (a) and (b) empirically. For these model checks, we develop simulation-based reference distributions, which differ substantially from reference distributions based on customary large-sample normal approximations. The proposed methods are applied to four variables from the U.S. Third National Health and Nutrition Examination Survey (NHANES III).
Release date: 2009-12-23 - Articles and reports: 11-522-X200800010946Description:
In the mid 1990s the first question testing unit was set-up in the UK Office for National Statistics (ONS). The key objective of the unit was to develop and test the questions and questionnaire for the 2001 Census. Since the establishment of this unit the area has been expanded into a Data Collection Methodology (DCM) Centre of Expertise which now sits in the Methodology Directorate. The DCM centre has three branches which support DCM work for social surveys, business surveys, the Census and external organisations.
In the past ten years DCM has achieved a variety of things. For example, introduced survey methodology involvement in the development and testing of business survey question(naire)s; introduced a mix-method approach to the development of questions and questionnaires; developed and implemented standards e.g. for the 2011 census questionnaire & showcards; and developed and delivered DCM training events.
This paper will provide an overview of data collection methodology at the ONS from the perspective of achievements and challenges. It will cover areas such as methods, staff (e.g. recruitment, development and field security), and integration with the survey process.
Release date: 2009-12-03 - 3. Nonresponse bias analysis using reluctant respondents who responded after receiving monetary incentives ArchivedArticles and reports: 11-522-X200800010953Description:
As survey researchers attempt to maintain traditionally high response rates, reluctant respondents have resulted in increasing data collection costs. This respondent reluctance may be related to the amount of time it takes to complete an interview in large-scale, multi-purpose surveys, such as the National Survey of Recent College Graduates (NSRCG). Recognizing that respondent burden or questionnaire length may contribute to lower response rates, in 2003, following several months of data collection under the standard data collection protocol, the NSRCG offered its nonrespondents monetary incentives about two months before the end of the data collection,. In conjunction with the incentive offer, the NSRCG also offered persistent nonrespondents an opportunity to complete a much-abbreviated interview consisting of a few critical items. The late respondents who completed the interviews as the result of the incentive and critical items-only questionnaire offers may provide some insight into the issue of nonresponse bias and the likelihood that such interviewees would have remained survey nonrespondents if these refusal conversion efforts had not been made.
In this paper, we define "reluctant respondents" as those who responded to the survey only after extra efforts were made beyond the ones initially planned in the standard data collection protocol. Specifically, reluctant respondents in the 2003 NSRCG are those who responded to the regular or shortened questionnaire following the incentive offer. Our conjecture was that the behavior of the reluctant respondents would be more like that of nonrespondents than of respondents to the surveys. This paper describes an investigation of reluctant respondents and the extent to which they are different from regular respondents. We compare different response groups on several key survey estimates. This comparison will expand our understanding of nonresponse bias in the NSRCG, and of the characteristics of nonrespondents themselves, thus providing a basis for changes in the NSRCG weighting system or estimation procedures in the future.
Release date: 2009-12-03 - Articles and reports: 11-522-X200800010954Description:
Over the past year, Statistics Canada has been developing and testing a new way to monitor the performance of interviewers conducting computer-assisted personal interviews (CAPI). A formal process already exists for monitoring centralized telephone interviews. Monitors listen to telephone interviews as they take place to assess the interviewer's performance using pre-defined criteria and provide feedback to the interviewer on what was well done and what needs improvement. For the CAPI program, we have developed and are testing a pilot approach whereby interviews are digitally recorded and later a monitor listens to these recordings to assess the field interviewer's performance and provide feedback in order to help improve the quality of the data. In this paper, we will present an overview of the CAPI monitoring project at Statistics Canada by describing the CAPI monitoring methodology and the plans for implementation.
Release date: 2009-12-03 - 5. An update on "a time to interview" ArchivedArticles and reports: 11-522-X200800010995Description:
In 1992, a paper entitled "The Optimum Time at which to Conduct Survey Interviews" sought to illustrate the economic benefits to market research organisations in structuring the calling pattern of interviewers in household surveys. The findings were based on the Welsh Inter Censal Survey in 1986. This paper now brings additional information on the calling patterns of interviewers from similar surveys in 1997 and 2006 to ascertain whether the calling patterns of interviewers have changed. The results also examine the importance of having a survey response that is representative of the population, and how efficient calling strategies can help achieve this.
Release date: 2009-12-03 - Articles and reports: 11-522-X200800010996Description:
In recent years, the use of paradata has become increasingly important to the management of collection activities at Statistics Canada. Particular attention has been paid to social surveys conducted over the phone, like the Survey of Labour and Income Dynamics (SLID). For recent SLID data collections, the number of call attempts was capped at 40 calls. Investigations of the SLID Blaise Transaction History (BTH) files were undertaken to assess the impact of the cap on calls.The purpose of the first study was to inform decisions as to the capping of call attempts, the second study focused on the nature of nonresponse given the limit of 40 attempts.
The use of paradata as auxiliary information for studying and accounting for survey nonresponse was also examined. Nonresponse adjustment models using different paradata variables gathered at the collection stage were compared to the current models based on available auxiliary information from the Labour Force Survey.
Release date: 2009-12-03 - Articles and reports: 11-522-X200800011006Description:
The Office for National Statistics (ONS) has an obligation to measure and annually report on the burden that it places on businesses participating in its surveys. There are also targets for reduction of costs to businesses complying with government regulation as part of the 2005 Administrative Burdens Reduction Project (ABRP) coordinated by the Better Regulation Executive (BRE).
Respondent burden is measured by looking at the economic costs to businesses. Over time the methodology for measuring this economic cost has changed with the most recent method being the development and piloting of a Standard Cost Model (SCM) approach.
The SCM is commonly used in Europe and is focused on measuring objective administrative burdens for all government requests for information e.g. tax returns, VAT, as well as survey participation. This method was not therefore specifically developed to measure statistical response burden. The SCM methodology is activity-based, meaning that the costs and time taken to fulfil requirements are broken down by activity.
The SCM approach generally collects data using face-to-face interviews. The approach is therefore labour intensive both from a collection and analysis perspective but provides in depth information. The approach developed and piloted at ONS uses paper self-completion questionnaires.
The objective of this paper is to provide an overview of respondent burden reporting and targets; and to review the different methodologies that ONS has used to measure respondent burden from the perspectives of sampling, data collection, analysis and usability.
Release date: 2009-12-03 - Articles and reports: 82-003-X200900210872Geography: CanadaDescription:
This article examines geographical variations in 30-day revascularization rates and 30-day in-hospital mortality rates for Canadian heart attack (acute myocardial infarction) patients. The data are from the Health Person-Oriented Information Database and pertain to health regions with at least 100,000 population in seven provinces for the years 1995/1996 and 2003/2004.
Release date: 2009-06-17 - Articles and reports: 89-637-X2009004Geography: CanadaDescription:
This report explores some initial findings regarding the health and well-being of Métis adults (aged 15 and over) and children (aged 6 to 14) from the 2006 Aboriginal Peoples Survey. Information on self-rated health, physical activity level, and opinions on how Métis can improve their health are provided. Important indicators of health such as chronic conditions and healthcare utilization, and some key social determinants of health are also examined. Some comparisons are made over time (between 2001 and 2006), revealing areas of improvement and decline. In addition, some comparisons are made between Métis men and women from urban and rural areas and from different age groups. Finally, where possible, comparisons are made between Métis and the total Canadian population.
Release date: 2009-02-19 - Stats in brief: 89-637-X2009006Geography: CanadaDescription:
This is one of three fact sheets in the series using information from the 2006 Aboriginal Peoples Survey (APS) and 2006 Census. This fact sheet provides information on the health and well-being of Métis adults (aged 15 and over) and children (aged 6 to 14).
Release date: 2009-02-19
Stats in brief (1)
Stats in brief (1) ((1 result))
- Stats in brief: 89-637-X2009006Geography: CanadaDescription:
This is one of three fact sheets in the series using information from the 2006 Aboriginal Peoples Survey (APS) and 2006 Census. This fact sheet provides information on the health and well-being of Métis adults (aged 15 and over) and children (aged 6 to 14).
Release date: 2009-02-19
Articles and reports (9)
Articles and reports (9) ((9 results))
- Articles and reports: 12-001-X200900211045Description:
In analysis of sample survey data, degrees-of-freedom quantities are often used to assess the stability of design-based variance estimators. For example, these degrees-of-freedom values are used in construction of confidence intervals based on t distribution approximations; and of related t tests. In addition, a small degrees-of-freedom term provides a qualitative indication of the possible limitations of a given variance estimator in a specific application. Degrees-of-freedom calculations sometimes are based on forms of the Satterthwaite approximation. These Satterthwaite-based calculations depend primarily on the relative magnitudes of stratum-level variances. However, for designs involving a small number of primary units selected per stratum, standard stratum-level variance estimators provide limited information on the true stratum variances. For such cases, customary Satterthwaite-based calculations can be problematic, especially in analyses for subpopulations that are concentrated in a relatively small number of strata. To address this problem, this paper uses estimated within-primary-sample-unit (within PSU) variances to provide auxiliary information regarding the relative magnitudes of the overall stratum-level variances. Analytic results indicate that the resulting degrees-of-freedom estimator will be better than modified Satterthwaite-type estimators provided: (a) the overall stratum-level variances are approximately proportional to the corresponding within-stratum variances; and (b) the variances of the within-PSU variance estimators are relatively small. In addition, this paper develops errors-in-variables methods that can be used to check conditions (a) and (b) empirically. For these model checks, we develop simulation-based reference distributions, which differ substantially from reference distributions based on customary large-sample normal approximations. The proposed methods are applied to four variables from the U.S. Third National Health and Nutrition Examination Survey (NHANES III).
Release date: 2009-12-23 - Articles and reports: 11-522-X200800010946Description:
In the mid 1990s the first question testing unit was set-up in the UK Office for National Statistics (ONS). The key objective of the unit was to develop and test the questions and questionnaire for the 2001 Census. Since the establishment of this unit the area has been expanded into a Data Collection Methodology (DCM) Centre of Expertise which now sits in the Methodology Directorate. The DCM centre has three branches which support DCM work for social surveys, business surveys, the Census and external organisations.
In the past ten years DCM has achieved a variety of things. For example, introduced survey methodology involvement in the development and testing of business survey question(naire)s; introduced a mix-method approach to the development of questions and questionnaires; developed and implemented standards e.g. for the 2011 census questionnaire & showcards; and developed and delivered DCM training events.
This paper will provide an overview of data collection methodology at the ONS from the perspective of achievements and challenges. It will cover areas such as methods, staff (e.g. recruitment, development and field security), and integration with the survey process.
Release date: 2009-12-03 - 3. Nonresponse bias analysis using reluctant respondents who responded after receiving monetary incentives ArchivedArticles and reports: 11-522-X200800010953Description:
As survey researchers attempt to maintain traditionally high response rates, reluctant respondents have resulted in increasing data collection costs. This respondent reluctance may be related to the amount of time it takes to complete an interview in large-scale, multi-purpose surveys, such as the National Survey of Recent College Graduates (NSRCG). Recognizing that respondent burden or questionnaire length may contribute to lower response rates, in 2003, following several months of data collection under the standard data collection protocol, the NSRCG offered its nonrespondents monetary incentives about two months before the end of the data collection,. In conjunction with the incentive offer, the NSRCG also offered persistent nonrespondents an opportunity to complete a much-abbreviated interview consisting of a few critical items. The late respondents who completed the interviews as the result of the incentive and critical items-only questionnaire offers may provide some insight into the issue of nonresponse bias and the likelihood that such interviewees would have remained survey nonrespondents if these refusal conversion efforts had not been made.
In this paper, we define "reluctant respondents" as those who responded to the survey only after extra efforts were made beyond the ones initially planned in the standard data collection protocol. Specifically, reluctant respondents in the 2003 NSRCG are those who responded to the regular or shortened questionnaire following the incentive offer. Our conjecture was that the behavior of the reluctant respondents would be more like that of nonrespondents than of respondents to the surveys. This paper describes an investigation of reluctant respondents and the extent to which they are different from regular respondents. We compare different response groups on several key survey estimates. This comparison will expand our understanding of nonresponse bias in the NSRCG, and of the characteristics of nonrespondents themselves, thus providing a basis for changes in the NSRCG weighting system or estimation procedures in the future.
Release date: 2009-12-03 - Articles and reports: 11-522-X200800010954Description:
Over the past year, Statistics Canada has been developing and testing a new way to monitor the performance of interviewers conducting computer-assisted personal interviews (CAPI). A formal process already exists for monitoring centralized telephone interviews. Monitors listen to telephone interviews as they take place to assess the interviewer's performance using pre-defined criteria and provide feedback to the interviewer on what was well done and what needs improvement. For the CAPI program, we have developed and are testing a pilot approach whereby interviews are digitally recorded and later a monitor listens to these recordings to assess the field interviewer's performance and provide feedback in order to help improve the quality of the data. In this paper, we will present an overview of the CAPI monitoring project at Statistics Canada by describing the CAPI monitoring methodology and the plans for implementation.
Release date: 2009-12-03 - 5. An update on "a time to interview" ArchivedArticles and reports: 11-522-X200800010995Description:
In 1992, a paper entitled "The Optimum Time at which to Conduct Survey Interviews" sought to illustrate the economic benefits to market research organisations in structuring the calling pattern of interviewers in household surveys. The findings were based on the Welsh Inter Censal Survey in 1986. This paper now brings additional information on the calling patterns of interviewers from similar surveys in 1997 and 2006 to ascertain whether the calling patterns of interviewers have changed. The results also examine the importance of having a survey response that is representative of the population, and how efficient calling strategies can help achieve this.
Release date: 2009-12-03 - Articles and reports: 11-522-X200800010996Description:
In recent years, the use of paradata has become increasingly important to the management of collection activities at Statistics Canada. Particular attention has been paid to social surveys conducted over the phone, like the Survey of Labour and Income Dynamics (SLID). For recent SLID data collections, the number of call attempts was capped at 40 calls. Investigations of the SLID Blaise Transaction History (BTH) files were undertaken to assess the impact of the cap on calls.The purpose of the first study was to inform decisions as to the capping of call attempts, the second study focused on the nature of nonresponse given the limit of 40 attempts.
The use of paradata as auxiliary information for studying and accounting for survey nonresponse was also examined. Nonresponse adjustment models using different paradata variables gathered at the collection stage were compared to the current models based on available auxiliary information from the Labour Force Survey.
Release date: 2009-12-03 - Articles and reports: 11-522-X200800011006Description:
The Office for National Statistics (ONS) has an obligation to measure and annually report on the burden that it places on businesses participating in its surveys. There are also targets for reduction of costs to businesses complying with government regulation as part of the 2005 Administrative Burdens Reduction Project (ABRP) coordinated by the Better Regulation Executive (BRE).
Respondent burden is measured by looking at the economic costs to businesses. Over time the methodology for measuring this economic cost has changed with the most recent method being the development and piloting of a Standard Cost Model (SCM) approach.
The SCM is commonly used in Europe and is focused on measuring objective administrative burdens for all government requests for information e.g. tax returns, VAT, as well as survey participation. This method was not therefore specifically developed to measure statistical response burden. The SCM methodology is activity-based, meaning that the costs and time taken to fulfil requirements are broken down by activity.
The SCM approach generally collects data using face-to-face interviews. The approach is therefore labour intensive both from a collection and analysis perspective but provides in depth information. The approach developed and piloted at ONS uses paper self-completion questionnaires.
The objective of this paper is to provide an overview of respondent burden reporting and targets; and to review the different methodologies that ONS has used to measure respondent burden from the perspectives of sampling, data collection, analysis and usability.
Release date: 2009-12-03 - Articles and reports: 82-003-X200900210872Geography: CanadaDescription:
This article examines geographical variations in 30-day revascularization rates and 30-day in-hospital mortality rates for Canadian heart attack (acute myocardial infarction) patients. The data are from the Health Person-Oriented Information Database and pertain to health regions with at least 100,000 population in seven provinces for the years 1995/1996 and 2003/2004.
Release date: 2009-06-17 - Articles and reports: 89-637-X2009004Geography: CanadaDescription:
This report explores some initial findings regarding the health and well-being of Métis adults (aged 15 and over) and children (aged 6 to 14) from the 2006 Aboriginal Peoples Survey. Information on self-rated health, physical activity level, and opinions on how Métis can improve their health are provided. Important indicators of health such as chronic conditions and healthcare utilization, and some key social determinants of health are also examined. Some comparisons are made over time (between 2001 and 2006), revealing areas of improvement and decline. In addition, some comparisons are made between Métis men and women from urban and rural areas and from different age groups. Finally, where possible, comparisons are made between Métis and the total Canadian population.
Release date: 2009-02-19
Journals and periodicals (0)
Journals and periodicals (0) (0 results)
No content available at this time.
- Date modified: