Keyword search

Description:

Over the last few years, there have been large progress in the web data collection area. Today, many statistical offices offer a web alternative in many different types of surveys. It is widely believed that web data collection may raise data quality while lowering data collection costs. Experience has shown that, offered web as a second alternative to paper questionnaires; enterprises have been slow to embrace the web alternative. On the other hand, experiments have also shown that by promoting web over paper, it is possible to raise the web take up rates. However, there are still few studies on what happens when the contact strategy is changed radically and the web option is the only option given in a complex enterprise survey. In 2008, Statistics Sweden took the step of using more or less a web-only strategy in the survey of industrial production (PRODCOM). The web questionnaire was developed in the generalised tool for web surveys used by Statistics Sweden. The paper presents the web solution and some experiences from the 2008 PRODCOM survey, including process data on response rates and error ratios as well as the results of a cognitive follow-up of the survey. Some important lessons learned are also presented.

Description:

Until now, years of experience in questionnaire design were required to estimate how long it would take a respondent, on the average, to complete a CATI questionnaire for a new survey. This presentation focuses on a new method which produces interview time estimates for questionnaires at the development stage. The method uses Blaise Audit Trail data and previous surveys. It was developed, tested and verified for accuracy on some large scale surveys.

First, audit trail data was used to determine the average time previous respondents have taken to answer specific types of questions. These would include questions that require a yes/no answer, scaled questions, "mark all that apply" questions, etc. Second, for any given questionnaire, the paths taken by population sub-groups were mapped to identify the series of questions answered by different types of respondents, and timed to determine what the longest possible interview time would be. Finally, the overall expected time it takes to complete the questionnaire is calculated using estimated proportions of the population expected to answer each question.

So far, we used paradata to accurately estimate average respondent interview completion times. We note that the method that we developed could also be used to estimate specific respondent interview completion times.

Description:

The growing difficulty of reaching respondents has a general impact on non-response in telephone surveys, especially those that use random digit dialling (RDD), such as the General Social Survey (GSS). The GSS is an annual multipurpose survey with 25,000 respondents. Its aim is to monitor the characteristics of and major changes in Canada's social structure. GSS Cycle 21 (2007) was about the family, social support and retirement. Its target population consisted of persons aged 45 and over living in the 10 Canadian provinces. For more effective coverage, part of the sample was taken from a follow-up with the respondents of GSS Cycle 20 (2006), which was on family transitions. The remainder was a new RDD sample. In this paper, we describe the survey's sampling plan and the random digit dialling method used. Then we discuss the challenges of calculating the non-response rate in an RDD survey that targets a subset of a population, for which the in-scope population must be estimated or modelled. This is done primarily through the use of paradata. The methodology used in GSS Cycle 21 is presented in detail.

Description:

In 1992, a paper entitled "The Optimum Time at which to Conduct Survey Interviews" sought to illustrate the economic benefits to market research organisations in structuring the calling pattern of interviewers in household surveys. The findings were based on the Welsh Inter Censal Survey in 1986. This paper now brings additional information on the calling patterns of interviewers from similar surveys in 1997 and 2006 to ascertain whether the calling patterns of interviewers have changed. The results also examine the importance of having a survey response that is representative of the population, and how efficient calling strategies can help achieve this.

Description:

Businesses which have not responded to a mail survey are generally subject to intensive follow up (IFU) by telephone or other means to obtain a response. As this contact is expensive, strategies are needed to optimise the approach to conducting calls for IFU purpose.

This paper presents results from an investigation conducted into the number and type of IFU contacts made for business surveys at the Australian Bureau of Statistics (ABS). The paper compares the amount of effort expended in IFU compared to the response rates and contribution to key estimates for these surveys, and discusses possible uses of this type of information to make more optimal use of resources.

Description:

The choice of number of call attempts in a telephone survey is an important decision. A large number of call attempts makes the data collection costly and time-consuming; and a small number of attempts decreases the response set from which conclusions are drawn and increases the variance. The decision can also have an effect on the nonresponse bias. In this paper we study the effects of number of call attempts on the nonresponse rate and the nonresponse bias in two surveys conducted by Statistics Sweden: The Labour Force Survey (LFS) and Household Finances (HF).

By use of paradata we calculate the response rate as a function of the number of call attempts. To estimate the nonresponse bias we use estimates of some register variables, where observations are available for both respondents and nonrespondents. We also calculate estimates of some real survey parameters as functions of varying number of call attempts. The results indicate that it is possible to reduce the current number of call attempts without getting an increased nonresponse bias.

Description:

The present report reviews the results of a mailing experiment that took place within a large scale demonstration project. A postcard and stickers were sent to a random group of project participants in the period between a contact call and a survey. The researchers hypothesized that, because of the additional mailing (the treatment), the response rates to the upcoming survey would increase. There was, however, no difference between the response rates of the treatment group that received the additional mailing and the control group. In the specific circumstances of the mailing experiment, sending project participants a postcard and stickers as a reminder of the upcoming survey and of their participation in the pilot project was not an efficient way to increase response rates.

Description:

Currently underway, the Québec Population Health Survey (EQSP), for which collection will wrap up in February 2009, provides an opportunity, because of the size of its sample, to assess the impact that sending out introductory letters to respondents has on the response rate in a controlled environment. Since this regional telephone survey is expected to have more than 38,000 respondents, it was possible to use part of its sample for this study without having too great an impact on its overall response rate. In random digit dialling (RDD) surveys such as the EQSP, one of the main challenges in sending out introductory letters is reaching the survey units. Doing so depends largely on our capacity to associate an address with the sample units and on the quality of that information.

This article describes the controlled study proposed by the Institut de la statistique du Québec to measure the effect that sending out introductory letters to respondents had on the survey's response rate.

Description:

Justice surveys represent a unique type of survey undertaken by Statistics Canada. While they all essentially use administrative data, Statistics Canada has had considerable input into the type of data that is collected as well as quality assurance methods guiding the collection of this data. This is true in the areas of policing, courts and corrections. The main crime survey, the Uniform Crime Reporting Survey (UCR), is the focus of this paper and was designed to measure the incidence of crime in Canadian society and its characteristics. The data is collected by the policing community in Canada and transmitted electronically to Statistics Canada. This paper will begin by providing an overview of the survey and its distinctive properties, such as the use of intermediaries (software vendors) that convert data from the police's information systems into the UCR survey format, following nationally defined data requirements. This level of consistency is uncommon for an administrative survey and permits a variety of opportunities for improving the overall data quality and capabilities of the survey. Various methods such as quality indicators and feedback reports are used on a regular basis and frequent two-way communication takes place with the respondents to correct existing data problems and to prevent future ones. We will discuss recent improvements to both the data itself and our collection methods that have enhanced the usability of the survey. Finally, future development of the survey will be discussed including some of the challenges that currently exist as well as those still to come.

Description:

The Aboriginal Children's Survey (ACS) provides an extensive set of data about Aboriginal (Métis, Inuit, and off-reserve First Nations) children under 6 years of age in urban, rural, and northern locations across Canada. The Aboriginal Children's Survey (ACS) was designed to provide a picture of the early development of Aboriginal children and the social and living conditions in which they are learning and growing.

The survey was developed by Statistics Canada and Aboriginal advisors from across the country and was conducted jointly with Human Resources and Social Development Canada.

Description: The public use microdata file from the 2010 Canada Survey of Giving, Volunteering and Participating is now available. This file contains information collected from nearly 15,000 respondents aged 15 and over residing in private households in the provinces.The public use microdata file provides provincial-level information about the ways in which Canadians donate money and in-kind gifts to charitable and nonprofit organizations; volunteer their time to these organizations; provide help directly to others. Socio-demographic, income and labour force data are also included on the file.

Description: The Canadian Tobacco, Alcohol and Drugs Survey (CTADS) is a biennial general population survey of tobacco, alcohol and drug use among Canadians aged 15 years and older, with the primary focus on 15- to 24-year-olds. The CTADS is a telephone survey conducted by Statistics Canada on behalf of Health Canada.

Description:

Statistics Canada was approached by Stentor Resource Centre Incorporated to conduct a survey to monitor the telephone penetration rates across Canada. The survey determines if the respondents have a telephone line in their residence. If they do not have a telephone line, information is collected as to the reasons why. Information is also collected on the income characteristics of the selected households.

The management of the survey was transferred from Stentor to Bell Canada in the Fall of 1998.

The Labour Force Survey (LFS) supplementary capacity is used to conduct this biannual survey. A sample of approximately 44,000 respondents is used for this survey (five out of six rotation groups). The survey data are collected using Computer Assisted Interviewing (CAI). The first data collection procedure took place during November's LFS week in 1996.

This microdata file is prepared biannually and contains the variables from the survey, plus geographical variables from the LFS (province, census metropolitan area, urban/rural breakdown). No other variables from the LFS are added to the file.

Description:

The Public Service Employee Survey was designed to solicit the views of Public Service employees on their work environment and overall job satisfaction. Employees expressed their opinions on their work units, their communications with their supervisors, skills and career aspirations, client services and labour management relations. General information such as age, gender, years of service and province of work were collected and questions were asked on specific themes such as staffing fairness, official languages, health and safety, harassment and discrimination and retention issues. The results were aggregated at the department and Public Service-wide levels. The survey ensures a measurement capacity between the 1999, 2002 and 2005 questionnaires.

In 2008, the 2005 questionnaire was used as the basis for the survey. New questions were added to construct an employee engagement model that will be used to evaluate each organization. As well, the scale of the response category was increased from 4 to 5 to include a neutral category.

Description:

This report presents the results of a pilot survey conducted by Statistics Canada to measure the fuel consumption of on-road motor vehicles registered in Canada. This study was carried out in connection with the Canadian Vehicle Survey (CVS) which collects information on road activity such as distance traveled, number of passengers and trip purpose.

Description:

This microdata file provides data from the Compensation Sector Survey. The purpose of the survey is to obtain a profile of members of the compensation community in the Human Resources community of the federal public service. The results will allow the Human Resources Community Secretariat to renew recruiting, training and development programs for this community in such a manner that these programs would take into account current data.

Description:

The National Longitudinal Survey of Children and Youth (NLSCY), developed jointly by Human Resources Development Canada and Statistics Canada, is a comprehensive survey which follows the development of children in Canada and paints a picture of their lives. The survey monitors children's development and measures the incidence of various factors that influence their development, both positively and negatively.

Description:

The National Population Health Survey (NPHS) used the Labour Force Survey sampling frame to draw the initial sample of approximately 20,000 households starting in 1994 and for the sample top-up this third cycle. The survey is conducted every two years. The sample collection is distributed over four quarterly periods followed by a follow-up period and the whole process takes a year. In each household, some limited health information is collected from all household members and one person in each household is randomly selected for a more in-depth interview.

The survey is designed to collect information on the health of the Canadian population and related socio-demographic information. The first cycle of data collection began in 1994, and continues every second year thereafter. The survey is designed to produce both cross-sectional and longitudinal estimates. The questionnaires includes content related to health status, use of health services, determinants of health, a health index, chronic conditions and activity restrictions. The use of health services is probed through visits to health care providers, both traditional and non-traditional, and the use of drugs and other mediciations. Health determinants include smoking, alcohol use and physical activity. A special focus content for this cycle includes family medical history with questions about certain chronic conditions among immediate family members and when they were acquired. As well, a section on self care has also been included this cycle. The socio-demographic information includes age, sex, education, ethnicity, household income and labour force status.

Description:

This is a CD-ROM product from the Ontario Adult Literacy Survey (OALS), conducted in the spring of 1998 with the goal of providing information on: the ability of Ontario immigrants to use either English or French in their daily activities; and on their self-perceived literacy skills, training needs and barriers to training.

In order to cover the majority of Ontario immigrants, the Census Metropolitan Areas (CMAs) of Toronto, Hamilton, Ottawa, Kitchener, London and St. Catharines were included in the sample. With these 6 CMAs, about 83% of Ontario immigrants were included in the sample frame. This sample of 7,107 dwellings covered the population of Ontario immigrants in general as well as specifically targetting immigrants with a mother tongue of Italian, Chinese, Portuguese, Polish, and Spanish and immigrants born in the Caribbean Islands with a mother tongue of English.

Each interview was approximately 1.5 hours in duration and consisted of a half-hour questionnaire, asking demographic and literacy-related questions as well as a one-hour literacy test. This literacy test was derived from that used in the 1994 International Adult Literacy Survey (IALS) and covered the domains of document and quantitative literacy. An overall response rate to the survey of 76% was achieved, resulting in 4,648 respondents.

Description:

Environmental protection expenditures in the business sector, preliminary data presents operating and capital expenditures made by primary and manufacturing industries in response to, or in anticipation of, environmental regulations and conventions. The results are from the Environmental Protection Expenditure Survey. The data contained in Environmental protection expenditures in the business sector help to fill important gaps in existing information on the demand side of the 'environment industry.' More specifically, it provides a measure of the cost to the industry of adopting pollution prevention and abatement technologies and other environmental protection practices. Data included in Environmental protection expenditures in the business sector are components of a national statistical database on the environment industry.

Description: From 2010 to 2019, the Labour Force Survey (LFS) response rate – or the proportion of selected households who complete an LFS interview – had been on a slow downward trend, due to a range of social and technological changes which have made it more challenging to contact selected households and to persuade Canadians to participate when they are contacted. These factors were exacerbated by the COVID-19 pandemic, which resulted in the suspension of face-to-face interviewing between April 2020 and fall 2022. Statistics Canada is committed to restoring LFS response rates to the greatest extent possible. This technical paper discusses two initiatives that are underway to ensure that the LFS estimates continue to provide an accurate and representative portrait of the Canadian labour market.

Description:

The operationalization of the Population and Housing Census in Portugal is managed by a hierarchical structure in which Statistics Portugal is at the top and local government institutions at the bottom. When the Census takes place every ten years, local governments are asked to collaborate with Statistics Portugal in the execution and monitoring of the fieldwork operations at the local level. During the Pilot Test stage of the 2011 Census, local governments were asked for additional collaboration: to answer the Perception of Risk survey, whose aim was to gather information to design a quality assurance instrument that could be used to monitor the Census operations. The response rate of the survey was desired to be 100%, however, by the deadline of data collection nearly a quarter of local governments had not responded to the survey and thus a decision was made to make a follow up mailing. In this paper, we examine whether the same conclusions could have been reached from survey without follow ups as with them and evaluate the influence of follow ups on the conception of the quality assurance instrument. Comparison of responses on a set of perception variables revealed that local governments answering previous or after the follow up did not differ. However the configuration of the quality assurance instrument changed when including follow up responses.

Description:

Nonresponse is present in almost all surveys and can severely bias estimates. It is usually distinguished between unit and item nonresponse. By noting that for a particular survey variable, we just have observed and unobserved values, in this work we exploit the connection between unit and item nonresponse. In particular, we assume that the factors that drive unit response are the same as those that drive item response on selected variables of interest. Response probabilities are then estimated using a latent covariate that measures the will to respond to the survey and that can explain a part of the unknown behavior of a unit to participate in the survey. This latent covariate is estimated using latent trait models. This approach is particularly relevant for sensitive items and, therefore, can handle non-ignorable nonresponse. Auxiliary information known for both respondents and nonrespondents can be included either in the latent variable model or in the response probability estimation process. The approach can also be used when auxiliary information is not available, and we focus here on this case. We propose an estimator using a reweighting system based on the previous latent covariate when no other observed auxiliary information is available. Results on its performance are encouraging from simulation studies on both real and simulated data.

Description:

This report is based on data from the 2011/2012 Victim Services Survey and provides a profile of victim service agencies in Canada that responded to the survey, as well as information on the clients they served. In reference to 2011/2012, the report presents data on the types of agencies in Canada, the services offered, staff and volunteers, and criminal injuries compensation applications and awards. Characteristics of clients, such as sex, age grouping and type of victimization, are based on counts of clients served on a snapshot day of May 24, 2012. The 2011/2012 Victim Services Survey was conducted by the Canadian Centre for Justice Statistics and was funded by Justice Canada's Policy Centre for Victim Issues. Victim service agencies surveyed include system-based, police-based and court-based agencies, sexual assault centres, other selected community-based agencies, and criminal injuries compensation and other financial benefit programs for victims of crime. It should be noted that data on transition homes and shelters for abused women and their children are collected through Statistics Canada's Transition Home Survey.

Description:

Web surveys are generally connected with low response rates. Common suggestions in textbooks on Web survey research highlight the importance of the welcome screen in encouraging respondents to take part. The importance of this screen has been empirically proven in research, showing that most respondents breakoff at the welcome screen. However, there has been little research on the effect of the design of this screen on the level of the breakoff rate. In a study conducted at the University of Konstanz, three experimental treatments were added to a survey of the first-year student population (2,629 students) to assess the impact of different design features of this screen on the breakoff rates. The methodological experiments included varying the background color of the welcome screen, varying the promised task duration on this first screen, and varying the length of the information provided on the welcome screen explaining the privacy rights of the respondents. The analyses show that the longer stated length and the more attention given to explaining privacy rights on the welcome screen, the fewer respondents started and completed the survey. However, the use of a different background color does not result in the expected significant difference.

Description:

In January 2006, a conference on longitudinal surveys hosted by Statistics Canada, the Social and Humanities Research Council of Canada (SSHRC) and the Canadian Institute of Health Research (CIHR) concluded that Canada lacks a longitudinal survey which collects information on multiple subjects such as family, human capital, labour health and follows respondents for a long period of time. Following this conference, funds were received from the Policy Research Data Gaps fund (PRDG) to support a pilot survey for a new Canadian Household Panel Survey (CHPS-Pilot). Consultations on the design and content were held with academic and policy experts in 2007 and 2008, and a pilot survey was conducted in the fall of 2008. The objectives of the pilot survey were to (1) test a questionnaire, evaluate interview length and measure the quality of data collected, (2) evaluate several design features; and (3) test reactions to the survey from respondents and field workers. The pilot survey achieved a response rate of 76%, with a median household interview time of 64 minutes. Several innovative design features were tested, and found to be viable. Response to the survey, whether from respondents or interviewers, was generally positive. This paper highlights these and other results from the CHPS-Pilot.

Description:

As survey researchers attempt to maintain traditionally high response rates, reluctant respondents have resulted in increasing data collection costs. This respondent reluctance may be related to the amount of time it takes to complete an interview in large-scale, multi-purpose surveys, such as the National Survey of Recent College Graduates (NSRCG). Recognizing that respondent burden or questionnaire length may contribute to lower response rates, in 2003, following several months of data collection under the standard data collection protocol, the NSRCG offered its nonrespondents monetary incentives about two months before the end of the data collection,. In conjunction with the incentive offer, the NSRCG also offered persistent nonrespondents an opportunity to complete a much-abbreviated interview consisting of a few critical items. The late respondents who completed the interviews as the result of the incentive and critical items-only questionnaire offers may provide some insight into the issue of nonresponse bias and the likelihood that such interviewees would have remained survey nonrespondents if these refusal conversion efforts had not been made.

In this paper, we define "reluctant respondents" as those who responded to the survey only after extra efforts were made beyond the ones initially planned in the standard data collection protocol. Specifically, reluctant respondents in the 2003 NSRCG are those who responded to the regular or shortened questionnaire following the incentive offer. Our conjecture was that the behavior of the reluctant respondents would be more like that of nonrespondents than of respondents to the surveys. This paper describes an investigation of reluctant respondents and the extent to which they are different from regular respondents. We compare different response groups on several key survey estimates. This comparison will expand our understanding of nonresponse bias in the NSRCG, and of the characteristics of nonrespondents themselves, thus providing a basis for changes in the NSRCG weighting system or estimation procedures in the future.

Description:

The Unified Enterprise Survey (UES) at Statistics Canada is an annual business survey that unifies more than 60 surveys from different industries. Two types of collection follow-up score functions are currently used in the UES data collection. The objective of using a score function is to maximize the economically weighted response rates of the survey in terms of the primary variables of interest, under the constraint of a limited follow-up budget. Since the two types of score functions are based on different methodologies, they could have different impacts on the final estimates.

This study generally compares the two types of score functions based on the collection data obtained from the two recent years. For comparison purposes, this study applies each score function method to the same data respectively and computes various estimates of the published financial and commodity variables, their deviation from the true pseudo value and their mean square deviation, based on each method. These estimates of deviation and mean square deviation based on each method are then used to measure the impact of each score function on the final estimates of the financial and commodity variables.

Description:

Non-response is inevitable in any survey, despite all the effort put into reducing it at the various stages of the survey. In particular, non-response can cause bias in the estimates. In addition, non-response is an especially serious problem in longitudinal studies because the sample shrinks over time. France's ELFE (Étude Longitudinale Française depuis l'Enfance) is a project that aims to track 20,000 children from birth to adulthood using a multidisciplinary approach. This paper is based on the results of the initial pilot studies conducted in 2007 to test the survey's feasibility and acceptance. The participation rates are presented (response rate, non-response factors) along with a preliminary description of the non-response treatment methods being considered.

Description:

A major issue in official statistics is the availability of objective measures supporting the based-on-fact decision process. Istat has developed an Information System to assess survey quality. Among other standard quality indicators, nonresponse rates are systematically computed and stored for all surveys. Such a rich information base permits analysis over time and comparisons among surveys. The paper focuses on the analysis of interrelationships between data collection mode and other survey characteristics on total nonresponse. Particular attention is devoted to the extent to which multi-mode data collection improves response rates.

Description:

This paper presents an analysis of the questions in the Survey of Labour and Income Dynamics (SLID) relating to supervision and management. It uses data collected in January 1993.

Description:

This report presents a summary evaluation of the quality of the data collected during the Survey of Labour and Income Dynamics (SLID) field test of income and wealth, held in April and May 1993.

Description:

This paper presents observations of the field test of the income and wealth content proposed for the Survey of Labour and Income Dynamics (SLID), as reported by members of the SLID head office project team and a summary of responses by a subset of interviewers who were asked to complete a debriefing questionnaire.

Description:

This report examines the feasibility of accessing income tax returns instead of collecting income information in a traditional survey for the Survey of Labour and Income Dynamics (SLID).