Analysis

Description:

A Hot Deck imputation procedure is defined to be one where an incomplete response is completed by using values from one or more other records on the same file and the choice of these records varies with the record requiring imputation.

General approaches to Hot Deck imputation are outlined, with emphasis on the interaction between the edit constraints and the imputation procedures. Distance functions can be constructed on a mixture of categorical and numeric fields, can be modified to take account of the relative importance of fields and can discriminate against less desirable donors. Matching fields may be correlated with missing fields, may be linked with missing fields by edits or may be natural stratification variables; but increasing the number of matching fields does not necessarily result in a better match. It is important to audit the imputation process and to summarize its performance.

Hot Deck procedures should be evaluated to study the bias and reliability of the estimates, donor usage and frequency of imputation failure in terms of a variety of conditions of the data and variations of the imputation procedure. It appears that the only generally available approach to evaluation is by simulation.

Description:

This paper looks at the current state of development of social statistics in Canada. Some key concepts related to statistics and social information are defined and discussed. The availability and analysis of administrative data is highlighted, along with the need for social surveys. Suggestions are made about the types of data analysis needed for the development of social decision models to meet policy requirements. Finally, an outline of priorities for future work toward the effective use of social statistics is given.

Description: This paper discusses the management of information within the context of the information industry and indicates some likely future trends related thereto. The information industry itself is first briefly described. Then the process used in producing information, the organizational structure required for such production, and the legislation relating to the information industry are discussed in turn. Finally, some approaches to solving the problems of the future are suggested.

Description: This paper includes a description of interviewer techniques and procedures used to minimize non-response, an outline of methods used to monitor and control non-response, and a discussion of how non-respondents are treated in the data processing and estimation stages of the Canadian Labour Force Survey. Recent non-response rates as well as data on the characteristics of non-respondents are also given. It is concluded that a yearly non-response rate of approximately 5 percent is probably the best that can be achieved in the Labour Force Survey.

Description: Two methods for estimating the correlated response variance of a survey estimator are studied by way of both theoretical comparison and empirical investigation. The variance of these estimators is discussed and the effects of outliers examined. Finally, an improved estimator is developed and evaluated.

Description: Let U = {1, 2, …, i, …, N} be a finite population of N identifiable units. A known “size measure” x_i is associated with unit i; i = 1, 2, ..., N. A sampling procedure for selecting a sample of size n (2 < n < N) with probability proportional to size (PPS) and without replacement (WOR) from the population is proposed. With this method, the inclusion probability is proportional to size (IPPS) for each unit in the population.

Description: Approximate cutoff rules for stratifying a population into a take-all and take-some universe have been given by Dalenius (1950) and Glasser (1962). They expressed the cutoff value (that value which delineates the boundary of the take-all and take-some) as a function of the mean, the sampling weight and the population variance. Their cutoff values were derived on the assumption that a single random sample of size n was to be drawn without replacement from the population of size N.

In the present context, exact and approximate cutoff rules have been worked out for a similar situation. Rather than providing the sample size of the sample, the precision (coefficient of variation) is given. Note that in many sampling situations, the sampler is given a set of objectives in terms of reliability and not sample size. The result is particularly useful for determining the take-all - take-some boundary for samples drawn from a known population. The procedure is also extended to ratio estimation.

Description: Under a sequential sampling plan, the proportion defective in the sample is generally a biased estimator of the population value. In this paper, an unbiased estimator is given. Also, an unbiased estimator of its variance is derived. These results are applied to an estimation problem from the 1976 Canadian Census.

Description: I.P. Fellegi and D. Holt proposed a systematic approach to automatic edit and imputation. An implementation of this proposal was a Generalized Edit and Imputation System by the Hot-Deck Approach, that was utilized in the edit and imputation of the 1976 Canadian Census of Population and Housing. This paper discusses that application, evaluating the strengths and weaknesses of the methodology with some empirical evidence. The system will be considered in relation to the general issues of the edit and imputation of survey data. Some directions for future developments will also be considered.

Description: Owners of small businesses complain about the quantity of forms they are required to collectors of statistics. Administrative data are an alternative source but do not usually include all the information required by the survey takers.

The “Tax Data Imputation System” makes use of tax data collected from a large number of businesses by Revenue Canada and data obtained by sample survey for a small subset of these businesses. Survey data is imputed (estimated) for all the businesses not actually surveyed using a “hot-deck” technique, with adjustments made to ensure certain edit rules are satisfied. The results of a simulation study suggest that this procedure has reasonable statistical properties. Estimators (of means or totals) are unbiased with variances of comparable size to the corresponding ratio estimators.

Description: Release published in The Daily – Statistics Canada’s official release bulletin

Description: Release published in The Daily – Statistics Canada’s official release bulletin

Description: This infographic uses data from the 2018 and 2022 Canadian Internet Use Survey to examine patterns and trends in online banking by population groups.

Description: Release published in The Daily – Statistics Canada’s official release bulletin

Description: From January 2nd to February 5th, 2024, Statistics Canada conducted the Canadian Survey on Business Conditions. The purpose of this survey is to collect information on businesses in Canada related to emerging issues. This iteration of the survey focuses on business expectations and business conditions in Canada. In addition, the questionnaire for the first quarter of 2024 includes a component specifically for non-profit organizations (NPOs). The intent of this set of questions is to address a present data gap and to provide a better understanding of the non-profit sector. This infographic presents key results from this.

Description: Release published in The Daily – Statistics Canada’s official release bulletin

Description: Release published in The Daily – Statistics Canada’s official release bulletin

Description: This infographic presents some highlights from the 2022 Canadian Income Survey data.

Description: Canada’s Poverty Reduction Strategy introduced the Official Poverty Line for Canada and a dashboard of 12 indicators to track progress on poverty reduction for Canadians and their households. This infographic presents trend information for Canada's official poverty rate and the associated 12 indicators.

Description: Release published in The Daily – Statistics Canada’s official release bulletin

Description:

This paper discusses some of the changes in market research we should expect in the next decade. Currently, studies are issue oriented: they provide answers to specific questions or marketing issues. The next decade will see research projects with a broader scope: to understand how markets work and why consumers behave as they do. Measurements will be more complex, and multivariate analysis techniques will be used extensively to identify the subtle relationships within the data. Marketing models will be the conceptual framework for these more complex studies. Market analysis identifying consumer responsiveness segments provides a case example of what might be expected from model-based market research studies.

Description:

This paper identifies the stages in the life-cycle of government policies and programs. For each stage, examples are given of how survey research is presently used and likely trends over the next decade are identified.

Description:

This document describes the process of commissioning market research at Imperial Oil Limited. It outlines the management processes that precede commissioning and defines the expectations of a typical buyer of research work. It also examines the need to have a satisfactory business relationship between the buyer and the seller, and it provides a list of the attributes most often considered by a company seeking a supplier for a particular research project.

Description:

This paper provides a summary description of some of the characteristics of the proposals for new surveys submitted to Statistics Canada for review and consultation by other federal government departments. It describes which departments have been involved, gives details of the types of studies proposed and methodologies used, and deals briefly with some of the problems which the review process has uncovered.

Description:

This paper examines the effects of fertility, mortality and migration on the age profile of the Canadian population, particularly the effect of fluctuating fertility patterns which have occurred since the second World War. The author analyses the impact on social services and the economy as the shifting requirements of the “Baby Boom” cohorts move through their life cycle.

Description:

A major packaged goods manufacturer details his firm’s assemblage and application of market understanding information, impact information, market tracking, share/volume forecasting and documentation procedure.

Description:

Increasing costs without a concomitant increase in research budgets are putting severe strains on research quality. Improvements in technology, however, both in the physical domain and in the conceptual domain are sufficient to maintain research productivity at least at its prior level.

Description:

Due to the absence of hard data and the lack of standardization with respect to nonresponse terminology and reporting procedures, U.S. commercial survey researchers have been unable to obtain an accurate assessment of the nature and extent of the nonresponse problem. However, the results of two recent studies conducted by the author among leading U.S. based market and public opinion research firms revealed that nonresponse is one of the major problems now confronting the commercial survey research industry. This paper discusses the results of the two studies and their implications.

Description:

The article provides a general overview of the concepts of incomplete data and non-response. It is recognized that non-response is an important indicator of data quality, as it affects the estimators by introducing bias and increasing variance due to a reduction in the effective sample size. The relationship between bias and the non-response rate is less obvious, since it depends on the extent of non-response and on the difference in the various characteristics between respondents and non-respondents.

The most effective way of dealing with the effects of non-response is to minimize its extent. However, any attempt to control the extent of non-response must be based on a good understanding of its origins. The causes and extent of non-response are fundamentally related to (i) the type of survey, (ii) the data capture methods, and (iii) the sample design. However, given a sample design, the extent of non-response will be influenced by factors such as the type of region and the type of non-response.

There are several ways to handle incomplete data. Each one, in the end, assigns a value to the missing or incorrect data, unless it is decided to publish “raw” data. The procedure for assigning values is called imputation and such an imputed value presumably describes the characteristic of the non-respondent.

The article provides a brief philosophical explanation about validation and imputation and their applications in the methodology of the various imputation procedures. These include weighting, replication, hot deck imputation using previous data and substitution by a zero value. The using of imputation compared with the methods used in the Canadian Labour Force Survey (LFS) is also discussed. A decision table is provided indicating the various steps to follow for a particular case of a partially completed LFS questionnaire.

Description:

This presentation focuses on the present and future social needs of the public, and tracking these needs by surveys. It is divided into two parts. First, the writer gives some history of the tracking systems. Then, he speaks about the future and his forecasts for the new tracking systems.

Description:

Each issue contains a short article highlighting statistical insights on themes relating to agriculture, food and rural issues.

Description: This publication presents energy balance sheets in natural units and heat equivalents in primary and secondary forms, by province. Each balance sheet shows data on production, trade, interprovincial movements, conversion and consumption by sector. Analytical tables and details on non-energy products are also included. It includes explanatory notes, a historical energy summary table and data analysis. The publication also presents data on natural gas liquids, electricity generated from fossil fuels, solid wood waste and spent pulping liquor.

Description: Once every five years, the Census of Population provides a detailed and comprehensive statistical portrait of Canada that is vital to our country. It is the primary source of sociodemographic data for specific population groups such as lone-parent families, Indigenous peoples, immigrants, seniors and language groups.

In order to help users of census products to better understand the various Census of Population concepts, Statistics Canada has developed, in the context of the activities of the 2021 Census and previous censuses, a collection of short videos. These videos are a reference source for users who are new to census concepts or those who have some experience with these concepts, but may need a refresher or would like to expand their knowledge.

Description: The Departmental Sustainable Development Strategy (DSDS) outlines departmental actions, with measurable performance indicators, that support the implementation strategies of the 2022-2026 Federal Sustainable Development Strategy. The DSDS further outlines Statistics Canada’s sustainable development vision to produce data to help track whether Canada is moving toward a more sustainable future and highlights projects with links to supporting sustainable development goals.

Description: This series provides detailed documentation on the issues, concepts, methodology, data quality and other relevant research related to household expenditures from the Survey of Household Spending, the Homeowner Repair and Renovation Survey and the Food Expenditure Survey.

Description: This report summarizes the annual achievements of the Methodology Research and Development Program (MRDP) sponsored by the Modern Statistical Methods and Data Science Branch at Statistics Canada. This program covers research and development activities in statistical methods with potentially broad application in the agency’s statistical programs; these activities would otherwise be less likely to be carried out during the provision of regular methodology services to those programs. The MRDP also includes activities that provide support in the application of past successful developments in order to promote the use of the results of research and development work. Selected prospective research activities are also presented.

Description: The series covers environment accounts and indicators, environmental surveys, spatial environmental information and other research related to environmental statistics. The technical paper series is intended to stimulate discussion on a range of environmental topics.

Description: This bulletin presents the most up-to-date available information extracted from all of the Aviation Statistics Centre's surveys. Regular features include releases on principal statistics for Canada's major air carriers, airport data, fare basis statistics and traffic data for Canada's most important markets.

Description: This series of analytical articles provides insights on the socio-economic environment in rural communities in Canada. New articles will be released periodically.

Description: Statistics Canada is committed to sharing our knowledge and expertise to help all Canadians develop their data literacy skills by developing a series of data literacy training resources. Data literacy is a key skill needed in the 21st century. It is generally described as the ability to derive meaning from data. Data literacy focuses on the competencies or skills involved in working with data, including the ability to read, analyze, interpret, visualize data, as well as to drive good decision-making.