Analysis

Description: In this rejoinder, I address the comments from the discussants, Dr. Takumi Saegusa, Dr. Jae-Kwang Kim and Ms. Yonghyun Kwon. Dr. Saegusa’s comments about the differences between the conditional exchangeability (CE) assumption for causal inferences versus the CE assumption for finite population inferences using nonprobability samples, and the distinction between design-based versus model-based approaches for finite population inference using nonprobability samples, are elaborated and clarified in the context of my paper. Subsequently, I respond to Dr. Kim and Ms. Kwon’s comprehensive framework for categorizing existing approaches for estimating propensity scores (PS) into conditional and unconditional approaches. I expand their simulation studies to vary the sampling weights, allow for misspecified PS models, and include an additional estimator, i.e., scaled adjusted logistic propensity estimator (Wang, Valliant and Li (2021), denoted by sWBS). In my simulations, it is observed that the sWBS estimator consistently outperforms or is comparable to the other estimators under the misspecified PS model. The sWBS, as well as WBS or ABS described in my paper, do not assume that the overlapped units in both the nonprobability and probability reference samples are negligible, nor do they require the identification of overlap units as needed by the estimators proposed by Dr. Kim and Ms. Kwon.

Description: In some of non-probability sample literature, the conditional exchangeability assumption is considered to be necessary for valid statistical inference. This assumption is rooted in causal inference though its potential outcome framework differs greatly from that of non-probability samples. We describe similarities and differences of two frameworks and discuss issues to consider when adopting the conditional exchangeability assumption in non-probability sample setups. We also discuss the role of finite population inference in different approaches of propensity scores and outcome regression modeling to non-probability samples.

Description: Pseudo weight construction for data integration can be understood in the two-phase sampling framework. Using the two-phase sampling framework, we discuss two approaches to the estimation of propensity scores and develop a new way to construct the propensity score function for data integration using the conditional maximum likelihood method. Results from a limited simulation study are also presented.

Description: Nonprobability samples emerge rapidly to address time-sensitive priority topics in different areas. These data are timely but subject to selection bias. To reduce selection bias, there has been wide literature in survey research investigating the use of propensity-score (PS) adjustment methods to improve the population representativeness of nonprobability samples, using probability-based survey samples as external references. Conditional exchangeability (CE) assumption is one of the key assumptions required by PS-based adjustment methods. In this paper, I first explore the validity of the CE assumption conditional on various balancing score estimates that are used in existing PS-based adjustment methods. An adaptive balancing score is proposed for unbiased estimation of population means. The population mean estimators under the three CE assumptions are evaluated via Monte Carlo simulation studies and illustrated using the NIH SARS-CoV-2 seroprevalence study to estimate the proportion of U.S. adults with COVID-19 antibodies from April 01-August 04, 2020.

Description: Our comments respond to discussion from Sen, Brick, and Elliott. We weigh the potential upside and downside of Sen’s suggestion of using machine learning to identify bogus respondents through interactions and improbable combinations of variables. We join Brick in reflecting on bogus respondents’ impact on the state of commercial nonprobability surveys. Finally, we consider Elliott’s discussion of solutions to the challenge raised in our study.

Description: This discussion summarizes the interesting new findings around measurement errors in opt-in surveys by Kennedy, Mercer and Lau (KML). While KML enlighten readers about “bogus responding” and possible patterns in them, this discussion suggests combining these new-found results with other avenues of research in nonprobability sampling, such as improvement of representativeness.

Description: Kennedy, Mercer, and Lau explore misreporting by respondents in non-probability samples and discover a new feature, namely that of deliberate misreporting of demographic characteristics. This finding suggests that the “arms race” between researchers and those determined to disrupt the practice of social science is not over and researchers need to account for such respondents if using high-quality probability surveys to help reduce error in non-probability samples.

Description: Nonprobability samples are quick and low-cost and have become popular for some types of survey research. Kennedy, Mercer and Lau examine data quality issues associated with opt-in nonprobability samples frequently used in the United States. They show that the estimates from these samples have serious problems that go beyond representativeness. A total survey error perspective is important for evaluating all types of surveys.

Description: Statistical approaches developed for nonprobability samples generally focus on nonrandom selection as the primary reason survey respondents might differ systematically from the target population. Well-established theory states that in these instances, by conditioning on the necessary auxiliary variables, selection can be rendered ignorable and survey estimates will be free of bias. But this logic rests on the assumption that measurement error is nonexistent or small. In this study we test this assumption in two ways. First, we use a large benchmarking study to identify subgroups for which errors in commercial, online nonprobability samples are especially large in ways that are unlikely due to selection effects. Then we present a follow-up study examining one cause of the large errors: bogus responding (i.e., survey answers that are fraudulent, mischievous or otherwise insincere). We find that bogus responding, particularly among respondents identifying as young or Hispanic, is a significant and widespread problem in commercial, online nonprobability samples, at least in the United States. This research highlights the need for statisticians working with commercial nonprobability samples to address bogus responding and issues of representativeness – not just the latter.

Description: This paper is an introduction to the special issue on the use of nonprobability samples featuring three papers that were presented at the 29^th Morris Hansen Lecture by Courtney Kennedy, Yan Li and Jean-François Beaumont.

Description: Release published in The Daily – Statistics Canada’s official release bulletin

Description: Release published in The Daily – Statistics Canada’s official release bulletin

Description: Release published in The Daily – Statistics Canada’s official release bulletin

Description: Release published in The Daily – Statistics Canada’s official release bulletin

Description: Release published in The Daily – Statistics Canada’s official release bulletin

Description: Release published in The Daily – Statistics Canada’s official release bulletin

Description: Release published in The Daily – Statistics Canada’s official release bulletin

Description: Using data from the Postsecondary Student Information System (PSIS) and the Census of Population, 2021, this infographic provides information on enrolment in Canadian public postsecondary institutions for transgender and non-binary people.

Description: The infographic uses data from the integrated file of the Postsecondary Student Information System, the 2016 Census, the 2021 Census and the T1 Family File to compare the job quality of Indigenous graduates with a bachelor's degree with that of non-racialized and non-Indigenous graduates two years after graduation. Job quality indicators include employment income, unionization rate, and employer pension plan coverage rate.

Description: Release published in The Daily – Statistics Canada’s official release bulletin

Description:

In a recent Statistics Canada survey, 77% of Canadian plant managers felt their production technology was as good as their domestic competitors. Against their U.S. counterparts, they were less confident: only 57% of Canadian firms believed their technologies were as good as their American competitors. The survey also reveals that 70% firms used the Internet and 60% had a "home page" on the World Wide Web.

Description:

In 1996, larger financial services companies were the most likely to use the Internet for communications, research and e-commerce. During that year, 73% of banks were using the Internet whereas less than half of the property and casualty insurance companies were connected. E-commerce was undertaken by only 17% of the connected firms whereas 70% was using e-mail and 86% was conducting web searches. Internet users were more innovative and introduced more new products than non-users.

Description:

In 1999, the federal government expects to fund 19.4% of the R&D in Canada. Less and less of the government-funded R&D is taking place in government labs. Although overall spending on R&D will increase from $3.5 billion to $4.0 billion, the share of this going to the government research has dropped from 59% to 52%.

Description:

You thought it was obvious but the ICT sector that everyone is talking about hasn't had an official definition - until now. We sorted through the SIC (1980) codes and selected 20 that fit. Next issue - the NAICS-based definitions.

Description:

Our jobs, communities, leisure activities and patterns of commerce are changing at a dizzying pace - the Internet is literally transforming the way we live, work and play. In 1998, 36% of Canadian households were regular users of computer communication - up sharply from 29% in 1997. And the technology revolution is not over yet!

Description:

Gross domestic product expenditures on R&D (GERD) for 1999 increased by 3.5% to $14.9 billion over the previous year. Despite this increase, the proportion of GDP devoted to R&D (1.6%) is still among the lowest of the G-7 countries.

Description:

A Statistics Canada study uses business demographics to learn about innovation and technological change and uncovers interesting patterns. Contrary to expectations, the author uncovered considerable volatility (start-ups and closures) in the service sector. The volatility rate for this sector was 31% compared with 23% for the manufacturing sector. Firms that do not innovate frequently are replaced by new ones that have new or improved products to offer or by those that employ more efficient methods of production and delivery.

Description:

Some analysts suggest that biotechnology may trigger a revolution equal to the one prompted by information technology. Various sectors of Canadian industry are already actively using biotechnologies for purposes ranging from research and development to pollution control. Many still see obstacles to adopting new biotechnologies including lack of information and government regulation.

Description:

In the first part of this study, we will explore the development of the ski industry in Canada, after taking a short historical detour. In part two we will examine the characteristics of American travellers who visited Canadian ski areas (to ski or snowboard) during an overnight stay in Canada in the winter of 1998-99. Lastly, we will take a quick look at some characteristics of the overseas skier/snowboarder and at their contribution to the Canadian economy.

Description:

This paper looks at trends in rural employment in Canada and compares them with trends for other Organisation for Economic Co-operation and Development (OECD) countries.

Description: Studies on Gender and Intersecting Identities brings together and analyzes a wide range of important issues related to gender, age, sexuality, disability, ethnocultural characteristics and other intersecting identities. Through a Gender-based Analysis Plus (GBA+) lens, these studies will enrich Canadians' understanding of how gender and other identity factors affect the social, economic and financial participation and status of diverse groups of Canadians.

Description: This publication features short and accessible analytical articles that delve further into key findings and emerging trends identified in Census of Agriculture and other data sources related to agriculture. Subjects of analysis include matters related to farm land, crops, livestock, farm finances, technology, the environment and the farm population, as well as other economic and social aspects of Canada’s agriculture industry. Analytical articles are written in plain language and are intended to be a valuable source of information for a broad audience, including policy analysts, students, researchers, agricultural operators, the media and the public at large.

Description: The papers in this series cover a variety of topics related to labour statistics. The studies are intended to show recent or historical trends observed with the surveys produced by the Centre for Labour Market Information, i.e. the Labour Force Survey, Survey of Employment Payrolls and Hours, Employment insurance Coverage Survey, Employment insurance statistics as well as administrative data sources. All the papers in this analytical series go through institutional and peer review to ensure that they conform to Statistics Canada's mandate as a government statistical agency and adhere to generally accepted standards of good professional practice.

Description: The publication features products and data highlights that focus on rural areas of Canada or that have a rural dimension present. Rural areas are typically areas outside of Canada's Census Metropolitan Areas (CMA) and Census Agglomerations (CA). The publication also includes explanatory notes on key concepts and definitions.

Description: Departmental Plans (DP) are individual expenditure plans for each department and agency. These reports provide increased levels of detail over a three-year period on an organization's main priorities by strategic outcome, program and planned/expected results, including links to related resource requirements presented in the Main Estimates. In conjunction with the Main Estimates, Departmental Plans serve to inform members of Parliament on planned expenditures of departments and agencies, and support Parliament's consideration of supply bills. The DPs are typically tabled soon after the Main Estimates by the President of the Treasury Board.

Description: These short analytical articles, based on data from the Census of Population, provide analysis on specific topics of interest related to the Canadian population. They are available with each Census of Population major release.

Description: This publication presents annual estimates of the total population and annual estimates by age and gender for Canada, provinces and territories. It also presents estimates of the following components of population change: births, deaths, immigration, emigration, returning emigration, net non-permanent residents and inter-provincial migration, the latter by origin and destination. As in the case of population estimates, the components are also available for the total population and by age and gender.

The Annual demographic estimates - Canada, provinces and territories publication contains the most recent estimates as well as an annual historical series. It also contains highlights and analysis of the most current demographic trends, as well as a brief description of the concepts, methods and data quality of the estimates.

Description: The series includes analysis on the characteristics of those with elementary-secondary, postsecondary and apprenticeship training. It also features analysis on students’ pathways through the education system and into the labour market-- including findings for different levels of education and fields of study. This research highlights specific groups of interest such as youth, women, men, immigrants, Indigenous people (First Nations people, Métis and Inuit) and visible minorities, and how intersections between these characteristics influence people’s educational experiences. Other topics include access to education; national and international adult performance assessments; use of technology; lifelong learning; and adult education.

Description: These papers provide background information as well as in depth analysis on data reported in any of the following accounts: income and expenditure accounts, provincial economic accounts, financial flow accounts, national balance sheet accounts, estimates of labour income, and national tourism indicators.

Description: Demographic documentsis a series of texts intended for scholars and researchers, published occasionally by the Demography Division of Statistics Canada for their methodological, analytical or descriptive interest in the population field.