Longitudinal Immigration Database (IMDB) Technical Report, 2021
7 Data evaluation and quality indicators

Skip to text

Text begins

7.1 Error sources

Because the IMDB is the product of several record linkages, it is subject to different sources of errors, including record linkage errors, measurement errors, and coverage errors. In this section, the sources of errors are explained and the prevalence of some of these errors is presented.

It is to be noted that, given that it is a census of immigrant taxfilers who were admitted in 1980 or thereafter, no weights are created in the IMDB. No adjustments are made for the missing tax years of filers or for linkage errors; no sampling is performed; and every linked taxfilers is kept in the final dataset. However, the linkage itself presents a form of sampling error when links are missed.

7.1.1 Record linkage errors

Datasets produced from the results of record linkages are subject to record linkage errors. Two types of errors are possible—false positives (false matches) and false negatives (false non-matches). A link is considered a false positive when two records not belonging to the same person are deemed a match. A link is considered a false negative when two records belonging to the same person are deemed a non-match.

It is possible to miss part of an immigrant’s fiscal history since some immigrants have more than one social insurance number (SIN) through time (a temporary SIN assigned at arrival to the individual as a non-permanent resident, and later a permanent SIN assigned after admission). Both SINs are required in order to have a complete fiscal history from arrival in Canada. The SDLE (described in Sections 2.3) allows for identification of these SINs. It is possible that, in a few instances, some SIN connections are missed or false connections are made.

7.1.2 Measurement errors

Measurement error is the difference between a variable’s measured value and its true value. This type of error can be attributed to a number of factors, including data capture (e.g., typos) and respondent error (e.g., misinterpretation of the question asked). This type of error was taken into account in the creation of the Integrated Permanent and Non-permanent Resident File (PNRF) to avoid conflicting information for any individual. For example, when a person has a record on both the ILF and the NRF, and the sociodemographic variables have inconsistent values, the values at admission (in the ILF) are kept. See sections 7.2 and section 7.5 for some counts.

7.1.3 Coverage errors

Coverage errors are the result of omissions, erroneous additions, duplicates, and errors of classification of records in the database. Coverage errors can result from inadequate coverage of the population. They can create biased estimates, and the impact can vary for different sub-groups of the population. These errors often result in undercoverage. Undercoverage in the IMDB is in part the result of the exclusion of tax files of immigrant taxfilers from the database. Immigrants who do not file taxes for a given year or who file late would not have an IMDB_T1FF record although linked to tax and part of the population of interest. If, for any reason, an immigrant record was not included in the Immigrant Landing File (ILF), it would not be part of the IMDB. Overcoverage is the result of the addition to the database of records excluded from the target population. An immigrant could have more than one ILF record as a result of multiple admissions not identified as such, for example. Please refer to Section 7.4 and Appendix B for more information on IMDB coverage.

7.2 Data accuracy

This section will discuss the accuracy of the immigration data. For details on the accuracy of the T1 Family File (T1FF), please refer to the T1FF entry (record number 4105).

The accuracy of the IMDB is dependent on the representativeness of the population included in it. A study conducted in the first years of the IMDB concluded that the IMDB “appears to be representative of the population most likely to file tax returns. Therefore, the results obtained from the IMDB should not be inferred to the immigrant population as a whole, but rather to the universe of tax-filing immigrants” (Carpentier and Pinsonneault 1994).

The reasons for the differences between taxfilers and the entire foreign-born population are explained in an article by Badets and Langlois (2000) describing the challenges of using the IMDB:

The characteristics of the immigrant taxfiler population will differ from those of the entire foreign-born population because the tendency or requirement to file a tax return will vary in relation to a person’s age, family status, and other factors. One would expect a higher percentage of males to file a tax return, for example, because males have higher labour force participation rates than females. The extent to which immigrants are “captured” in the IMDB will also be influenced by changes to the income tax. For example, the introduction of federal and provincial non-refundable tax credit programs encourage individuals with no taxable income to file a return to qualify for certain tax credits. (Badets and Langlois 2000)

7.2.1 2021 IMDB: Linkage rates

This section is based on the 2021 IMDB. The overall linkage rate between IRCC immigration file and the SDLE Derived Record Depository was 97.1% (see Section 4). A link does not necessarily mean that a tax file is available since it is possible to link dependents of taxfilers or immigrants who have yet to file taxes. This SDLE theoretical linkage rate mostly informs on how well IRCC files could be associated within a larger repository environment.

Of the immigrants who landed in any year from 1980 to 2020, 85.3% were linked to at least one T1FF record. This rate represents the effective coverage of immigrant linkage to tax files. As presented in the following statistics, this coverage rate may change according to gender and age.

The proportion of linked taxfilers by age group at admission and sex is shown in Table 4. The lower rates for the 0-to-14 age group are expected since those in this age group are not of working age. See Appendix B for rates by sex, age group and admission cohort.

As immigrants become older, they start filing taxes and are included in the IMDB. Chart 1 shows that, among immigrants who landed at any age from birth to age 14, the proportion of linked taxfilers is higher for immigrants who landed prior to 2000 than for immigrants who have landed since 2000. Recent immigrants also have lower linkage rates. See Appendix B for table showing the proportion of linked taxfilers by age group at admission, sex and admission decade.

Chart 2 illustrates the proportion of filers, and the number of filers and non-filers by landing year, where the term “non-filer” means that no T1FF records are available. For the 2021 IMDB, the filing rate varies by landing year, ranging from 71.7% for those who landed in 2019 to 91.3% for those who landed in 1989. The filing rates increase with the number of years that immigrants stay in Canada; this may explain why the linkage rates are higher for those who landed in the 1990s and early 2000’s. See Appendix B, tables 14 and 15, for detailed distribution numbers by landing year.

7.2.2 Availability of date of death

The year and month of death, as well as a death flag, are included in the PNRF. Starting in 2018, these variables were linked by using the Canadian Mortality Database (CMDB). In the past, these variables were based on Statistics Canada’s Amalgamated Mortality Database (AMDB), which is a retired dataset that combined records between CMDB and vital statistics and tax files. The CMDB is an administrative database that collects information on death dates and cause of death from all provincial and territorial vital statistics registries in Canada. Some undercoverage, while minimal, exists in the database as it does not include deaths of Canadians (1) who died outside of Canada, with the exception of United States; (2) who served as members of the Canadian military, or (3) whose bodies were unidentified. Note that the CMDB does not include deaths which were reported in the tax files.

Chart 3 describes the general trend in the number of deaths per year since 1974 for immigrants admitted since 1952. The availability of data for pre-1980 admission was recently added to the IMDB. The value “9999” represents the records of deceased immigrants for which the year of death is not available.

7.2.3 Prefilers compared to records on the Non-permanent Resident File (NRF)

The results included in this section are drawn from a study based on the 2014 IMDB. Prefilers are immigrants who filed taxes prior to their landing year. It is sometimes assumed that all prefilers are immigrants who were non-permanent residents prior to admission. This section discusses why it is not the case. A total of 1.26 million individuals filed taxes before officially admission in 1980 or a subsequent year—of these, 212,500 are not linked to a non-permanent resident record as may otherwise be expected. Upon further investigation, it has been discovered that most permanent resident prefilers not linked to a non-permanent resident record are likely immigrants who have filed taxes when not required: 96% of these prefilers filed taxes only for the year prior to admission, and 75% reported no income (96% had no wages ). As shown in Chart 4, most of these prefilers landed in the first months of the year, prior to the deadline to file taxes for the previous year. It appears some immigrants who landed prior to the month of May filed taxes for the year prior to their landing year, for which they were not required to file.

Given these findings, whether it is appropriate to remove records with Prefiler_ind=1 and FIRST_EFFECTIVE_YEAR=. from studies on immigrants with pre-admission experience depends on the analysis since FIRST_EFFECTIVE_YEAR=. means no record is available on the non-permanent permit file.

Not all immigrants with pre-admission experience are identified as prefilers: 478,100 immigrants have non-permanent resident records with Prefiler_ind=0. Depending on the subject of interest, using the FIRST_EFFECTIVE_YEAR<>. or the number of temporary resident permits (variable NUMBER_ALL_PERMITS) is more appropriate to study immigrants with pre-admission experience. Prefiler_ind=0 indicates that no tax records have been filed prior to admission, but this does not mean that the individual had no pre-admission Canadian experience.

7.2.4 Spouse indicator

The IMDB contains variables that enable data users to obtain information on marital status and spouses. The following section contains results of a study done on the 2012 IMDB. No major changes have occurred since then in the marital status codes or family flag.

The spouse identification number (SP__IDI) is derived from tax files. This information can be derived only when the respondent claims his or her spouse or common-law partner while filing taxes; this causes an underestimation of couples as compared to the marital status declared in the tax files. From the T1FF, it is also possible to obtain the marital status at time of filing.

Prior to 1991, the “single” category was not available as marital status (MSTCO). The “common-law” status was made available as of 1992 for all datasets (1982 to 2012). Since 1992, the proportion of IMDB records indicating marital status as “single” has ranged from 20% to 30%. The proportion of “separated” has declined from 30% prior to 1992 to 4% after. The other marital status categories have not been affected by pattern changes.

Analysis done on the distribution of marital status (MSTCO from tax files) and the spouse ID (SP__IDI) shows differences between the two variables. This is because values for marital status are missing for some records. In a perfect situation, the records of all married persons would have spousal information, and the records of all single persons would have no spousal information. This analysis shows data quality to be better after 1992, when separate statuses for “common-law” and “single” were introduced.

Presence of spouse reporting gaps

Further to a review of the longitudinal history of immigrants on the 2012 IMDB, some cases where the spouse or common-law partner is missing (or different) for a given year and the same spouse is declared two or three years later have been found. The Chart 5 gives a summary of these gaps.

Most immigrants on the file have one or no spouse in the years from 1980 to 2012 according to the IMDB_T1FF files. It is to be noted that no marital status (and no spouse info) is available for 1.2 million immigrants out of approximately 6 million immigrants.

7.3 Imputed variables

7.3.1 Imputation of education variables

A data quality issue regarding the variables for education qualifications and years of schooling was identified. A non-negligible proportion of individuals who did not state their education qualifications or years of schooling were coded as “0” or “None” instead of “Missing” on EDUCATION_QUALIFICATIONS and YEARS_OF_SCHOOLING. This problem was prevalent from 2011 to 2014. In 2011, 35% of immigrants stated that they had no education qualifications, compared to roughly 10% in the 1990s.

This issue was resolved by imputing the education variables by means of values for education variables from 2008 to 2010 to model the most recent year’s education variables. For the imputation, variables such as admission age, immigration_category_rollup2, intended occupation, gender and country of last permanent residence were used. The nearest-neighbour imputation method was employed. The variable Education_imputation_ind (0: no; 1: yes), available in the PNRF, was created to identify records with imputed education variables.

For immigrants admitted in 2016, the number of cases where a non-stated education was coded to “0” or “None” instead of “Missing” was reduced. However, a non-negligible number of records had a missing education qualification with a valid number of years of schooling. For these records, years of schooling was used to impute a value for education qualifications.

For principal applicants admitted since 2015, under the express entry, the year of schooling in most cases are underestimated.

For the 2021 IMDB, those who were admitted between 2015 and 2020 and who were connected to an Express Entry record had their education imputed using values found in the Express Entry file. A more comprehensive education variable called Education_Derived was created, combining data from Education_Qualification, for those who were not found in the Express Entry file, and the new values from Express Entry. Users should note that the values from the Express Entry file are based on the immigration officer’s assessment of the educational qualifications of the applicant in the context of a Canadian equivalency, whereas the values from Education_Qualification are self-declared by the applicant, and do not necessarily reflect a Canadian equivalency.

Education_Derived was set to missing for those admitted in 2020 or later.

7.3.2 Imputation of language variables

For the 2019 IMDB, two new language variables were added, English_IND and French_IND, reporting the first official language known at admission. For those who were admitted in 2018 or earlier, they are defined as permanent residents having English (French) as their mother tongue or having a mother tongue other than English or French while declaring English only (French only) as their knowledge of official language at admission.

For those admitted in 2019 or later, they are defined as permanent residents having declared English only (French only) as their knowledge of official language at admission or having declared English and French as their knowledge of official language at admission and reporting English (French) as the language in which they are most at ease.

7.4 Coverage

7.4.1 Coverage of the Integrated Permanent and Non-permanent Resident File (PNRF)

The 2021 Integrated Permanent and Non-permanent Resident File (PNRF) contains over 8.8 million records (Table 5); of these, over 7.5 million records (84.9%) are linked to at least one tax file. It is to be noted that immigration data belonging to non-taxfilers and taxfilers alike are included in a file named PNRF_1980_2021. The following table shows the distribution of records depending on their presence in the different immigration and tax files. Over 2.1 million records belong to immigrants who were temporary residents prior to becoming permanent residents; over 2.0 million of these records are linked to at least one tax file. See Appendix B for detailed distribution numbers by landing year.

See Appendix B for detailed distribution numbers by landing year.

Data on immigrants with non-permanent resident permits are available. The proportion of immigrants with pre-admission experience varies by landing year (Chart 6); it ranges from 3.8% in 1980 to 47.3% in 2020. As a result, the proportion of immigrants with pre-admission experience in the early 1980s is underrepresented. The proportion of immigrant filers with pre-admission experience (solid line) is higher than the overall proportion of immigrants with pre-admission experience (dotted line) because the linkage rate for these immigrants is higher than that for immigrants without pre-admission experience.

7.4.1.2 Coverage of non-permanent residents

This section describes the coverage of individuals who only had non-permanent resident permits since 1980, overall tax records are available for 30.2% of them. Among individuals who have not become permanent residents, asylum seekers have the highest coverage rate, tax records are available for 46.3% of them (see table 6). There is a wide variety of non-permanent resident permits; some permits are as short as one day.

7.4.2 T1 Family File (T1FF) size and coverage by year

Tax files for 1982 and subsequent years are available for linked non-permanent and permanent residents. Some permanent residents were non-permanent residents prior to admission. Table 7 gives details on the distribution of linked permanent residents with and without non-permanent permits prior to admission, by tax year. At least one tax file is available for the 82.2% of permanent residents without a non-permanent permit prior to admission and for the 95.3% of permanent residents who were non-permanent residents prior to admission. The fact that permanent residents with pre-admission temporary permits have a higher rate of filing taxes than permanent residents without pre-admission permits can be explained by a requirement in the permanent resident application process with respect to non-permanent residents. Non-permanent residents who apply for permanent residency are required to fulfil their obligation to file tax in Canada. The number of taxfilers on the IMDB_T1FF increases as the years pass since the size of the in-scope population increases.

Chart 7 shows the proportion of permanent residents who were non-permanent residents prior to admission varies by tax year from a low of 22.6% for the 1983 tax year to a high of 30.3% for the 2018 tax year.

An immigrant who filed taxes for a given year will not necessarily file taxes the next year. For example, if Person A landed in 1983, this individual might be found on tax files from 1984 to 1999, but not be found on the 2000 file, and again be found on the 2001 to 2013 files. For example, 25.2% of filers from the 1980 cohort had tax files available for all years. Out-migration, death and late filing are some of the reasons immigrant filers might stop filing permanently or for some years.

Most immigrants file taxes for the first time in the year they land or one year before or after. For example, of the 251,110 immigrants who landed in 2006, 100,690 (40.1%) filed taxes for the first time in 2006, while 15,560 (6.2%) did so in 2007 and 3,200 (1.3%) did so in 2015 .

7.5 Quality assessment of immigration data

7.5.1 Quality assessment of the Integrated Permanent and Non-permanent Resident File (PNRF)

A validation of the content of the PNRF_1980_2021 was done. While admission and tax data are collected mandatorily from those in scope, some fields may not have been completed. They could be left empty because the response was unknown, or for other reasons unbeknownst to database users (e.g., refusal) (McLeish 2011). Item non-response can present issues when one is considering the IMDB for statistical purposes, including the following:

1. If the database user is interested in producing a sample based on characteristics for which there are missing records, there will be coverage error (i.e., those being included in the sampling frame may not be representative of the target population).
2. If the non-response is non-ignorable (i.e., the fact that information is missing is not a random occurrence; the fact that there is no response is indicative of what the response would have been), any analysis using those variables would be biased.

The presence of missing variables and invalid values was assessed. The numbers presented in this section are rounded. Invalid values are either inconsistent or not listed in the metadata tables available to users (see the immigration component of the data dictionary appendix). Most of the quality issues listed in Table 8 are for data collected in the 1980s and 1990s. It should be noted that some seemingly valid values may be erroneous as well.

The variable Case Identification Number (CASE_ID) has item response rates generally in the high 90% range

(usually over 99%). However, for some landing years, the response rate drops significantly (to as low as 80% in 1991 and 1992). Therefore, any analysis using this variable for all landing years will under-represent those years where the item non-response is higher (e.g., 1986, 1987 , 1991, 1992, 1993, 2020). No detection of invalid values was performed for the variable Case Identification Number (CASE_ID).

The variable Landing_age was defined as invalid when it was greater than 100, although it is possible in some instances that these values are accurate. It should be noted that, according to the values for this variable, the number of immigrants who landed after age 100 was much higher between 1987 and 1995 than the other landing years. This could be the result of a data capture issue.

In the PNRF of the 2021 IMDB, 25 records had a birth year prior to 1880, with 18 records having birth year 1753 with corresponding landing years that are post 1985, even up to 2012.

The variables related to country have quality issues as well. The country of birth is missing for some records in almost all landing years. For example, values are missing for over 100 records in each of the years from 1985 to 1993. The country of citizenship is missing for fewer than 20 records per landing year for most years (with the major exceptions of 2005, 2006, 2016 and 2017, where over 80 records were missing per landing year). The country of residence is missing for many admission records from 2013 (this value is missing for 1190 records, or 0.5% of admissions taking place that year) and 2014, (this value is missing for 5845 records, or 2.3% of admissions taking place that year) and 2015 (missing for 7360 records, or 2.8% of admissions in that year).

The education variables, prior to the 2017 cohort, after imputation (see Section 6.3), have over 150 missing values per landing year from 1980 to 1984; this translates as a rate of missing values per landing year of less than 0.5%. A new derive variable using Express Entry data was used to help fill some missing data for the education variables for those admitted from 2015 to 2020

The percentage of valid responses for the occupation variables is above 99% for all landing years.

The variables Family_Status and CSQ_IND have most of their missing values for records with a landing year prior to 1999.

Mother_Tongue is missing for 550 records from the 2011 admissions and 535 records for the 1991 admissions.

The variable Official language has an increasing number of missing values; from 2016 to 2020, between 1810 and 13045 missing values per cohort.

The variable Marital_Status has over 200 missing values per cohort since 2012.

The variables Destination_CD, Destination_CMA, Destination_CSD and Destination_province have few missing values; the 2021 IMDB uses the Standard Geographical Classification (SGC) to update the geographical region and code.

The year and month of death was missing for some individuals identified as deceased (Death_Indicator=1). The value “9999” was assigned to Death_Year and the value “99” was assigned to Death_Month in cases where the year and month of death were unknown.

7.5.2 Quality assessment of the Non-permanent Resident File (NRF)

A validation of the content of the NRF_PERMIT_1980_2021 and NRF_PERSON_1980_2021 files was done. These files contain different sets of variables from each other. In Table 8B, variables “Landing_Year” to “Number_All_Permits) appear on the person file, while the remainder appear on the permits file. While admission and tax data are collected mandatorily from those in scope, some fields may not have been completed. They could be left empty because the response was unknown, or for other reasons unbeknownst to database users (e.g., refusal) (McLeish 2011). Item non-response can present issues when one is considering the IMDB for statistical purposes, including the following:

1. If the database user is interested in producing a sample based on characteristics for which there are missing records, there will be coverage error (i.e., those being included in the sampling frame may not be representative of the target population).
2. If the non-response is non-ignorable (i.e., the fact that information is missing is not a random occurrence; the fact that there is no response is indicative of what the response would have been), any analysis using those variables would be biased.

The presence of missing variables and invalid values was assessed. The numbers presented in this section are rounded. Invalid values are either inconsistent or not listed in the metadata tables available to users (see the immigration component of the data dictionary appendix). It should be noted that some seemingly valid values may be erroneous as well.

The variable Landing_Year has a high percentage of missing values ( 70.3%). This is normal as only landed individual will have a landing year, and the NRF includes all non-permanent residents, both landed and un-landed.

In the NRF_PERSON of the 2021 IMDB, 355 records had a birth year prior to 1880, with 350 records having birth year 1753.

While most records have a birth country, those with a missing Country_Birth also have a missing landing year.

The variables Effective_Date and Valid_Date don’t have invalid responses themselves, but when compared together can produce invalid responses. For example, the Valid_Date must always appear after the Effective_Date. Records that have the Valid_Date appear before the Effective_Date could be considered as invalid responses for one or both of these variables. Additionally, any record that has a duration of 5 or more years between the Effective_Date and the Valid_Date are suspicious and are likely to include an invalid value for one of the variables. Overall, 0.005% of effective/valid date comparisons could be considered invalid because of these 2 issues.

Over 99% of missing Valid_Date occur when the Document_Type variable is 46 (refugee claim).The reason for this is because refugee claims are not assigned an end date.
The variables Destination_CD, Destination_ER, Destination_CMA, Destination_CSD and Destination_province have a smaller proportion of missing values than other variables, but much larger than the PNRF. Most years (based on the effective_date variable) have a very low missing variables rate, around 1%. However, years 1989, 2018 and 2019 have almost a 12% missing rate, and years 2014, 2015, 2016 and 2017 have between 32%-37% missing rate. The 2021 IMDB uses the Standard Geographical Classification (SGC) to update the geographical region and code.

7.6 Quality assessment of the Province of Residence Variable (PRCO_)

A validation of the geography variables included in the IMDB tax files was done. This section discusses how the variable Province of Residence (PRCO_) was derived and its quality.

The Province of residence (PRCO_) is based on information from taxfilers when available. Missing information from the province of residence is replaced by information collected on the postal code of the mailing address either from the individual (PSCO_I), if available, otherwise from the family (PSCO_F).

While the Province of residence (PRCO_) is more reliable than the Taxing province (TXPCO_), some abnormalities were observed mostly on the non-resident code in the reporting for taxation years 1989, 1993, and 1998. These may impact specific provinces.

For the 1993 tax year, IMDB_T1FF includes anomalies for the province of Manitoba with an unusual number of residents (48,130 in 1993, compared to 33,650 the tax year before, and 37,365 the tax year after). Similar changes are observed for the Northwest Territories. Additionally, 740 individuals are coded as residing in Nunavut while Nunavut was created in 1998. 725 individuals are coded as residing in multiple jurisdictions. Users can use the information from the variable PSCO_F to diminish the effect of the anomalies on their analyses that include province of residence. However, as stated above, the time are different between PSCO_ (based residence at time of filling) and PRCO_ (residence on December 31st).

Non-resident (PRCO_=12) records appear to be overestimated in the 1989 IMDB_T1FF. It includes 79,210 non-residents of Canada, with many of them having a non-permanent residency status. Users can decide to use the postal code of the mailing address (PSCO_ at the individual or family level) to derive the value of PRCO_ or remove the non-residents from their analysis.

In the 1998 IMDB_T1FF, a higher than expected number of records are assigned to Newfoundland and Labrador (PRCO_). In these cases the place of residence of the family at the time of filing is also Newfoundland based on variable PSCO_F.

• Previous
• Next