Publications
Culture, Tourism and the Centre for Education Statistics
A Profile of Minority-Language Students and Schools in Canada: Results from the Programme for International Student Assessment (PISA), 2009
Appendix 2
Archived Content
Information identified as archived is provided for reference, research or recordkeeping purposes. It is not subject to the Government of Canada Web Standards and has not been altered or updated since it was archived. Please "contact us" to request a format other than those available.
The Programme for International Student Assessment: What is PISA 2009?
Sixty-five countries and economies participated in PISA 2009, including all 33 OECD member countries. Between 5,000 and 10,000 students aged 15 from at least 150 schools were typically tested in each country.
With reading being the first of the PISA domains to be reassessed as the major domain, the reading framework developed in 2000 was revisited to account for changes in the domain in the past decade. Much of the substance of the PISA 2000 reading framework was retained in 2009, which allows reporting on trends in performance over time. However, two major modifications in the 2009 framework focus on the incorporation of reading of electronic texts and the elaboration of the constructs of reading engagement and metacognition. In 2009, the assessment of reading of electronic texts was implemented as an international option in which Canada elected not to participate. Therefore, this report presents the Canadian results for the core paper-and-pencil assessment of reading in which Canada, along with the other 65 countries and economies participated. Since the same reading scales are relevant to all PISA participating countries it is appropriate to compare the performance of countries involved in this assessment directly and to report on trends in performance between 2000 and 2009.
As was the case in PISA 2000, PISA 2009 reports results globally and for the three aspects identified in the framework (Accessing and Retrieving, Integrating and Interpreting, and Reflecting and Evaluating). Additionally it reports on two text formats used in PISA (Continuous texts and Non-continuous texts). … Further information is available in the PISA 2009 framework. Although there is a high correlation between these sub-scales, reporting results on each subscale may reveal interesting interactions which could be linked to curriculum and teaching methodology used.
Why did Canada participate in PISA?
Canada's continued participation in PISA 2009 stems from many of the same questions motivating other participating countries. In Canada, provinces and territories responsible for education invest significant public resources in the provision of elementary and secondary education and Canadians are interested in the outcomes of compulsory education provided to their youth. How can expenditures be directed to the achievement of higher levels of knowledge and skills upon which lifelong learning is founded and to potentially reduce social inequality in life outcomes?
Elementary and secondary education systems play a key role in providing students with the knowledge and skills that form an essential foundation necessary to further develop human capital either through participation in the workforce, post-secondary education or lifelong learning. Previous studies based on PISA data have shown the effects of strong skills at age 15 in later life. Youth with strong reading skills were much more likely to have finished high school, pursue post-secondary education and finish it. For example, results from the Youth in Transition Survey (YITS) show that there is a strong association between reading proficiency and education attainment. Canadian students in the bottom quartile of PISA reading scores were much more likely to drop out of secondary school and less likely to have completed a year of post-secondary education than those in the high quartile of reading score. In contrast, Canadian students in the top PISA level (Level 5) of reading performance were twenty times more likely to go to university than those in the lowest PISA level (at or below Level 1).
Questions about educational effectiveness can be partly answered with data on the average performance of Canada's youth in key subject areas. However, two other questions with respect to equity can only be answered by examining the distribution of competencies: Who are the students at the lowest levels? Do certain groups or regions appear to be at greater risk? These are important questions because, among other things, acquisition of knowledge and skills during compulsory schooling influences access to postsecondary education, eventual success in the labour market and the effectiveness of continuous, lifelong learning.
Measuring Up: Canadian Results of the OECDPISA Study. The Performance of Canada's Youth in Reading, Mathematics and Science. 2009 First Results for Canadians aged 15. Statistics Canada. 2010. P. 8,11,12
A note on statistical comparisons
The average [scores] were computed from the scores of random samples of students from each country and not from the population of students in each country. Consequently, it cannot be said with certainty that a sample average has the same value as the population average that would have been obtained had all 15- year-old students been assessed. Additionally, a degree of error is associated with the scores describing student performance as these scores are estimated based on student responses to test items. A statistic, called the standard error, is used to express the degree of uncertainty associated with sampling error and measurement error. The standard error can be used to construct a confidence interval, which provides a means of making inferences about the population averages and proportions in a manner that reflects the uncertainty associated with sample estimates. A 95% confidence interval is used in this report and represents a range of plus or minus about two standard errors around the sample average. Using this confidence interval it can be inferred that the population mean or proportion would lie within the confidence interval in 95 out of 100 replications of the measurement, using different samples randomly drawn from the same population.
When comparing scores among countries, provinces, or population subgroups the degree of error in each average must be considered in order to determine if the true population averages are likely different from each other. Standard errors and confidence intervals may be used as the basis for performing these comparative statistical tests. Such tests can identify, with a known probability, whether there are actual differences in the populations being compared.
For example, when an observed difference is significant at the 0.05 level, it implies that the probability is less than 0.05 that the observed difference could have occurred because of sampling or measurement error. When comparing countries and provinces[or sub-populations], extensive use is made of this type of statistical test to reduce the likelihood that differences due to sampling or measurement errors will be interpreted as real.
Only statistically significant differences at the 0.05 level are noted in this report, unless otherwise stated. Averages did not differ unless the 95% confidence intervals for the averages being compared did not overlap.
Measuring Up: Canadian Results of the OECDPISA Study. The Performance of Canada's Youth in Reading, Mathematics and Science. 2009 First Results for Canadians aged 15. Statistics Canada. 2010. P 15
- Date modified: