A mixed latent class Markov approach for estimating labour market mobility with multiple indicators and retrospective interrogation
Section 3. The data
The Continuous Labour Force Survey (CLFS), conducted by ISTAT (Italian Institute of Statistics), is the main and official source of statistical documentation on the Italian labour market. The CLFS has been conducted since 1969 and has been modified many times. In 2004, major updating was carried out, mainly dictated by the requirement to adapt the survey to new EU (European Union) standards. The principal changes involved interviews distributed throughout the years of the study, new criteria to classify respondents’ status in the labour market, computer-assisted data collection techniques, and dependent interviewing. Every year the survey collects information on about 280,000 households, for a total of about 700,000 individuals. The reference population consists of all household members officially resident in Italy.
The Italian CLFS sampling design has two stages: 1) municipalities were denominated as primary sampling units (PSUs) with stratification, and households as final sampling units (FSUs) with rotation. PSUs were stratified according to demographic size. Large municipalities, with population over a given threshold (also called self-representative municipalities), were always included in the sample; smaller municipalities (not self-representative) were grouped in strata, so that one municipality in each stratum was selected with probability proportional to its population; 2) households were randomly selected from the population registers in all municipalities drawn at stage 1.
The survey was quarterly with a 2-2-2 rotating design. Householders were interviewed in two consecutive quarters. After a two-quarter break, they were interviewed again, twice in the corresponding two quarters of the following year. As a result, each household was included in four waves of the survey over a period of 15 months. This rotation system meant that half of the sample remained unchanged in two consecutive quarters and in quarters one year apart, and 25% of the sample remained unchanged over three quarters.
All the following statistical analyses are made on the so-called longitudinal population. The CLFS is not designed as a proper panel: the initial population changes during the observation period due to demographic events and migrations. Although ISTAT has proposed a procedure to calculate longitudinal weights (Boschetto, Discenza, Lucarelli, Rosati and Fiori 2009), they are not available to researchers, so that we could not take into account the complex sample design. However, we consider that it was reasonable to assume that respondents belonging to the same households were independent.
Information on labour force condition in one reference quarter was collected three times: (i) each respondent was classified as employed, unemployed or not in the labour force according to the definition of the ILO on the basis of answers given to a selected group of questions; (ii) in a subsequent section of the questionnaire, all respondents were asked to classify themselves in the labour market, in order to collect the “self-perceived” condition; (iii) after one year, a retrospective question asked about respondents’ state in the labour market one year before the first interview.
According to the ILO definition, respondents were classified as employed in the reference quarter if, aged 15 years or over, during the reference week they performed some kind of work, for at least one hour, for pay, profit or family gain, or were not at work but had a job or business from which they were temporarily absent because of illness, holidays, industrial dispute, or education and training. Respondents were classified as unemployed if, aged from 15 to 74, they were: (a) without work during the reference week; (b) currently available for work in the two weeks following the reference week; (c) actively seeking work, i.e., had taken specific steps, in the four-week period ending with the reference week, to seek work or who did not seek work but who had found a job to be started later, within a period of up to three months (International Labour Organization (ILO) 2008).
Current self-perception and the retrospective question classified respondents in eight categories: employed; unemployed looking for new employment; unemployed looking for first employment; fulfilling domestic tasks; student; retired; disabled for work; other.
Table 3.1 shows the rotating design of the survey for two consecutive calendar years. Letters identify rotation groups: four rotation groups were interviewed in each quarter. With reference to one calendar year, information on labour market condition came from nine rotation groups. However, the rotation design generates a specific pattern of missing data. For example, for units of rotation group A who are interviewed for the fourth time in the first quarter of year 1, only the ILO (I) indicator and self-perception (S) of labour market condition in the first quarter of year 1 are available. For units in rotation group F, who were first interviewed in the first quarter of year 1, we only have information on labour force state based on the ILO definition, self-perception and the retrospective question (R) for the first and second quarters of year 1.
| Rotation Group | Year 1 | Year 2 | ||||||
|---|---|---|---|---|---|---|---|---|
| I quarter | II quarter | III quarter | IV quarter | I quarter | II quarter | III quarter | IV quarter | |
| A | I-S | This is an emplty cell | This is an emplty cell | This is an emplty cell | This is an emplty cell | This is an emplty cell | This is an emplty cell | This is an emplty cell |
| B | I-S | I-S | This is an emplty cell | This is an emplty cell | This is an emplty cell | This is an emplty cell | This is an emplty cell | This is an emplty cell |
| C | This is an emplty cell | I-S | I-S | This is an emplty cell | This is an emplty cell | This is an emplty cell | This is an emplty cell | This is an emplty cell |
| D | This is an emplty cell | This is an emplty cell | I-S | I-S | This is an emplty cell | This is an emplty cell | This is an emplty cell | This is an emplty cell |
| E | I-S-R | This is an emplty cell | This is an emplty cell | I-S | I-S | This is an emplty cell | This is an emplty cell | This is an emplty cell |
| F | I-S-R | I-S-R | This is an emplty cell | This is an emplty cell | I-S | I-S | This is an emplty cell | This is an emplty cell |
| G | This is an emplty cell | I-S-R | I-S-R | This is an emplty cell | This is an emplty cell | I-S | I-S | This is an emplty cell |
| H | This is an emplty cell | This is an emplty cell | I-S-R | I-S-R | This is an emplty cell | This is an emplty cell | I-S | I-S |
| I | This is an emplty cell | This is an emplty cell | This is an emplty cell | I-S-R | I-S-R | This is an emplty cell | This is an emplty cell | I-S |
| L | This is an emplty cell | This is an emplty cell | This is an emplty cell | This is an emplty cell | I-S-R | I-S-R | This is an emplty cell | This is an emplty cell |
| M | This is an emplty cell | This is an emplty cell | This is an emplty cell | This is an emplty cell | This is an emplty cell | I-S-R | I-S-R | This is an emplty cell |
| N | This is an emplty cell | This is an emplty cell | This is an emplty cell | This is an emplty cell | This is an emplty cell | This is an emplty cell | I-S-R | I-S-R |
| O | This is an emplty cell | This is an emplty cell | This is an emplty cell | This is an emplty cell | This is an emplty cell | This is an emplty cell | This is an emplty cell | I-S-R |
| I = ILO indicator, S = self-perception of labour market condition, R = retrospective indicator. | ||||||||
We examined data collected from 2005 to 2010. (Excluded from these analyses are data collected in 2004, the first year of implementation of the new labour force survey, because the data may not be totally reliable; with reference to 2010, here we use only information collected with the retrospective question and referring to labour condition in 2009.) Table 3.2 lists labour market composition in the first quarter from pooled data over the five-year period. The ILO indicator clearly counts a lower percentage of unemployed and a higher percentage of persons not in the labour force than the other two indicators. The two measures based on self-perception give a higher unemployment rate because ILO applies a very strict definition of unemployment. To be classified as unemployed, respondents between the ages of 15 and 74 must not be in employment at the moment of the interview but would accept suitable jobs in the next two weeks if the opportunity arose, and had actively looked for ways of obtaining jobs in the preceding two weeks. ILO provides these guidelines in order to facilitate comparisons of labour market performance over time and across countries (ILO 2008). However, this framework was set up when the prevailing type of employment was full-time and under permanent contract; since then, the employment situation has changed to one of more flexibility, with more part-time and fixed-term types of work, especially for those about to enter the labour market.
| E | U | N | |
|---|---|---|---|
| ILO | 43.07 | 3.60 | 53.33 |
| S | 41.73 | 6.73 | 51.54 |
| R | 41.55 | 6.49 | 51.96 |
| E = Employed, U = Unemployed, N = Not in the Labour Force. | |||
Other studies in the literature show that the distinction between labour market states is not always clear-cut: people may not know official definitions or perceive their labour condition as different from that arising from standard criteria (see, for example, Clark and Summer 1979; Flinn and Heckman 1983; Gonul 1992). In most cases, it is difficult to distinguish between unemployment and not in the labour force: the most critical condition seems to be that of actively seeking a job, since respondents may perceive themselves as unemployed even when they are not actively looking for a job. Inconsistencies may consequently arise between information collected in surveys and effective behaviour. Another explanation of the differences between the ILO and the self-perceived classifications is that respondents with temporary jobs in terms of hours of work per week may not classify themselves as employed.
Table 3.3 lists inconsistencies, i.e., different labour conditions observed for the same respondent with two indicators, among the three indicators for the period in question. Data over quarters and years were pooled for reasons of space. The number of inconsistencies is clearly higher for the state of unemployment than for the other two states, and most of the misclassifications tend to refer to people out of the labour force rather than in employment, as many previous studies show (see, for example, Poterba and Summers 1986). Comparing the labour condition according to the ILO definition with that reported according to answers to the retrospective question generated the highest number of inconsistencies. Examining consistencies over quarters and years for couples of the three indicators (not reported here for reasons of space) we note that consistency tends to increase slightly over time, perhaps because all the actors involved in the survey process - interviewers, respondents, etc. - learn how to collect and supply good-quality information while participating in the survey. Although we did not observe seasonal effects in the number of inconsistencies, the number of inconsistencies indicated non-negligible measurement error in the data, which means that one of the two indicators, or both, were reported incorrectly.
| EU | EN | UE | UN | NE | NU | |
|---|---|---|---|---|---|---|
| ILO – Self-perception | 0.97 | 1.72 | 0.44 | 13.02 | 0.17 | 5.80 |
| ILO – Retrospective | 1.14 | 2.06 | 5.22 | 16.76 | 1.00 | 5.76 |
| Self-perception – Retrospective | 0.92 | 1.62 | 6.03 | 8.73 | 1.00 | 0.89 |
| EU = Classified as Employed with first indicator but Unemployed with second indicator. EN = Classified as Employed with first indicator but Not in the Labour Force with second indicator. UE = Classified as Unemployed with first indicator but as Employed with second indicator. UN = Classified as Unemployed with first indicator but Not in the Labour Force with second indicator. NE = Classified as Not in the Labour Force with first indicator but Employed with second indicator. NU = Classified as Not in the Labour Force with first indicator but Unemployed with second indicator. |
||||||
However, the inconsistencies emerging from Tables 3.2 and 3.3 may also occur because all three indicators are exposed to measurement error. Previous studies have investigated the causes of labour condition misperception, finding that it is influenced by social, demographic, economic and institutional factors (e.g., Richiardi 2002). Inconsistencies between the two self-perceptions (actual and retrospective) may mainly be due to memory decay (Bound, Brown and Mathiowetz 2001). Lastly, the higher consistency between the self-perception indicators suggests the possibility of correlated measurement errors.
Table 3.4 lists observed quarterly transition probabilities among the three labour force conditions from the first to the second quarter of the years from 2005 to 2009 with the three indicators. The ILO indicator describes a much more dynamic labour market, especially for unemployed respondents, than that described by the self-perceived and retrospective indicators. This difference is another piece of evidence revealing measurement error in the data. From the existing literature, we know that even small degrees of classification error may lead to severe bias in the estimation of transition probabilities (Hagenaars 1994; Pavlopoulos, Muffles and Vermunt 2012). If errors are uncorrelated over time, we can expect to observe a more dynamic labour market than the true one, and the opposite if error correlation over time also exists.
Table 3.5 compares observed gross flows, as an example from the first to the second quarter of 2005, by gender and age. The three age intervals were obtained by dividing the samples into three groups, with equal dimensions (i.e., 33rd and 66th percentiles). In detail, for the year 2005, in age 1 we find respondents aged between 16 and 36; in age 2 they are between 36 and 55, and in age 3 between 56 and 75. The evidence is that women are more dynamic, especially with regard to unemployment, than men. When leaving unemployment, women tend to leave the labour market more often than to become employed. There are also some important differences in observed gross flows across ages. The older respondents were more stable when out of the labour market and had higher probabilities of moving out of the labour market than of becoming unemployed after being employed. Younger respondents have lower probabilities than those in the second age-group of leaving unemployment and the condition of not being in the labour market by finding jobs. This evidence suggests that gender and age should be included as covariates in our model, to estimate corrected gross flows in the labour market.
| EE | EU | EN | UE | UU | UN | NE | NU | NN | ||
|---|---|---|---|---|---|---|---|---|---|---|
| 2005 | ILO | 96.49 | 0.87 | 2.63 | 18.97 | 50.50 | 30.53 | 1.49 | 1.99 | 96.52 |
| S | 96.99 | 1.33 | 1.69 | 15.32 | 69.85 | 14.83 | 1.29 | 1.50 | 97.21 | |
| R | 95.32 | 2.10 | 2.58 | 20.96 | 59.56 | 19.48 | 1.96 | 2.22 | 95.81 | |
| 2006 | ILO | 96.13 | 0.78 | 3.09 | 20.40 | 45.21 | 34.39 | 2.42 | 1.74 | 95.84 |
| S | 96.11 | 1.74 | 2.16 | 19.84 | 63.66 | 16.50 | 1.88 | 1.75 | 96.37 | |
| R | 95.55 | 1.72 | 2.73 | 17.93 | 66.57 | 15.50 | 2.00 | 1.75 | 96.25 | |
| 2007 | ILO | 96.22 | 0.68 | 3.10 | 21.45 | 40.41 | 38.14 | 2.21 | 1.78 | 96.02 |
| S | 96.08 | 1.74 | 2.16 | 19.84 | 63.66 | 16.50 | 1.88 | 1.75 | 96.37 | |
| R | 95.66 | 1.78 | 2.56 | 19.95 | 60.67 | 19.38 | 2.26 | 1.93 | 95.80 | |
| 2008 | ILO | 97.05 | 0.80 | 2.16 | 19.82 | 48.50 | 31.68 | 1.87 | 1.87 | 96.26 |
| S | 96.92 | 1.54 | 1.53 | 15.25 | 70.84 | 13.92 | 1.56 | 1.69 | 96.75 | |
| R | 95.76 | 2.13 | 2.11 | 19.04 | 62.60 | 18.36 | 2.02 | 2.26 | 95.72 | |
| 2009 | ILO | 96.58 | 0.88 | 2.54 | 18.41 | 48.10 | 33.49 | 2.08 | 1.83 | 96.09 |
| S | 96.14 | 1.76 | 2.10 | 15.17 | 70.09 | 14.75 | 1.59 | 1.61 | 96.80 | |
| R | 95.45 | 1.88 | 2.66 | 16.88 | 67.15 | 15.97 | 1.78 | 1.89 | 96.33 | |
| EE = Employed in both quarters. EU = Employed in first quarter and Unemployed in second one. EN = Employed in first quarter and Not in the Labour Force in second one. UE = Unemployed in first quarter and Employed in second one. UU = Unemployed in both quarters. UN = Unemployed in first quarter and Not in the Labour Force in second one. NE = Not in the Labour Force in first quarter and Employed in second one. NU = Not in the Labour Force in first quarter and Unemployed in second one NN = Not in the Labour Force in both quarters. |
||||||||||
| EE | EU | EN | UE | UU | UN | NE | NU | NN | ||
|---|---|---|---|---|---|---|---|---|---|---|
| Males | ILO | 97.20 | 0.78 | 2.02 | 22.73 | 51.60 | 25.68 | 1.93 | 2.07 | 96.00 |
| S | 97.63 | 1.08 | 1.29 | 18.97 | 73.80 | 7.23 | 1.36 | 1.10 | 97.53 | |
| R | 96.13 | 1.84 | 2.03 | 26.14 | 65.27 | 8.60 | 2.13 | 1.50 | 96.37 | |
| Females | ILO | 95.43 | 1.01 | 3.57 | 15.70 | 49.31 | 34.99 | 1.23 | 1.98 | 96.79 |
| S | 96.00 | 1.69 | 2.31 | 11.93 | 65.73 | 22.34 | 1.26 | 1.81 | 96.93 | |
| R | 94.14 | 2.46 | 3.40 | 16.24 | 53.56 | 30.19 | 1.86 | 2.71 | 95.43 | |
| Age 1 | ILO | 88.27 | 0.46 | 11.27 | 21.16 | 27.50 | 51.35 | 0.26 | 0.06 | 99.67 |
| S | 89.66 | 0.56 | 9.78 | 10.20 | 60.09 | 29.71 | 0.31 | 0.10 | 99.60 | |
| R | 83.36 | 0.45 | 16.19 | 20.78 | 42.54 | 36.68 | 0.51 | 0.13 | 99.36 | |
| Age 2 | ILO | 97.65 | 0.55 | 1.80 | 21.62 | 43.01 | 35.37 | 2.72 | 2.95 | 94.33 |
| S | 97.87 | 0.92 | 1.20 | 16.83 | 64.65 | 18.52 | 2.52 | 2.61 | 94.87 | |
| R | 97.04 | 1.23 | 1.74 | 24.60 | 53.42 | 21.98 | 4.05 | 4.24 | 91.70 | |
| Age 3 | ILO | 96.18 | 1.32 | 2.50 | 17.54 | 51.14 | 31.32 | 3.81 | 6.75 | 89.44 |
| S | 96.83 | 1.89 | 1.28 | 14.77 | 71.97 | 13.27 | 3.17 | 4.82 | 92.01 | |
| R | 94.82 | 3.29 | 1.89 | 19.62 | 63.60 | 16.78 | 4.52 | 6.68 | 88.80 | |
| EE = Employed in both quarters. EU = Employed in first quarter and Unemployed in second one. EN = Employed in first quarter and Not in the Labour Force in second one. UE = Unemployed in first quarter and Employed in second one. UU = Unemployed in both quarters. UN = Unemployed in first quarter and Not in the Labour Force in second one. NE = Not in the Labour Force in first quarter and Employed in second one. NU = Not in the Labour Force in first quarter and Unemployed in second one. NN = Not in the Labour Force in both quarters. |
||||||||||
- Date modified: