IRCC Evaluation of Language Training Services
2021/05/25 Leave a comment
Of interest, particularly the differences between settlement service language training clients and non-clients, the greater effectiveness of employment-focussed language training and the overall impact of the socio-demographic profile of clients and non-clients:
This report presents the findings of the evaluation of Immigration, Refugee and Citizenship Canada’s (IRCC) Language Training Services. The evaluation was conducted to provide an in- depth assessment of this major program and considered issues of program effectiveness, covering the period from 2015 to 2018.
The Evaluation of the Settlement Program (2018) highlighted the need to further assess the different success factors and approaches to language learning. While language training is helping newcomers improve their language ability, progression was shown to vary by skill (i.e., reading, writing, listening and speaking), as well as client characteristics, which pointed to the need for a greater understanding of progression across skills. As such, the evaluation recommended an in- depth examination and thorough analysis to provide fulsome outcomes results and specific recommendations for improvements to the Department with the aim of improving language training effectiveness.
The language learning services have been evaluated, focusing on two key areas. The main focus was to better understand language skills improvement – what works for whom and under what conditions, with a view to determining the specific characteristics that influence language skills improvement. The secondary area of focus was to examine whether the language learning framework is adapted to address newcomers’ needs.
Summary of conclusions and recommendations
Based on the evidence analyzed, it was found that language learning services are designed to be flexible and effective in meeting the diverse needs of newcomers and to support their progression. The findings also show that language progression for newcomers is mostly positive, but there are differences between clients and non-clients with respect to likelihood of progression. While clients were seen to progress at the same pace as non-clients when assessed in the short term, using an objective measure, clients appeared to progress more than their non- client counterparts when assessed on a longer timeframe using a subjective measure. It was also found that some components of language training are associated with a greater likelihood of newcomers improving their language skills, such as full-time language training and multi-level classes, while others lowered chances of progression, such as continuous intake classes.
Furthermore, when assessing other settlement outcomes, the evidence indicated that:
- clients of general formal language training use official languages less frequently than non- clients, while formal language training focused on employment were using it significantly more than non-clients.
- clients of formal language training, and clients who took both formal and informal language training, are more likely to report an increase in the frequency of use of official languages.Although not a direct objective of language training, employability remains a primary concern for clients. The evaluation carefully analyzed this theme and assessed the impact of language training on various labour market outcomes. Clients of general language training used English or French at work less frequently and were less comfortable using official languages than non-clients, however taking language training focused on employment contributed to making these gaps smaller. Also, clients often had poorer labour market outcomes than non-clients on the short to medium term. The analysis showed that a large part of the difference in employment outcomes between clients and non-clients could be attributed to socio-demographic profiles of individuals (e.g., education, age, gender, year of admission). This suggests that taking language training is not necessarily a cause of poorer labour market outcomes, but rather that clients and non-clients may have different characteristics that explain their outcomes on the labour market. Furthermore, the evaluation found that employment outcomes of clients do not vary greatly based on how language training is delivered, language training focused on employment generally had a positive impact on employment outcomes, and taking language training during core hours was associated with less favourable results.
While the client progression and their labour market outcomes show mixed results, it should be noted that language learning services correspond to the diversity in clients’ need and IRCC- funded language learning services are designed in a manner to be conducive to language improvement for newcomers.
In response to the findings from the evaluation, this report has grouped the recommendations into two main themes. First, the evaluation proposes three recommendations around the topic of outcomes measurement. Second, the evaluation recommends improvements to the program to foster success. To this end, the evaluation proposes seven additional recommendations to further support clients, instructors and program stakeholders.