Are language tests really the best way to assess your employees business English skills?

When a department manager asks us to “test their employee’s business English” there are typically 2 reasons – they want to know if somebody is suitable for a specific job, or they are looking for evidence that somebody has improved their business English. In both cases we fully understand the need for the information – and we often find ourselves challenging the idea of a “test”. HR & L&D, line managers, business English providers, teachers and participants are all familiar with the idea of tests – we’ve all been doing them since we started school – but as a business tool they have clear limits. 

hbspt.cta.load(455190, ‘6da22dcf-c124-41f2-8a4f-6f3a8c60c362’, {});

Are language tests really the best fit for purpose when it comes to corporate English training?

At the heart of these limits is the question “does the test really reflect the purpose?”.  These limits were highlighted in a recent newspaper article “Difficulty of NHS language test ‘worsens nurse crisis’”. The article focuses on the shortage of nurses applying for work in the UK, and behind this shortage are 2 factors: firstly the inevitable (and avoidable) uncertainty created by Brexit, and secondly that qualified and university-educated nurses who are native English speakers from countries such as Australia and New Zealand are failing to pass the English language test the NHS uses. One of the nurses said:“After being schooled here in Australia my whole life, passing high school with very good scores, including English, then passing university and graduate studies with no issues in English writing – now to ‘fail’ IELTS [the English language test] is baffling.”

To be clear there is nothing wrong with the International English Language Testing System (IELTS) per se. It is one of the most robust English language tests available, and is a multi-purpose tool used for work, study and migration. The test has four elements: speaking, listening, reading and writing.  My question is “Is this really the best way to assess whether a nurse can do her job effectively in English?”

Design assessment approaches to be as close to your business reality as possible

We all want nurses who can speak, listen, read and write in the language of the country they are working in – but is a general off-the-shelf solution really the best way?  What does a nurse need to write?  Reports, notes, requests – yes …essays – no.  Yet that is what was being “tested”. One nurse with 11 years experience in mental health, intensive care, paediatrics, surgical procedures and orthopaedics commented: “The essay test was to discuss whether TV was good or bad for children. They’re looking for how you structure the essay … I wrote essays all the time when I was doing my bachelor of nursing. I didn’t think I’d have to do another one. I don’t even know why I failed.”

Jumping from nursing to our corporate clients, our InCorporate Trainers work in-house, training business English skills with managers in such diverse fields as software development, automotive manufacturing, oil and gas, logistics, purchasing etc etc . All these managers need to speak, read, write and listen and they need to do these within specific business-critical contexts such as meetings, negotiations, presentations, emails, reports etc. So how do we assess their skills? The key is in designing assessment approaches which are as close to their business reality as possible.

Using business specific can-do statements to assess what people can do in their jobs

The Common European Framework of Reference for Languages (CEFR) is a scale indicating language competency. It offers an excellent start for all business English programs. BUT the CEFR does have 2 major drawbacks when it comes to business English:

• The CEFR is not specifically focussed on business-related communication
• The CEFR levels are broad, impacting their suitability for assessing the progress of professionals with limited training availability

In 2010, and in response to our client’s demand for a business-related focus, we developed a robust set of can-do statements. These statements focus on  specific business skills such as meetings, networking and socializing, presenting, working on the phone and in tele- and web-conferences. Rather than assessing a software developers writing skills by asking them to write an essay on whether TV is good or bad for kids we ask them to share actual samples – emails, functional specifications, bug reports etc.  They don’t lose time from the workplace and it allows us to look at what they can already do within a work context. The Business Can-do statements then provide a basis for assessing their overall skills.

This “work sample” approach can also be used when looking to measure the impact of training. Before and after examples of emails help a manager see what they are getting for their training investment and, in cooperation with works councils, many of our InCorporate Trainers use a portfolio approach where clients keep samples of what they are learning AND how this has transferred to their workplace.  This practical and easily understandable approach is highly appreciated by busy department heads.

To wrap up, I understand that the NHS relying on a reputable off-the-shelf solution like IELTS has clear attractions. However, if you are looking at assessing at a department level then consider other options.  And if you’d like support with that then contact us.

FOR MORE INFORMATION

• How great training clients make the most of their training budget
• How we built the business English can-do statements
• Common European Framework of Reference for Languages: Learning, Teaching, Assessment (CEFR)