Professional Documents
Culture Documents
We start by considering which elements of speech can be evaluated, and which cannot or should not. We then think about what form evaluation can take and how the different
ways to evaluate work. In the third part of this article we will analyse a common formal
speaking test: IELTS.
and a suitable context, e.g. in interaction with other speakers. Observing the speaker,
we can ask questions such as:
Is the speaker choosing the right vocabulary? Does it make sense? Is it formal
enough? Does it collocate with other words correctly?
Is the speaker connecting together what they say and connecting this with what
other speakers say effectively? In other words, is it coherent and cohesive?
Paralinguistic devices
It is clear that speakers need to be able to understand and use paralinguistic devices,
as they are an essential part of communication, and competence includes the ability to
manage these devices. We can convey an enormous amount with use of eye contact
and facial expression, for example, and gestures work in the same way as linguistic
communication. However, there are problems. For example, it is difficult to evaluate
many of these features explicitly. The speaker's use of gestures, expressions and verbal
tools such as noises can be observed, but can we establish a standard, correct use? Eye
contact, movement of the body and head, and posture all send powerful messages but
how do we describe them in a framework for evaluation? How do we elicit them in a
controlled form? In addition to this, we may feel that it is not appropriate to evaluate
this area at all as part of spoken language testing, and that the best way to address
these may be under another heading, such as intercultural communicative competence.
This then means evaluating them separately, using very different techniques.
Communicative functions
Speakers need to be able to recognise, understand and use the communicative
functions of speech. This means what speakers actually communicate with their choices
of vocabulary and grammar, intonation and stress, changes in volume and tone etc.
These features can be evaluated through observation of the speaker's performance and
comparison against a standard. As we are evaluating communicative functions, it is
relevant to evaluate a speaker from this perspective, for example by asking:
Does the speaker use intonation and stress effectively to support their message?
Does the speaker use the right functional language (exponents) to express their
message?
Does the speaker use pauses, repetition and noises appropriately to support
communication?
Social meaning
Speakers need to be able to understand and use the social meaning of speech and
many aspects of this can be evaluated formally. We can for example assess the ability
to use formal and informal language, and the degree of directness, by using suitable
tasks which recreate social factors such as status and age. The speaker's understanding
of conversational principals and rules can be observed in interaction with others, e.g. in
a group task. Connotations of language can be included as part of evaluation of use of
vocabulary.
How do we evaluate?
As we can see most aspects of spoken language can be evaluated formally. The
challenge is to find a form for testing which enables us to do so. An effective format for
evaluation should enable us to isolate and analyse various elements, possibly under a
series of general headings, but also use tasks which allow us to measure the speaker's
communicative competence in general. Clearly if we want to measure a speaker's
language we want them to perform to their best ability, so we also need to consider the
best ways to reduce the impact of emotional factors such as stress and nerves. Finally,
we need to think about practical concerns around available resources, such as time,
examiners, equipment if we are going to record the speaker, and space.
There are a wide range of test types and elicitation available. In this article we are
limiting discussion to formal evaluation by an examiner, as opposed for example to selfassessment or informal evaluation during classes. Below then we review some of the
most common ways for a teacher or examiner to evaluate speaking formally; many
speaking tests use a mixture of different types, as will be seen in part 3 (Ed. to be
published later) of this article.
Discussions
The candidate has a conversation with the examiner, or with another candidate with the
examiner observing. Natural conversation gives the examiner an opportunity to
evaluate a wide range of areas (and helps the candidate produce a relaxed and so
realistic performance) but this is very difficult to achieve and requires skilful handling
by the examiner.
Joint tasks
A discussion activity can be given more focus and drive by asking the candidates to
complete a task which requires them to talk together and then make a decision. This is
an effective way to evaluate functions such as agreeing and disagreeing, and making
suggestions, as well as conventions of conversation such as turn-taking.
Conclusion
In this part of the article we have discussed which elements of spoken language can be
evaluated and what kinds of questions we can ask when we consider each. These
questions measure communicative competence, in other words with the underlying
message of How good is the speaker at communicating?'. We have also considered
some of the many types of tests and elicitation techniques available. These need to be
matched to testing aims, types of candidates and the resources available. In the third
part of this article we will look at three formal speaking tests, identify how they work,
and consider their effectiveness.