Professional Documents
Culture Documents
fcrespo@eafit.edu.co
for summative purposes rather than formative; that assessment is done unsystematically and
without much planning; and that teachers use multiple activities to assess different aspects of SANDRA GAVIRIA
oral language with some attention to students level of language proficiency. The implications MONSALVE
of these results indicate the need for educational programs in the area of assessment and the (Colombiana) Magister en
enseanza del Ingls.
creation of an oral assessment system
Actualmente Coordinadora
Acadmica en el Centro de
RESUMEN Idiomas de la Universidad
El artculo presenta los resultados de un estudio sobre las creencias y prcticas en la evaluacin EAFIT.
sgaviria@eafit.edu.co
oral del idioma Ingls. El estudio se realiz en el Centro de Idiomas de la Universidad EAFIT. La
informacin se recogi entre 30 profesores de diferentes niveles quienes fueron entrevistados LUZ ADRIANA LOPERA
a travs de grupos focales. Los resultados mostraron que los profesores realizan la evaluacin OROZCO
con fines cuantitativos. En general se desconocen los propsitos formativos de la evaluacin. (Colombiana) Licenciada en
Igualmente, no existen procedimientos sistemticos para evaluar los estudiantes, ms s, una Idiomas. Trabaja como
Fecha de recepcin: 27 de enero de 2002
gran variedad de actividades apropiadas para la evaluacin. Las implicaciones del estudio indican Coordinadora Academica
en el Centro de Idiomas de
la necesidad de ofrecer programas de capacitacin as como desarrollar un instrumento vlido
la Universidad EAFIT.
y confiable para medir el desempeo oral de los estudiantes.
alopera@eafit.edu.co
PALABRAS CLAVES MARCELA PALACIO
URN
Summative Assessment, formative assessment, oral assessment techniques, authentic (Colombiana) Licenciada en
assessment Idiomas. Actualmente se
desempea como
KEY WORDS Profesora e Investigadora
en el Centro de Idiomas de
Evaluacin sumativa, evaluacin formativa, tcnicas para la evaluacin oral, evaluacin la Universidad EAFIT.
autntica opalacio@eafit.edu.co
64
difference between alternative assessments and assessments have different intentions according to the
traditional assessments and presents a list of moment they are applied at: during instruction or at
characteristics stating that alternative assessments: the end of instruction and both imply a decision-making
process in the classroom. These decisions as pointed
1. Require students to perform, create, produce, or by Genesee and Upshur (1996) involve judgements
do something about who should pass or fail a course, whether to
2. Use real world contexts or simulations proceed with a unit or not, whether to change a
particular approach to teaching or not. At any rate,
3. Are non-intrusive in that they extend the day-to- the choices that teachers make aim at improving
day classroom activities language teaching and learning. For this reason, it is
important for teachers to consider the purposes of
4. Allow students to be assessed on what they
assessment. These purposes are basically two:
normally do in class every day
1. Social or administrative: It aims at informing
5. Use tasks that represent meaningful instructional
students (and parents) of their progress and
activities
determining which students have the
6. Focus on process as well on products competencies required by the school system so
they can be promoted or certified to a higher
7. Provide information about both the strengths and level.
weaknesses of students
2. Pedagogical or formative: It aims at providing the
8. Ensure that people, not machines, do the scoring, teacher with useful information to suit the
using human judgement teaching-learning activities to the students needs
and thus improve the quality of teaching in general.
The ideas proposed here support a formative type of
It also recognizes the changes that need to be
assessment through which the teacher observes the
made so that the students learn in a more
student doing something real, provides him/her with
meaningful way, that is, it regulates teaching and
feedback, and adjusts his/her teaching. Formative
learning processes.
assessment is continuous and is meant to inform the
student, parent/guardian, and the teacher of the Identifying the purposes of assessment helps teachers
students progress toward the curriculum objectives. plan their assessment procedures. In this sense,
The main purpose of this assessment is then to identify teachers should clearly identify what students should
the difficulties in learning rather than consider the final know and be able to do at different levels of oral
results. According to Jorba and Sanmart (1994), language proficiency, that is, to identify the
formative assessment seeks information on the achievement standards for each level and for each
students mental representations and strategies that language skill (reading, writing, listening and speaking).
he/she uses to achieve a goal. In the case of oral assessment, teachers should identify
what students should be able to comprehend and
Formative assessment can be contrasted with
produce by the end of a course.
summative assessment through which students
progress and achievement are reported at the end of It is clear that the ideas proposed by the new trends
a course or year. It is usually reported in the form of in assessment aim at the regulation of teaching and
grades, generally determined by test scores. The main learning. Thus assessment becomes an essential
purpose of this type of assessment is to determine component for change and improvement. Through
knowledge, skills, abilities that have developed over assessment, the teacher gets information in order to
a period of time, in other words to summarize adapt his/her teaching practices so that the student can
student progress. Both formative and summative learn better. The students themselves are involved in
67
this decision-making process by participating in their received, the data analysis was somewhat difficult;
own evaluation thus taking more responsibility for besides, the results were fairly impressionistic and
their own learning. Beyond the final product of superficial. From the results it could not be explained
learning, non-traditional forms of assessment also look teachers reasons and purposes for doing assessment.
at the learning process and environment, the students By consequence, the researchers decided to
social and emotional contexts, and the good match supplement the information and further investigate into
between instructional objectives and classroom teachers understanding of assessment.
content.
The data was gathered through a Focus Group
RESEARCH QUESTIONS technique. Originally, the research team planned to
include a stratified sample of 48 teachers both from
The objectives of this study are to investigate teachers the Adult and Adolescent English programs at EAFIT
understanding of assessment in order to establish Language Center. Teachers were scheduled into eight
similar oral assessment criteria for teachers at the different focus groups. Unfortunately, many teachers
EAFIT Language Center. The research questions did not arrive on the scheduled day leaving a total
formulated are: sample population of 30 teachers. The focus group
sessions were rigorously carried out making sure all
1. To what extent do teachers at the Language Center the participants answered the same questions. The
make of assessment an ongoing process? questions were related to their understanding of
assessment, aspects of oral language assessed,
2. What are the existing tools teachers use to assess
assessment techniques, reasons for doing assessment,
students oral production?
and frequency of assessment. In each focus group
6. How does the Language Center syllabus by level The data analysis process started by transcribing the
influence teachers tailoring of assessment tasks focus group sessions. The transcripts were repeatedly
read, analyzed, and compared with researchers notes.
METHOD During this process, recurrent themes and salient
comments were identified and noted. That is, the
This study started in the first semester of 2000. During analysis of the data followed a grounded approach
that first semester, the researchers looked a series of where the information obtained emerged from an
formats used to record oral assessment grades and examination of the data rather than being determined
follow-up activities. The purpose was to identify areas beforehand and imposed on the data. The naming and
of oral assessment to be explored. Based on this grouping was done on index cards. Coding categories
analysis, a questionnaire called Task Description Form were then assigned to groups of cards. The emerging
was created. Teachers were asked to describe the categories were described by each of the researchers
tasks used for oral assessment, the aspects of oral in terms of propositions and then compared among
language assessed, the frequency and duration of the researchers in order to ensure reliability. When
assessment, the classroom arrangement, the topics looking at the described data, the researchers
and the nature of the assessment tasks. From the concluded that it responded some basic assessment
questionnaires distributed to 110 teachers 34 were questions: What, how, why, when. Therefore, these
returned. Since less than 50% of the forms were questions were used as the guidelines to interpret the
68
(comprehensibility) and their ability to join sentences silent or self-correct thus producing an acceptable and
and produce ideas in a coherent, meaningful and relaxed quality of speech.
complex way (9). Moreover, fluency was associated A third feature of oral language considered by teachers
with the students capability to stay in the second when assessing oral production is vocabulary.
language when speaking, or the students ability to Teachers look at students ability to use vocabulary in
speak in English without recurring to or translating context (9) and if vocabulary usage affects
from Spanish (4). Another definition of fluency found comprehensibility of messages. Here, teachers are not
in the data refers to the speed (3) at which the looking at words in isolation, but at how they relate
students communicate and to the possession of to the context to convey a message that is
vocabulary and idiomatic expressions (1) so that ideas understandable for the listener. A final aspect which
teachers take into account when doing oral
can be expressed continuously and naturally. Indeed,
assessment, is the overall comprehension and
it is not easy to assess fluency, even impressionistically.
competence the students have.
For example, as pointed out by Cohen (1994), there
are problems connected to criteria such as speed or We could say that although the aspects considered by
ease of speech. Speaking easily, he says, does not teachers may follow a traditional view of oral language
necessarily mean speaking appropriately. In fact, assessment that reflects accuracy of language in some
aspects, there is a tendency to assess language in its
according to Cohen (1994), the very hesitation
communicative perspective. Thus assessing accuracy
phenomena that make a students speech seem
is not a goal in itself, but one component which is
broken may really be a sign that the student is
closely connected with form, meaning, and use. This
searching for the appropriate vocabulary item or tendency, different from results found in the past, may
grammatical structure. Fluency is rather the ability to be due to teaching training in the area of
know how to hesitate (minimum of pauses or communicative language teaching and learning
hesitation before beginning or during speech), stay offered at the Language Center.
In relation to how assessment is done, teachers oral interactions. There is no evidence in the data
report on using multiple tasks to assess oral whether teachers tailor activities to students level of
performance being presentations (11), role-plays (11), language development
the most favored by teachers followed by conversation
(8), recording on tapes (9), picture description (5), In addition, the data show that some teachers use
question and answer (4), and others (see graphic 3). error correction as a way to have the students assess
These tasks are in few cases chosen depending on the their oral production (3). This is done by eliciting
students needs and interests, level of proficiency, and either self-correction in intermediate or advanced
size of the group. levels or teacher correction in basic levels. Peer
correction was also mentioned but the level was not
Regarding the reasons why teachers select a specific specified. Indeed, errors are indicators of learning.
activity to assess oral performance, few generalizations Students may benefit from error correction by
can be made. It could be said, however, that there is analyzing their progress and success in language
lack of similar criteria for selecting activities since learning. Errors also provide feedback, they tell
answers vary from teacher to teacher. Nonetheless, the teachers about the effectiveness of their
the answers lead us to believe that teachers encourage teaching.
role-plays in lower levels because students may be
more willing to take risks. Role-plays become a very When asking teachers about the grouping technique
spontaneous activity that fosters a relaxing classroom to do assessment, the answers indicate a preference
atmosphere. Furthermore, role-plays seem to be a for pair assessment (9) and small group assessment
good tool to promote naturalness of language. (9), followed by individual (8) and whole group
assessment (2). Decisions on when to assess
Assessment tasks
No. of answers
18%
15%
12%
9%
6%
3%
0%
Presentation Role-Plays Informal Recording Picture Games Question Interviews Drilling Others
conversation on tape description and answer
72
Regarding the category when assessment is done, Doing assessment on an every day basis may be a
the data did not reveal consistent answers among threatening experience for students whose level of
teachers. Teachers seem to have their own frequency anxiety may increase due to constant evaluation. On
when assessing. However, many of them assess their the other hand, lack of formal assessment does not
students oral performance between 2 to 4 times allow students to know at what point in their
during the course (10). A variety of factors such as development they are. Teachers must balance
level, objectives, and tasks are kept in mind when assessment activities according to different factors such
assessing oral performance. Some teachers report on as duration of the course, students needs,
doing assessment on an ongoing basis, sometimes administrative requirements, and others. At any rate,
every class (6). Other teachers say they never do it is essential to consider that assessment should be
formal assessment or that they only assess when done on an ongoing basis. This, according to OMalley
there is an opportunity. It seems then that the and Valdez (1996), provides baseline data as well as
number of times to do assessment varies from information on improvement of language proficiency
teacher to teacher with no consistent pattern of on a continuous basis. Doing assessment on a
frequency and somehow determined by a subjective continuous basis implies that oral assessment should
decision and lack of planning on how often to assess be spread out throughout the course and not be left
students. as a final activity.
CHART 2
When is assessment done?