Conclusion
Bachman-Palmer Approach to Language Test Development
Requires test developers to consider the fundamental correspondence between language test performance and non-test language use.
Test Task Specifications A (write a formal letter to a customer)
Test Task Specifications B (write a memo to a co-worker)
Distinctive Characteristics of TLU Task Type
Create Specifications for Original Test Tasks
Test Task Specifications
Example Test Development Project
Project setting:
telephone company needs to hire new
A Framework of Task Characteristics
Task Characteristics

Rubric: the context for the task; includes those characteristics that provide the structure for the task, and constrain how language users or test takers are expected to respond to these tasks
A Framework of Task Characteristics
Task Characteristics

Expected response: the language use that is expected, given the way in which the rubric or context for the task is configured, and the particular input that is provided
A Framework of Task Characteristics
Task Characteristics
Relationship
between input and response:
• Reactivity: the degree of reciprocity, or interaction involved. • Scope: the amount and range of input that needs to be processed in order to respond. • Directness: the extent to which the response can be made by using information in the input by itself, or whether the language user or test taker must also rely on information in the context or in his or her own real world knowledge.
Task 4 responding to customer complaints in writing
Task 5 giving complaint information to co-workers by phone
Task 6 giving complaint information to co-workers in writing
A Framework of Task Characteristics
Target Language Use (TLU) Domain
a set of specific language use tasks that the test taker is likely to encounter outside of the test itself, and to which we want our inferences about
Developing Test Tasks
Modify
TLU task types for use as test
tasks
Create
original test tasks
TLU Task Type A (letter)
TLU Task Type B (memo)
Modify TLU Task Type to Develop Test Task Specifications
Language Use
Language Test Performance
Language Ability of the Language User
Language Ability of the Test Taker
A Framework of Task Characteristics
Language Use Task
Example TLU Domain PR Department of a Phone Company
Task 1 writing promotional material Task 3 responding to customer complaints on the phone Task 2 phone discussions with clients, co-workers
employees
Describing Target Language Use Tasks
1.Identify the TLU tasks in the relevant domain. 2. Select TLU tasks as a basis for designing test tasks. 3.Describe these tasks in terms of their task characteristics.
make decisions about individuals
to
Correspondences between Language Test Performance and Language Use
Characteristics of the Language Use Task
Characteristics of the Language Test Task
Qualities of Usefulness of Tests

Reliability
Validity
Authenticity
Interactiveness


Backwash effects (Impact)
Practicality
Language Use
Language Test Performance
Characteristics of the Language User
Characteristics of the Test Taker
Characteristics of the Language Use Task
Characteristics of the Language Test Task
an activity that involves individuals in using language for the purpose of achieving a particular goal in a particular situation (Bachman & Palmer, 1996, p. 44)
language ability to extrapolate
(Bachman & Palmer, 1996, p.ask Characteristics
Task Characteristics

Setting: the physical circumstances under which either language use or language testing takes place. Includes the physical characteristics of the setting, the participants involved, and the time of the task.
A Framework of Task Characteristics
Task Characteristics

Input: material contained in the task, which test takers need to process in some way, and to which they are expected to respond.
Designing and Developing Useful Language Tests
Uses of Language Tests
to
make inferences about individuals’ language ability
to
make predictions about individuals’ ability to use language in contexts outside the test itself
Language Use
Language Test Performance
Language Ability of the Language User