Lecture I: Definition and Function of Language Tests
13
II. Function of language tests A. In Educational Administration 1. For the language-policy making 2. For syllabus design 3. For teachers' selection and promotion 4. For the evaluation of language education 5. For the selection of people to be sent to study abroad B. In Language Teaching and Learning 1. For selecting students 2. For placing students 3. For encouraging the students 4. For finding out about achievement
Example 2: Calculation of Subjective Items D Value Suppose there is a 10-point writing task in a test and 50 testees have taken the test. Their writing scores are divided into three groups as follows: UG 15 (consisting of 30% of the testees) MG 20 (consisting of 40% of the testees) LG 15 (consisting of 30% of the testees) Total Score of the UG: 120 Total Score of the LG: 60 Number of Testees in UG/LG: 15 Full Score of the item: 10 Apply the formula:
Description of the Course
9
II. Teaching Strategy for the Course Taught by a combination of plenary sessions and discussion. III. The Content of the Course Functions and Types of Language Tests Qualities of a Good Test Commonly Used Testing Items Ways of Designing Multiple Choice Items Ways of Designing Cloze Test
D = (Total Score of UG (120) - Total Score of LG(60))/n(15)/Full Score (10)
7
= (120 - 60)/15/10 = 60/15/10 = 4/10 = 0.4
Description of the Course
8
I. The Aims of the Course are: 1. to enable students to evaluate different types of tests; 2. to familiarize students with the uses of different types of tests and the techniques in language testing; 3. to provide students with different ways of interpreting the raw scores; 4. to enable students to design their own tests according to the specific purposes of teaching.
3
N = 26 X = 702 Mean = 702 26 = 27 d² = 432 d² /N = 432 26 = 16.62 s.d. = d² /N = 16.62 = 4.77 = 4.8
Table 3: Calculation of Correlation Coefficient
St X Y X² Y² XY 1 8 10 64 100 80 2 5 7 25 49 35 3 4 6 16 36 24 4 3 5 9 25 15 5 0 2 0 4 0 6 6 8 36 64 48 7 1 3 1 9 3 8 0 2 0 4 0 9 3 5 9 25 15 10 2 4 4 16 8 N = 10 X = 32 Y = 52 X² = 164 Y ² = 332 XY= 228 [N • XY– ( X ) ( Y) ] ² [10228 – 32 52]² rxy² = = [N • X² – (X)² ][N • Y² – (Y)² ] [10164 – 32² ][10332 – 52² ]
-1 40 400
0 50 500
+1 60 600
+2 70 700
+3 (z score) 80 (T score) 800(CEEB s.)
Example 1: Facility Value of Subjective Items
6

Suppose there is a 10-point writing task in a test and 5 testees have taken the test. Their writing scores are as follows: S1. 5 S2. 8 S3. 7 S4. 3 S5. 7 Total Score of the testees: 30 Number of Testees: 5 Full Score of the item: 10 Apply the formula: FV= Total Score (30)/N(5)/Full Score (10) = 30/5/10 = 3.6/10 = 0.6
4
[2280 – 1664]²
= [1640 – 1024][3320 – 2704] =
616²
616 616 = 1.00
Figure 1: Norm Distribution and Standard Score
5
2% 14% 34% 34% 14% 2%
-3 20 200
-2 30 300
Description of the Course
10
Ways of Designing Multiple Choice Items Ways of Designing Cloze Test Procedures of designing a test Interpreting Test Scores IV. Reference books Hughes, Arthur. 1989. Testing For Language Teachers. Cambridge: Cambridge University Press. Heaton, J. B. 1989. Writing English Language Tests (New Edition). London: Longman. （北京：外 语教学与研究出版社 2002）
2
Table 2: Standard Deviation
Score 35 34 33 33 32 30 30 29 29 27 27 27 26 26 26 26 26 25 25 25 24 23 23 22 20 19 Mean 27 d 8 7 6 6 5 3 3 2 2 0 0 0 -1 -1 -1 -1 -1 -2 -2 -2 -3 -4 -4 -5 -7 -8 d² 64 49 36 36 25 9 9 4 4 0 0 0 1 1 1 1 1 4 4 4 9 16 16 25 49 64
Lecture I: Definition and Function of Language Tests 5. For finding out learning difficulties 6. For helping the students understand the purpose of teaching 7. For helping the students consolidate what they have learned 8. For reporting the progress of the students 9. For predicting the success or failure in language learning 10.For evaluating the efficiency of teaching 11.For evaluating the teaching methods 12.For evaluating the teaching materials
Language Testing
Chen Youlin(陈佑林)
English Department School of Foreign Languages Central China Normal University
Table 1: Percentile Scores
St B G A H/D I C E/O/F J L N K M P R Q S T Score 49 48 47 46 45 44 43 42 41 40 39 38 37 36 35 34 33 Rank 1 2 3 4 6 7 8 11 12 13 14 15 16 17 18 19 20 F 1 1 1 2 1 1 3 1 1 1 1 1 1 1 1 1 1 CF 20 19 18 17 15 14 13 10 9 8 7 6 5 4 3 2 1 RCF 1.00 .95 .90 .85 .75 .70 .65 .50 .45 .40 .35 .30 .25 .20 .15 .10 .05 PCF 100 95 90 85 75 70 65 50 45 40 35 30 25 20 15 10 5