Wednesday, May 27, 2009

TEST EVALUATIONS

Construction of Formal Test

The types of questions are multiple choice and subjective. For multiple choices it will content by all topics in the KBSR syllabus involving skills higher than basic skills and for subjective it will content by minimum mastery level in KBSR syllabus.

Constructing multiple choice items, it is suggested as following:-
1. The stem of the item should be meaningful by itself and should present a definite problem.
2. The item stem should include as much of the as possible and should be free of irrelevant material.
3. All of the alternatives should be grammatically consistent with the stem of the item.
4. An item should contain only one correct or clearly best answer.
5. All distracters should be plausible and homogenous.
6. The relative length of the alternative should not provide a clue to the answer.
7. The correct answer should appear in each of the alternative positions approximately an equal number of time, but in random order.
8. Use special alternatives such as “none of the above” and “all of the above” sparingly.
9. Do not use multiple choice items where other item types are more appropriate.
10. Arrange the distracters in ascending order.

Constructing subjective items, it is suggested as following:-
1. Restrict the use of subjective questions to those learning outcomes which cannot be satisfactorily measured by multiple choice items.
2. Give adequate time and thought to the preparation of essay questions.
3. Phrase each question so that the student’s task is clearly indicated.
4. Indicate an approximate time limit for each question.
5. Avoid the use of optional questions.
6. Prepare a scoring key.

TITLE

6 HIERARCHIES OF BLOOM TAXONOMY
MATHEMATICS SYLLABUS FOR PREPARE TEST ITEMS
TEST BLUE PRINT
ANALYZE THE TEST SCORE SUGGESTION AND IMPLEMENTATION

6 Hierarchies of Bloom Taxonomy
The major idea of the taxonomy is that statements of educational objectives can be arranged in a hierarchy from less to more complex. The taxonomy is presented below with sample verbs and a sample behavior statement for each level. In general, research over the last 40 years has confirmed the taxonomy as a hierarchy with the exception of the last two levels. It is uncertain at this time whether synthesis and evaluation should be reversed (i.e., evaluation is less difficult to accomplish than synthesis) or whether synthesis and evaluation are at the same level of difficulty but use different cognitive processes.
In any case it is clear that students can "know" about a topic or subject at different levels. While most teacher-made tests still test at the lower levels of the taxonomy, research has shown that students remember more when they have learned to handle the topic at the higher levels of the taxonomy.

Mathematics Syllabus for Prepare Test Items


Analysis of Year 3 Mathematics Question Paper 1 thesok19
Analyze the test scores
Link to the web below to see the analyze.
http://spreadsheets.google.com/ccc?key=rHcntK-AySajINM1C5I5yaQ

Test question
Mathematics Questions







Suggestion and implementation

Based on analyzed as been done by our group, from analyzed we found that: -

1. From 20 items, there are 11 items can be interpretation as High Positive Discrimination. The index is greater or equal 0.4. These items are suitable and can be accepted.
2. There is 1 item that interpreted as Moderate Positive Discrimination. The index is greater or equal 0.2 and lower then 0.39. These item need to modify.
3. There 1 item is categorize in High Difficulty Index. These item need to modify too. This is because the difficulty index of that item is more than 0.8. It’s mean that most of the pupils managed to answer the question correctly.
4. There are 4 items that need to reconstruct. These items are interpreted as Low Positive Discrimination. The index is greater or equal 0.19 and lower or equal 0.1.
5. The last one for interpretation of items which index lower then 0.09 and Negative Discrimination. In this analyze, there are 3 items should be remove.

In order to modify and reconstruct some of the items, we do some suggestion and implementation from the items as following:-

Question 1
Difficulty index is lower than 0.3, so question 10 is categorised as a difficult question and it needs to modify. While, its discrimination index value = 0 and it is interpreted as positive discrimination low, so this question needs to be reconstructed.
Students may not understand about this topic and they need further understanding, so the question needs to be reconstructed to simpler question as suggested below: -
1. Which of the following numbers become 460 after rounding off to the nearest 10?
(A) 352
(B) 353
(C) 354
(D) 355

Question 2
Based on the difficulty index, 0.80 question 2 is interpreted as average difficulty and it is acceptable. But, its discrimination index value, 0.2 is interpreting as positive discrimination low, so this question needs to be reconstructed. This question is suggested to reconstruct as suggested below: -
Which of the following numbers is the smallest?
(A) 6556
(B) 6565
(C) 6655
(D) 6665

Question 6
Difficulty index = 0.35, question 6 can be categorised as an average difficulty question and it is acceptable. But, its discrimination index value, 0.2 is interpreted as positive discrimination low, so this question needs to be reconstructed.
Which one of the following is correct?

Question 10
Difficulty index = 0.15, question 10 is categorised as a difficult question and it needs to modify. While, its discrimination index value, 0.10 and it is interpreted as positive discrimination low, so this question needs to be reconstructed.
Students may confuse due to the “a week” is used in the question, so the question needs to be reconstructed become easier and it is suggested as below: -
Puan Sita sold 360 eggs in 5 days. How many eggs did she sell in a day?
(A) 72
(B) 73
(C) 76
(D) 82

Question 20
Difficulty index is between lower 0.3 and 0.8, so question 20 is categorised as an average difficulty question and it is acceptable. But, its discrimination index value = 0 and it is interpreted as positive discrimination low, so this question needs to be reconstructed.
Students may not understand about this topic and they need further understanding, so the question needs to be reconstructed as suggested below: -


RM178.85

Which of the following adds up to the same value as the price tag?
(A) RM100 + RM70 + RM8 + 8sen + 50sen
(B) RM100 + RM7 + RM8 + 80sen + 5sen
(C) RM700 + RM 10 + RM8 + 80sen + 50sen
(D) RM100 + RM8 + RM70 + 80sen + 5sen

No comments:

Post a Comment