ExamsDirect's Simple Answers to Common Quesitons About Testing

ExamsDirect's Simple Answers to Common Quesitons About Testing http://examsdirect.wordpress.com I teach my “Best Practices in Testing” workshop between 15 and 20 times a year. In addition, I typically speak at three to four conferences a year on developing fair, valid and reliable assessments. Anyone who has taught the same course multiple times knows that you tend to hear the same questions over and over. Indeed, if you teach a course often enough it’s rare to hear a brand new question. So, in the coming series of articles I am going to answer (in simple terms) my most frequently asked questions. Fri, 18 Sep 2009 19:32:01 +0000 en hourly 1 http://wordpress.com/ http://s2.wp.com/i/buttonw-com.png ExamsDirect's Simple Answers to Common Quesitons About Testing http://examsdirect.wordpress.com Writing Questions When You Don’t Have Learning Objectives http://examsdirect.wordpress.com/2009/08/11/writing-questions-when-you-don%e2%80%99t-have-learning-objectives/ http://examsdirect.wordpress.com/2009/08/11/writing-questions-when-you-don%e2%80%99t-have-learning-objectives/#comments Tue, 11 Aug 2009 12:37:00 +0000 Steven Just http://examsdirect.wordpress.com/?p=20 ]]> Question: I know that I am supposed to write my questions to test the learning objectives. Our learning systems all have learning objectives, but sometimes I test on something that doesn’t have learning objectives (e.g. an SOP). How can I write my questions to the learning objectives if they don’t exist?

Answer: You have two choices: (1) You could create learning objectives for your own use and write your questions to them or (2) You could go through the SOP with a yellow highlighter and highlight the important points you want to write test questions on. (Most people opt to do the latter.)

If you want more detail, or my rationale for an answer, or if you disagree feel free to e-mail me at sjust@examsdirect.com.

]]> http://examsdirect.wordpress.com/2009/08/11/writing-questions-when-you-don%e2%80%99t-have-learning-objectives/feed/ 0 examsdirect Should I Use True & False Quesitons? http://examsdirect.wordpress.com/2009/08/05/should-i-use-true-fales-quesitons/ http://examsdirect.wordpress.com/2009/08/05/should-i-use-true-fales-quesitons/#comments Wed, 05 Aug 2009 11:26:25 +0000 Steven Just http://examsdirect.wordpress.com/?p=16 ]]> Question: Are True/False questions invalid?

Answer: There is nothing inherently invalid in a T/F question, but as we all know even the student who knows absolutely nothing has a 50% chance of guessing the correct answer. So, if the goal of each question on a test is to “discriminate” between those who have mastered the material and those who have not, T/F questions should be avoided – or if used, used infrequently.

If you want more detail, or my rationale for an answer, or if you disagree feel free to e-mail me at sjust@examsdirect.com.

]]> http://examsdirect.wordpress.com/2009/08/05/should-i-use-true-fales-quesitons/feed/ 0 examsdirect How Many Choices? http://examsdirect.wordpress.com/2009/06/21/how-many-choices/ http://examsdirect.wordpress.com/2009/06/21/how-many-choices/#comments Sun, 21 Jun 2009 12:25:14 +0000 Steven Just http://examsdirect.wordpress.com/?p=14 ]]> Question: How many choices should I have in a multiple choice question?

Answer: A minimum of four. There is no absolute maximum, but five is usually sufficient.

If you want more detail, or my rationale for an answer, or if you disagree feel free to e-mail me at sjust@examsdirect.com.

]]> http://examsdirect.wordpress.com/2009/06/21/how-many-choices/feed/ 0 examsdirect Choice “C” as the correct answer http://examsdirect.wordpress.com/2009/06/14/choice-%e2%80%9cc%e2%80%9d-as-the-correct-answer/ http://examsdirect.wordpress.com/2009/06/14/choice-%e2%80%9cc%e2%80%9d-as-the-correct-answer/#comments Sun, 14 Jun 2009 11:16:48 +0000 Steven Just http://examsdirect.wordpress.com/?p=10 ]]> Question: Is it true that C is most often the correct answer in a multiple choice question?
Answer: Yes, when an inexperienced question writer creates the question.

Question: Is there anything I can do to make sure that doesn’t happen in my test?
Answer: Yes, use the “scramble choices” option of your testing system.

Question: If I scramble the choices does the order of the choices make a question easier or more difficult?
Answer: Research says “no.” The order of the choices does not affect question difficulty.

If you want more detail, or my rationale for an answer, or if you disagree feel free to e-mail me at sjust@examsdirect.com.

]]> http://examsdirect.wordpress.com/2009/06/14/choice-%e2%80%9cc%e2%80%9d-as-the-correct-answer/feed/ 0 examsdirect All of the Above and None of the Above http://examsdirect.wordpress.com/2009/06/07/pedagogue_simpleanswers_all-above/ http://examsdirect.wordpress.com/2009/06/07/pedagogue_simpleanswers_all-above/#comments Sun, 07 Jun 2009 11:44:35 +0000 Steven Just ]]> Question: Is it ever appropriate to use “All of the Above” as a choice?
Answer: No

Question: OK, can I use “None of the Above” as a choice?
Answer: Yes (in my opinion, though some disagree). To be clear, I am not suggesting that “None of the Above” be the correct answer, just that it be one of the choices. When “None of the Above” is a choice the correct answer could be anything. It makes guessing more difficult.

If you want more detail, or my rationale for an answer, or if you disagree feel free to e-mail me at sjust@examsdirect.com.

]]> http://examsdirect.wordpress.com/2009/06/07/pedagogue_simpleanswers_all-above/feed/ 0 examsdirect