Question: How Does Oracle Use The Beta Results To Create The Production Exams?
Beta participants’ responses are gathered into a statistical profile of each question, which tells OCP program managers whether the question is too difficult, too easy, lacks clarity, or does not help us distinguish between those who know the material and those who don’t.Questions that are too easy or too difficult are thrown out because they don’t help us measure the skills and abilities of the majority of candidates.
We encourage beta candidates to register their comments on the exam questions in the ‘Beta Comments’ field while taking the beta exam. All beta candidate comments are inspected and researched by the exam developers. If the comments point to a technical error or lack of clarity in a question, the question may be thrown out, or revised and re-evaluated.
Once we’ve identified all the questions that will 'survive' in the production exam, the statistical profiles of the questions are used to help us create multiple exam versions that are equivalent in difficulty, timing and measurement power. This way candidates can be assured that they are being evaluated on the same criteria as their colleagues, and that they are being evaluated the same way each time they attempt the exam.
Paul Sorensen,
Director, Oracle Certification
QUICK LINKS
