CE Practice Exam
-
Hi Lizeth and Benjamin,
Your screenshots are showing the correct answers, not your answers. Unfortunately, the score report at the end of each practice exam does not visually show your response for drag and place items. It only tells you whether your response was correct or incorrect. We are hoping to roll this out as an enhancement to the practice exams in the future.
-
Understood. But the issue we are seeing is that the scoring software isn't reading our correct answers. In my example, the first screen shot was taken while in the middle of the exam. The second screen shot is the graded response. So it appears to me (and Lizeth) that the computer isn't accurately grading our exams for certain items - especially the drag-and-place items.
For the real exams, is there a real person who checks to make sure errors such as these aren't affecting our score?
Thanks
-
Hi Benjamin,
I believe there are two different situations going on in this thread that are a bit different. Lizeth's images appear to be of the key shown in the final score report and from the practice mode explanation button. Neither of these screens will show your response, only the correct response. Lizeth, can you clarify each of your screenshots?
In your case, Benjamin, I apologize for missing the first screenshot. Demonstration items on the multidivisional practice exam are frequently used for internal item development training at NCARB. They also live in a completely different database than actual ARE questions. It appears that during a training exercise, the keyed dropped areas for this demo DnP item were manipulated incorrectly. We have corrected the issue, and the item should now score appropriately. Thank you for bringing this to our attention.
Scoring of the ARE is completed by computer, however, all results go through statistical analysis, completed by a psychometrician. If statistical anomalies are detected for any item, they are reviewed by NCARB to ensure all items are being scored correctly.
-
Hi Benjamin,
That is correct. One thing to note, all items on the ARE go through a pretesting phase prior to becoming scored items on the ARE. Following the pretesting phase, our psychometricians analyze how candidates performed on the item based on various statistics. If a large percentage of candidates are getting a particular pretest item incorrect, it gets flagged for review by NCARB's Item Development Committee, which consist of licensed architects from around the country. If the Committee determines the item contains an issue, they will update the item and send it back for a second pretesting cycle. Scored items on the ARE have to successfully make it through the pretesting phase before impacting a candidate's final score on the ARE.
Please sign in to leave a comment.
Comments
8 comments