CE Practice Exam

Comments

7 comments

  • Avatar
    Benjamin Sullivan

     

    I've noticed this too on multiple items. I hope the real exam doesn't have similar errors. Does anyone know if an actual person looks at our answers before our scores are on our records?

    My drag and place answer:

     

    ...and the scored report with explanation:

    0
    Comment actions Permalink
  • Avatar
    NCARB (Edited )

    Hi Lizeth and Benjamin,

    Your screenshots are showing the correct answers, not your answers. Unfortunately, the score report at the end of each practice exam does not visually show your response for drag and place items. It only tells you whether your response was correct or incorrect. We are hoping to roll this out as an enhancement to the practice exams in the future. 

    0
    Comment actions Permalink
  • Avatar
    Benjamin Sullivan

    Understood. But the issue we are seeing is that the scoring software isn't reading our correct answers. In my example, the first screen shot was taken while in the middle of the exam. The second screen shot is the graded response. So it appears to me (and Lizeth) that the computer isn't accurately grading our exams for certain items - especially the drag-and-place items.

    For the real exams, is there a real person who checks to make sure errors such as these aren't affecting our score?

    Thanks

    0
    Comment actions Permalink
  • Avatar
    NCARB

    Hi Benjamin, 

    I believe there are two different situations going on in this thread that are a bit different. Lizeth's images appear to be of the key shown in the final score report and from the practice mode explanation button. Neither of these screens will show your response, only the correct response. Lizeth, can you clarify each of your screenshots?

    In your case, Benjamin, I apologize for missing the first screenshot. Demonstration items on the multidivisional practice exam are frequently used for internal item development training at NCARB. They also live in a completely different database than actual ARE questions. It appears that during a training exercise, the keyed dropped areas for this demo DnP item were manipulated incorrectly. We have corrected the issue, and the item should now score appropriately. Thank you for bringing this to our attention. 

    Scoring of the ARE is completed by computer, however, all results go through statistical analysis, completed by a psychometrician. If statistical anomalies are detected for any item, they are reviewed by NCARB to ensure all items are being scored correctly.

    0
    Comment actions Permalink
  • Avatar
    Benjamin Sullivan

    Thank you for the clarification & information regarding the scoring. I am assuming that if the psychometrician sees that an abnormal amount of "incorrects" are appearing on one particular item, then it goes in for repairs.

    0
    Comment actions Permalink
  • Avatar
    NCARB

    Hi Benjamin,

    That is correct. One thing to note, all items on the ARE go through a pretesting phase prior to becoming scored items on the ARE. Following the pretesting phase, our psychometricians analyze how candidates performed on the item based on various statistics. If a large percentage of candidates are getting a particular pretest item incorrect, it gets flagged for review by NCARB's Item Development Committee, which consist of licensed architects from around the country. If the Committee determines the item contains an issue, they will update the item and send it back for a second pretesting cycle. Scored items on the ARE have to successfully make it through the pretesting phase before impacting a candidate's final score on the ARE. 

    0
    Comment actions Permalink
  • Avatar
    Lizeth Rios

    NCARB, I took the practice exam again and it worked.
    Sorry about that, my mistake I got confused.

    0
    Comment actions Permalink

Please sign in to leave a comment.

Powered by Zendesk