California Supplemental Examination Program (CSE)
Licensure Examination for Architects to Practice in California - The California Architects Board (CAB) regulates the practice of architecture in California. In order to obtain a license to practice architecture in California, a candidate must pass not only the national examination but also the California Supplemental Examination (CSE), which is an oral examination. The CSE assesses minimally competent architectural knowledge, skills, and abilities necessary for practice specifically in California. This 3½ -year contract, ending December 31, 2010, included an occupational analysis study, development, administration, standard setting, scoring and reporting of the CSE. In September of 2009, the California Architects Board voted to transition the exam to a multiple-choice format. This decision was based on a format study that recommended a multiple-choice format. California's own Office of Professional Examination Services opted to develop the multiple-choice examination, which will be administered for the first time in 2011. The project activities performed by HumRRO for the oral examination are summarized below.
Project Management
HumRRO provided ongoing project planning and management tasks, including planning and scheduling project activities and meetings, providing progress reports, developing the candidate brochure, and presentations at Board meetings as needed.
Occupational Analysis and Test Plan
HumRRO worked with CAB to conduct an occupational analysis. With the input of multiple committees of subject matter experts (SMEs), HumRRO developed comprehensive lists of architect tasks and the knowledges, skills, and abilities (KSAs) required to perform those tasks. Data about the relevance of the tasks and KSAs were collected through an online survey programmed and hosted by HumRRO. HumRRO used the survey results with input from SMEs to develop a new KSA-based test plan.
Examination Development
HumRRO guided the development of three new examination forms. The development process included multiple development and review meetings with SME Committees, a peer review, a pilot test, development of training materials, and facilitation of standard setting workshops.
Exam Administration Support
At each administration (6 per year), HumRRO provided on-site training and monitoring of administration procedures. HumRRO used custom software to monitor the calibration of commissioners relative to the training and to scan and verify the integrity of score sheet data. HumRRO also provided psychometric guidance relative to administration procedures, assisted CAB in providing special accommodations, and assisted with other administration activities.
Exam Analysis, Scoring, and Reporting
Following each administration, HumRRO performed standard item and test level analyses as well as candidate score reports (individual and group summary). HumRRO also consulted with CAB as needed regarding psychometric implications of the results.
