CAA (Computer Assisted Assessment)
CAA can be used for a number of reasons:
- To pass or fail students
- To rank students
- To identify what a student has learnt
- To identify a students strengths and weaknesses
- To provide feedback allowing students to improve their learning
- To allow students to conduct self assessments
- To motivate students
- To provide immediate feedback to students
- To provide immediate feedback to staff
- To evaluate a courses strengths and weaknesses
- To allow for student revision
- To allow students to review progress and plan further learning.
CAA is the use of computers in the assessment of student learning. The term encompasses the use of computers to deliver, mark and analyse assessments
Bull, J. & McKenna, K., (2001)
Software
The LTT carried out a survey of academic staff CAA requirements towards the end of 2005. Using these data available software packages were identified and tested. This work concluded that the duo assessment engine was the most appropriate CAA software for use within the University.
Assessment using duo
Features include:
- 17 different question types.
- Automated marking (except for essay, short answer and file response)
- Results automatically populated into the gradebook
- Gradebook analysis includs filtering, sorting and downloading grades
- Media compliant - you can include images as parts of questions and answers
- Adjustable delivery options and feedback settings to tailor assessments to the course objectives
SecureExam Browser
The SecureExam Browser is a locked down web-browser which is installed on some test computer across the University. It allows students to access online tests in duo, but nothing else. When using this software students can not access any other part of duo, search the web, or open other applications on the PC. This software increases the security of running summative assessments. If you are interested in using it please contact the LTT.
QuestionMark Perception
The ITS ran a trial of QuestionMark Perception. This trial service has now been ceased. Online assessment should now be carried out using the duo assessment engine.
Pedagogical Value
To successfully integrate CAA into a course the objectives and learning outcomes should be identified before developing the assessment. Duo can be used for both Summative and Formative assessment. However if you plan to use duo for Summative assessments please contact the LTT in advance and we can assist you to ensure you exam runs as smoothly as possible.
There are a range of advantages for using CAA, these being:
- Lecturers can monitor the progress of students through more frequent assessment.
- Students can monitor their own progress; self assessments can be provided.
- Detailed, specific feedback is available to students during or immediately after testing.
- Students acquire information technology (IT) skills.
- More frequent assessment of students is made possible by automatic marking.
- Large groups can be assessed more easily, quickly and consistently.
- Potential to introduce multimedia allows for the inclusion of questions not possible with paper assessments.
- Quality of questions can be easily monitored by statistical analysis.
- Diagnostic reports and analysis can be generated.
- Eliminates the need for double marking.
- Marking is not prone to human error.
- Assessments can be made available 'on demand' to support flexible learning.
- Adaptive testing can be used to match the test to the student's ability.
- Randomisation of questions which reduces the potential for cheating.
- Potential for sharing questions via question banks.
Bull & McKenna (2001)
Online Training Course
An online CAA Training course is available within duo. You can enrol yourself on this course which covers all aspects of creating and running CAA within duo.
Workshops are run periodically throughout the year. View the ITS training booking system for further information.