Improving assessment reliability and student experience with a particular focus on student feedback and opportunities for reflection
A general criticism of many areas of learning in HE has been around the quality of student feedback. If students have taken part in a practical activity, for example teaching a group of school students or even delivering a presentation, they really do need the opportunity to get good quality feedback. This feedback will identify a student’s strengths and weaknesses so that they can move forward and improve.
There are many general theories on how learning happens. Most educators agree that opportunities for reflection and abstract conceptualisation are key to the learning process.
Physiotherapy staff (cardiovascular and respiratory) have been working with the Digital Learning Team. We are using Panopto to capture on video “Observed Structured Practical Examinations”, (OSPEs) performed by students as part of their assessment.
These assessments last about 30 minutes. The ‘live’ marking of numerous criteria as well as observing potentially dangerous practice is difficult to achieve, record and moderate without recourse to video.
Lengthy rounds of video recording and editing are highly technical and time-consuming. The same is true for the individual discrete deployment of each video to students, in a timely fashion.
By using Panopto, a series of video sessions can be created in advance, by uploading an excel spreadsheet with the help of iSolutions. Individual sessions can be recorded using a low-cost webcam and a Bluetooth microphone.
iSolutions send you back a complete list of all the students with links to the videos.
There are numerous advantages to conventional video recording
- There is no editing involved
- No lengthy manual uploading, to say youtube
- Deployment is automatic
- Each link is password-protected, so each student can see only their own video
- Assessors can see all recordings
- Each video is available within a few minutes of the OSPE being completed
- Moderation between assessors is easily achievable making marking much more secure.
Potential advantages going forward
- Each video in Panoto has a notes field (ringed in red below) and it is possible for live annotation (of assessment criteria, for example) during the video to be attached to specific points on the timeline. Mobile devices with a browser extension can be employed to use speed keys for assessment comments.
- A discussion field (for text) can be employed by students to comment on their own reflections on their performance within the video, again attached to the timeline.
- Panopto by its very nature can employ multiple sources. We have worked with two cameras and a view of a patient monitor (top left in the image below), giving an accurate picture of all the circumstances surrounding a patient examination.
Panopto can be used in so many different ways where we want to deploy individual videos to individual students. We are also using the system so students can record over 800 individual, ongoing therapeutic practice interviews in Therapeutic Engagements in Occupational Therapy Practice.
Time-saving and secure, with the encouragement and monitoring of genuine student reflection.