Iterative Case Study
Meaningful Connection from Formative to Summative Assessment
College of Arts and Humanities Students: Year 1 Class Size: Medium (26-100) Suitable for online learning Technology Competence: Basic (general computer literacy) |
Rationale
Make a meaningful connection of formative to summative assessment. Students must do a 10-minute oral exam (April/May), worth 25% of the final grade, it's imperative they have a meaningful feedback to which they can report back and consult often.
Implementation
We implemented Kaltura as a tool for formative feedback on Spoken Portuguese. We trained teaching staff on how to use it for feedback, learnt how to use it as a student before rolling the task out to students.
Effectiveness
It works really well, but is not perfect. Basically, Kaltura allows for comments to be typed on a chat-type section that is linked to a time-stamp of the video. So, whenever a student performs a particular aspect of Spoken Portuguese that merits a comment (e.g. what a student did well, what was good but here is what to do to improve, etc.). This allows the student to click on the time-stamp to jump to that particular utterance in their video, and hear themselves speak whilst reading the tutor's feedback comment. This written feedback is then available for students to revisit as a revision prompt to practice and revise their spoken Portuguese performance. Before this, we relied on students making adequate notes on the fly, in class, with regards to our own comments on their spoken Portuguese performance in class.
Scalability
Any discipline where feedback on a presentation-type assessment is required. This is especially helpful if on-going remarks are necessary and useful.
Student Benefits & Challenges
Benefits | Challenges |
---|---|
It is also useful for EDI purposes, as it allows students to, e.g., not switch their camera on and still perform the task that is required (speak). | Technical challenges -- using Kaltura is really simple, but there is never a universally intuitive system. Be aware that students might ask really simple questions on how to use the system. |
Staff Benefits & Challenges
Benefits | Challenges |
---|---|
Better use of feedback from students is more rewarding in seeing better results in the summative assessment. | Marking the Kaltura videos is time-consuming. We normally allow 10 minutes to mark a 200-word written composition at this level. For a similar video, it takes longer, sometimes 30 minutes. |
References
Ocasio. Kaltura was used in my PgCAP modules, and immediately I could see the benefits of it for this particular case of Spoken Portuguese assessment.
Author of Case Study
Dr Luis Gomes, Senior Lecturer (Portuguese) (Hispanic Studies)
Link to Staff Contact