Reading view
Nobody Wants Your Damn App
Testing alternatives to video in student communications
Our previous research found that students often skipped videos on University webpages. This follow-up explores whether audio, timestamped videos or structured transcripts better support students in finding the information they need.
In June, I wrote a blog post about whether students watched videos on University webpages, describing my research as part of the UX Service.
Do students actually watch videos on websites?
As part of that research, we ran a small qualitative study with three student participants, observing their natural behaviour as they encountered video content embedded in a student-facing newsletter from the University. We asked a simple question: when a University-wide communication points students to video content, do they actually watch it?
Our first case study suggested the answer was often no. Two of the three participants were not engaged by video content, with one actively avoiding it and another being highly selective. In contrast, one participant was receptive to video, likely due to its relevance to his current situation, highlighting the importance of timing and context in determining video engagement.
This blog post continues where that left off, testing why and what students would rather have instead.
We investigated student reactions to alternative forms of video content
The obvious next question was what students would choose instead of a video if given the option. We decided to run A/B tests, which are controlled experiments that typically compare multiple versions of a digital interface, for example, a webpage to determine which performs better based on user behaviour. We recruited six participants and showed them the same newsletter in three different formats.
- Two participants were shown an audio version.
- Two were shown a video with timestamps.
- Two were shown a transcript, restructured into digestible text rather than auto-generated wall of text.
The findings from this short experiment were interesting. We learnt that, of the three alternatives, the audio format was the least well perceived by the participants. The main reason was because an audio version offered no visual elements, no way to scan ahead, no quick way to extract the one piece of information someone actually needed. Even when the participants were explicitly told that audio was lighter in weight and reduced the carbon footprint of the web estate, it was still the least preferred option.
The video with timestamps on the other hand, was much more positively received. Timestamps allow people jump straight to the relevant section rather than watching linearly, therefore allowing a more efficient way to consume information.
Of all three alternative formats, the transcript was the clear preference of the participants, since this permitted them to quickly skim through the content and find the key information they were looking for. The transcript participants favoured wasn’t just “text instead of video”,which can often appear as a ‘wall of text’ it was text that had been deliberately restructured to pull out the key takeaway points. Taking these findings together, we learned that, for video transcripts to be easily read, and to ensure people can extract most value from them, it is worth putting effort into structuring and presenting text from transcripts, and not simply relying on the auto-generated ones.
Our research revealed ways to make video content more impactful and effective
From a relatively small experiment, we learned a lot about the effectiveness of different formats of student communications and student preferences. The main findings were as follows:
- When it came to assessing content in student communications, students did not seem to be primarily concerned with the digital sustainability of the format. While digital sustainability considerations did not drive student format preferences, it’s worth noting that the most preferred format (structured text) had the lowest environmental impact of those tested.
- Audio did not appear effective for this type of student communication. Audio formats lack the scannability that students rely on, making them a less suitable choice for this type of communication.
- Complying with accessibility requirements does not guarantee usability or a good user experience. A transcript can meet accessibility requirements, yet still fail to provide adequate scannability, highlighting the importance of considering both accessibility and usability.
- Students prioritise their time and seek relevant information, emphasising the need for formats that can be easily updated and kept current.
- More research is needed on video and text complementarity. Further study is required to determine the most effective ways to combine video and text to support communicating with students in the most effective ways possible.
- When researching the effectiveness of student communications, hearing direct feedback from students is essential. A useful next step would be to ask students directly about their experiences with structured text content versus timestamped video and compare the accuracy as well as the completeness of their recall.
We’re planning to continue our research into effectiveness of video content
Our findings have implications for the development of educational content. We shared our results with the Careers Service, who were interested in using our research to inform their content development. This collaboration has the potential to impact how they work with media in the future. Looking ahead, we would like to investigate how students interact with videos on social media platforms like LinkedIn, as their attitudes towards video seem to differ depending on whether it’s for entertainment or educational purposes. This could provide valuable insights into the role of video in student learning and engagement.