A Breakthrough in Oral History: Artificial Intelligence Face Recognition

Overview

‘In-depth Hong Kong: An Interview on Using AI Face Recognition in Oral History’ does not only rely on audio and written notes for recording primary sources, but it is also a breakthrough.

This open lesson will showcase the use 'AI Face Recognition in Oral History', which is a project co-organised by the Value Education and the Civil and Social Development Division. By interviewing the librarian of the Urdu language library at Mirador Building, Tsim Sha Tsui, and using facial recognition technology to conduct Oral History analysis, the information obtained in the Oral History interview can be beyond text and sound. Using the Microsoft Face API to embed facial recognition in the application, the functions include face detection, which can perceive, recognise and analyse the facial features and attributes (such as age, emotions, etc.) in the interview video, adding Oral History research data source, and improving its validity and reliability. After the Oral History video was analysed by face recognition and coding in Microsoft Azure Face API, the expression and voice of the Urdu language library librarian were embedded in the Minecraft Tsim Sha Tsui scene as a virtual character to establish a Metaverse. Through gamification learning, learning history is not boring and oral history becomes more interesting. Students answer and complete tasks with virtual characters, so as to understand the multi-cultural characteristics of Hong Kong and the contribution of ethnic minorities to Hong Kong from multiple dimensions. First, the speaker will introduce Face API to the participants and teach them how to do it with Visual Studio. After that, they will output the sound / audio track and facial expression of the interviewees and learn how to embed it into Minecraft.