The Pisa Audio-visual Corpus Project: A multimodal approach to ESP research and teaching

This paper presents an ongoing project sponsored by the University of Pisa Language Centre to compile an audiovisual corpus of specialized types of discourse of particular relevance to ESP learners in higher education. The first phase of the project focuses on collecting digitally available video clips that encode specialized language in a range of genres along an ‘authentic’ to ‘fictional’ continuum. The video clips will be analyzed from a multimodal perspective to determine how various semiotic resources work together to construct meaning. They will then be utilized in the ESP classroom to increase learners’ awareness of the key contribution of different modes in specialized communication. We present some exploratory multimodal analyses performed on video clips that encode instances of political discourse across two different genres on the extreme poles of the continuum: a fictional political drama film and an authentic political science lecture.