Conference Presentation at CRAL 2013 (Spain)
A preliminary study on visual vs verbal metaphors analysis has been succesfully presented at the third International CRAL conference on Meaning Construction and Meaning Interpretation: applications and implications. The title of the presentation was: “The behavior of source and target domains in corpora of texts and images: where the mappings come from”. The presentation took place on friday 19th, within a special session, dedicated to the 4 best post-doc proposals selected by the advisory committee.
In this study, a small sample of visual metaphors used in advertising (9 metaphors), and a small group of verbal metaphors and conceptual metaphors that have been inferred by looking just at linguistic expressions (11 metaphors) have been taken into account, analysed and modeled. The source and the target domains of each metaphor have been identified (18+22 concepts) and the resulting 40 concepts have been analysed automatically with distributional analyses conducted across texts and across annotated images. As a result, it was possible to compare each source/target pair of concepts in the 2 environments, and quantify the relatedness between these concepts in each environment (language and annotated images).
Assuming that the shared contextual features between source and target domains of a metaphor define the relatedness between the two concepts, and that the metaphor is arguably realised on those shared features, the following hp was tested: the relatedness between source and target domains of a visual metaphor emerges mainly from the corpus of annotated images (which conveys those elements on which we construct meaning and we make sense of our experiences starting from perceptual stimuli), while the relatedness between source and target domains of a verbal metaphor emerges mainly from the corpus of language.
This does not imply that language and perceptual experiences are two independent modules, but rather that the 2 modalities of communication (visual and verbal) convey meaning in different ways, and given a stimulus expressed in the visual or in the verbal modality, we might activate in our minds different sets of conceptual knowledge, deriving from our encounters with the give concept that have been stored in memory via the verbal or via the perceptual modality.
Here a picture of the four finalists taken a the Bodegas Franco-Españolas, where we had the conference dinner. Great wine, great company!
(thank you Kasia for the picture!)
Posted July 24, 2013