Multimodal Representation with Embedded Visual Guiding Objects for Named Entity Recognition in Social Media Posts

Visual contexts often help to recognize named entities more precisely in short texts such as tweets or snapchat. For example, one can identify "Charlie'' as a name of a dog according to the user posts. Previous works on multimodal named entity recognition ignore the corresponding relations of visual objects and entities. Visual objects ar...More