Exploiting textual and visual features for image categorization.

•Our proposed approach eliminates the dependence on manually labeled knowledge.•We propose to extract the semantic refinement subcategories from untagged corpora has a better scalability.•We propose a new unified objective function to jointly learn the classifiers for categories and subcategories.•Our approach shows substantial improvement over existing weakly supervised state-of-the-art baseline methods.