Rapid relevance classification of social media posts in disasters and emergencies: A system and evaluation featuring active, incremental and online learning

•Abstract and precise relevance criteria for emergency services and classifiers.•Batch learning for relevance classification using precise relevance criteria.•Active learning for rapid classification during time-critical disasters.•Incremental learning for real-time classifier quality prediction during labeling.•Feedback learning allowing users to correct misclassifications reactively.