Multi-stage adaptive regression for online activity recognition.

•An effective multi-stage adaptive regression framework is proposed to address the partial activity observation problem in online activity recognition.•Multiple score functions are collaboratively learned via an adaptive label strategy to reinforce the capacity of distinguishing similar partial activities and the robustness to arbitrary activity fragments.•A challenging interaction database, Online Human Interaction (OHI), is collected in a realistic scenario to further evaluate the online activity recognition.