Jointly social grouping and identification in visual dynamics with causality-induced hierarchical Bayesian model

•Causality-Induced Hierarchical Bayesian tackles where/when/what interaction happens.•The spatio-temporal learned latent topics aggregate for power of discrimination.•Relative Entropy metric estimates motion dependence formulating interactive group.•The effectiveness and scalability of proposed method are shown in realistic scenario.