Sequential conditional reinforcement learning for simultaneous vertebral body detection and segmentation with modeling the spine anatomy

•A new Deep Reinforcement Learning proposed to detect and segment the vertebral body.•Modelling the anatomical correlation of the spine using a decisionmaking process.•Improving accuracy by solving the Unbalanced-experience with a new reward function.•Enhancing robustness by balancing the experience with a new experience-replay method.