Evaluation of measures for assessing time-saving of automatic organ-at-risk segmentation in radiotherapy

•Automatic delineation software shows promising results in terms of time-saving.•Standard geometry measures do not have a high correlation with delineation time.•New evaluation measures were introduced: added path length (APL) and surface DSC.•(Added) path length showed the highest correlation with time-recordings.•This makes APL the most representative measure for clinical usefulness.