Assessing The Performance Of Watson For Oncology, A Decision Support System, Using Actual Contemporary Clinical Cases.

8023 Background: IBM Watson for Oncology (WFO), trained by Memorial Sloan Kettering (MSK), is a cognitive computing system designed to assist medical oncologists making treatment decisions for individual patients. Recommendations are consistent with established guidelines and published evidence, as reflected in MSK’s practice and historical cases. Treatment options are classified as Recommended (WFO-REC), For Consideration (WFO-FC), or Not Recommended (WFO-Not REC). Published evidence, medical logic, and drug information are presented for each treatment option. We sought to assess the current performance of WFO to benchmark accuracy and identify areas for development. Methods: 20 de-identified cases were selected from the practices of two MSK thoracic medical oncologists. Patients presented for initial consultation regarding first-line systemic therapy during 2014 and all necessary information to make a treatment decision was available at the time of initial consultation or within two weeks, including mol...