Background Continuing professional development (CPD) activities are one way that new knowledge can be translated into changes in practice. However, few tools are available for evaluating the extent to which these activities change health professionals’ behavior. We developed a questionnaire called CPD-Reaction for assessing the impact of CPD activities on health professionals’ clinical behavioral intentions. We evaluated its responsiveness to change in behavioral intention and verified its acceptability among stakeholders. Methods and findings We enrolled 376 health professionals who completed CPD-Reaction before and immediately after attending a CPD activity. We contacted them three months later and asked them to self-report on any behavior change. We compared the mean rankings on each CPD-Reaction construct before and immediately after CPD activities. To estimate its predictive validity, we compared the median behavioral intention score (post-activity) of health professionals reporting a behavior change three months later with the median behavioral intention score of physicians who reported no change. We explored stakeholders’ views on CPD-Reaction in semi-structured interviews. Participants were mostly family physicians (62.2%), with an average of 19 years of clinical practice. Post-activity, we observed an increase in intention-related scores for all constructs (P < 0.001) with the most appreciable for the construct beliefs about capabilities. A total of 313 participants agreed to be contacted at follow up, and of these only 69 (22%) reported back. Of these, 43 (62%) self-reported a behavior change. We observed no statistically significant difference in intention between health professionals who later reported a behavior change and those who reported no change (P = 0.30). Overall, CPD stakeholders found the CPD-Reaction questionnaire of interest and suggested potential solutions to perceived barriers to its implementation. Conclusion The CPD-Reaction questionnaire seems responsive to change in behavioral intention. Although CPD stakeholders found it interesting, future implementation will require addressing barriers they identified.

Purpose Continually improving patient outcomes requires that physicians start new behaviors, stop old behaviors, or adjust how they practice medicine. Continuing professional development (CPD) is the method most commonly used by physicians to improve their knowledge and skills. However, despite regular physician attendance at these activities, change in clinical behavior is rarely observed. The authors sought to identify which of Bloom's domains (cognitive, affective, or psychomotor) are targeted by the learning objectives of CPD activities offered by medical associations, regulatory bodies, and academic institutions in the province of Quebec, Canada. Method The authors evaluated the objectives of 110 accredited CPD activities offered to physicians and other health professionals from November 2012 to March 2013. The objectives of each activity were extracted and classified into learning domains using Bloom's taxonomy. Results Ninety-six percent of the learning objectives analyzed targeted the cognitive domain, which consists of six levels of increasing complexity: knowledge, comprehension, application, analysis, synthesis, and evaluation. Half (47%) targeted knowledge and comprehension, whereas only 26% aimed to improve skills in analysis, synthesis, and evaluation. Conclusions Most accredited CPD activities within this sample were generally not designed to promote clinical behavior change because the focus of these activities was on remembering and understanding information instead of preparing physicians to put knowledge into practice by analyzing information, evaluating new evidence, and planning operations that lead to behavior change. Educators and CPD providers should take advantage of well-established theories of health professional behavior change, such as sociocognitive theories, to develop their activities.

Background: Decision-makers in organizations providing continuing professional development (CPD) have identified the need for routine assessment of its impact on practice. We sought to develop a theory-based instrument for evaluating the impact of CPD activities on health professionals' clinical behavioral intentions.Methods and Findings: Our multipronged study had four phases. 1) We systematically reviewed the literature for instruments that used socio-cognitive theories to assess healthcare professionals' clinically-oriented behavioral intentions and/or behaviors; we extracted items relating to the theoretical constructs of an integrated model of healthcare professionals' behaviors and removed duplicates. 2) A committee of researchers and CPD decision-makers selected a pool of items relevant to CPD. 3) An international group of experts (n = 70) reached consensus on the most relevant items using electronic Delphi surveys. 4) We created a preliminary instrument with the items found most relevant and assessed its factorial validity, internal consistency and reliability (weighted kappa) over a two-week period among 138 physicians attending a CPD activity. Out of 72 potentially relevant instruments, 47 were analyzed. Of the 1218 items extracted from these, 16% were discarded as improperly phrased and 70% discarded as duplicates. Mapping the remaining items onto the constructs of the integrated model of healthcare professionals' behaviors yielded a minimum of 18 and a maximum of 275 items per construct. The partnership committee retained 61 items covering all seven constructs. Two iterations of the Delphi process produced consensus on a provisional 40-item questionnaire. Exploratory factorial analysis following test-retest resulted in a 12-item questionnaire. Cronbach's coefficients for the constructs varied from 0.77 to 0.85.Conclusion: A 12-item theory-based instrument for assessing the impact of CPD activities on health professionals' clinical behavioral intentions showed adequate validity and reliability. Further studies could assess its responsiveness to behavior change following CPD activities and its capacity to predict health professionals' clinical performance.

BACKGROUND:The quality of physician communication skills influences health-related decisions, including use of cancer screening tests. We assessed whether patient-physician communication examination scores in a national, standardized clinical skills examination predicted future use of screening mammography (SM).METHODS:Cohort study of 413 physicians taking the Medical Council of Canada clinical skills examination between 1993 and 1996, with follow up until 2006. Administrative claims for SM performed within 12 months of a comprehensive health maintenance visit for women 50-69 years old were reviewed. Multivariable regression was used to estimate the relationship between physician communication skills exam score and patients' SM use while controlling for other factors.RESULTS:Overall, 33.8 % of 96,708 eligible women who visited study physicians between 1993 and 2006 had an SM in the 12 months following an index visit. Patient-related factors associated with increased SM use included higher income, non-urban residence, low Charlson co-morbidity index, prior benign breast biopsy and an interval >12 months since the previous mammogram. Physician-related factors associated with increased use of SM included female sex, surgical specialty, and higher communication skills score. After adjusting for physician and patient-related factors, the odds of SM increased by 24 % for 2SD increase in communication score (OR: 1.24, 95 % CI: 1.11 - 1.38). This impact was even greater in urban areas (OR 1.30, 95 % CI: 1.16, 1.46) and did not vary with practice experience (interaction p-value 0.74).CONCLUSION:Physicians with better communication skills documented by a standardized licensing examination were more successful at obtaining SM for their patients.

BACKGROUND:Syndromic surveillance systems are plagued by high false-positive rates. In chronic disease monitoring, investigators have identified several factors that predict the accuracy of case definitions based on diagnoses in administrative data, and some have even incorporated these predictors into novel case detection methods, resulting in a significant improvement in case definition accuracy. Based on findings from these studies, we sought to identify physician, patient, encounter, and billing characteristics associated with the positive predictive value (PPV) of case definitions for 5 syndromes (fever, gastrointestinal, neurological, rash, and respiratory (including influenza-like illness)).METHODS:The study sample comprised 4,330 syndrome-positive visits from the claims of 1,098 randomly-selected physicians working in Quebec, Canada in 2005-2007. For each visit, physician-facilitated chart review was used to assess whether the same syndrome was present in the medical chart (gold standard). We used multivariate logistic regression analyses to estimate the association between claim-chart agreement about the presence of a syndrome and physician, patient, encounter, and billing characteristics.RESULTS:The likelihood of the medical chart agreeing with the physician claim about the presence of a syndrome was higher when the treating physician had billed many visits for the same syndrome recently (ORper 10 visit, 1.05; 95% CI, 1.01-1.08), had a lower workload (ORper 10 claims, 0.93; 95% CI, 0.90-0.97), and when the patient was younger (ORper 5 years of age, 0.96; 95% CI, 0.94-0.97), and less socially deprived (ORmost versus least deprived, 0.76; 95% CI, 0.60-0.95).CONCLUSIONS:Many physician, patient, encounter, and billing characteristics associated with the PPV of surveillance case definition are accessible to public health, and could be used to reduce false-positive alerts by surveillance systems, either by focusing on the data most likely to be accurate, or by adjusting the observed data for known biases in diagnosis reporting and performing surveillance using the adjusted values.

In 2004, faced with demographic data predicting large increases in the number of older drivers within a relatively short period combined with the realization that screening for driver fitness was largely dependent on health professionals, principally physicians, the Société de l'assurance automobile du Québec (SAAQ) initiated measures to achieve better cooperation with the health professionals performing the screening. A continuing medical education (CME) program was initiated to improve the health professionals' understanding of road safety considerations. This article describes the program and its impact. A 90-minute workshop combining presentation and discussion methods and centering on five case studies was developed and delivered to 824 participants. Outcomes were evaluated at the levels of satisfaction and performance. Participants reported a high level of satisfaction with the workshop. Data suggest that there was an increase in the number of reports submitted by physicians. The quality of physician reports also improved. SAAQ statistics show the benefit of its CME program. Informed physicians appear more willing to report drivers with medical problems affecting driver fitness, especially when they are asked to provide functional evaluations and not make decisions about fitness to drive. We believe that the success of this program was due to several factors: (1) its clinical rather than administrative orientation, (2) the use of physicians to deliver the workshop, and (3) formal recognition of the program by the authority responsible for licensing physicians.

BACKGROUND:Adverse drug events are responsible for up to 7% of all admissions to acute care hospitals. At least 58% of these are preventable, resulting from incomplete drug information, prescribing or dispensing errors, and overuse or underuse of medications. Effective implementation of medication reconciliation is considered essential to reduce preventable adverse drug events occurring at transitions between community and hospital care. An electronically enabled discharge reconciliation process represents an innovative approach to this problem.METHODS/DESIGN:Participants will be recruited in Quebec and are eligible for inclusion if they are using prescription medication at admission, covered by the Quebec drug insurance plan, admitted from the community, 18 years or older, admitted to a general or intensive care medical or surgical unit, and discharged alive. A sample size of 3,714 will be required to detect a 5% reduction in adverse drug events. The intervention will comprise electronic retrieval of the community drug list, combined with an electronic discharge reconciliation module and an electronic discharge communication module. The primary outcomes will be adverse drug events occurring 30 days post-discharge, identified by a combination of patient self-report and chart abstraction. All emergency room visits and hospital readmission during this period will be measured as secondary outcomes. A cluster randomization approach will be used to allocate 16 medical and 10 surgical units to electronic discharge reconciliation and communication versus usual care. An intention-to-treat approach will be used to analyse data. Logistic regression will be undertaken within a generalized estimating equation framework to account for clustering within units.DISCUSSION:The goal of this prospective trial is to determine if electronically enabled discharge reconciliation will reduce the risk of adverse drug events, emergency room visits and readmissions 30 days post-discharge compared with usual care. We expect that this intervention will improve adherence to medication reconciliation at discharge, the accuracy of the community-based drug history and effective communication of hospital-based treatment changes to community care providers. The results may support policy-directed investments in computerizing and training of hospital staff, generate key requirements for future hospital accreditation standards, and highlight functional requirements for software vendors.TRIAL REGISTRATION:NCT01179867.

Continuing professional development (CPD) is an important vehicle for knowledge translation (KT); however, selecting CPD strategies that will impact health professionals' behavior and improve patient outcomes is complex. In response, we, KT researchers and CPD knowledge users, have recently formed a partnership known as the National Network for Patient-Centered Evidence-Based Continuing Professional Development. The partnership was initiated in 2006 with a series of CIHR Knowledge Translation: Planning, Meetings and Dissemination grants. The objectives of these grants were to bring members of the CPD and KT communities together, determine their interest in working together, identify similarities and differences in the fields of CPD and KT, and develop working groups to inform larger collaborative initiatives to support knowledge translation and exchange. The vision for this partnership is to become a premiere knowledge translation collaboration and a cutting-edge implementation network that informs the provision of CPD across Canada and abroad. This paper reports on the development and outcomes of this network to date.

Contexte : Si les orientations sont relativement claires dans la littérature en ce qui concerne l'enseignement du raisonnement clinique, force est de constater qu'il n'en est pas de même pour l'identification de ses lacunes et leurs remédiations. Buts : Dans cette recherche qualitative exploratoire, nous avons voulu mettre en lumière les pratiques, mais également les perceptions des cliniciens enseignants engagés dans une démarche de diagnostic et de remédiation des lacunes du raisonnement clinique. Notre cadre conceptuel s'appuie sur le modèle de Hesketh qui distingue les tâches, la façon avec laquelle ces tâches sont abordées et la perception du rôle d'enseignant. Sujets/matériel/méthode : 14 entrevues semi-structurées ont été réalisées auprès d'enseignants cliniciens travaillant dans différents contextes d'évaluation des lacunes du raisonnement clinique. Résultats : Les différentes étapes du processus pédagogique d'identification, de diagnostic et de remédiation des difficultés de raisonnement clinique se font selon un mode essentiellement intuitif. Il manque des outils spécifiques à l'évaluation du raisonnement clinique et il n'y a pas de processus pédagogique structuré et défini, ce qui diminue la précision des interventions. Ceci a un impact sur la conciliation du double rôle des cliniciens enseignants : un doute quand à l'efficacité de leurs démarches pédagogiques et une tendance à se recentrer sur leur rôle de clinicien. Conclusion : Il est nécessaire d'aller « au-delà de l'intuition » pour mieux diagnostiquer les lacunes du raisonnement clinique et y remédier de façon ciblée. Afin de soutenir les cliniciens enseignants dans cette démarche, il est déterminant de développer des processus pédagogiques et des outils spécifiques.

BACKGROUND:Continuing professional development (CPD) is one of the principal means by which health professionals (i.e. primary care physicians and specialists) maintain, improve, and broaden the knowledge and skills required for optimal patient care and safety. However, the lack of a widely accepted instrument to assess the impact of CPD activities on clinical practice thwarts researchers' comparisons of the effectiveness of CPD activities. Using an integrated model for the study of healthcare professionals' behaviour, our objective is to develop a theory-based, valid, reliable global instrument to assess the impact of accredited CPD activities on clinical practice.METHODS:Phase 1: We will analyze the instruments identified in a systematic review of factors influencing health professionals' behaviours using criteria that reflect the literature on measurement development and CPD decision makers' priorities. The outcome of this phase will be an inventory of instruments based on social cognitive theories. Phase 2: Working from this inventory, the most relevant instruments and their related items for assessing the concepts listed in the integrated model will be selected. Through an e-Delphi process, we will verify whether these instruments are acceptable, what aspects need revision, and whether important items are missing and should be added. The outcome of this phase will be a new global instrument integrating the most relevant tools to fit our integrated model of healthcare professionals' behaviour. Phase 3: Two data collections are planned: (1) a test-retest of the new instrument, including item analysis, to assess its reliability and (2) a study using the instrument before and after CPD activities with a randomly selected control group to explore the instrument's mere-measurement effect. Phase 4: We will conduct individual interviews and focus groups with key stakeholders to identify anticipated barriers and enablers for implementing the new instrument in CPD practice. Phase 5: Drawing on the results from the previous phases, we will use consensus-building methods to develop with the decision makers a plan to implement the new instrument.DISCUSSION:This project proposes to give stakeholders a theory-based global instrument to validly and reliably measure the impacts of CPD activities on clinical practice, thus laying the groundwork for more targeted and effective knowledge-translation interventions in the future.

BACKGROUND:Shared decision-making is not widely implemented in healthcare. We aimed to set a research agenda about promoting shared decision-making through continuing professional development.METHODS:Thirty-six participants met for two days.RESULTS:Participants suggested ways to improve an environmental scan that had inventoried 53 shared decision-making training programs from 14 countries. Their proposed research agenda included reaching an international consensus on shared decision-making competencies and creating a framework for accrediting continuing professional development initiatives in shared decision-making.CONCLUSIONS:Variability in shared decision-making training programs showcases the need for quality assurance frameworks.

BACKGROUND:Community clinics offer potential for timelier outbreak detection and monitoring than emergency departments. However, the accuracy of syndrome definitions used in surveillance has never been evaluated in community settings. This study's objective was to assess the accuracy of syndrome definitions based on diagnostic codes in physician claims for identifying 5 syndromes (fever, gastrointestinal, neurological, rash, and respiratory including influenza-like illness) in community clinics.METHODS:We selected a random sample of 3,600 community-based primary care physicians who practiced in the fee-for-service system in the province of Quebec, Canada in 2005-2007. We randomly selected 10 visits per physician from their claims, stratifying on syndrome type and presence, diagnosis, and month. Double-blinded chart reviews were conducted by telephone with consenting physicians to obtain information on patient diagnoses for each sampled visit. The sensitivity, specificity, and positive predictive value (PPV) of physician claims were estimated by comparison to chart review.RESULTS:1,098 (30.5%) physicians completed the chart review. A chart entry on the date of the corresponding claim was found for 10,529 (95.9%) visits. The sensitivity of syndrome definitions based on diagnostic codes in physician claims was low, ranging from 0.11 (fever) to 0.44 (respiratory), the specificity was high, and the PPV was moderate to high, ranging from 0.59 (fever) to 0.85 (respiratory). We found that rarely used diagnostic codes had a higher probability of being false-positives, and that more commonly used diagnostic codes had a higher PPV.CONCLUSIONS:Future research should identify physician, patient, and encounter characteristics associated with the accuracy of diagnostic codes in physician claims. This would enable public health to improve syndromic surveillance, either by focusing on physician claims whose diagnostic code is more likely to be accurate, or by using all physician claims and weighing each according to the likelihood that its diagnostic code is accurate.

BACKGROUND:Shared decision making (SDM) is a process by which a healthcare choice is made jointly by the healthcare professional and the patient. SDM is the essential element of patient-centered care, a core concept of primary care. However, SDM is seldom translated into primary practice. Continuing professional development (CPD) is the principal means by which healthcare professionals continue to gain, improve, and broaden the knowledge and skills required for patient-centered care. Our international collaboration seeks to improve the knowledge base of CPD that targets translating SDM into the clinical practice of primary care in diverse healthcare systems.METHODS:Funded by the Canadian Institutes of Health Research (CIHR), our project is to form an international, interdisciplinary research team composed of health services researchers, physicians, nurses, psychologists, dietitians, CPD decision makers and others who will study how CPD causes SDM to be practiced in primary care. We will perform an environmental scan to create an inventory of CPD programs and related activities for translating SDM into clinical practice. These programs will be critically assessed and compared according to their strengths and limitations. We will use the empirical data that results from the environmental scan and the critical appraisal to identify knowledge gaps and generate a research agenda during a two-day workshop to be held in Quebec City. We will ask CPD stakeholders to validate these knowledge gaps and the research agenda.DISCUSSION:This project will analyse existing CPD programs and related activities for translating SDM into the practice of primary care. Because this international collaboration will develop and identify various factors influencing SDM, the project could shed new light on how SDM is implemented in primary care.

BACKGROUND:Less than 75% of people prescribed antihypertensive medication are still using treatment after 6 months. Physicians determine treatment, educate patients, manage side effects, and influence patient knowledge and motivation. Although physician communication ability likely influences persistence, little is known about the importance of medical management skills, even though these abilities can be enhanced through educational and practice interventions. The purpose of this study was to determine whether a physician's medical management and communication ability influence persistence with antihypertensive treatment.METHODS:This was a population-based study of 13,205 hypertensive patients who started antihypertensive medication prescribed by a cohort of 645 physicians entering practice in Quebec, Canada, between 1993 and 2007. Medical Council of Canada licensing examination scores were used to assess medical management and communication ability. Population-based prescription and medical services databases were used to assess starting therapy, treatment changes, comorbidity, and persistence with antihypertensive treatment in the first 6 months.RESULTS:Within 6 months after starting treatment, 2926 patients (22.2%) had discontinued all antihypertensive medication. The risk of nonpersistence was reduced for patients who were treated by physicians with better medical management (odds ratio per 2-SD increase in score, 0.74; 95% confidence interval, 0.63-0.87) and communication (0.88; 0.78-1.00) ability and with early therapy changes (odds ratio, 0.45; 95% confidence interval, 0.37-0.54), more follow-up visits, and nondiuretics as the initial choice of therapy. Medical management ability was responsible for preventing 15.8% (95% confidence interval, 7.5%-23.3%) of nonpersistence.CONCLUSION:Better clinical decision-making and data collection skills and early modifications in therapy improve persistence with antihypertensive therapy.

BACKGROUND:Adherence with antihypertensive and lipid-lowering therapy is poor, resulting in an almost 2-fold increase in hospitalization. Treatment side effects, cost, and complexity are common reasons for nonadherence, and physicians are often unaware of these potentially modifiable problems.OBJECTIVE:To determine if a cardiovascular medication tracking and nonadherence alert system, incorporated into a computerized health record system, would increase drug profile review by primary care physicians, increase the likelihood of therapy change, and improve adherence with antihypertensive and lipid-lowering drugs.METHODS:There were 2293 primary care patients prescribed lipid-lowering or antihypertensive drugs who were randomized to the adherence tracking and alert system or active medication list alone to determine if the intervention increased drug profile review, changes in cardiovascular drug treatment, and refill adherence in the first 6 months. An intention to treat analysis was conducted using generalized estimating equations to account for clustering within physician.RESULTS:Overall, medication adherence was below 80% for 36.3% of patients using lipid-lowering drugs and 40.8% of patients using antihypertensives at the start of the trial. There was a significant increase in drug profile review in the intervention compared to the control group (44.5% v. 35.5%; P < 0.001), a nonsignificant increase in drug discontinuations due to side effects (2.3% v. 2.0%; P = 0.61), and a reduction in therapy increases (28.5% v. 29.1%; P = 0.86). There was no significant change in refill adherence after 6 months of follow-up.CONCLUSION:An adherence tracking and alert system increases drug review but not therapy changes or adherence in prevalent users of cardiovascular drug treatment. Targeting incident users where adverse treatment effects are more common and combining adherence tracking and alert tools with motivational interventions provided by multidisciplinary primary care teams may improve the effectiveness of the intervention.

In many countries, peer assessment programs based on the examination of patient charts are becoming a standard to assess physician’s clinical performance. Although data on validity of the process are acceptable, reliability issues need some improvement. This article addresses the rarely studied aspect of optimal number of patient charts for an acceptable reliable assessment. Fifteen patient charts for each of a group of 20 practicing physicians were independently reviewed by 4 professional peer assessors. Generalizability (G) and decision (D) studies were applied to the data. It appears that as few as 10 patient charts are sufficient for any assessor to obtain a G coefficient of 0.80. Results of the current study suggest the possibility of getting generalizable assessments by peer reviewer with minimal information. These results are not in accordance with the concept of case specificity in which it is claimed that performance on a case is a poor predictor of performance on a different case.

INTRODUCTION:Evaluation of poorly performing physicians is a worldwide concern for licensing bodies. The Collège des Médecins du Québec currently assesses the clinical competence of physicians previously identified with potential clinical competence difficulties through a day-long procedure called the Structured Oral Interview (SOI). Two peer physicians produce a qualitative report. In view of remediation activities and the potential for legal consequences, more information on the clinical reasoning process (CRP) and quantitative data on the quality of that process is needed. This study examines the Script Concordance Test (SCT), a tool that provides a standardized and objective measure of a specific dimension of CRP, clinical data interpretation (CDI), to determine whether it could be useful in that endeavor.METHODS:Over a 2-year period, 20 family physicians took, in addition to the SOI, a 1-hour paper-and-pencil SCT. Three evaluators, blind as to the purpose of the experiment, retrospectively reviewed SOI reports and were asked to estimate clinical reasoning quality. Subjects were classified into 2 groups (below and above median of the score distribution) for the 2 assessment methods. Agreement between classifications is estimated with the use of the Kappa coefficient.RESULTS:Intraclass correlation for SOI was 0.89. Cronbach alpha coefficient for the SCT was 0.90. Agreement between methods was found for 13 participants (Kappa: 0.30, P = 0.18), but 7 out of 20 participants were classified differently in both methods. All participants but 1 had SCT scores below 2 SD of panel mean, thus indicating serious deficiencies in CDI.DISCUSSION:The finding that the majority of the referred group did so poorly on CDI tasks has great interest for assessment as well as for remediation. In remediation of prescribing skills, adding SCT to SOI is useful for assessment of cognitive reasoning in poorly performing physicians. The structured oral interview should be improved with more precise reporting by those who assess the clinical reasoning process of examinees, and caution is recommended in interpreting SCT scores; they reflect only a part of the reasoning process.

Objectives  This study aimed to determine if national licensing examinations that measure medical knowledge (QE1) and clinical skills (QE2) predict the quality of care delivered by doctors in future practice.

Context.—Good communication of pathologic characteristics of a malignancy is crucial to therapy choices and accurate prognostication. The information must be easily retrieved from a surgical pathology report. Objectives.—To evaluate, first in 1999, the quality of surgical pathology reports for segmental breast resections for cancer in Quebec hospitals. Subsequently, to reevaluate, in 2003, the same indicators to determine if the first surveillance, with feedback, was associated with an improvement in the quality of the reports. Design.—All Quebec hospitals performing the preset number of 20 or more segmental breast resections for cancer in 1999 and 2003 participated. A committee of pathologists, after review of the literature, chose 7 diagnostic elements deemed vital to a surgical pathology report for conservative breast cancer surgery. Medical archivists in each institution were instructed on how to retrieve the data. The main outcome measure was the presence or absence of the diagnostic information clearly presented on the surgical pathology report. Results.—Fifty-one hospitals participated in 1999 and 50 in 2003. Overall, conformity improved from 85.0% in 1999 for the first evaluation to 92.5% in 2003 for the second evaluation (P < .001). Six of the 7 indicators showed an improvement in the level of conformity between the first and second evaluations. Conformity was weakest for recording the distance between the tumor and the resection margin (68.2%) and vascular/lymphatic invasion (61.4%) in 1999. Conclusions.—Surveillance of quality of surgical pathology reports, with feedback, is significantly associated with an improvement in the quality of reports.