Missing data are frequently encountered in registries that are used to compare performance across hospitals. The most appropriate method for handling missing data when analysing differences in outcomes between hospitals with a generalised linear mixed model is unclear. We aimed to compare methods for handling missing data when comparing hospitals on ordinal and dichotomous outcomes. We performed a simulation study using data from the Multicentre Randomised Controlled Trial of Endovascular Treatment for Acute Ischaemic Stroke in the Netherlands (MR CLEAN) Registry, a prospective cohort study in 17 hospitals performing endovascular therapy for ischaemic stroke in the Netherlands. The investigated methods for handling missing data, both case-mix adjustment variables and outcomes, were complete case analysis, single imputation, multiple imputation, single imputation with deletion of imputed outcomes and multiple imputation with deletion of imputed outcomes. Data were generated as missing completely at random (MCAR), missing at random and missing not at random (MNAR) in three scenarios: (1) 10% missing data in case-mix and outcome; (2) 40% missing data in case-mix and outcome; and (3) 40% missing data in case-mix and outcome with varying degree of missing data among hospitals. Bias and reliability of the methods were compared on the mean squared error (MSE, a summary measure combining bias and reliability) relative to the hospital effect estimates from the complete reference data set. For both the ordinal outcome (ie, the modified Rankin Scale) and a common dichotomised version thereof, all methods of handling missing data were biased, likely due to shrinkage of the random effects. The MSE of all methods was on average lowest under MCAR and with fewer missing data, and highest with more missing data and under MNAR. The 'multiple imputation, then deletion' method had the lowest MSE for both outcomes under all simulated patterns of missing data. Thus, when estimating hospital effects on ordinal and dichotomous outcomes in the presence of missing data, the least biased and most reliable method to handle these missing data is 'multiple imputation, then deletion'.

Abstract Background Standardized Mortality Ratios (SMRs) are case-mix adjusted mortality rates per hospital and are used to evaluate quality of care. However, acute care is increasingly organized on a regional level, with more severe patients admitted to specialized hospitals. We hypothesize that the current case-mix adjustment insufficiently captures differences in case-mix between non-specialized and specialized hospitals. We aim to improve the SMR by adding proxies of disease severity to the model and by calculating a regional SMR (RSMR) for acute cerebrovascular disease (CVD) and myocardial infarction (MI). Methods We used data from the Dutch National Basic Registration of Hospital Care. We selected all admissions from 2016 to 2018. SMRs and RSMRs were calculated by dividing the observed in-hospital mortality by the expected in-hospital mortality. The expected in-hospital mortality was calculated using logistic regression with adjustment for age, sex, socioeconomic status, severity of main diagnosis, urgency of admission, Charlson comorbidity index, place of residence before admission, month/year of admission, and in-hospital mortality as outcome. Results The IQR of hospital SMRs of CVD was 0.85–1.10, median 0.94, with higher SMRs for specialized hospitals (median 1.12, IQR 1.00-1.28, 71%-SMR > 1) than for non-specialized hospitals (median 0.92, IQR 0.82–1.07, 32%-SMR > 1). The IQR of RSMRs was 0.92–1.09, median 1.00. The IQR of hospital SMRs of MI was 0.76–1.14, median 0.98, with higher SMRs for specialized hospitals (median 1.00, IQR 0.89–1.25, 50%-SMR > 1 versus median 0.94, IQR 0.74–1.11, 44%-SMR > 1). The IQR of RSMRs was 0.90–1.08, median 1.00. Adjustment for proxies of disease severity mostly led to lower SMRs of specialized hospitals. Conclusion SMRs of acute regionally organized diseases do not only measure differences in quality of care between hospitals, but merely measure differences in case-mix between hospitals. Although the addition of proxies of disease severity improves the model to calculate SMRs, real disease severity scores would be preferred. However, such scores are not available in administrative data. As a consequence, the usefulness of the current SMR as quality indicator is very limited. RSMRs are potentially more useful, since they fit regional organization and might be a more valid representation of quality of care.

Background Insight into outcome variation between hospitals could help to improve quality of care. We aimed to assess the validity of early outcomes as quality indicators for acute ischemic stroke care for patients treated with endovascular therapy (EVT). Methods and Results We used data from the MR CLEAN (Multicenter Randomized Controlled Trial of Endovascular Treatment for Acute Ischemic Stroke in the Netherlands) Registry, a large multicenter prospective cohort study including 3279 patients with acute ischemic stroke undergoing EVT. Random effect linear and proportional odds regression were used to analyze the effect of case mix on between‐hospital differences in 2 early outcomes: the National Institutes of Health Stroke Scale (NIHSS) score at 24 to 48 hours and the expanded thrombolysis in cerebral infarction score. Between‐hospital variation in outcomes was assessed using the variance of random hospital effects (tau2). In addition, we estimated the correlation between hospitals' EVT‐patient volume and (case‐mix–adjusted) outcomes. Both early outcomes and case‐mix characteristics varied significantly across hospitals. Between‐hospital variation in the expanded thrombolysis in cerebral infarction score was not influenced by case‐mix adjustment (tau 2=0.17 in both models). In contrast, for the NIHSS score at 24 to 48 hours, case‐mix adjustment led to a decrease in variation between hospitals (tau 2 decreases from 0.19 to 0.17). Hospitals' EVT‐patient volume was strongly correlated with higher expanded thrombolysis in cerebral infarction scores (r=0.48) and weakly with lower NIHSS score at 24 to 48 hours (r=0.15). Conclusions Between‐hospital variation in NIHSS score at 24 to 48 hours is significantly influenced by case‐mix but not by patient volume. In contrast, between‐hospital variation in expanded thrombolysis in cerebral infarction score is strongly influenced by EVT‐patient volume but not by case‐mix. Both outcomes may be suitable for comparing hospitals on quality of care, provided that adequate adjustment for case‐mix is applied for NIHSS score.

Background: Endovascular treatment (EVT) for acute ischemic stroke (AIS) is performed in intervention centers that provide the full range of neuro(endo)vascular care (level 1) and centers that only perform EVT for AIS (level 2). We compared outcomes between these center types and assessed whether differences in outcomes could be explained by center volume (CV). Patients and methods: We analyzed patients included in the MR CLEAN Registry (2014–2018), a registry of all EVT-treated patients in the Netherlands. Our primary outcome was the shift on the modified Rankin scale (mRS) after 90 days (ordinal regression). Secondary outcomes were the NIHSS 24–48 h post-EVT, door-to-groin time (DTGT), procedure time (linear regression), and recanalization (binary logistic regression). We compared outcomes between level 1 and 2 centers using multilevel regression models, with center as random intercept. We adjusted for relevant baseline factors, and in case of observed differences, we additionally adjusted for CV. Results: Of the 5144 patients 62% were treated in level 1 centers. We observed no significant differences between center types in mRS (adjusted(a)cOR: 0.79, 95% CI: 0.40 to 1.54), NIHSS (aβ: 0.31, 95% CI: −0.52 to 1.14), procedure duration (aβ: 0.88, 95% CI: −5.21 to 6.97), or DTGT (aβ: 4.24, 95% CI: −7.09 to 15.57). The probability for recanalization was higher in level 1 centers compared to level 2 centers (aOR 1.60, 95% CI: 1.10 to 2.33), and this difference probably depended on CV. Conclusions: We found no significant differences, that were independent of CV, in the outcomes of EVT for AIS between level 1 and level 2 intervention centers.

Introduction Various statistical approaches can be used to deal with unmeasured confounding when estimating treatment effects in observational studies, each with its own pros and cons. This study aimed to compare treatment effects as estimated by different statistical approaches for two interventions in observational stroke care data. Patients and methods We used prospectively collected data from the MR CLEAN registry including all patients ( n = 3279) with ischemic stroke who underwent endovascular treatment (EVT) from 2014 to 2017 in 17 Dutch hospitals. Treatment effects of two interventions – i.e., receiving an intravenous thrombolytic (IVT) and undergoing general anesthesia (GA) before EVT – on good functional outcome (modified Rankin Scale ≤2) were estimated. We used three statistical regression-based approaches that vary in assumptions regarding the source of unmeasured confounding: individual-level (two subtypes), ecological, and instrumental variable analyses. In the latter, the preference for using the interventions in each hospital was used as an instrument. Results Use of IVT (range 66–87%) and GA (range 0–93%) varied substantially between hospitals. For IVT, the individual-level (OR ~ 1.33) resulted in significant positive effect estimates whereas in instrumental variable analysis no significant treatment effect was found (OR 1.11; 95% CI 0.58–1.56). The ecological analysis indicated no statistically significant different likelihood (β = − 0.002%; P = 0.99) of good functional outcome at hospitals using IVT 1% more frequently. For GA, we found non-significant opposite directions of points estimates the treatment effect in the individual-level (ORs ~ 0.60) versus the instrumental variable approach (OR = 1.04). The ecological analysis also resulted in a non-significant negative association (0.03% lower probability). Discussion and conclusion Both magnitude and direction of the estimated treatment effects for both interventions depend strongly on the statistical approach and thus on the source of (unmeasured) confounding. These issues should be understood concerning the specific characteristics of data, before applying an approach and interpreting the results. Instrumental variable analysis might be considered when unobserved confounding and practice variation is expected in observational multicenter studies.

Objectives The aim of this study was to explore the perspectives of healthcare providers and researchers in a large academic hospital on facilitators and barriers for implementing patient-reported outcome measures (PROMs) in clinical care. Methods A customized web-based questionnaire was developed and disseminated to healthcare providers and researchers across multiple medical departments involved in a value-based health care initiative in the hospital. Questionnaire statements were rated using a 5-point Likert scale ranging from "strongly agree" to "strongly disagree". In addition, 8 open-ended questions were included allowing respondents to mention additional facilitators and barriers for implementing PROMs. Descriptive statistics were used to summarize the results. Results In total, 61 participants from both surgical and non-surgical departments completed the survey. Most respondents (51%) were medical specialists and the median employment duration was 14 years. Frequently reported facilitators were the presence of a PROM coordinator in the (outpatient) clinic (85%), the integration of PROMs in the electronic health record (81%), and the intrinsic motivation of members involved in the implementation (N=9 open responses). Commonly reported barriers were language barriers (76%), IT issues (N=17 open responses), and time constraints (N=14 open responses). Conclusions For the successful implementation of PROMs in clinical practice, it is imperative that healthcare organizations consider supporting motivated healthcare professionals, involving PROMs coordinators, and investing in an adequate IT infrastructure, and removal of language barriers.

Although the provision of performance feedback to healthcare professionals based on data from quality registries is common practice in many fields of medicine, observational studies of its effect on the quality of care have shown mixed results. The objective of this study is to evaluate the effect of performance feedback on the quality of care for acute ischemic stroke. PERFEQTOS is a stepped wedge cluster randomized trial in 13 hospitals in the Netherlands providing endovascular thrombectomy for ischemic stroke. The primary outcome is the hospital’s door-to-groin time. The study starts with a 6-month period in which none of the hospitals receives the performance feedback intervention. Subsequently, every 6 months, three or four hospitals are randomized to cross over from the control to the intervention conditions, until all hospitals receive the feedback intervention. The feedback intervention consists of a dashboard with quarterly reports on patient characteristics, structure, process, and outcome indicators related to patients with ischemic stroke treated with endovascular thrombectomy. Hospitals can compare their present performance with their own performance in the past and with other hospitals. The performance feedback is provided to local quality improvement teams in each hospital, who define their own targets on specific indicators and develop performance improvement plans. The impact of the performance feedback and improvement plans will be evaluated by comparing the primary outcome before and after the intervention. This study will provide evidence on the effectiveness of performance feedback to healthcare providers. The results will be actively disseminated through peer-reviewed journals, conference presentations, and various stakeholder engagement activities. Netherlands Trial Register NL9090 . Registered on December 3, 2020

Background Between-center variation in outcome may offer opportunities to identify variation in quality of care. By intervening on these quality differences, patient outcomes may be improved. However, whether observed differences in outcome reflect the true quality improvement potential is not known for many diseases. Therefore, we aimed to analyze the effect of differences in performance on structure and processes of care, and case-mix on between-center differences in outcome after endovascular treatment (EVT) for ischemic stroke. Methods In this observational cohort study, ischemic stroke patients who received EVT between 2014 and 2017 in all 17 Dutch EVT-centers were included. Primary outcome was the modified Rankin Scale, ranging from 0 (no symptoms) to 6 (death), at 90 days. We used random effect proportional odds regression modelling, to analyze the effect of differences in structure indicators (center volume and year of admission), process indicators (time to treatment and use of general anesthesia) and case-mix, by tracking changes in tau 2 , which represents the amount of between-center variation in outcome. Results Three thousand two hundred seventy-nine patients were included. Performance on structure and process indicators varied significantly between EVT-centers ( P < 0.001). Predicted probability of good functional outcome (modified Rankin Scale 0–2 at 90 days), which can be interpreted as an overall measure of a center’s case-mix, varied significantly between 17 and 50% across centers. The amount of between-center variation ( tau 2 ) was estimated at 0.040 in a model only accounting for random variation. This estimate more than doubled after adding case-mix variables ( tau 2 : 0.086) to the model, while a small amount of between-center variation was explained by variation in performance on structure and process indicators ( tau 2 : 0.081 and 0.089, respectively). This indicates that variation in case-mix affects the differences in outcome to a much larger extent. Conclusions Between-center variation in outcome of ischemic stroke patients mostly reflects differences in case-mix, rather than differences in structure or process of care. Since the latter two capture the real quality improvement potential, these should be used as indicators for comparing center performance. Especially when a strong association exists between those indicators and outcome, as is the case for time to treatment in ischemic stroke.

The concentrations of high- and low-density-lipoprotein cholesterol and triglycerides are influenced by smoking, but it is unknown whether genetic associations with lipids may be modified by smoking. We conducted a multi-ancestry genome-wide gene-smoking interaction study in 133,805 individuals with follow-up in an additional 253,467 individuals. Combined meta-analyses identified 13 new loci associated with lipids, some of which were detected only because association differed by smoking status. Additionally, we demonstrate the importance of including diverse populations, particularly in studies of interactions with lifestyle factors, where genomic and lifestyle differences by ancestry may contribute to novel findings.

Elevated blood pressure (BP), a leading cause of global morbidity and mortality, is influenced by both genetic and lifestyle factors. Cigarette smoking is one such lifestyle factor. Across five ancestries, we performed a genome-wide gene-smoking interaction study of mean arterial pressure (MAP) and pulse pressure (PP) in 129 913 individuals in stage 1 and follow-up analysis in 480 178 additional individuals in stage 2. We report here 136 loci significantly associated with MAP and/or PP. Of these, 61 were previously published through main-effect analysis of BP traits, 37 were recently reported by us for systolic BP and/or diastolic BP through gene-smoking interaction analysis and 38 were newly identified (P < 5 × 10-8, false discovery rate < 0.05). We also identified nine new signals near known loci. Of the 136 loci, 8 showed significant interaction with smoking status. They include CSMD1 previously reported for insulin resistance and BP in the spontaneously hypertensive rats. Many of the 38 new loci show biologic plausibility for a role in BP regulation. SLC26A7 encodes a chloride/bicarbonate exchanger expressed in the renal outer medullary collecting duct. AVPR1A is widely expressed, including in vascular smooth muscle cells, kidney, myocardium and brain. FHAD1 is a long non-coding RNA overexpressed in heart failure. TMEM51 was associated with contractile function in cardiomyocytes. CASP9 plays a central role in cardiomyocyte apoptosis. Identified only in African ancestry were 30 novel loci. Our findings highlight the value of multi-ancestry investigations, particularly in studies of interaction with lifestyle factors, where genomic and lifestyle differences may contribute to novel findings.

A person's lipid profile is influenced by genetic variants and alcohol consumption, but the contribution of interactions between these exposures has not been studied. We therefore incorporated gene-alcohol interactions into a multiancestry genome-wide association study of levels of high-density lipoprotein cholesterol, low-density lipoprotein cholesterol, and triglycerides. We included 45 studies in stage 1 (genome-wide discovery) and 66 studies in stage 2 (focused follow-up), for a total of 394,584 individuals from 5 ancestry groups. Analyses covered the period July 2014-November 2017. Genetic main effects and interaction effects were jointly assessed by means of a 2-degrees-of-freedom (df) test, and a 1-df test was used to assess the interaction effects alone. Variants at 495 loci were at least suggestively associated (P < 1 × 10-6) with lipid levels in stage 1 and were evaluated in stage 2, followed by combined analyses of stage 1 and stage 2. In the combined analysis of stages 1 and 2, a total of 147 independent loci were associated with lipid levels at P < 5 × 10-8 using 2-df tests, of which 18 were novel. No genome-wide-significant associations were found testing the interaction effect alone. The novel loci included several genes (proprotein convertase subtilisin/kexin type 5 (PCSK5), vascular endothelial growth factor B (VEGFB), and apolipoprotein B mRNA editing enzyme, catalytic polypeptide 1 (APOBEC1) complementation factor (A1CF)) that have a putative role in lipid metabolism on the basis of existing evidence from cellular and experimental models.

Many genetic loci affect circulating lipid levels, but it remains unknown whether lifestyle factors, such as physical activity, modify these genetic effects. To identify lipid loci interacting with physical activity, we performed genome-wide analyses of circulating HDL cholesterol, LDL cholesterol, and triglyceride levels in up to 120,979 individuals of European, African, Asian, Hispanic, and Brazilian ancestry, with follow-up of suggestive associations in an additional 131,012 individuals. We find four loci, in/near CLASP1 , LHX1 , SNTA1 , and CNTNAP2 , that are associated with circulating lipid levels through interaction with physical activity; higher levels of physical activity enhance the HDL cholesterol-increasing effects of the CLASP1 , LHX1 , and SNTA1 loci and attenuate the LDL cholesterol-increasing effect of the CNTNAP2 locus. The CLASP1 , LHX1 , and SNTA1 regions harbor genes linked to muscle function and lipid metabolism. Our results elucidate the role of physical activity interactions in the genetic contribution to blood lipid levels.

Genome-wide association analysis advanced understanding of blood pressure (BP), a major risk factor for vascular conditions such as coronary heart disease and stroke. Accounting for smoking behavior may help identify BP loci and extend our knowledge of its genetic architecture. We performed genome-wide association meta-analyses of systolic and diastolic BP incorporating gene-smoking interactions in 610,091 individuals. Stage 1 analysis examined ∼18.8 million SNPs and small insertion/deletion variants in 129,913 individuals from four ancestries (European, African, Asian, and Hispanic) with follow-up analysis of promising variants in 480,178 additional individuals from five ancestries. We identified 15 loci that were genome-wide significant (p < 5 × 10-8) in stage 1 and formally replicated in stage 2. A combined stage 1 and 2 meta-analysis identified 66 additional genome-wide significant loci (13, 35, and 18 loci in European, African, and trans-ancestry, respectively). A total of 56 known BP loci were also identified by our results (p < 5 × 10-8). Of the newly identified loci, ten showed significant interaction with smoking status, but none of them were replicated in stage 2. Several loci were identified in African ancestry, highlighting the importance of genetic studies in diverse populations. The identified loci show strong evidence for regulatory features and support shared pathophysiology with cardiometabolic and addiction traits. They also highlight a role in BP regulation for biological candidates such as modulators of vascular structure and function (CDKN1B, BCAR1-CFDP1, PXDN, EEA1), ciliopathies (SDCCAG8, RPGRIP1L), telomere maintenance (TNKS, PINX1, AKTIP), and central dopaminergic signaling (MSRA, EBF2).

Blood eosinophil count is associated with a variety of common complex outcomes in epidemiological observation. The aim of this study was to explore the causal association between determined blood eosinophil count and 20 common complex outcomes (10 metabolic, 6 cardiac, and 4 pulmonary). Through Mendelian randomization, we investigated genetic evidence for the genetically determined eosinophil in association with each outcomes using individual-level LifeLines cohort data (n = 13,301), where a weighted eosinophil genetic risk score comprising five eosinophil associated variants was created. We further examined the associations of the genetically determined eosinophil with those outcomes using summary statistics obtained from genome-wide association study consortia (6 consortia and 14 outcomes). Blood eosinophil count, by a 1-SD genetically increased, was not statistically associated with common complex outcomes in the LifeLines. Using the summary statistics, we showed that a higher genetically determined eosinophil count had a significant association with lower odds of obesity (odds ratio (OR) 0.81, 95% confidence interval (CI) [0.74, 0.89]) but not with the other traits and diseases. To conclude, an elevated eosinophil count is unlikely to be causally associated to higher risk of metabolic, cardiac, and pulmonary outcomes. Further studies with a stronger genetic risk score for eosinophil count may support these results.

Heavy alcohol consumption is an established risk factor for hypertension; the mechanism by which alcohol consumption impact blood pressure (BP) regulation remains unknown. We hypothesized that a genome-wide association study accounting for gene-alcohol consumption interaction for BP might identify additional BP loci and contribute to the understanding of alcohol-related BP regulation. We conducted a large two-stage investigation incorporating joint testing of main genetic effects and single nucleotide variant (SNV)-alcohol consumption interactions. In Stage 1, genome-wide discovery meta-analyses in ≈131K individuals across several ancestry groups yielded 3,514 SNVs (245 loci) with suggestive evidence of association (P < 1.0 x 10-5). In Stage 2, these SNVs were tested for independent external replication in ≈440K individuals across multiple ancestries. We identified and replicated (at Bonferroni correction threshold) five novel BP loci (380 SNVs in 21 genes) and 49 previously reported BP loci (2,159 SNVs in 109 genes) in European ancestry, and in multi-ancestry meta-analyses (P < 5.0 x 10-8). For African ancestry samples, we detected 18 potentially novel BP loci (P < 5.0 x 10-8) in Stage 1 that warrant further replication. Additionally, correlated meta-analysis identified eight novel BP loci (11 genes). Several genes in these loci (e.g., PINX1, GATA4, BLK, FTO and GABBR2) have been previously reported to be associated with alcohol consumption. These findings provide insights into the role of alcohol consumption in the genetic architecture of hypertension.

C-reactive protein (CRP) is a sensitive biomarker of chronic low-grade inflammation and is associated with multiple complex diseases. The genetic determinants of chronic inflammation remain largely unknown, and the causal role of CRP in several clinical outcomes is debated. We performed two genome-wide association studies (GWASs), on HapMap and 1000 Genomes imputed data, of circulating amounts of CRP by using data from 88 studies comprising 204,402 European individuals. Additionally, we performed in silico functional analyses and Mendelian randomization analyses with several clinical outcomes. The GWAS meta-analyses of CRP revealed 58 distinct genetic loci (p < 5 × 10-8). After adjustment for body mass index in the regression analysis, the associations at all except three loci remained. The lead variants at the distinct loci explained up to 7.0% of the variance in circulating amounts of CRP. We identified 66 gene sets that were organized in two substantially correlated clusters, one mainly composed of immune pathways and the other characterized by metabolic pathways in the liver. Mendelian randomization analyses revealed a causal protective effect of CRP on schizophrenia and a risk-increasing effect on bipolar disorder. Our findings provide further insights into the biology of inflammation and could lead to interventions for treating inflammation and its clinical consequences.

Heavy alcohol consumption is an established risk factor for hypertension; the mechanism by which alcohol consumption impact blood pressure (BP) regulation remains unknown. We hypothesized that a genome-wide association study accounting for gene-alcohol consumption interaction for BP might identify additional BP loci and contribute to the understanding of alcohol-related BP regulation. We conducted a large two-stage investigation incorporating joint testing of main genetic effects and single nucleotide variant (SNV)-alcohol consumption interactions. In Stage 1, genome-wide discovery meta-analyses in 131K individuals across several ancestry groups yielded 3,514 SNVs (245 loci) with suggestive evidence of association (P < 1.0 x 10−5). In Stage 2, these SNVs were tested for independent external replication in 440K individuals across multiple ancestries. We identified and replicated (at Bonferroni correction threshold) five novel BP loci (380 SNVs in 21 genes) and 49 previously reported BP loci (2,159 SNVs in 109 genes) in European ancestry, and in multi-ancestry meta-analyses (P < 5.0 x 10−8). For African ancestry samples, we detected 18 potentially novel BP loci (P < 5.0 x 10−8) in Stage 1 that warrant further replication. Additionally, correlated meta-analysis identified eight novel BP loci (11 genes). Several genes in these loci (e.g., PINX1, GATA4, BLK, FTO and GABBR2) have been previously reported to be associated with alcohol consumption. These findings provide insights into the role of alcohol consumption in the genetic architecture of hypertension.