An ensemble of 3D ensemble-variational (En-3DEnVar) data assimilations is demonstrated with the Joint Effort for Data assimilation Integration (JEDI) with the Model for Prediction Across Scales – Atmosphere (MPAS-A) (i.e., JEDI-MPAS). Basic software building blocks are reused from previously presented deterministic 3DEnVar functionality and combined with a formal experimental workflow manager in MPAS-Workflow. En-3DEnVar is used to produce an 80-member ensemble of analyses, which are cycled with ensemble forecasts in a 1-month experiment. The ensemble forecasts approximate a purely flow-dependent background error covariance (BEC) at each analysis time. The En-3DEnVar BECs and prior ensemble-mean forecast errors are compared to those produced by a similar experiment that uses the Data Assimilation Research Testbed (DART) ensemble adjustment Kalman filter (EAKF). The experiment using En-3DEnVar produces a similar ensemble spread to and slightly smaller errors than the EAKF. The ensemble forecasts initialized from En-3DEnVar and EAKF analyses are used as BECs in deterministic cycling 3DEnVar experiments, which are compared to a control experiment that uses 20-member MPAS-A forecasts initialized from Global Ensemble Forecast System (GEFS) initial conditions. The experimental ensembles achieve mostly equivalent or better performance than the off-the-shelf ensemble system in this deterministic cycling setting, although there are many obvious differences in configuration between GEFS and the two MPAS ensemble systems. An additional experiment that uses hybrid 3DEnVar, which combines the En-3DEnVar ensemble BEC with a climatological BEC, increases tropospheric forecast quality compared to the corresponding pure 3DEnVar experiment. The JEDI-MPAS En-3DEnVar is technically working and useful for future research studies. Tuning of observation errors and spread is needed to improve performance, and several algorithmic advancements are needed to improve computational efficiency for larger-scale applications.
Black carbon (BC) absorbs solar radiation, increasing the buoyancy and vertical ascent of absorbing aerosol in the atmosphere. This self-lofting process has been observed for individual plumes in the troposphere and lower stratosphere but here we show it occurring at broader scales through enhanced large-scale ascent over BC-rich regions. This is demonstrated in a pair of simulation using the UKESM1 Earth-System model where BC aerosols were modeled either with or without the ability to absorb radiation. With absorption included the annual global mean concentration of BC in the upper troposphere and lower stratosphere (8-22 km) rose by up to 50% and the column loading over some remote oceanic regions more than doubled. The increase in aerosol height was particularly notable over the southeast Atlantic where biomass burning aerosol from Africa was elevated up to 1 km higher when their absorption was included. Similar effects were seen over the Arctic where the absorbing haze was transported in at higher levels and surface concentrations were halved. The absorption by BC also increased ascent over southern Asia, which tended to thicken the Asian brown cloud during the dry season but in the wet season enhancing ascent promoted deep convection and had the tendency to deplete the aerosol through wash-out. We conclude that representing aerosol absorption accurately is important in simulating the vertical distribution, transport and abundance of aerosol in the Earth-system that will affect their interactions with climate.
The Joint Center for Satellite Data Assimilation (JCSDA) Community Radiative Transfer Model (CRTM) is a fast, 1D radiative transfer model used in numerical weather prediction, calibration/validation, etc., across multiple federal agencies and universities. The key benefit of the CRTM is that it is a satellite simulator. It provides a highly accurate representation of satellite radiances by using the specific sensor response functions convolved with a Line-by-Line Radiative Transfer Model (LBLRTM). CRTM covers the spectral ranges consistent with all present operational and most research satellites, from visible to microwave. The capability to simulate ultraviolet radiances and support space-based radar sensors is being added over the next 2 years in CRTM version 3.0. In addition to simulated radiances, the CRTM also provides Jacobian outputs needed to interpret satellite observations for numerical weather prediction. The Jacobian estimates how changes in geophysical parameters affect simulated measurements from satellite sensors. Using the Jacobian in modeling and weather prediction improves the accuracy and efficiency of data analysis, leading to better weather predictions. The CRTM model's success and growth depend on community contributions and evaluation. To facilitate this, we have made the CRTM highly accessible through modular programming, clear documentation and tutorials, public domain licensing, unfettered public access via GitHub, and a clear path to operational implementation for innovative research. We encourage and welcome contributions from the community to help us continue to improve the CRTM.
Active radar instruments provide vertically resolved clouds and precipitation measurements that cannot be provided by the passive instruments. These active measurements are not conventionally assimilated into the data assimilation systems because of the lack of fast forward radiative transfer (RT) models and also difficulties in the error modeling of the measurements. This article describes the development, evaluation, and sensitivity analysis for a forward radar model implemented in the community RT model (CRTM). The scattering properties required by the forward model are provided by the hydrometeor lookup tables that were generated using the discrete dipole approximation (DDA). The model is able to calculate both the reflectivity and the attenuated reflectivity for any given radar instrument at any given zenith angles as long as CRTM instrument-specific coefficients are available. The evaluation using CloudSat measurements shows a very good agreement between the simulations and measurements as long as the input profiles of hydrometeors are consistent with the measured reflectivity profiles. Major sources contributing to the differences between the measured and simulated reflectivities are input hydrometeor profiles, scattering lookup tables, lack of melting layer in the forward model, CRTM scattering solvers, and attenuation calculations. In addition to the forward model, both tangent linear (TL) and adjoint (AD) of the model are also implemented and tested within CRTM. These components may be required by some data assimilation systems for the assimilation of radar measurements.
Thermal infrared (IR) environmental satellite data assimilation and remote sensing of the surface and lower troposphere depend on the accurate specification of the spectral surface emissivity within clear-sky forward calculations. Over ocean surfaces, accurate modeling of surface-leaving radiances over the sensor scanning swaths is complicated by a quasi-specular bidirectional reflectance distribution function (BRDF). Recent findings at the Joint Center for Satellite Data Assimilation (JCSDA) have also revealed significant zonally varying systematic biases ( $\approx |0.5|$ K) on a global scale over cold ocean waters; these are the results of temperature dependence in the thermal IR optical constants. This article proposes practical solutions to these problems by modeling thermal IR “effective emissivity” in a manner that accounts for both surface emission and quasi-specular reflectance, along with temperature dependence, while meeting the latency and computational constraints of operational global data assimilation and retrieval systems. We overview the theoretical basis of the model and validate it against ship-based Marine Atmospheric Emitted Radiance Interferometer (MAERI) spectra obtained from cold and warm water ocean campaigns.
Accurate thermal infrared (TIR) fast-forward models are critical for weather forecasting via numerical weather prediction (NWP) satellite radiance assimilation and operational environmental data record (EDR) retrieval algorithms. The thermodynamic and compositional data about the surface and lower troposphere are derived from semi-transparent TIR window bands (i.e., surface-sensitive channels) that can span into the far-infrared (FIR) region under dry polar conditions. To model the satellite observed radiance within these bands, an accurate a priori emissivity is necessary for the surface in question, usually provided in the form of a physical or empirical model. To address the needs of hyperspectral TIR satellite radiance assimilation, this paper discusses the research, development, and preliminary validation of a physically based snow/ice emissivity model designed for practical implementation within operational fast-forward models such as the U.S. National Oceanic and Atmospheric Administration (NOAA) Community Radiative Transfer Model (CRTM). To accommodate the range of snow grain sizes, a hybrid modeling approach is adopted, combining a layer scattering model based on the Mie theory (viz., the Wiscombe–Warren 1980 snow albedo model, its complete derivation provided in the Appendices) with a specular facet model. The Mie-scattering model is valid for the smallest snow grain sizes typical of fresh snow and frost, whereas the specular facet model is better suited for the larger sizes and welded snow surfaces typical of aged snow. Comparisons of the model against the previously published spectral emissivity measurements show reasonable agreement across zenith observing angles and snow grain sizes, and preliminary observing system experiments (OSEs) have revealed notable improvements in snow/ice surface window channel calculations versus hyperspectral TIR satellite observations within the NOAA NWP radiance assimilation system.
This paper describes a data archaeology and rescue of temperature-dependent thermal infrared (IR) optical constants for liquid water from previously published works. The data rescue is based upon digitization of a figure published by Pinkley et al. [ J. Opt. Soc. Am. 67 , 494 ( 1977 ) 10.1364/JOSA.67.000494 ], which showed ratios of laboratory measured spectral reflectances taken at 4 different temperatures (1, 16, 39, and 50 °C) with those measured previously at 27°C. Using our digitization of these data, we perform Kramers-Kronig analyses to derive temperature-dependent optical constants for existing standard datasets taken at room temperatures for the entire thermal IR spectrum. These datasets are of interest for the accurate modeling of thermal IR surface emissivity and reflectance over the range of global surface temperatures.
On 24 September 2021, JEDI-MPAS 1.0.0, a new data assimilation (DA) system for the Model Prediction Across Scales – Atmosphere (MPAS-A) built on the software framework of the Joint Effort for Data assimilation Integration (JEDI) was publicly released for community use. Operating directly on the native MPAS unstructured mesh, JEDI-MPAS capabilities include three-dimensional variational (3DVar) and ensemble–variational (EnVar) schemes as well as the ensemble of DA (EDA) technique. On the observation side, one advanced feature in JEDI-MPAS is the full all-sky approach for satellite radiance DA with the introduction of hydrometeor analysis variables. This paper describes the formulation and implementation of EnVar for JEDI-MPAS. JEDI-MPAS 1.0.0 is evaluated with month-long cycling 3DEnVar experiments with a global 30–60 km dual-resolution configuration. The robustness and credible performance of JEDI-MPAS are demonstrated by establishing a benchmark non-radiance DA experiment, then incrementally adding microwave radiances from three sources: Advanced Microwave Sounding Unit-A (AMSU-A) temperature sounding channels in clear-sky scenes, AMSU-A window channels in all-sky scenes, and Microwave Humidity Sounder (MHS) water vapor channels in clear-sky scenes. JEDI-MPAS 3DEnVar behaves well with a substantial and significant positive impact obtained for almost all aspects of forecast verification when progressively adding more microwave radiance data. In particular, the day 5 forecast of the best-performing JEDI-MPAS experiment yields an anomaly correlation coefficient (ACC) of 0.8 for 500 hPa geopotential height, a gap of roughly a half day when compared to cold-start forecasts initialized from operational analyses of the National Centers for Environmental Prediction, whose ACC does not drop to 0.8 until a lead time of 5.5 d. This indicates JEDI-MPAS's great potential for both research and operations.
Abstract. The Community Radiative Transfer Model (CRTM), a sensor-based radiative transfer model, has been used within the Gridpoint Statistical Interpolation (GSI) system for directly assimilating radiances from infrared and microwave sensors. We conducted numerical experiments to illustrate how including aerosol radiative effects in CRTM calculations changes the GSI analysis. Compared to the default aerosol-blind calculations, the aerosol influences reduced simulated brightness temperature (BT) in thermal window channels, particularly over dust-dominant regions. A case study is presented, which illustrates how failing to correct for aerosol transmittance effects leads to errors in meteorological analyses that assimilate radiances from satellite IR sensors. In particular, the case study shows that assimilating aerosol-affected BTs affects analyzed temperatures in the lower atmosphere significantly in several different regions of the globe. Consequently, a fully-cycled aerosol-aware experiment improves 1–5 day forecasts of wind, temperature, and geopotential height in the tropical troposphere and Northern Hemisphere stratosphere. Whilst both GSI and CRTM are well documented with online user guides, tutorials and code repositories, this article is intended to provide a joined-up documentation for aerosol absorption and scattering calculations in the CRTM and GSI. It also provides guidance for prospective users of the CRTM aerosol option and GSI aerosol-aware radiance assimilation. Scientific aspects of aerosol-affected BT in atmospheric data assimilation are briefly discussed.
The Community Radiative Transfer Model (CRTM) is a powerful and versatile scalar radiative transfer model for satellite data assimilation and remote sensing applications. It is implemented as an object oriented Fortran library, enabling flexible code development and optimal runtime performance on clusters. The downsides of the Fortran interface are a steep learning curve for students and the reduced productivity of users that is typical for static compiled languages, in contrast to dynamic interpreted languages like Python. pyCRTM is a new software framework that directly interfaces the CRTM Fortran data structures and procedures in Python, leveraging both the simplicity and ease of use of Python syntax as well as the flexibility arising from the vast contemporary Python ecosystem. The goal of pyCRTM is to lower the barrier of entry for university students to learn and use the CRTM and to boost the productivity of researchers seeking to create new methods in radiative transfer and data assimilation, or seeking to apply the CRTM to study atmospheric phenomena without having to go through the pre-existing complexity of the CRTM Fortran interface.(c) 2022 Elsevier Ltd. All rights reserved.
For a variational data assimilation (DA) system that assimilates radiance observations, the simulated brightness temperature (BT) at the top of the atmosphere and the corresponding Jacobians carried out by the radiance observation operator are needed information. Previous studies reported that the incorporation of aerosol information into the radiance observation operator leads to cooler simulated infrared (IR) BTs and warmer temperature analyses at low levels of the atmosphere. However, the role of the aerosol-affected Jacobians in the DA system, which not only affect the determination of analysis increments but also influence the quality control and the bias correction algorithm, is yet to be investigated. This study examines the aerosol impacts on the sensitivity of IR radiance simulations, Jacobians, and the analysis increments by conducting two experiments: (i) sensitivity tests to assess how the different aspects of the aerosol profiles (i.e., mass loading, peak aerosol level, aerosol thickness layer, and bin partition) affect the simulated BT and the Jacobians from the Community Radiative Transfer Model (CRTM), which is the radiance observation operator in the Gridpoint Statistical Interpolation (GSI) analysis system; (ii) single IR observation experiments using GSI to investigate how the aerosol-affected atmospheric Jacobians influence the analysis increment. The results show that dust aerosols produce the strongest cooling to simulated BTs under similar aerosol optical depths; simulated BTs and Jacobians are most sensitive to the loading and peak altitude of the aerosol layer; simulated BTs become more sensitive to the temperature of the aerosol layer; aerosol-induced differences in atmospheric Jacobians lead to considerable changes to temperature and moisture increments. These results provide a better understanding of the aerosol impacts on each component involved in radiance DA, which can provide guidance for assimilating aerosol-affected IR observations.
The Community Radiative Transfer Model (CRTM) is a fast model that requires bulk optical properties of hydrometeors in the form of lookup tables to simulate all‐sky satellite radiances. Current cloud scattering lookup tables of CRTM were generated using the Mie‐Lorenz theory thus assuming spherical shapes for all frozen habits, while actual clouds contain frozen hydrometeors with different shapes. The Discrete Dipole Approximation (DDA) technique is an effective technique for simulating the optical properties of non‐spherical hydrometeors in the microwave region. This paper discusses the implementation and validation of a comprehensive DDA cloud scattering database into CRTM for the microwave frequencies. The original DDA database assumes total random orientation in the calculation of single scattering properties. The mass scattering parameters required by CRTM were then computed from single scattering properties and water content dependent particle size distributions. The new lookup tables eliminate the requirement for providing the effective radius as input to CRTM by using the cloud water content for the mass dimension. A collocated dataset of short‐term forecasts from Integrated Forecast System of the European Center for Medium‐Range Weather Forecasts and satellite microwave data was used for the evaluation of results. The results overall showed that the DDA lookup tables, in comparison with the Mie tables, greatly reduce the differences among simulated and observed values. The Mie lookup tables especially introduce excessive scattering for the channels operating below 90 GHz and low scattering for the channels above 90 GHz.
Dr. Gail Skofronick-Jackson (IEEE Fellow), 58, died suddenly September 7, 2021. Skofronick-Jackson was deployed with a joint NASA-ESA sub-orbital campaign in St. Croix, U.S. Virgin Islands. On a day off from experiments, she perished in a tragic accident while hiking with colleagues. Skofronick- Jackson's contributions to satellite remote sensing spanned 25 years of remote sensing research, NASA spaceflight mission leadership, professional volunteerism, and scientific program management.
Due to the sheer volume of data, leveraging satellite instrument observations effectively in a data assimilation context for numerical weather prediction or for remote sensing requires a radiative transfer model as an observation operator that is both fast and accurate at the same time. Physics-based line-by-line radiative transfer (RT) models fulfil the requirement for accuracy, but are too slow and too costly in computational terms for operational applications. Therefore, fast methods were developed to be able to perform fast RT calculations using techniques such as spectral sampling or pre-computed look-up tables. The operational fast models currently calculate the absorption and scattering coefficients from the pre-computed regression coefficients and atmospheric state and cloud profiles. As a novel solution to this problem, this work investigates a deep learning approach to replace the regression coefficients in the fast RT models. A selection of hidden-layer neural network configurations is trained against atmospheric transmittance profile data computed by an accurate line-by-line model and their performance is evaluated and their advantages and disadvantages are discussed.
An ensemble Kalman filter reanalysis has been archived in the Research Data Archive at the National Center for Atmospheric Research. It used a CAM6 configuration of the Community Earth System Model (CESM), several million observations per day, and the Data Assimilation Research Testbed (DART). The data saved from this global, [Formula: see text] resolution, 80 member ensemble span 2011-2019. They include ensembles of: sub-daily, real world, atmospheric forcing for use by all of the nonatmospheric models of CESM; weekly, CAM6, restart file sets; 6 hourly, prior hindcast estimates of the assimilated observations; 6 hourly, land model, plant growth variables, and 6 hourly, ensemble mean, gridded, atmospheric analyses. This data can be used for hindcast studies and data assimilation using component models of CESM; CAM6, CLM5, CICE5, POP2. MOM6, MOSART, and CISM; and non-CESM Earth system models. This large dataset (~ 120 Tb) has a unique combination of a large ensemble, high frequency, and multiyear time span, which provides opportunities for robust statistical analysis and use as a machine learning training dataset.
Predicting major floods during extreme rainfall events remains an important challenge. Rapid changes in flows over short timescales, combined with multiple sources of model error, makes it difficult to accurately simulate intense floods. This study presents a general data assimilation framework that aims to improve flood predictions in channel routing models. Hurricane Florence, which caused catastrophic flooding and damages in the Carolinas in September 2018, is used as a case study. The National Water Model (NWM) configuration of the WRF-Hydro modeling framework is interfaced with the Data Assimilation Research Testbed (DART) to produce ensemble streamflow forecasts and analyses. Instantaneous streamflow observations from 107 United States Geological Survey (USGS) gauges are assimilated for a period of 1 month. The data assimilation (DA) system developed in this paper explores two novel contributions, namely (1) along-the-stream (ATS) covariance localization and (2) spatially and temporally varying adaptive covariance inflation. ATS localization aims to mitigate not only spurious correlations, due to limited ensemble size, but also physically incorrect correlations between unconnected and indirectly connected state variables in the river network. We demonstrate that ATS localization provides improved information propagation during the model update. Adaptive prior inflation is used to tackle errors in the prior, including large model biases which often occur in flooding situations. Analysis errors incurred during the update are addressed using posterior inflation. Results show that ATS localization is a crucial ingredient of our hydrologic DA system, providing at least 40 % more accurate (root mean square error) streamflow estimates than regular, Euclidean distance-based localization. An assessment of hydrographs indicates that adaptive inflation is extremely useful and perhaps indispensable for improving the forecast skill during flooding events with significant model errors. We argue that adaptive prior inflation is able to serve as a vigorous bias correction scheme which varies both spatially and temporally. Major improvements over the model's severely underestimated streamflow estimates are suggested along the Pee Dee River in South Carolina, and many other locations in the domain, where inflation is able to avoid filter divergence and, thereby, assimilate significantly more observations.
While drawing upon the existing literature and policy documents on health security and its practice at the national and global levels, this article shows that the idea of health security has mostly remained rhetoric or at the most conceptualised and operationalised within the narrow Westphalian tradition of protecting nation states from external threats. By undertaking a critical examination of the national security strategies of some powerful G-20 countries, we show that non-traditional threats such as infectious diseases and pandemics are either absent from the list of potential threats or are accorded a weak priority and addressed within the state and military-centric notion of security. This approach has shortcomings that are laid bare by the ongoing pandemic. In this article, we show how national and global health security agendas can be advanced much more productively by mobilising a wider securitisation discourse that is driven by the human security paradigm as advanced by the United Nations in 1994, that considers people rather than states as the primary referent of security and that emphasises collective action rather than competition to address the transnational nature of security threats. We discuss the relevance of this paradigm in broadening the concept of health security in view of the contemporary and future threats to public health.