Previous approaches to dispatching nuclear integrated energy systems (NIES) have focused on the profitability and flexibility of these systems to operate on energy grids with highly variable pricing. However, due to the complexity involved in modeling and designing these systems, there has been less emphasis on ensuring that these dispatch strategies are physically achievable. It is imperative to develop methods that allow the system to remain within the desired NIES operating conditions and perform this based on realistic limited forecasted information. This research employs next generation artificial intelligence, namely deep reinforcement learning (DRL), and a dynamic system model written in Modelica to find a safe and profitable dispatch strategy for a solar nuclear hybrid design. The DRL agent is shown to find a novel dispatch strategy that manages both power ramping and power levels while respecting operational limits. This DRL-based dispatch is compared to other dispatching strategies including an optimal design solution from mixed integer linear programming (MILP). It is found that incorporating the physics of such a tightly coupled NIES limits the profitability of the MILP-based dispatch strategy. As a result, the MILP solution overestimates the design’s generated revenue. In contrast, DRL significantly reduces the number of breaches of safe operational conditions during energy arbitrage while maintaining profitability. This work paves the way for a more detailed assessment of NIES profitability and could be used to aid operator decisions on future NIES projects.
A heat pipe integrated thermal battery system has been constructed to investigate a high-temperature latent heat thermal energy storage technology that takes advantage of near isothermal operation of latent heat storage and heat pipes to potentially enable high-energy isothermal heat storage. A dynamic model constructed in Modelica has been validated, showing errors between 2.5 degrees C-39.7 degrees C across 10-h to 47-h simulations against experiment results, showing good prediction capability of experiment output, especially against phase change time. Model calibrations showing vessel heat-up capability of 3 kW and heat pipes combining to provide 600 W each during experiment operation validate experiment circumstances including reduced material loading and reduced power capability. The experiment configuration uses an Al-Mg-Zn eutectic metal as the storage material, heated via heat tape wrapped around the vessel and guide tubes to bring the system to operation range (>400 degrees C) and to simulate charging heat exchange, respectively, with heat rejection occurring through the surfaces of the material and facilitated via guide tubes with less insulation wrapping. The model is available in the open-source repository HYBRID on Github.
To decarbonize their industrial facilities, The Dow Chemical Company has collaborated with Idaho National Laboratory (INL) to study the integration of nuclear power with an industrial chemical facility. Using Holistic Energy and Resource Optimization Network developed at INL for optimizing and analyzing integrated energy systems, a nuclear microreactor system was sized and evaluated for dynamic dispatch to Dow Silicones Corporation's Carrollton, KY (USA) site for siloxane production. It was found that a 180 MWth system (12 x 15MWth) with 75.1 MWhth of thermal energy storage could provide heat and power to the chemical facilities. In the process, this would reduce electricity imports by 99.9 % and reduce the Scope 1 and 2 emissions of the site by 292,100 tonnesCO2 /yr (98.8 %). The primary novelty of this work is a first of a kind design and optimization of a microreactor powered integrated energy system to provide heat and power to a chemical plant using real plant data. This analysis will pave the way for future studies using dispatchable clean energy sources to reduce carbon emissions and commodity industries' reliance on fossil fuels.
The ability of nuclear reactors to operate their power conversion cycles more flexibly will enhance their value to energy grids with variable pricing. Current nuclear control systems are typically classical controllers that are often based on proportional-integral-derivative (PID) control. This paper presents a method of augmenting the existing PID control for difficult transient operations in nuclear power plants using a reinforcement learning-derived feedforward signal applied in real time. The agents, which are trained on a test thermal load-following problem, are designed to improve steam generator outlet temperature control for a range of fast load-following scenarios covering ramp rates from 9%/min to 15%/min.Several reinforcement learning algorithms were initially investigated for the training of the feedforward agents with deep Q-learning (DQN) and proximal policy optimization (PPO) networks, which were found to be the most promising. The DQN controllers utilize discrete actions, giving them a better disturbance rejection at steady state but inconsistent response to initial temperature deviations. In contrast, PPO-trained agents, which take continuous actions except for a dead zone around zero, were shown to have the best combination of high disturbance rejection at steady state and good tracking of the desired temperature value. The ability of the PPO agent was also examined, with the average time of decision making found to be on the order of 1 ms.The fault properties of the controller under the loss of the reinforcement learning agent feedforward signal were also examined. The controller showed strong performance in situations of "no-signal" faults. but was less good at handling "stuck-at" faults, where the feedforward signal remains at a set value. In both cases, however, the PID was able to successfully maintain stability, eventually returning the system to a steady state. It is hoped that this work will allow for the proposed control architecture to be examined for more difficult control problems such that it may eventually be used to adapt existing nuclear plants for more aggressive load-following on grids of the future.
Nuclear microreactors have the potential to provide heat and power to remote communities around the world. Thermodynamic designs for two nuclear-powered remote microgrid systems were modeled balancing thermal and electrical production and consumption and evaluating different equipment configurations; optimal selection of equipment and the resulting dynamic energy distribution were calculated to minimize capital investment and simultaneously reduce reliance on emitting sources, using Holistic Energy Resource Optimization Network (HERON), a technoeconomic optimization tool. The systems use a microreactor coupled to a thermal energy storage system to provide heat and power for a remote microgrid. Using HERON, an integrated energy system (IES) designed to provide electricity and district heating for the town of Nome, Alaska was found to have optimal reactor size of 11.39 MWth and optimal thermal energy storage (TES) sizes of 17.64 MWhth. Another IES was designed to provide electricity, district heating, and power for a synthetic liquid hydrocarbon fuels plant for the remote Antarctic McMurdo research station was found to have an optimal reactor and TES sizes of 124.6 MWth and 21.6 MWhth, respectively. The results from the HERON models for both scenarios were validated using physics based dynamic models developed in the Modelica language. The dynamic models matched reasonably well with the dispatch from HERON, with improved accuracy for scenarios with lower variability. This paper expands upon previous work on nuclear microgrid IES optimization, which examined deployment of a microreactor based Integrated Energy System for electricity production and desalination on the island of El Hierro, Spain.
With the ongoing push to decarbonize energy use and especially greenhouse gas emissions across all sectors, there are incentives to investigate how nuclear reactors may be used to generate clean energy and be used in various energy economies beyond just the electrical grid. Two initial integrations, high temperature steam electrolysis (HTSE) and oil refineries, are investigated in this first DOE Integrated Energy Systems (IES) program detailed industrial integration design report. Increasingly detailed reports are anticipated both for the industries discussed in this report and for additional industries in the future of the program. This report is a robust starting point showing how integration thermodynamic analysis establishes the requirements on the reactor and methods by which those requirements can be evaluated for specific reactor designs. Two Advanced Reactor Demonstration Program awardees are selected as representative designs for their respective technologies: NuScale for light-water reactors (LWRs) and X-Energy for high temperature gas reactors (HTGRs). Other reactor technologies or specific reactor configurations would require specific analysis similar to what is done in this report, thus this report can be a reference point by which to extend this work to other nuclear plant designs.
Potential competing interests: No potential competing interests to declare.The prompt for this review indicates I should be thorough, constructive
Advanced nuclear power plants are well-positioned for future zero-carbon grids, however, the need for flexible power generation will be required over the traditional emphasis on baseload generation for meeting historical demands. To achieve such flexibility, this work examines viable configurations for coupling nuclear energy production with thermal energy storage. Previous designs on nuclear-thermal energy storage configurations for advanced reactor designs, which utilized reactor steam as the heat source for charging the thermal energy storage, are restricted by the heat diversion ratio and efficiency losses, thus their impacts can be limited. In this context, this study proposes configurations for fully decoupling the nuclear reactor from the power cycle and positioning the storage as an intermediate loop, thereby achieving an unconstrained heat diversion ratio and improved efficiency. Compared with a standard high-temperature gas-cooled reactor's power cycle, steady-state thermodynamic modeling and dispatch optimizations quantify the benefits of a steam reheat cycle within the fully decoupled thermal energy system to separate the plant cycle from the high-pressure primary side. These benefits are further detailed, compatible with required high-temperature and high-pressure conditions, through (1) open-source dynamic transient models that examine the impact of off-design operation on the systems, (2) the investigation of components design and costing and finally (3) sizing and dispatch optimization. The fullydecoupled design achieves a cycle efficiency of 43.1%, an enhancement over the vendor's standard efficiency of 42.2% (Xe-100 design). The proposed design offers strengthened physical barriers from the nuclear island as well as superior operational flexibility and power boosting. Dispatch optimization and market analysis reveal that thermal energy storage size is highly dependent on the peak patterns of electricity prices and the minimum generation level constraint imposed on the balance of plant. Evaluation of off-design operation demonstrates that the full decoupling design with the suggested fail-safe control mechanisms ensures a minimal impact on reactor parameters, even during rapid power ramping.
Nuclear microreactors are a potential technology to provide heat and electricity for remote microgrids. There is potential for the microgrid on the island of El Hierro to use a microreactor, within an integrated energy system (IES), to generate electricity and provide desalinated water. This work proposes a workflow for optimizing and analyzing IESs for microgrids. In this study, an IES incorporating a microreactor, thermal energy storage (TES) system, combined heat and power plant, and a thermal desalination plant was designed, optimized, and analyzed using Idaho National Laboratory’s Framework for Optimization of Resources and Economics (FORCE) toolset. The optimization tool, Holistic Energy Resource Optimization Network (HERON), was used to determine the optimal capacity sizes and dispatch for the reactor and thermal energy storage systems to meet demand. The optimized reactor and TES sizes were found to be 11.61 MWth and 58.47 MWhth, respectively, when optimizing the IES to replace 95% of the island’s existing diesel generation needs. A dynamic model of the system was created in the Modelica language, using models from the HYBRID repository, to analyze and verify the dispatch from the optimizer. The dynamic model was able to meet the ramp rates while maintaining reactor power with minimal control adjustments.