The Swift–Hohenberg equation is a widely studied fourth-order model, originally proposed to describe hydrodynamic fluctuations. It admits an energy-dissipation law and, under suitable assumptions, bounded solutions. Many structure-preserving numerical schemes have been proposed to retain such properties; however, existing approaches are often fully implicit and therefore computationally expensive. We introduce a simple design principle for constructing dissipation-preserving finite difference schemes and apply it to the Swift–Hohenberg equation in three spatial dimensions. Our analysis relies on discrete inequalities for the underlying energy, assuming a Lipschitz continuous gradient and either convexity or μ-strong convexity of the relevant terms. The resulting method is linearly implicit, yet it preserves the original energy-dissipation law, guarantees unique solvability, ensures boundedness of numerical solutions, and admits an a priori error estimate, provided that the time step is sufficiently small. To the best of our knowledge, this is the first linearly implicit finite difference scheme for the Swift–Hohenberg equation for which all of these properties are established.
Multi-symplectic diamond schemes proposed by McLachlan and Wilkins (2015) provide a framework for the numerical integration of Hamiltonian partial differential equations, combining local implicitness with high-order accuracy and discrete multi-symplectic conservation laws. Despite these advantages, their behavior beyond a limited class of model equations remains poorly understood, and numerical difficulties may arise depending on the underlying multi-symplectic formulation. In this paper, we present a systematic stability analysis framework for diamond schemes applied to general multi-symplectic PDEs. The approach consists of three stages. First, we identify structural inconsistency of the local diamond update using Dulmage–Mendelsohn decomposition, revealing cases in which the scheme is intrinsically unsolvable. Second, we introduce a graph-based error-propagation analysis that yields a necessary stability condition by detecting negative cycles in a weighted directed graph. Third, for equations that pass the preliminary tests, we derive eigenvalue-based timestep restrictions providing sufficient conditions for stability. The analysis leads to a comprehensive classification of multi-symplectic PDEs according to whether diamond schemes are structurally inconsistent, unconditionally unstable, or conditionally stable. In particular, we show that benchmark equations such as the Korteweg–de Vries equation are intrinsically incompatible with the diamond update, while systems including the nonlinear Dirac and “good” Boussinesq equations admit stability regimes under mild timestep scaling. Extensive numerical experiments confirm the theoretical predictions and demonstrate the practical implications of the proposed framework. Our results clarify fundamental limitations of diamond schemes and provide practical guidelines for their reliable application to new PDE models.
This paper is a short introduction to numerical methods using the double exponential (DE) transformation, such as tanh-sinh quadrature and DE-Sinc approximation. The DE-based methods for numerical computation have been developed intensively in Japan and the objective of this paper is to describe their history in addition to the underlying mathematical ideas.
Designing and analyzing optimization methods via continuous-time models expressed as ordinary differential equations (ODEs) is a promising approach for its intuitiveness and simplicity. A key concern, however, is that the convergence rates of such models can be arbitrarily modified by time rescaling, rendering the task of seeking ODEs with “fast” convergence meaningless. To eliminate this ambiguity of the rates, we introduce the notion of the essential convergence rate. We justify this notion by proving that, under appropriate assumptions on discretization, no method obtained by discretizing an ODE can achieve a faster rate than its essential convergence rate.
Numerical schemes that conserve invariants have demonstrated superior performance in various contexts, and several unified methods have been developed for constructing such schemes. However, the mathematical properties of these schemes remain poorly understood, except in norm-preserving cases. This study introduces a novel analytical framework applicable to general energy-preserving schemes. The proposed framework is applied to Korteweg-de Vries (KdV)-type equations, establishing global existence and convergence estimates for the numerical solutions.
The target of this study is a norm-conservative scheme for the Ostrovsky equation, as its mathematical analysis has not been addressed. First, the existence and uniqueness of its numerical solutions are demonstrated. Subsequently, a convergence estimate in the two-norm is established. This, in turn, implies a convergence in the first-order Sobolev space using a supplementary sup-norm boundedness argument. Finally, this conservative scheme can be implemented in a differential form, which is considerably better than the integral form in terms of computational cost-effectiveness.
Numerical integrators which conserve invariants of original differential equations are called conservative integrators. While most of them are computationally expensive, a cheaper class is the projection methods, where conservation is realized by simple projections. However, such methods do not necessarily preserve affine invariance originally held in differential equations. In this study, we point out several affine-invariant projections and discuss how the affine invariance affects the quality of numerical solutions.
The ordinary differential equation (ODE) models of optimization methods allow for concise proofs of convergence rates through discussions based on Lyapunov functions. The weak discrete gradient (wDG) framework discretizes ODEs while preserving the properties of convergence, serving as a foundation for deriving optimization methods. Although various optimization methods have been derived through wDG, their properties and practical applicability remain underexplored. Hence, this study elucidates these aspects through numerical experiments. Particularly, although wDG yields several implicit methods, we highlight the potential utility of these methods in scenarios where the objective function incorporates a regularization term.
Furihata and Matsuo proposed in 2010 an energy-conserving scheme for the Zakharov equations, as an application of the discrete variational derivative method (DVDM). This scheme is distinguished from conventional methods (in particular the one devised by Glassey in 1992) in that the invariants are consistent with respect to time, but it has not been sufficiently studied both theoretically and numerically. In this study, we theoretically prove the solvability under the loosest possible assumptions. We also prove the convergence of this DVDM scheme by improving the argument by Glassey. Furthermore, we perform intensive numerical experiments for comparing the above two schemes. It is found that the DVDM scheme is superior in terms of accuracy, but since it is fully-implicit, the linearly-implicit Glassey scheme is better for practical efficiency. In addition, we proposed a way to choose a solution for the first step that would allow Glassey's scheme to work more efficiently.
Nesterov's acceleration in continuous optimization can be understood in a novel way when Nesterov's accelerated gradient (NAG) method is considered as a linear multistep (LM) method for gradient flow. Although the NAG method for strongly convex functions (NAG-sc) has been fully discussed, the NAG method for $L$-smooth convex functions (NAG-c) has not. To fill this gap, we show that the existing NAG-c method can be interpreted as a variable step size LM (VLM) for the gradient flow. Surprisingly, the VLM allows linearly increasing step sizes, which explains the acceleration in the convex case. Here, we introduce a novel technique for analyzing the absolute stability of VLMs. Subsequently, we prove that NAG-c is optimal in a certain natural class of VLMs. Finally, we construct a new broader class of VLMs by optimizing the parameters in the VLM for ill-conditioned problems. According to numerical experiments, the proposed method outperforms the NAG-c method in ill-conditioned cases. These results imply that the numerical analysis perspective of the NAG is a promising working environment, and considering a broader class of VLMs could further reveal novel methods.
A sequence of solutions generated by a continuous optimization method can be associated with a solution trajectory of the continuous dynamical system obtained by the continuous limit of step sizes being 0. Such dynamical systems can contain Hessians even when the original optimization methods do not. In this paper, we show the convergence rate of such dynamical systems via the method of Lyapunov functions and argue their optimality.
The differential equation (DE) approach for convex optimization, which relates optimization methods to specific continuous DEs with rate-revealing Lyapunov functionals, has gained increasing interest since the seminal paper by Su--Boyd--Candès (2014). However, the approach still lacks a crucial component to make it truly useful: there is no general, consistent way to transition back to discrete optimization methods. Consequently, even if we derive insights from continuous DEs, we still need to perform individualized and tedious calculations for the analysis of each method. This paper aims to bridge this gap by introducing a new concept called ``weak discrete gradient'' (wDG), which consolidates the conditions required for discrete versions of gradients in the DE approach arguments. We then define abstract optimization methods using wDG and provide abstract convergence theories that parallel those in continuous DEs. We demonstrate that many typical optimization methods and their convergence rates can be derived as special cases of this abstract theory. The proposed unified discretization framework for the differential equation approach to convex optimization provides an easy environment for developing new optimization methods and achieving competitive convergence rates with state-of-the-art methods, such as Nesterov's accelerated gradient.
We propose a new unified framework for describing and designing gradient-based convex optimization methods from a numerical analysis perspective. There the key is the new concept of weak discrete gradients (weak DGs), which is a generalization of DGs standard in numerical analysis. Via weak DG, we consider abstract optimization methods, and prove unified convergence rate estimates that hold independent of the choice of weak DGs except for some constants in the final estimate. With some choices of weak DGs, we can reproduce many popular existing methods, such as the steepest descent and Nesterov's accelerated gradient method, and also some recent variants from numerical analysis community. By considering new weak DGs, we can easily explore new theoretically-guaranteed optimization methods; we show some examples. We believe this work is the first attempt to fully integrate research branches in optimization and numerical analysis areas, so far independently developed.
Some continuous optimization methods can be regarded as numerical methods applied to ordinary differential equations, and attempts to derive and analyze optimization methods from this perspective have been made for quite a long time. In this study, along this line of research we point out a possibly overlooked simple fact that by carefully observing the relationship between the convergence of optimization methods and the stability of numerical methods, we can construct an efficient optimization method based on certain numerical methods with extremely wide stability domain.
Some continuous optimization methods can be connected to ordinary differential equations (ODEs) by taking continuous limits, and their convergence rates can be explained by the ODEs. However, since such ODEs can achieve any convergence rate by time scaling, the correspondence is not as straightforward as usually expected, and deriving new methods through ODEs is not quite direct. In this letter, we pay attention to stability restriction in discretizing ODEs and show that acceleration by time scaling basically implies deceleration in discretization; they balance out so that we can define an attainable unique convergence rate which we call an "essential convergence rate".
A new multi-symplectic formulation of the two-component Camassa-Holm equation (2CH) is presented, and the associated local conservation laws are shown to correspond to certain well-known Hamiltonian functionals. A multi-symplectic discretisation based on this new formulation is exemplified by means of the Euler box scheme. Furthermore, this scheme preserves exactly two discrete versions of the Casimir functions of 2CH. Numerical experiments show that the proposed numerical scheme has good conservation properties.
The short pulse equation was introduced by Schäfer–Wayne (2004) for modeling the propagation of ultrashort optical pulses. While it can describe a wide range of solutions, its ultrashort pulse solutions with a few cycles, which the conventional nonlinear Schrödinger equation does not possess, have drawn much attention. In such a region, the solutions can become quite close to a singularity, and thus existing numerical methods cease to work stably, or even if they do, they require high computational cost. In this paper, we propose a robust numerical integration method which is obtained by combining a hodograph transformation and some structure-preserving methods. The resulting scheme successfully works even when the singularity occurs, and thus gives a highly robust method for resolving near singular solutions of interest. It is confirmed by numerical experiments, and some new insights about derivative blow-up are obtained.
Recently, various evolutionary partial differential equations (PDEs) with a mixed derivative have been emerged and drawn much attention. Nonetheless, their PDE-theoretical and numerical studies are still in their early stage. In this paper, we aim at the unified framework of numerical methods for such PDEs. However, due to the presence of the mixed derivative, we cannot discuss numerical methods without some appropriate reformulation, which is mathematically challenging itself. Therefore, we first propose a novel procedure for the reformulation of target PDEs into a standard form of evolutionary equations. This contribution may become an important basis not only of numerical analysis, but also of PDE-theory. In order to illustrate this point, we establish the global well-posedness of the sine-Gordon equation. After that, we classify and discuss the spatial discretizations based on the proposed reformulation technique. As a result, we show the average-difference method is suitable for the discretization of the mixed derivative.