The Scientific World Journal

Volume 2014 (2014), Article ID 142907, 16 pages

http://dx.doi.org/10.1155/2014/142907

Research Article

High-Accuracy Approximation of High-Rank Derivatives: Isotropic Finite Differences Based on Lattice-Boltzmann Stencils

Keijo Kalervo Mattila,¹ Luiz Adolfo Hegele Júnior,² and Paulo Cesar Philippi¹

¹Laboratory of Porous Media and Thermophysical Properties, Mechanical Engineering Department, Federal University of Santa Catarina, 88040-900 Florianópolis, SC, Brazil

²Department of Petroleum Engineering, State University of Santa Catarina, 88330-668 Balneário Camboriú, SC, Brazil

Received 8 August 2013; Accepted 12 October 2013; Published 29 January 2014

Academic Editors: J. Banaś and C. Yiu

Copyright © 2014 Keijo Kalervo Mattila et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

We propose isotropic finite differences for high-accuracy approximation of high-rank derivatives. These finite differences are based on direct application of lattice-Boltzmann stencils. The presented finite-difference expressions are valid in any dimension, particularly in two and three dimensions, and any lattice-Boltzmann stencil isotropic enough can be utilized. A theoretical basis for the proposed utilization of lattice-Boltzmann stencils in the approximation of high-rank derivatives is established. In particular, the isotropy and accuracy properties of the proposed approximations are derived directly from this basis. Furthermore, in this formal development, we extend the theory of Hermite polynomial tensors in the case of discrete spaces and present expressions for the discrete inner products between monomials and Hermite polynomial tensors. In addition, we prove an equivalency between two approaches for constructing lattice-Boltzmann stencils. For the numerical verification of the presented finite differences, we introduce 5th-, 6th-, and 8th-order two-dimensional lattice-Boltzmann stencils.

1. Introduction

The approximation of derivatives by finite differences is the cornerstone of numerical computing. Forward, backward, and central differences, the five-point stencil for approximating Laplacian in a two-dimensional domain, and the numerical analysis of the convergence rate of the related approximation errors, based on the application of Taylor series, require no introduction for anyone working in the field of scientific computing.

Construction of finite-difference stencils for the approximation of high-rank derivatives in two or three dimensions, say gradient of Laplacian or biLaplacian, will already be a more advanced topic—even if achieved by solving a modest linear system of equations. A further complication is introduced when requiring an isotropic approximation of derivatives. More specifically, when the leading-order error term of the finite difference approximation is required to be an isotropic expression or, in other words, to be free of directional bias. Such a property may be essential, for example, when solving certain partial differential equations.

Conventional finite differences are not isotropic in the above sense. Isotropic finite differences of second-order accuracy for the approximation of first and second derivatives, both in two and three dimensions, together with a systematic procedure for constructing the differences, are presented in [1]. Patra and Karttunen proceed further: they present up to fourth-order accurate isotropic stencils, in two and three dimensions, for the numerical computation of second, third, and fourth derivatives [2].

In the context of lattice Boltzmann methods, isotropic finite differences have been well known for some time, mainly because of their importance in the approximation of interparticle forces in multiphase and multicomponent models. For example, in the so-called Shan-Chen multiphase model [3], as was remarked by Yuan and Schaefer [4], the originally proposed approximation of interparticle forces includes an isotropic finite-difference approximation of the gradient of the interaction potential. In fact, when the standard D2Q9 lattice-Boltzmann stencil is used, the approximation is equivalent to the one proposed by Kumar [1].

Recently new efforts were undertaken to construct, or define, isotropic finite-difference stencils by utilizing the lattice-Boltzmann method framework. Namely, in the construction of lattice-Boltzmann stencils, a set of weights and discrete velocity vectors have to be found, together with a scaling factor related to the lattice speed of sound, in such a way that these weights and velocities will fulfill isotropy conditions up to a given order—a property ensuring a correspondence between continuous and discrete moments of the equilibrium distribution functions [5–7]. For example, in [8–10], this construction procedure is adopted in order to produce isotropic finite-difference stencils: there second-order accurate approximations are presented, but the isotropy goes beyond the leading order error term.

Lee et al. present a different strategy: they propose to approximate derivatives in 2D and 3D by taking moments of the conventional 1D finite differences along the characteristic lines—the moments are isotropic finite-differences [11, 12]. In the computation of these moments, the weights, discrete velocity vectors, and the scaling factor of a lattice Boltzmann stencil are utilized. Philippi et al. present up to fourth-order accurate isotropic finite difference stencils, constructed directly with the weights and velocity vectors of a given lattice Boltzmann stencil, for the approximation of gradient, Laplacian, and gradient of Laplacian [13]. Independently of Philippi et al., but by adopting the same approach, second-order accurate isotropic finite-difference approximation of Laplacian was proposed by Thampi et al. [14]. In [15], following the work of Thampi et al., approximations for the divergence and curl were presented together with fourth-order approximations for the gradient and Laplacian.

Naturally, in both approaches by Lee and Philippi, the validity of the presented expressions for the isotropic finite differences, and their isotropy properties, depends directly on the order of isotropy fulfilled by the lattice Boltzmann stencil utilized. On the other hand, these approaches provide beauty in abstraction: expressions for the finite differences are valid regardless of dimension, and any lattice Boltzmann stencil isotropic enough can be utilized—a family of finite differences is defined with a single expression.

Here our purpose is to go further by presenting isotropic finite differences, based on the direct utilization of lattice Boltzmann stencils, for the high-accuracy approximation of high-rank derivatives. In the construction of these isotropic differences we make use of the Hermite polynomial tensors in a very similar manner in which they are used in the construction of so-called kinetic projectors. Theory of Hermite polynomial tensors was first introduced by Grad in his innovative article [16]. This formal approach allows us to have very compact and abstract expressions for the coefficients of the stencils. It also allows the isotropy and accuracy properties of the proposed approximations to be derived theoretically. After these formal developments, we resort to simple calculus and construct, hierarchically, higher-order accurate stencils for the approximation of high-rank derivatives.

First, an introduction to Hermite polynomial tensors, monomials and their properties is presented in Section 2 using a specific notation. The fundamentals of lattice-Boltzmann schemes and stencils are then introduced in Section 3. Also in this section, 5th-, 6th-, and 8th-order lattice-Boltzmann stencils for two dimensions are introduced. The theory of using Hermite polynomial tensors together with the weights, velocity vectors, and the scaling factor for the construction of isotropic differences is presented in Section 4. This is followed by the hierarchical calculus of higher-order accurate stencils in Section 5. Application of the proposed stencils is discussed in Section 6. The discussion involves explicit expressions for the coefficients of some finite-difference approximations; these coefficients are then compared with other corresponding approximations proposed in the literature. The new lattice-Boltzmann stencils, introduced in Section 3, are utilized in Section 7 for the numerical verification of the proposed finite differences. Finally, a short conclusion is presented.

2. Theoretical Background

The theory of lattice-Boltzmann method, as well as the theory of isotropic finite differences proposed in this work, relies on Hermite polynomial tensors, monomials, and their properties. In this section, these fundamental concepts are defined using a specific notation explained below. This section is strongly based on the work of Grad [16].

2.1. Notational Conventions

The presentation of explicit expressions for Hermite polynomial tensors, or the related mathematical derivations, in an unambiguous yet comprehensible way is not an easy task because the expressions involve combinations. Here we will adopt the notation used by Grad in his original article with a minor modification. Namely, let the nonstandard operation

denote summation of tensor products over all possible combinations of indices: the number of combinations is , where is the rank of the tensor products. For example,

The notation is a shorthand, and it always has precedence over all other mathematical operations and manipulations. A similar notation was recently adopted in [17] for the same purpose of facilitating mathematical treatments.

Furthermore, the subscripts with bold typesetting, and , denote separate nonempty index sets; that is, and ; denotes their union and the number of indices in each set is implied by the context. The operator is used in conjunction with these index sets: the implied summations over index combinations are only over the shared index set —the index set is considered as fixed. For example, when and ,

or when and ,

The appendix of [6] provides an alternative notation for the same operations.

With we denote the generalized Kronecker delta: these isotropic tensors are symmetric with respect to all of their subscripts. The first generalized Kronecker deltas are

Their expressions are given by the recurrence relation

The number of separate terms in the expressions for the generalized Kronecker delta, if written only by using the standard Kronecker delta symbol, is given by the so-called double factorial . For example, and involve and separate terms, respectively.

In addition, by we denote rank orthogonality tensor. The first orthogonality tensors are

More generally, is a sum of terms where each term is a product of Kronecker deltas; the sum is over permutation of the indices so that each Kronecker delta has always one index from the set and the other from . The orthogonality tensors can be defined by the recurrence relation

The tensor can also be regarded as a symmetry operator. That is, a tensor product between an arbitrary rank tensor and will extract the symmetric part of that tensor. When the arbitrary tensor is already symmetric, the product is (Einstein summation convention is applied)

Finally, a summation over index combinations can be split into two separate summations. Let and again denote arbitrary tensors, and is assumed to be a single index set. Then,

where the left-hand side involves all possible index combinations from the set .

2.2. Hermite Polynomial Tensors, Monomials, and Their Properties

Let us define a monomial tensor ; notation will always imply an argument . Hermite polynomial tensors are defined by the formula

where is a weighting function, refers to the spatial dimension, and . Like with monomials, notation will always imply an argument . Furthermore, a rank Hermite polynomial tensor is also a polynomial of degree . The explicit expressions for the first few Hermite polynomial tensors are given in Appendix A.

An important property related to the weighting function is

Equation (12) defines the moments of the weighting function; all odd order moments vanish. Clearly, (12) can also be regarded as an expression for the weighted tensorial inner product of two monomials. An analogous expression for the inner product of Hermite polynomial tensors is

This means that not only Hermite polynomial tensors of different rank are orthogonal, but also distinct polynomials of the same degree.

In fact, an explicit formula for Hermite polynomial tensors is given by a simple summation:

where and define even and odd tensors, respectively. A useful recurrence relation for Hermite polynomial tensors is

The recurrence relation is very convenient for a computer implementation of high-rank Hermite polynomial tensors. Useful mathematical tools are provided also by the two relations

2.3. Inner Products in Discrete Spaces

Above we presented weighted tensorial inner products between two monomials and between two Hermite polynomial tensors in a continuous space. However, numerical methods inherently involve discrete spaces. Hence, it is of computational interest to construct discrete representations for the continuous space admitting the above inner products. The construction of such a discrete representation is basically a quadrature problem: find the discrete weights and abscissas so that

or

is satisfied up to a given order ; in the general solution . In fact, in Appendix B we prove that a solution to either of the two quadrature problems will guarantee both (17) and (18).

Furthermore, matching the inner products of two Hermite polynomial tensors of equal rank, up to a given order , will guarantee orthogonality of the Hermite polynomial tensors in the discrete space:

In other words, the inner products of two Hermite polynomial tensors, not necessarily of equal rank, will match in the discrete and continuous spaces. This has been shown in the appendix of [5].

Now we will proceed to the discrete inner product between a monomial and a Hermite polynomial tensor. In Appendix A, explicit expressions are given for the first few monomials as linear combinations of Hermite polynomial tensors. In fact, these expressions are given by a simple summation formula:

even and odd tensors are defined by and , respectively. A proof for this summation formula is given in Appendix C. Since the Hermite polynomial tensor expansion for the monomials is now available, we find that

Inner products between and , , vanish. Note that (22) is valid only when .

3. Lattice-Boltzmann Method

The principal variable in Boltzmann model equations is the mass distribution function : the arguments , , and refer to the spatial, temporal, and microscopic velocity space, respectively. Lattice-Boltzmann methods can be directly derived from Boltzmann model equations. The first step in the derivation is to discretize the microscopic velocity space , where is a dimensionless velocity, the thermal reference velocity, the Boltzmann constant, the molecular mass of the fluid, and a reference temperature. The relevance of Hermite polynomial tensors and monomials to lattice-Boltzmann method is related to the discretization of the velocity space.

Particularly, in conventional lattice-Boltzmann schemes, the discrete velocity vectors always connect two sites of a uniform lattice; that is, is a lattice site whenever is. By and we denote the spatial spacing of a uniform lattice and the discrete time step of the temporal evolution, respectively; the lattice reference velocity . It is hence implied that , where denote appropriate dimensionless discrete velocities. The relation is called the scaling factor. The triplet , , and is called a lattice-Boltzmann stencil.

A way to construct lattice-Boltzmann stencils is to first prescribe and to assign . Moreover, the discrete velocity set is prescribed so that a vector from the set always has an opposite counterpart; that is, where index refers to the opposite vector—the zero or rest vectors are an obvious exception. The unknowns and are then defined by solving either of the two quadrature problems, (17) or (18), up to a given order . This is the method of prescribed abscissas [5]. The underlying motivation is to ensure correspondence between continuous and discrete moments of the equilibrium distribution functions. For example, the well-known stencils D2Q9 and D2V37 are of second and fourth order ( and ) [5, 18]. Specification of three lattice-Boltzmann stencils are given in Tables 1 and 2. The two-dimensional stencils are here presented for the first time: D2V49, D2V81, and D2V141 are fifth-, sixth-, and and eighth-order stencils, respectively. In Section 7 we will apply D2V141 to numerically confirm accuracy of our isotropic finite differences. Furthermore, D2V49 and D2V81 will be used in a numerical comparison of some specific finite-difference approximations.

Table 1: Specification of a fifth-order lattice-Boltzmann stencil: . The second column indicates the number of velocity vectors, obtained by permutating the vector components, sharing the given weight.

(D2V49)

,

(±1, 0)

(±1, ±1)

(±2, 0)

(±2, ±1)

(±2, ±2)

(±3, 0)

(±3, ±1)

(±3, ±3)

(±5, 0)

(±4, ±4)

Table 2: Specification of a sixth-order (D2V81) and eighth-order (D2V141) lattice-Boltzmann stencil: and , respectively. The second column indicates the number of velocity vectors, obtained by permutating the vector components, sharing the given weight.

(D2V81)
(D2V141)

(0, 0)

(±1, 0)

(±1, ±1)

(±2, 0)

(±2, ±1)

(±2, ±2)

(±3, 0)

(±3, ±1)

(±3, ±2)

(±4, 0)

(±4, ±1)

(±3, ±3)

(±4, ±2)

(±5, 0)

(±4, ±3)

—

(±5, ±1)

—

(±5, ±2)

(±4, ±4)

—

(±5, ±3)

—

(±6, 0)

—

(±6, ±1)

—

(±6, ±3)

—

(±7, 0)

—

(±7, ±2)

—

The simplest evolution equation, that is, a lattice-Boltzmann equation (LBE), for the single-particle distribution function is

where is, in general, a nonlinear collision operator. For example, will specify the famous lattice-BGK equation involving only a single relaxation time . The nonequilibrium function is defined with respect to the equilibrium function discussed below. The equilibrium function, in turn, is defined by the conserved hydrodynamic variables, that is, by the first few moments of the distribution function in the velocity space:

the local fluid density , velocity , and internal energy are the zeroth, first, and second moment of the distribution function, respectively. The above LBE results from a first-order discretization along the characteristics: higher-order discretizations are considered, for example, in [19].

A discrete equilibrium function can be specified by expanding the famous Maxwell-Boltzmann equilibrium distribution function in Hermite polynomial tensors; the expansion is truncated to a given order. For isothermal models, the resulting discrete equilibrium function is

where

is the so-called kinetic projector mapping hydrodynamic variables into a space of kinetic description; note the relation . In the next section we will base our isotropic finite-difference stencils on difference projectors: close analogs to kinetic projectors. From programming point of view, there remain three properties which deserve a note.

(1)By definition, Hermite polynomial tensors are symmetric in their subscripts.(2)The expressions for even order Hermite polynomial tensors involve only even order monomials. Hence, .(3)The expressions for odd order Hermite polynomial tensors involve only odd order monomials. Hence, .

By acknowledging these properties, whether implementing equilibrium functions based on kinetic projectors or isotropic finite differences based on difference projectors, a significant improvement in computational performance can be achieved. The number of independent components in a symmetric tensor can be obtained directly from Pascal’s triangle. For example, a general rank-eight tensor, in three dimensions, has components whereas a symmetric tensor has only independent components. Furthermore, the sum of components in general tensors up to rank eight, again in 3D, is ; the corresponding number for symmetric tensors is —a number also directly obtained from Pascal’s triangle. The second and third property together reduce the number of independent tensor components by a factor of two (but only approximately, because the discrete velocity set usually includes a zero vector, associated with the so-called rest particles, and it does not have an opposite counterpart).

4. Isotropic Finite Differences of Second-Order Accuracy

We propose to approximate partial derivatives of a function with a simple finite difference:

where the rank tensor is the difference projector storing the coefficients of the finite-difference stencil; the superscript denotes the order of accuracy of the finite difference. The second-order accurate difference projectors are the Hermite polynomial tensors multiplied by appropriate constants:

where and is the order of the lattice-Boltzmann stencil.

In order to prove the second-order accuracy of , we first Taylor-expand function at the right-hand side of (27), use the definition in (28), and change the order of summation:

Note that here the repeated index set emphasizes a full tensor contraction between and . By using the inner products presented in Section 2.3 and by acknowledging the simple relations and , we can transform the right-hand side into

Remember that the operator has precedence over all other mathematical operations and manipulations. Hence, the correct interpretation above is to first expand the summation over combinations and then enforce the tensor contractions for each term separately.

Since is clearly a symmetric tensor, we can make use of (9) and obtain , ; that is, the orthogonality tensor changes indices from set to set p. Furthermore, the contraction results in , where denotes Laplacian, denotes Laplacian of Laplacian, and so on. In fact, because involves terms, the Laplacians will be repeated an equal number of times. Finally, the summation over combinations includes terms. Hence

This is our master equation. It confirms that the difference projectors defined in (28), together with the finite difference specified in (27), result in second-order approximations for the partial derivatives . Also, (31) exposes the isotropy: with , the first leading order error terms are isotropic (Laplacian is an isotropic operator).

5. High-Order Accurate Isotropic Finite Differences

After establishing the second-order accurate finite-difference stencils, we proceed to define higher-order accurate stencils. In order to do so, we explicitly write the first few leading-order error terms of the second-order approximation:

With the above equation, it is straightforward to write higher-order difference projectors. First, the fourth-order accurate finite-difference stencils are defined with

Now by using the above fourth-order stencils, we can write the sixth-order stencils:

In a similar way, we use the sixth-order stencils in the definitions of eighth-order stencils:

Above we have defined the high-accuracy difference projectors in an hierarchical way. In practice, however, more straightforward definition might be more convenient for a computer implementation. That is, we can simply write out the expressions and get, for example,

In this way, the high-accuracy projectors are defined using only second-order accurate projectors.

The degree of isotropy in the case of high-accuracy approximation of high-rank derivatives is discussed next. First we remind the reader that denotes the rank of the derivative, is the order of the lattice-Boltzmann stencil utilized, and refers to the order of accuracy of the approximation. Then, the number of leading-order error terms which are isotropic, or the degree of isotropy, is

6. Application of the Isotropic Finite Differences

In order to elucidate the usage of the above proposed finite-differences, we will provide the coefficients of some simple stencils in their most explicit form. Let us consider a particular application where the gradient and the gradient of Laplacian of an arbitrary function must be approximated with fourth- and second-order accuracy, respectively. Furthermore, the approximations must be isotropic meaning that at least the leading-order error term is not directionally biased. In the case of the gradient, and . Hence, from (37), in order to have . The gradient of Laplacian case, and , leads to the same conclusion. That is, at least a fourth-order lattice-Boltzmann stencil must be utilized: the well-known D2V37 stencil is a candidate [5].

Directly from (27) and (28), the second-order approximations of gradient and gradient of Laplacian, in their most explicit form, are

where , the auxiliary coefficient , and . The approximation of the gradient, (38), is well known in the lattice-Boltzmann context and the approximation of the gradient of Laplacian, (39), is exactly the same as proposed in Appendix of [13]. Furthermore, using the appropriate expression from Section 5, the explicit form of the fourth-order approximation of the gradient is

where . Again, the corresponding expression given by Philippi et al. agrees with this approximation (Equation (B1) in [13] involves a mistake: (40) is the correct expression).

Our approximations are derived from the theoretical basis developed in the previous sections. In [13], Philippi et al. use a three-step procedure for constructing their stencils: the general function is Taylor-expanded, discrete moments (in the velocity space) of the Taylor expansion are computed, where the moments involve the discrete weights, and linear combinations of these moments, and , are computed so as to deliver appropriate approximations. That is, the three-step procedure allows tailored approximations which, in some cases, can be, for example, more compact than the approximations derived here. Thampi et al. proposed the same procedure [14], independently of Philippi et al., and applied it for a second-order accurate isotropic approximation of Laplacian.

As an example, let us consider second- and fourth-order accurate approximations of Laplacian. From (37), and in order to have for the two approximations, respectively. Hence, for example, the D2V17 and D2V49 stencils could be utilized. Using only (27) and (28), the explicit expressions for the second-order approximations of Laplacian an BiLaplacian () are

Then, with the appropriate expression from Section 5, the explicit form for the fourth-order approximation of the Laplacian is

where .

The corresponding second- and fourth-order approximations of Laplacian obtained with the three-step procedure, as proposed by Philippi et al., are

the same second-order approximation of Laplacian was also proposed by Thampi et al. [14]. In fact, (44) is equivalent to the approximation proposed earlier by Lee and Lin [11]. In addition, when (44) is utilized together with D2Q9, it coincides with the Mehrstellen approximation (see, e.g., [1, 2]).

Clearly, in the case of Laplacians, our approximations are not equivalent to those obtained using the three-step procedure. Moreover, the approximations given in (44) and (45) are isotropic whenever and , respectively. Hence, for example, (45) allows more compact approximations than (43): the span (or the spatial extent in an axis direction) of the fifth-order stencil D2V49 presented in Table 1 is 5 lattice spacings, whereas the span of D2V37 is only 3.

Above the explicit forms of our approximations, still valid in any dimension, are given only as examples. In the implementations, however, it is not necessary to use the explicit forms in order to reach high computational efficiency; we consider it more convenient to use the abstract definitions given in the previous sections. First, even the high-rank Hermite polynomial tensors can be easily implemented, in an hierarchical manner, using the recurrence relation of (15). For example, preprocessor directives (macros), if available in the programming language, can be used for implementing the tensors. The finite-difference coefficients, that is, components of an appropriate difference projector, can then be stored by utilizing the appropriate Hermite polynomial tensors. Due to their definitions, the difference projectors share important properties with the Hermite polynomial tensors. Namely, the difference projectors are fully symmetric in their subscripts. Also,

for even and odd , respectively. Hence, a relatively small number of finite-difference coefficients need to be stored even when approximating high-rank derivatives.

7. Numerical Experiments and Discussion

In order to verify the accuracy of the presented finite differences, we numerically compute the derivative approximations and compare them against analytical solutions. Our analytical reference function is

for which derivatives, even high rank, are easily available. The additional constant parameter is introduced as an extra degree of freedom for the numerical experiments. In order to construct a square lattice (equal lattice spacing in the - and -directions), we always define the number of lattice nodes in the -direction to be two times the number of nodes in the -direction. Numerical error of the approximations is measured with a relative -error norm:

where the summation is over all lattice nodes, denotes a numerically computed value, and is a corresponding analytical value.

First we verify the theoretical convergence rates of the approximation errors. In such a verification, the truncation errors must dominate over the round-off errors arising from the floating-point arithmetic. Hence, we use relatively small lattices: in the reported results for the convergence rates, the number of nodes in the -direction is between 15 and 60. Furthermore, we set and apply the eighth-order lattice-Boltzmann stencil D2V141, presented in Section 3, for the specification of the difference projectors. The difference projectors are defined in Sections 4 and 5. Figure 1 reports the relative -error norms for some numerical approximations: for each rank, an approximation with a difference projector of highest attainable order of accuracy is chosen. Otherwise, the approximations for the figure are randomly chosen. Figure 1 confirms the theoretical results for the chosen approximations; we have checked all the approximations and the theoretical results are indeed verified. In the approximations of high-rank derivatives, round-off errors start to dominate with larger lattice spacings than in the approximations of lower-rank derivatives—as expected.

Figure 1: Order of convergence of the numerical error for some derivative approximations. The lattice-Boltzmann stencil D2V141 has been utilized. The dashed lines indicate 2nd-, 4th-, 6th-, and 8th-order convergence.

Next we measure the computational efficiency of the approximations proposed here. For reference, we also measure the efficiency of some previously published approximations. In the approach of Lee et al. [11, 12], derivatives in 2D and 3D are approximated by taking moments of the conventional 1D finite differences along the characteristic lines. As an example, in order to have a minimal isotropic fourth-order approximation of the first derivative—only the leading-order error term is isotropic—a standard fourth-order central difference together with a third-order lattice-Boltzmann stencil can be used. It is also possible to use the third-order isotropic stencil presented in [8, 10]: has 12 nodes (without the center node) and a span of 2 lattice spacings. The fourth-order central difference together with the D2V17 and stencils will result in effective stencils of 32 and 24 nodes, respectively; the effective spans are 6 and 4 lattice spacings. In comparison, utilization of (40) requires at least a fourth-order lattice-Boltzmann stencil, for example, D2V37. Note also that it remains to be investigated whether the Lee et al. approach can be extended for the approximation of cross derivatives.

The approximations proposed by Lee et al. [11, 12], Thampi et al. [14], and by Philippi et al. [13] are equal to the approximations presented here in one important sense: expressions for the finite differences are valid regardless of dimension, and any lattice Boltzmann stencil isotropic enough can be utilized; a family of finite differences are defined with single expressions. In contrast, Patra and Karttunen presented more specified isotropic stencils for the numerical computation of second, third, and fourth derivatives [2]. In their approach, the labor of explicitly specifying the coefficients for each case is rewarded with highly compact stencils (a narrow span and a small number of nodes) (sections G and H of [2] appear to involve a mistake: we utilized the coefficients after inverting the signs. Probably the same applies also for section I).

In order to compare the computational efficiency of the aforementioned approaches, we approximate some low- and moderate-rank derivatives with second- and fourth-order accuracy. Our analytical reference function is again given by (47) and a lattice of nodes is used. The reference function values are precomputed for the lattice nodes and stored in the computer memory. For all finite-difference stencils, the computational times are measured after repeating the approximations 50 times; that is, the lattice is iterated 50 times and during each iteration the derivatives are approximated once at every node. With this repetition we aim for robust computational times. The additional parameter now evolves with the iterations: the initial value 1 is incremented by after each iteration. The purpose of evolving is to prevent aggressive compiler optimizations which may compromise the comparisons between different stencils. The reference function values are updated at a node after the approximation of the local derivative.

The computational times are measured in a computer equipped with AMD Athlon 64 X2 Dual Core Processor 5000+ (2.6 GHz and 2 GB RAM); the GNU compiler g++ (version 4.4.1) is used with the option -O3. The computational times reported in Table 3 are average values of 5 executions and given in milliseconds. The Empty load refers to the Mehrstellen case where only the actual approximation of the derivative is skipped: the relative computational times are defined with respect to the empty load. The relative times are presented also in Figure 2 for visual inspection. With the Patra and Karttunen stencils, we use in the fourth-order accurate approximations of . The leading-order error terms related to the isotropic stencils of Patra and Karttunen are (theoretically) independent of the degrees of freedom present. Note that, in the case of odd-rank derivatives, the number of nodes in Table 3 does not agree with the lattice-Boltzmann stencil utilized. This is due to our choice of omitting the zero-velocity vector from the finite-difference stencils on those particular approximations in an attempt to have a fair efficiency comparison between the schemes.

Table 3: Comparison of various approximations for low- and moderate-rank derivatives with second- and fourth-order accuracy. The computational times are given in milliseconds and the Empty load refers to the Mehrstellen case where only the actual approximation is skipped: the relative computational times are defined with respect to the empty load. References for the below compared approximations are as follows: Lee and Lin [11], Lee and Fischer [12], Patra and Karttunen [2], and Philippi et al. [13].

Nodes
Span
C. time
Rel. time
Rel. -error

Empty load
—
—
7984

—

(2nd-order approximation)

Mehrstellen

Equation (41), D2V17

(4th-order approximation)

Lee,

Lee, D2V17

Equation (40), D2V37

(2nd-order approximation)

Patra,

Patra,

Equation (39), D2V37

(4th-order approximation)

Patra,

Patra,

Philippi, D2V37

Equation (43), D2V49

(2nd-order approximation)

Patra,

Patra,

Equation (42), D2V49

(4th-order approximation)

Patra,

Patra,

Section 5, D2V81

(a)

(b)

Figure 2: The relative computational times of Table 3 in a graphical format. On the right, the relative times are plotted as functions of the number of nodes in the finite-difference stencils; the line indicates a linear fit. References for the above compared approximations are as follows: Lee et al. [11, 12], Patra and Karttunen [2], and Philippi et al. [13].

Our first observation is that even the heaviest approximation, utilizing the D2V81 stencil, requires only about 41% more computing time than that of the empty load. In many applications the approximations of derivatives are only a part of the computation: the relative computation times measured suggest that the isotropic derivative approximations do not necessarily introduce a large overhead into the total computing time. Be that as it may, the relative computing times measured appear to be in-line with those reported in [2].

On the other hand, the comparison of relative times between various approximations reveals large differences. In fact, the relative computing times seem to depend linearly on the number of nodes in the finite-difference stencil. The right part of Figure 2 presents a linear fit to the computing times. Furthermore, the stencil with the smallest span among the candidates consistently produces the most accurate approximation. In summary, our observations indicate that compact finite-difference stencils with a small number of nodes are to be preferred. Hence, from strictly a computational efficiency point of view, the approximations proposed in this work are suboptimal and this can be attributed to their generality. At the same time, the generality is also the major asset: it allows a straightforward construction of high-accuracy, isotropic approximations of high-rank derivatives. An interesting compromise between efficiency and generality might be feasible by combining the Philippi et al. approach with the isotropic (nonlattice-Boltzmann) stencils presented in [8–10]—this possibility warrants further investigation.

In our last numerical experiments, we validate the theoretically derived isotropy properties of the finite-difference stencils. This is done by approximating solutions of the diffusion equation in a two-dimensional case: the local concentration is the dynamic variable and the constant diffusion coefficient. Here we will use . For an unbounded domain and when the initial condition is given by a point impulse , the analytical solution for the concentration is

where is the distance from the point impulse. To compute numerical solutions, we approximate the Laplacian with a finite-difference stencil and then treat the resulting ordinary differential equation using the standard second-order Runge-Kutta scheme with the midpoint rule. We execute the computations on a grid and the grid spacing is set to ; the point impulse is located at the center of the domain. The numerical computations are initialized with the analytical field evaluated at time .

The numerical solutions are advanced until with a constant time step after which the local relative errors are measured with respect to the analytical solution. Note that the purpose is to investigate the isotropy properties of the finite-difference stencils. Hence, due to the relatively low-order numerical time-integration scheme, the time step has to be small enough in order to allow spatial discretization errors to dominate over the temporal discretization errors. This is especially true for the high-order accurate finite-difference approximations. Figure 3 presents the local relative errors for four different second-order accurate finite-difference approximations of the Laplacian. For visualization purposes, the local errors are presented only for the domain . The errors for two of them, (a) the standard five-point stencil and (b) (41) with D2Q9, are anisotropic while for (c) the Mehrstellen approximation and (d) (41) with D2V17 the errors are isotropic. The local relative errors hence confirm the theoretically predicted isotropy properties.

Figure 3: Isocontours of the local relative errors when numerical solutions of the diffusion equation are computed using second-order accurate finite-difference approximations for the Laplacian. The errors are anisotropic for two of the approximations, (a) the standard five-point stencil and (b) (41) with D2Q9, while for the remaining two, (c) the Mehrstellen approximation and (d) (41) with D2V17, the errors are isotropic. The numerical results conform with the theoretical predictions. The colors are not scaled between the approximations.

Similarly, Figure 4 presents the local errors for fourth-order accurate finite-difference approximations. For (a) the standard nine-point stencil, (c) (45) with D2V37, and (d) Patra and Karttunen () the errors conform with the theoretical predictions. The error for (b) (43) with D2V37 is isotropic: this is not in accordance with the prediction from (37). In general, according to (37), the proposed fourth-order approximation of Laplacian with a fourth-order LB stencil is anisotropic. However, occasionally LB stencils fulfill particular isotropy conditions beyond their order of construction. This can perhaps explain the observed, positive anomaly but, nevertheless, further investigation is needed to explain the observation. Figure 5 presents the errors for sixth- and eighth-order approximations and, again, the numerical results conform with the theory. In summary, the numerical results verify the theoretically derived isotropy properties, particularly (37), with the above-discussed exception.

Figure 4: See the caption of Figure 3. The anisotropic error for (a) the standard nine-point stencil and the isotropic errors for (c) (45) with D2V37 and (d) Patra and Karttunen () conform with the theoretical predictions. The error for (b) (43) with D2V37 is isotropic: this is not in accordance with the prediction from (37). The colors are not scaled between the approximations.

Figure 5: See the caption of Figure 3. The error for the sixth-order approximation for (a) Section 5 with D2V81 is slightly anisotropic while for (b) Section 5 with D2V141 the error is isotropic. The error for the eighth-order approximation for (c) Section 5 with D2V141 also exhibits small anisotropic patterns. The theoretically predicted isotropy properties are hence numerically confirmed. The colors are not scaled between the approximations.

8. Conclusions

We have presented, and numerically verified, finite differences based on application of lattice-Boltzmann stencils. In particular, high-order accurate isotropic approximations for high-rank derivatives are presented. The expressions for finite differences are valid in arbitrary dimensions, particularly in two and three dimensions, and any lattice Boltzmann stencil isotropic enough can be utilized.

The isotropy and accuracy properties of the proposed approximations are derived directly from the theoretical basis developed in this work. For the numerical verification of the presented theory, we introduced 5th-, 6th-, and 8th-order two-dimensional lattice-Boltzmann stencils. Moreover, in the construction of the finite differences, we extended the theory of Hermite polynomial tensors in discrete spaces. First, we proved the equivalency between two approaches for constructing lattice-Boltzmann stencils. Secondly, we presented the expressions for discrete inner products between monomials and Hermite polynomial tensors. These inner products can be useful tools, for example, in the Chapman-Enskog analysis of lattice-Boltzmann schemes and, more generally, in any numerical analysis involving functions expanded in Hermite polynomial tensors.

Finally, the isotropic finite-difference approximations appear to be more stable than their anisotropic counterparts. Hence, an analytical and numerical investigation on stability properties of isotropic finite differences is a relevant research topic for the future.

Appendices

A. Hermite Polynomial Tensors and Monomials

Using the notation presented in Section 2.1, the explicit expressions for the first few Hermite polynomial tensors are , , and

Note that, for example, in the last expression above the second, third, and fourth terms at the right-hand side involve summation of 28, 70, and 28 tensor products, respectively. Furthermore, the expressions for even and odd rank Hermite polynomial tensors involve only even and odd rank monomials, respectively.

In a similar way, monomials can be expressed as linear combinations of Hermite polynomial tensors. By using the explicit expressions for the Hermite polynomial tensors presented above, the first few monomials can be written as

Above we have used the identities , , and repeatedly in the derivation. The expressions for even and odd rank monomials include only even and odd rank Hermite polynomial tensors, respectively.

B. Proof of Equivalency between Quadrature Problems

We prove that a solution to either of the two quadrature problems, (17) or (18), will also be solution to the other one (up to the same order). First we assume a solution and for , obtained by solving the system of equations arising from (18). That is, (18) holds for , where is the given order. Next we write the tensor product of monomials in terms of Hermite polynomial tensors in a specific way:

where the polynomial tensor coefficients are left undetermined. Then we substitute this expression into the right-hand side of (17) and obtain

With the solution for (18), we can equate the right-handside of the above equation to

Because expression (B.1) is true for every , it is especially true for . Hence, we can use expression (B.1) in (B.3) to obtain the left-hand side of (17) which concludes the first half of our proof. In other words, the solution to (18) will also satisfy (17) for ; that is, the inner products of the monomials in discrete and continuous space will be also matched. In the second half of the proof it is shown that the solution to (17) will also satisfy (18). The proof proceeds in exactly the same way as the first half above and, hence, is not shown here.

C. Proof of the Summation Formula for the Monomials

We use induction to prove (20). The expansion is valid for and . Then, by first using the induction assumption and (15),

By rearranging the terms on the right-hand side we get

which, after applying (6), becomes

Finally, we use (10) and arrive at

The expansion terminates properly, and hence we have completed the induction.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Acknowledgments

Petrobras funding is gratefully acknowledged.

References

A. Kumar, “Isotropic finite-differences,” Journal of Computational Physics, vol. 201, no. 1, pp. 109–118, 2004.

M. Patra and M. Karttunen, “Stencils with isotropic discretization error for differential operators,” Numerical Methods for Partial Differential Equations, vol. 22, no. 4, pp. 936–953, 2006.

X. Shan and H. Chen, “Lattice Boltzmann model for simulating flows with multiple phases and components,” Physical Review E, vol. 47, no. 3, pp. 1815–1819, 1993.

P. Yuan and L. Schaefer, “Equations of state in a lattice Boltzmann model,” Physics of Fluids, vol. 18, no. 4, Article ID 042101, 2006.

P. C. Philippi, L. A. Hegele, L. O. E. Dos Santos, and R. Surmas, “From the continuous to the lattice Boltzmann equation: the discretization problem and thermal models,” Physical Review E, vol. 73, no. 5, Article ID 056702, 2006.

X. Shan, X.-F. Yuan, and H. Chen, “Kinetic theory representation of hydrodynamics: a way beyond the Navier-Stokes equation,” Journal of Fluid Mechanics, vol. 550, pp. 413–441, 2006.

H. Chen, I. Goldhirsch, and S. A. Orszag, “Discrete rotational symmetry, moment isotropy, and higher order lattice Boltzmann models,” Journal of Scientific Computing, vol. 34, no. 1, pp. 87–112, 2008.

X. Shan, “Analysis and reduction of the spurious current in a class of multiphase lattice Boltzmann models,” Physical Review Letters E, vol. 73, no. 4, Article ID 047701, 2006.

G. Falcucci, G. Bella, G. Chiatti, S. Chibbaro, M. Sbragaglia, and S. Succi, “Lattice Boltzmann models with mid-range interactions,” Communications in Computational Physics, vol. 2, no. 6, pp. 1071–1084, 2007.

M. Sbragaglia, R. Benzi, L. Biferale, S. Succi, K. Sugiyama, and F. Toschi, “Generalized lattice Boltzmann method with multirange pseudopotential,” Physical Review E, vol. 75, no. 2, Article ID 026702, 2007.

T. Lee and C.-L. Lin, “A stable discretization of the lattice Boltzmann equation for simulation of incompressible two-phase flows at high density ratio,” Journal of Computational Physics, vol. 206, no. 1, pp. 16–47, 2005.

T. Lee and P. F. Fischer, “Eliminating parasitic currents in the lattice Boltzmann equation method for nonideal gases,” Physical Review E, vol. 74, no. 4, Article ID 046709, 2006.

P. Philippi, K. Mattila, D. Siebert, L. dos Santos, L. Hegele Jr, and R. Surmas, “Lattice-Boltzmann equations for describing segregation in non-ideal mixtures,” Journal of Fluid Mechanics, vol. 713, pp. 564–587, 2012.

S. Thampi, S. Ansumali, R. Adhikari, and S. Succi, “Isotropic discrete Laplacian operators from lattice hydrodynamics,” Journal of Computational Physics, vol. 234, no. 1, pp. 1–7, 2013.

R. Ramadugu, S. Thampi, R. Adhikari, S. Succi, and S. Ansumali, “Lattice differential operators for computational physics,” Europhysics Letters, vol. 101, no. 5, article 50006, 2013.

H. Grad, “Note on N-dimensional hermite polynomials,” Communications on Pure and Applied Mathematics, vol. 2, no. 4, pp. 325–330, 1949.

J. Shim and R. Gatignol, “How to obtain higher-order multivariate Hermite expansion of Maxwell-Boltzmann distribution by using Taylor expansion?” Zeitschrift für Angewandte Mathematik und Physik, vol. 64, no. 3, pp. 473–482, 2013.

Y. Qian, D. d’Humi’eres, and P. Lallemand, “Lattice BGK models for navier-stokes equation,” Europhysics Letters, vol. 17, no. 6, article 479, 1992.

K. Mattila, D. Siebert, L. Helege Jr., and P. Philippi, “High-order lattice-Boltzmann equations and stencils for multiphase models,” International Journal of Modern Physics C, vol. 24, no. 12, Article ID 1340006, 2013.