4.4 Approximation by Polynomial Functions
4.4.1 The Extended ABM Algorithm
Now present the so-called extended ABM algorithm and discuss its properties.
Algorithm 24: Extended ABM Algorithm
Input: A tuple of ane points X = [p1, ..., ps] with pi∈ Cn, V = [v1, ..., vs] with vi∈ C and kVk > εmachine, small numbers ε ≥ 0, 0 ≤ τ < kVk, D ∈ N such that D < s, and a degree compatible term ordering σ on Tn
Output: An approximate O-border basis G, a list H of polynomials (see Theorem 4.4.3 for details)
1 d := 1, O := [1], G := [ ], H := [ ], M := (1, ..., 1)tr∈ Mats,1(C);
2 L := [t1, ..., t`] = all terms of degree 1 ordered decreasingly w.r.t. σ;
3 repeat
4 for i := 1 to ` do
5 m := |O|;
// We assume that O = [om, ..., o1]
6 A := (evalX(ti) , M );
7 B := A∗A;
8 γ := smallest eigenvalue of B ;
9 if √
γ ≤ ε then
10 s := (sm+1, sm, ..., s1) := norm one eigenvector of B w.r.t. to γ ;
11 g := sm+1ti+ smom+ ... + s1o1;
12 G := concat(G, [g]);
13 else
14 s := (sm+1, sm, ..., s1) = solution of the least squares problem mins
As − Vtr
(compare algorithms in Section 2.11);
15 if As − Vtr
≤ τ then
16 h := sm+1ti+ smom+ ... + s1o1;
17 H := concat(H, [h]);
18 end
19 O := concat([ti] , O);
20 M := A;
21 end
22 end
23 d := d + 1;
24 L := [t1, ..., t`] := all terms of degree d in ∂O ordered decreasingly w.r.t. σ;
25 until L = [ ] or d > D;
26 return (G, O, H);
Theorem 4.4.3. This algorithm computes three sets G = {g1, ..., gν}, O = {t1, ..., tµ}, and H = {h1, ..., hκ} which have the following properties:
1. All the polynomials in G are unitary and generate an ε-approximate vanishing ideal of X.
2. There is no unitary polynomial in hOiC which vanishes ε-approximately on X.
3. For all polynomials hi in H we have kevalX(hi) − Vk ≤ τ .
4. The condition number κ of the inhomogeneous least squares problem which is solved in line 14 is bounded by
s · kXkDmax
ε + s · kXkDmax ε
!2s
1 −(kVk − τ )2 kVk2
kVk − τ kVk .
If additionally the parameter D is chosen large enough, e.g. D = s − 1, such that the algorithm does not terminate prematurely, then also the following properties hold:
5. If O is an order ideal of terms, then the set ˜G = { (1/ LCσ(g)) g| g ∈ G} is an O-border prebasis.
6. If O is an order ideal of terms, then the set ˜G is an δ-approximate border basis with
δ = 2 kXkmax/ min
i |γi| + ν/
mini |γi|
2
.
Here kXkmax denotes the maximal absolute coordinate in X and mini|γi| the minimal border coecient of all polynomials in G.
Proof. First of all we note that the ABM and the extended ABM algorithm share the same basic structure. The latter algorithm only contains some additional processing steps in lines 14 to 18 and an additional degree check in line 25.
The individual steps are well-dened because of the same reasons as in the ABM algorithm. An explanation is contained in the rst part of the proof of Theorem 4.3.1.
Next we discuss niteness. In line 25 termination is assured by checking if the current degree d exceeds a user specied upper bound D. If so the execution will stop and a possibly partial result, i.e. no complete approximate border basis, will be returned. However, even if we would drop the additional check in line 25 the algorithm would still terminate. This is shown in the second part of the proof of Theorem 4.3.1.
Claims 1, 2, 5, and 6 in fact refer to properties of the result of the ABM algorithm, which we have already discussed and proven in Theorem 4.3.1. Note, that we have to assume that D is chosen large enough, i.e. D = s − 1, such that a full approximate border basis will be returned in the end.
Claim 3 holds because the polynomials which are added to H are tested to have this property in line 15.
For each polynomial hi∈ H we let Ai = evalX(supp (hi)). Let us denote the coecient vector of hi with respect to supp (hi) by ci. This means that evalX(hi) = Aici holds. To prove claim 4 let us rst cast a result from Theorem 2.12.1 into our setting which states that the general condition number of the inhomogeneous least squares problem is
κ (Ai) +tan (θi) κ (Ai)2
ηi ,
where cos (θi) = kevalkVkX(hi)k = kAkVkicik for all hi ∈ H and ηi = kAkAikkcik
icik . First we observe that 1 ≤ ηi ≤ κ (A). The rst inequality follows from kAk kcik ≥ kAcik. For the second inequality, note that ci is not the zero vector as kVk 6= 0 and A has only a trivial kernel which means that kAcik 6= 0. With the help of Proposition 2.6.5 we can now compute κ (Ai) = kAik
A+i = kAikkA+i kkAicik
kAicik ≥ kAikkA+iAicik
kAicik = kAkAikkcik
icik . Therefore, we obtain κ (Ai) +tan (θi) κ (Ai)2
ηi
≤ κ (Ai) + tan (θi) κ (Ai)2. Next we use the equationtan cos−1(x) =
√ 1−x2
x in order to obtain tan (θi) =
s
1 −kAicik2 kVk2
kAicik kVk .
Because of the triangle inequality and because of claim 5 we can establish that kAicik ≥ kVk − kAici− Vk ≥ kVk − τ > 0. So
tan (θi) ≤ s
1 −(kVk − τ )2 kVk2
kVk − τ kVk . Now it remains to bound κ (Ai) = kAik
A+i
. Because we make sure during the computation that the evaluation matrices Ai have no singular values smaller than ε we thus know that A+i
< 1ε. Additionally, for any Ai ∈ Matm,n(C) the inequality kAik ≤ √
mn kAikmax holds (see Proposition 2.3.20). In our case the matrix dimensions can at most be m = n = s. The entries of the evaluation matrix are products of powers of the entries of X. As O can at most contain s elements the maximal degree is naturally bounded by s, but as we are using an articial degree bound in form of the input parameter D (see line 25 of the algorithm) we can be more precise and state that the limit is in fact D. So kAik ≤ s · kXkDmax where kXkmax is the maximal absolute entry in the input data set X. Now we have established that κ (Ai) ≤ s · kXkDmax1ε. If we collect all the facts we obtain the inequality
κ = κ (Ai) ≤ s · kXkDmax
ε + s · kXkDmax ε
!2s
1 −(kVk − τ )2 kVk2
kVk − τ kVk , which concludes the proof.
Remark 4.4.4. In case kVk is very small, e.g. kVk ≈ εmachine, we are essentially considering a homogeneous least squares problem. Thus, the ABM algorithm (22) should be used instead of the extended ABM algorithm (24), as the polynomials in H (if any) have very small coecients.
Now we tend to have a look at an example which demonstrates the operation of the extended ABM algorithm.
Example 4.4.5. Let P = R [x1], X = [(−2) , (−1) , (−0.01) , (0) , (0.01) , (1) , (2)],
V = [(−1) , (0) , (0.99) , (1) , (0.99) , (0) , (−1)] , and let σ be the DegRevLex term ordering. We now apply the extended ABM algorithm (24) with ε = 0.1, τ = 10−3, and D = 5:
• d = 1, O = {1}, G = ∅, M = (1, ..., 1)tr, and L = [x1]
• The algorithm terminates because L is empty. Finally, we obtain the sets G = {g1}, H = {h1} and O = x41, x31, x21, x1, 1
, where G is an approximate O-border basis.
Remark 4.4.6. The extended ABM algorithm can be used to check if a polynomial function (in general or up to a specied degree D) exists such that V can be expressed τ -approximately
by the input data X. For this purpose we need to set the parameter ε to 0. If H is empty upon termination of the algorithm, then we have the guarantee that no such relations exists.
Next, we look at an example that emphasises that in general no solution needs to exist, which means that H will contain no polynomials.
Example 4.4.7. [Existence of Solutions]
Let P = C [x1, x2], X = (0, 0), V = (1, 0), ε = 0 and τ = 0.1. When we use the extended ABM algorithm, all least squares problems we have to solve in line 14 are of the form
mins
0 · · · 0 1 0 · · · 0 1
!
s − 1 0
!
with s = (sm+1, ..., s1)tr∈ Cm+1. A polynomial is added to H if it satises q
|s1− 1|2+ |s1|2 < 0.1.
This is equivalent to the following conditions:
(s1− 1) (¯s1− 1) + s1s¯1 < 0.01 2s1¯s1− s1− ¯s1+ 1 < 0.01 2 s1s¯1− 0.5s1− 0.5¯s1+ 0.52+ 0.25
< 0.01 2 (s1− 0.5) (¯s1− 0.5) + 0.5 < 0.01
2 |s1− 0.5|2 < −0.49.
As we can see, there exists no number s that would satisfy this inequality.