math0602031/hod.tex
1: \documentclass{article}
2: 
3: \usepackage{amsmath}
4: \usepackage{amssymb}
5: %\usepackage[ruled]{algorithm}
6: %\usepackage{algorithmic}
7: \usepackage{amsbsy}
8: \usepackage{amscd}
9: %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
10: \catcode`\@=11\relax
11: \newdimen\p@renwd
12: \font\tenex=cmex10 \setbox0=\hbox{\tenex B} \p@renwd=\wd0
13: \def\bbordermatrix#1{\begingroup \m@th
14: \setbox\z@\vbox{\def\\{\crcr\noalign{\kern2\p@\global\let\cr\endline}}%
15:     \ialign{$##$\hfil\kern2\p@\kern\p@renwd&\thinspace\hfil$##$\hfil
16:       &&\quad\hfil$##$\hfil\crcr
17:       \omit\strut\hfil\crcr\noalign{\kern-\baselineskip}%
18:       #1\crcr\omit\strut\cr}}%
19:   \setbox\tw@\vbox{\unvcopy\z@\global\setbox\@ne\lastbox}%
20:   \setbox\tw@\hbox{\unhbox\@ne\unskip\global\setbox\@ne\lastbox}%
21:   \setbox\tw@\hbox{$\kern\wd\@ne\kern-\p@renwd\left[\kern-\wd\@ne
22:     \global\setbox\@ne\vbox{\box\@ne\kern2\p@}%
23:     \vcenter{\kern-\ht\@ne\unvbox\z@\kern-\baselineskip}\,\right]$}%
24:   \null\;\vbox{\kern\ht\@ne\box\tw@}\endgroup}
25: \catcode`\@=12\relax
26: %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
27: 
28: \newcommand{\rr}{{\mathbb R}}
29: \newcommand{\cc}{{\mathbb C}}
30: \newcommand{\ZZ}{{\mathbb Z}}
31: 
32: \newcommand{\rE}{{\rm E}}
33: 
34: \newcommand{\bfe}{{\boldsymbol{e}}}
35: \newcommand{\bfh}{{\boldsymbol{h}}}
36: 
37: \newcommand{\boldf}{{\boldsymbol{f}}}
38: \newcommand{\x}{{\boldsymbol{x}}}
39: \newcommand{\y}{{\boldsymbol{y}}}
40: \newcommand{\zero}{{\boldsymbol{0}}}
41: \newcommand{\bfl}{{\boldsymbol{\lambda}}}
42: \newcommand{\bfp}{{\boldsymbol{\partial}}}
43: 
44: \newcommand{\p}{{\partial}}
45: \newcommand{\LC}{{\operatorname{lc}}}
46: \newcommand{\LE}{{\operatorname{le}}}
47: \newcommand{\LM}{{\operatorname{lm}}}
48: \newcommand{\LT}{{\operatorname{lt}}}
49: \newcommand{\IN}{{\operatorname{in}}}
50: \newcommand{\supp}{{\operatorname{supp}}}
51: \newcommand{\corank}{{\operatorname{corank}\,}}
52: \newcommand{\rank}{{\operatorname{rank}\,}}
53: \def\D0{D_\zero}
54: \def\Span{\operatorname{Span}}
55: \newcommand{\ignore}[1]{}
56: 
57: \newtheorem{theorem}{Theorem}[section]
58: \newtheorem{lemma}[theorem]{Lemma}
59: \newtheorem{proposition}[theorem]{Proposition}
60: \newtheorem{definition}[theorem]{Definition}
61: \newtheorem{example}[theorem]{Example}
62: \newtheorem{algorithm}[theorem]{Algorithm}
63: \newtheorem{corollary}[theorem]{Corollary}
64: \newtheorem{remark}[theorem]{Remark}
65: \newcommand{\bC}{{\mathbb C}}
66: \newcommand{\bZ}{{\mathbb Z}}
67: 
68: \newcommand\qed{{\hspace*{\fill}$\Box$\vskip12pt plus 1pt}}
69: \newcommand\qex{\hfill $\diamond$}  % end of example
70: 
71: \hyphenation{Singular}
72: 
73: \parskip 1mm
74: 
75: \begin{document}
76: 
77: \title{Higher-Order Deflation for Polynomial Systems
78:        with Isolated Singular Solutions}
79: 
80: \author{
81: Anton Leykin\thanks{
82: Department of Mathematics, Statistics, and Computer Science,
83: University of Illinois at Chicago, 851 South Morgan (M/C 249),
84: Chicago, IL 60607-7045, USA.
85: {\em Email:} leykin@math.uic.edu.
86: {\em URL:} http://www.math.uic.edu/{\~{}}leykin.}
87: \and
88: Jan Verschelde\thanks{
89: Department of Mathematics, Statistics, and Computer Science,
90: University of Illinois at Chicago, 851 South Morgan (M/C 249),
91: Chicago, IL 60607-7045, USA.
92: {\em Email:} jan@math.uic.edu or jan.verschelde@na-net.ornl.gov.
93: {\em URL:} http://www.math.uic.edu/{\~{}}jan.
94: This material is based upon work
95: supported by the National Science Foundation under Grant No.\
96: 0105739 and Grant No.\ 0134611.}
97: \and
98: Ailing Zhao\thanks{
99: Department of Mathematics, Statistics, and Computer Science,
100: University of Illinois at Chicago, 851 South Morgan (M/C 249),
101: Chicago, IL 60607-7045, USA.
102: {\em Email:} azhao1@uic.edu.
103: {\em URL:} http://www.math.uic.edu/{\~{}}azhao1.}
104: }
105: 
106: \date{4 January 2007}
107: 
108: \maketitle
109: \begin{abstract}
110: 
111: Given an approximation to a multiple isolated solution of a polynomial
112: system of equations, we have provided a symbolic-numeric deflation
113: algorithm to restore the quadratic convergence of Newton's method.
114: Using first-order derivatives of the polynomials in the system,
115: our method creates an augmented system of equations which has the
116: multiple isolated solution of the original system as a regular root.
117: 
118: In this paper we consider two approaches to computing the
119: ``multiplicity structure'' at a singular isolated solution.
120: An idea coming from one of them gives rise to our new
121: higher-order deflation method.
122: Using higher-order partial derivatives of the original polynomials,
123: the new algorithm reduces the multiplicity faster than our first method
124: for systems which require several first-order deflation steps.
125: 
126: We also present an algorithm to predict the order of the deflation.
127: 
128: \noindent {\bf 2000 Mathematics Subject Classification.} Primary
129: 65H10.  Secondary 14Q99, 68W30.
130: % 14Q99 Computational aspects in algebraic geometry
131: % 65H10 Systems of nonlinear equations
132: % 68W30 Symbolic Computation and algebraic computation
133: 
134: \noindent {\bf Key words and phrases.} Deflation,
135: isolated singular solutions, Newton's method, multiplicity,
136: polynomial systems, reconditioning, symbolic-numeric computations.
137: 
138: \end{abstract}
139: 
140: \newpage
141: 
142: \section{Introduction}
143: 
144: This paper describes a numerical treatment of singular solutions
145: of polynomial systems. A trivial example to consider 
146: would be a single equation with a double root, $f(x) = x^2 = 0$, 
147: or a cluster of two very close roots, $f(x) = x^2 - \varepsilon^2  = 0$, 
148: where $0<\varepsilon \ll \mbox{machine precision}$. 
149: In both cases getting good approximate solutions with straightforward 
150: numerical approaches such as Newton's method is not easy.
151: Instead of attempting to solve the given equations we replace them with 
152: the system augmented by the equation's derivative,
153: $\bar \boldf (x)=(f(x),f'(x))=\zero$. 
154: Note that this completely symbolic procedure leads to a system 
155: with exact regular root in the first case, whereas in the second 
156: the system $\bar \boldf (x)=\zero$ would be inconsistent. 
157: However, a numerical solver applied to the latter would converge 
158: to a regular solution of a close-by system.   
159: 
160: In general setting, given an overdetermined system of equations in
161: many variables with a multiple isolated solution (a cluster of solutions)
162: our approach deflates the multiplicity of the solution (cluster)
163: by applying a certain numerical procedure. 
164: From the point of view of the numerical analysis it may be called 
165: a \emph{reconditioning} method: to recondition means to
166: reformulate a problem so its condition number improves.
167: 
168: Our deflation method was first presented at~\cite{VZ04},
169: and then described in greater detail in~\cite{LVZ06}.
170: In~\cite{LVZ07}, a directed acyclic graph of Jacobian matrices was
171: introduced for an efficient implementation.
172: 
173: On input we consider clusters of approximate zeroes of systems
174: $F(\x) = (f_1(\x)$, $f_2(\x)$, $\ldots,$ $f_N(\x)) = \zero$ of $N$ equations
175: in $n$ unknowns $\x \in \cc^n$.  We assume the cluster approximates
176: an isolated solution~$\x^*$ of $F(\x) = \zero$.  Therefore, $N \geq n$.
177: As~$\x^*$ is a singular solution, the Jacobian matrix of $F(\x)$,
178: denoted by~$A(\x)$, is singular at~$\x^*$.
179: In particular, we have $r = {\rm Rank}(A(\x^*)) < n$.
180: 
181: In case $r = n-1$, consider a nonzero vector~$\bfl$ in the kernel
182: of~$A(\x^*)$, which we denote by $\bfl \in \ker(A(\x^*))$,
183: then the equations
184: \begin{equation}
185:   g_i(\x)= \sum_{i=1}^{n} \lambda_j
186:  \frac{\partial f_i(\x)}{\partial x_j}, \quad i=1,2,\ldots,N,
187: \end{equation}
188: vanish at~$\x^*$, because $r = {\rm Rank}(A(\x^*)) < n$.
189: For $r < n-1$, our algorithm reduces to the corank-1 case,
190: replacing $A(\x)$ by $A(\x) B$, where $B$ is a random complex
191: $N$-by-$(r+1)$ matrix.  For the uniqueness $\bfl \in \ker(A(\x^*))$,
192: we add a linear scaling equation $\langle \bfh ,\bfl \rangle = 1$
193: (using a random complex $(r+1)$-vector $\bfh$).
194: and consider the augmented system
195: \begin{equation}
196:    G(\x,\bfl) =
197:    \left\{
198:      \begin{array}{lcl}
199:         F(\x)        & = & \zero \\
200:         A(\x) B \bfl & = & \zero \\
201:         \multicolumn{1}{r}{\langle \bfh ,\bfl \rangle} & = & 1.
202:      \end{array}
203:    \right.
204: \end{equation}
205: Let us denote by $\mu_F(\x^*)$ the multiplicity of $\x^*$ as 
206: a solution of the system $F(\x)=0$. In~\cite{LVZ06} we proved 
207: that there is a $\bfl^*$ 
208: such that $\mu_G(\x^*,\bfl^*) < \mu_F(\x^*)$.
209: Therefore, our deflation algorithm takes at most $m-1$ stages to determine
210: $\x^*$ as a regular root of an augmented polynomial system.
211: 
212: \noindent {\bf Related work.}  The literature on Newton's method
213: is vast.  As stated in~\cite{Deu04}, Lyapunov-Schmidt reduction
214: (see also~\cite[\S 6.2]{Gov00}, \cite{ABHJ99}, \cite{Kun96},
215: and~\cite{Lij04})) stands at the beginning of every
216: mathematical treatment of singularities.
217: We found the inspiration to develop a symbolic-numeric deflation
218: algorithm in~\cite{OWM83}.  The symbolic deflation procedure
219: of~\cite{Lec02} restores the quadratic convergence of Newton's method
220: with a complexity proportional to the square of the multiplicity
221: of the root.  Algorithms to compute the multiplicity are presented
222: in~\cite{BPS06}, \cite{DZ05}, and~\cite{ST98}.
223: 
224: \noindent {\bf Our Contributions.} We establish the link between
225: two different objects describing what we call the
226: \emph{multiplicity structure} of an isolated singular solution:
227: the dual space of differential functionals and the
228: initial ideal with respect to a local monomial order, both
229: associated to the ideal generated by the polynomials in the system
230: in the polynomial ring.
231: 
232: Next, following the latter method, we explain how to compute a
233: basis of the dual space, first, following the ideas of Dayton and
234: Zeng~\cite{DZ05}, then using the approach of Stetter and
235: Thallinger~\cite{ST98}.
236: We provide a formal symbolic algorithm for each approach,
237: respectively called the DZ and ST algorithms;
238: the ingredients of the algorithms do not go beyond linear algebra.
239: Moreover, we present an algorithm to determine the order of
240: the deflation.
241: 
242: The formalism developed for DZ and ST algorithms found a natural
243: continuation in \emph{higher-order deflation} method that
244: generalizes and extends the first-order deflation in \cite{LVZ06}.
245: For the systems that require more than one deflation step by our
246: first algorithm, the new deflation algorithm is capable of
247: completing the deflation in fewer steps. 
248: 
249: \noindent {\bf Acknowledgements.}  The material in this paper
250: was presented by the first two authors at the workshops on
251: computational algebraic geometry and real-number complexity,
252: organized respectively by Teresa Krick \& Andrei Gabrielov and
253: Peter Buergisser \& Gregorio Malajovich.  The authors thank the
254: organizers for the opportunities to present their work at these
255: FoCM 2005 workshops.
256: 
257: \section{Statement of the Main Theorem \& Algorithms}
258:  
259: The matrices $A^{(d)}(\x)$ we introduce below coincide for $d=1$
260: with the Jacobian matrix of a polynomial system.  
261: They are generalizations of the Jacobian matrix, built along the
262: same construction as the matrices used in the computation of the
263: multiplicity by Dayton and Zeng in~\cite{DZ05}.
264: 
265: \begin{definition} {\rm
266: The \emph{deflation matrix $A^{(d)}(\x)$ of a polynomial system
267: $F = (f_1$, $f_2$, $\ldots,f_N)$} of $N$ equations in $n$ 
268: unknowns~$\x = (x_1,x_2,\ldots,x_n)$ 
269: is a matrix with elements in $\bC[\x]$.  
270: The rows of $A^{(d)}(\x)$ are indexed by $\x^\alpha f_j$, 
271: where $|\alpha| < d$ and $j=1,2,\ldots,N$.
272: The columns are indexed by partial differential operators
273: $\bfp^\beta = \frac{\partial^{|\beta|}}{\partial x_1^{\beta_1}
274:    \cdots \partial x_n^{\beta_n}}$, 
275: where $\beta\neq\zero$ and $|\beta|\leq d$.
276: The element at row $\x^\alpha f_j$ and column $\partial^\beta$
277: of $A^{(d)}(\x)$ is
278: \begin{equation}
279:    \partial^\beta\cdot(\x^\alpha f_j) =
280:    \frac{\partial^{|\beta|}(\x^\alpha f_j)}{\partial \x^\beta}.
281: \end{equation}
282: $A^{(d)}(\x)$ has $N_r$ rows and $N_c$ columns,
283: $N_{r} = N \cdot \binom{n+d-1}{n}$ and $N_{c} = \binom{n+d}{n} - 1$.
284: }
285: \end{definition}
286: 
287: \begin{example}[Second-order deflation matrix]{\rm
288: Consider a system of 3 equations in 2 variables
289: $F=(f_1,f_2,f_3)=\zero$, where $f_1 = x_1^2$, $f_2 = x_1^2 - x_2^3$,
290: and $f_3 = x_2^4$. 
291: Then the second-order deflation matrix $A^{(2)}(\x)$ of $f$ is
292: \begin{equation}
293: \bbordermatrix{
294:  & \partial_{x_1} & \partial_{x_2} & \partial_{x_1}^2 
295:  & \partial_{x_1} \partial_{x_2} & \partial_{x_2}^2 \\
296:       f_1 & 2 x_1     &    0         & 2     & 0        &  0         \\
297:       f_2 & 2 x_1     & -3 x_2^2     & 2     & 0        & -6 x_2     \\
298:       f_3 & 0         & 4 x_2^3      & 0     & 0        & 12 x_2^2   \\
299:   x_1 f_1 & 3 x_1^2   & 0   & 6 x_1  & 0     & 0                     \\
300:   x_1 f_2 & 3 x_1^2   & -3 x_1 x_2^2 & 6 x_1 & 3 x_2^2  & -6 x_1 x_2 \\
301:   x_1 f_3 & x_2^4     & 4 x_1 x_2^3  & 0     & 0        & 0          \\
302:   x_2 f_1 & 2 x_1 x_2 & x_1^2        & 2 x_2 & 2 x_1    & 0          \\
303:   x_2 f_2 & 2 x_1 x_2 & -4 x_2^3     & 2 x_2 & 2 x_1    & -12 x_2^2  \\
304:   x_2 f_3 & 0         & 5 x_2^4      & 0     & 0        & 20 x_2^3
305:  }.
306: \end{equation}
307: Notice that $A^{(1)}(\x)$ (or the Jacobian matrix of $F$)
308: is contained in the first three rows and two columns of~$A^{(2)}(\x)$.
309: }%end \rm
310: \end{example}
311: 
312: \begin{definition} {\rm
313: Let $\x^*$ be an isolated singular solution of the system $F(\x) = \zero$
314: and let $d$ be the order of the deflation.
315: Take a nonzero $N_{r}$-vector $(\lambda_\beta)_{\beta\neq\zero,\
316: |\beta|\leq d}$ in the kernel of $A^{(d)}(\x^*)$. 
317: It corresponds to what we call a \emph{deflation operator} -- a
318: linear differential operator with constant coefficients $\lambda_\beta$
319: \begin{equation}
320:    Q = \sum_{\beta\neq\zero,\ |\beta|\leq d}
321:    \lambda_\beta\partial^\beta \ \in \bC[\bfp].
322: \end{equation}
323: We use $Q$ to define $N_{r}$ new equations
324: \begin{equation}
325:   g_{j,\alpha}(\x) = Q \cdot (\x^\alpha f_j) = 0,
326:   \quad j=1,2,\ldots,N,\ |\alpha|<d.
327: \end{equation}
328: When we consider $\lambda_\beta$ as indeterminate,
329: we write $g_{j,\alpha}$ as~$g_{j,\alpha}(\x,\bfl)$.
330: In that case, we define $m$ additional linear equations,
331: for $m = \corank(A^{(d)}(\x^*))$:
332: \begin{equation}
333:   h_k(\bfl) = \sum_\beta b_{k, \beta} \lambda_\beta - 1 = 0,
334:   \quad k = 1,2,\ldots,m,
335: \end{equation}
336: where the coefficients $b_{k,\beta}$ are randomly chosen complex numbers.
337: }
338: \end{definition}
339: 
340: Now we are ready to state our main theorem.
341: 
342: \begin{theorem} \label{thm-deflation-step-general}
343: Let $\x^*\in\bC^n$ be an isolated solution of $F(\x)=\zero$.
344: Consider the following system in $\bC[\x,\bfl]$:
345: \begin{equation}\label{equ-d-deflation-system}
346:   G^{(d)}(\x,\bfl) =
347:   \left\{
348:     \begin{array}{rcll}
349:        f_j(\x) & = & 0, & j=1,2,\ldots,N; \\
350:        g_{j,\alpha}(\x,\bfl) & = & 0, & j=1,2,\ldots,N,\ |\alpha|<d; \\
351:        h_k(\bfl) & = & 0, & k=1,2,\ldots,m.
352:     \end{array}
353:   \right.
354: \end{equation}
355: For a generic choice of coefficients $b_{k,\beta}$, there exists a
356: unique $\bfl^*\in\bC^{N_{c}}$ such that the system
357: $G^{(d)}(\x,\bfl)$ has an isolated solution at $(\x^*,\bfl^*)$.
358: Moreover, the multiplicity of $(\x^*,\bfl^*)$ in $G(\x,\bfl)=\zero$
359: is strictly less than the multiplicity of $\x^*$ in $F(\x)=\zero$.
360: \end{theorem}
361: 
362: To determine the order $d$, we propose
363: Algorithm~\ref{alg_MinOrderForCorankDrop}.
364: This $d$ is then used 
365: in Algorithm~\ref{alg_SymbolicNumericDeflation}.
366: 
367: \begin{algorithm} \label{alg_MinOrderForCorankDrop}
368: {\rm d = {\bf MinOrderForCorankDrop}($F,\x_0$)
369: 
370: \begin{tabular}{ll}
371: Input: & $F$ is a finite set of polynomials; \\
372:        &  $\x^0 \approx \x^*$,
373:           $\x^*$ is an isolated multiple solution of $F(\x)=\zero$. \\
374: Output: & $d$ is the minimal number such that the augmented system $G^{(d)}$ \\
375:         & produced via a generic deflation operator $Q$ of order~$d$ has \\
376:         & corank of the Jacobian at $\x^*$ lower than $\corank A(\x^*)$. \\
377: \end{tabular}
378: 
379: \begin{tabular}{l}
380: take a generic vector 
381: $\gamma =(\gamma_1,\ldots,\gamma_n) \in \ker A(\x^0)$; \\
382: let $H(t) = F(\x^0+\gamma t) = F(x_1^0+\gamma_1 t,\ldots,x_n^0+\gamma_n t)$; \\
383: $d := \min\{ \ a \ |\  a \mbox{\rm ~belongs~to~the~support~of~} H(t) \ \} - 1$.
384: \end{tabular} }
385: \end{algorithm}
386: 
387: \begin{algorithm} \label{alg_SymbolicNumericDeflation}
388: {\rm $D^{(d)}F$ = {\bf Deflate}($F$,$d$,$\x_0$)
389: 
390: \begin{tabular}{ll}
391: Input: & $F$ is a finite set of polynomials in $\bC[\x]$; \\
392:        & $d$ is the order of deflation; \\
393:        & $\x^0 \approx \x^*$, 
394:          $\x^*$ is an isolated multiple solution of $F(\x)=\zero$. \\
395: Output: & $D^{(d)}F$ is a finite set of polynomials in $\bC[\x,\bfl]$ \\
396:         & such that there is $\bfl^*$ with 
397:           $\mu_{D^{(d)}F}(\x^*,\bfl^*) < \mu_{F}(\x^*)$.
398: \end{tabular}
399: 
400: \begin{tabular}{l}
401: determine the numerical corank $m$ of $A^{(d)}(\x^0)$; \\
402: return ${D^{(d)}F} := G^{(d)}(\x,\bfl)$ 
403: as in (\ref{equ-d-deflation-system}). 
404: \end{tabular}
405: }
406: \end{algorithm}
407:  
408: \section{Multiplicity Structure} \label{sec-multiplicity}
409: 
410: This section relates two different ways to obtain the multiplicity
411: of an isolated solution, constructing its {\em multiplicity
412: structure}.  Note that by a ``multiplicity structure'' -- a term
413: without a precise mathematical definition -- we mean any structure
414: which provides more local information about the singular solution
415: in addition to its multiplicity.  In this section we mention two
416: different approaches to describe this so-called multiplicity
417: structure.
418: 
419: \begin{example}[Running example 1] \label{exa-running} {\rm
420: Consider the system
421: \begin{equation} \label{equ-running}
422:   F(\x)
423:   = \left\{
424:        \begin{array}{c}
425:           x_2^3 = 0 \\
426:           x_1^2 x_2^2 = 0 \\
427:           x_1^4 + x_1^3x_2 = 0.
428:        \end{array}
429:     \right.
430: \end{equation}
431: The system $F(\x) = \zero$ has only one isolated solution
432: at~$(0,0)$ of high multiplicity.  Below we will show how
433: to compute the multiplicity of~$(0,0)$.~\qex  }
434: \end{example}
435: 
436: \subsection{Standard Bases}
437: 
438: Assume $\zero\in\bC^n$ is an isolated solution
439: of the system $F(\x)=\zero$.
440: Let $I = \langle F \rangle \subset R =\bC[\x]$ be
441: the ideal generated by the polynomials in the system.
442: Given a local monomial order $\geq$, the initial ideal
443: $\IN_\geq(I) = \{ \IN_\geq(f)\ |\ f \in I \} \subset R$
444: describes the multiplicity structure of $\zero$ by means
445: of \emph{standard monomials}, i.e.:
446: monomials that are not contained in $\IN_\geq(I)$.
447: A graphical representation of a monomial ideal
448: is a monomial \emph{staircase}.
449: 
450: \begin{example}[Initial ideals with respect to a local order]
451: {\rm Consider the system~(\ref{equ-running})
452: of Example~\ref{exa-running}.
453: 
454: Figure~\ref{figstair} shows the staircases for initial ideals of
455: $I = \langle F \rangle$ w.r.t. two local weight orders $\geq_\omega$.
456: Computer algebra systems Macaulay~2~\cite{Macaulay2} 
457: and Singular~\cite{GPS01} can be used for these kind of computations, 
458: see also~\cite{GP96,GP02} for theory, in particular, on Mora's 
459: tangent cone algorithm~\cite{Mor82}.
460: 
461: In the example the leading monomials at the corners of the
462: staircase come from the elements of the corresponding \emph{standard basis}.
463: For the weight vector $w=(-1,-2)$ the original generators give such a 
464: basis (initial terms underlined).
465: For $w=(-2,-1)$ one more polynomial is needed.~\qex }
466: \end{example}
467: 
468: \begin{figure}[hbt]
469: 
470: \unitlength 0.8mm
471: 
472: \begin{picture}(200,50)(0,0)
473: 
474: \put(4,0){
475: \begin{picture}(80,50)(0,0)
476: 
477: \linethickness{0.3mm}
478:  \put(0,0){\vector(0,1){45}}
479:  \put(0,0){\vector(1,0){65}}
480:  \put(0,0){\circle{4}}
481:  \put(0,10){\circle{4}}
482:  \put(20,0){\circle{4}}
483:  \put(0,20){\circle{4}}
484:  \put(10,10){\circle{4}}
485:  \put(10,0){\circle{4}}
486:  \put(0,30){\circle*{4}}
487:  \put(40,0){\circle*{4}}
488:  \put(0,30){\line(1,0){20}}
489: \linethickness{0.6mm}
490:  \put(40,0){\line(0,1){20}}
491: 
492: \put(25,25){\makebox(0,0)[cl]{$\underline{x_1^2x_2^2}$}}
493: \put(44,4){\makebox(0,0)[cl]{$\underline{x_1^4}+x_1^3x_2$}}
494: 
495: \linethickness{0.6mm} \put(20,20){\line(0,1){10}}
496: \linethickness{0.6mm} \put(20,20){\line(1,0){20}}
497: \linethickness{0.3mm} \put(20,20){\circle*{4}}
498: 
499: \put(5,35){\makebox(0,0)[cl]{$\underline{x_2^3}$}}
500: \put(40,40){\makebox(0,0)[cl]{$w = (-1,-2)$}}
501: 
502: \linethickness{0.3mm}
503: \multiput(30,30)(0.12,0.24){83}{\line(0,1){0.24}}
504: \put(30,30){\vector(-1,-2){0.12}}
505: 
506: \linethickness{0.3mm} \put(30,0){\circle{4}}
507: \linethickness{0.3mm} \put(10,20){\circle{4}}
508: \linethickness{0.3mm} \put(20,10){\circle{4}}
509: \linethickness{0.3mm} \put(30,10){\circle{4}}
510: 
511: \end{picture}
512: }
513: 
514: \put(85,0){
515: \begin{picture}(80,50)(0,0)
516: 
517: \linethickness{0.3mm} 
518:  \put(0,0){\vector(0,1){45}}
519:  \put(0,0){\vector(1,0){60}}
520:  \put(0,0){\circle{4}}
521:  \put(0,10){\circle{4}}
522:  \put(20,0){\circle{4}}
523:  \put(0,20){\circle{4}}
524:  \put(10,10){\circle{4}}
525:  \put(10,0){\circle{4}}
526:  \put(0,30){\circle*{4}}
527:  \put(50,0){\circle*{4}}
528:  \put(0,30){\line(1,0){20}}
529: \linethickness{0.6mm}
530: \put(50,0){\line(0,1){10}}
531: \put(25,25){\makebox(0,0)[cl]{$\underline{x_1^2x_2^2}$}}
532: 
533: \put(66,14){\makebox(0,0)[cc]{}}
534: \put(35,15){\makebox(0,0)[cl]{$\underline{x_1^3x_2}+x_1^4$}}
535: 
536: \linethickness{0.6mm} \put(20,20){\line(0,1){10}}
537: \linethickness{0.6mm} \put(20,20){\line(1,0){10}}
538: \linethickness{0.3mm} \put(20,20){\circle*{4}}
539: 
540: \put(5,35){\makebox(0,0)[cl]{$\underline{x_2^3}$}}
541: 
542: \put(8,44){\makebox(0,0)[cl]{}}
543: 
544: \put(20,40){\makebox(0,0)[cl]{$w = (-2,-1)$}}
545: 
546: \put(0,20){\makebox(0,0)[cl]{}}
547: 
548: %\linethickness{0.3mm} \put(70,30){\circle{4}}
549: %\linethickness{0.3mm} \put(70,40){\circle*{4}}
550: %\put(80,40){\makebox(0,0)[cl]{the generators of $\IN(I)$}}
551: %\put(80,30){\makebox(0,0)[cl]{the standard monomials}}
552: %\put(22,32){\makebox(0,0)[cl]{}}
553: 
554: \linethickness{0.3mm}
555: \multiput(30,30)(0.24,0.12){83}{\line(1,0){0.24}}
556: \put(30,30){\vector(-2,-1){0.12}}
557: \linethickness{0.3mm} \put(30,0){\circle{4}}
558: 
559: \linethickness{0.3mm} \put(10,20){\circle{4}}
560: \linethickness{0.3mm} \put(20,10){\circle{4}}
561: \linethickness{0.3mm} \put(40,0){\circle{4}}
562: \linethickness{0.6mm} \put(30,10){\line(0,1){10}}
563: \linethickness{0.3mm} \put(30,10){\circle*{4}}
564: \linethickness{0.6mm} \put(30,10){\line(1,0){20}}
565: \put(55,5){\makebox(0,0)[cl]{$\underline{x_1^5}$}}
566: 
567: \end{picture}
568: }
569: \end{picture}
570: 
571: \caption{Two monomial staircases for two different monomial orderings
572: applied to the same system.
573: The full circles represent the generators of the initial ideals.
574: The multiplicity is the number of standard monomials,
575: represented by the empty circles under the staircase.}
576: \label{figstair}
577: \end{figure}
578: 
579: \subsection{Dual Space of Differential Functionals}
580: 
581: Another approach at the multiplicity structure is
582: described in detail in~\cite{Ste04,Tha98}; see also~\cite{Mou97}.
583: Using duality to define
584: the multiplicity of a solution goes back to Macaulay~\cite{Mac16}.
585: In this approach,
586: {\em differential functionals} are denoted by
587: \begin{equation}
588:    \Delta_\alpha(f) = \left.\frac{1}{\alpha_1!\cdots\alpha_n!}\cdot
589:    \frac{\partial^{|\alpha|}f}{\partial x^{\alpha_1}\cdots\partial
590:    x^{\alpha_n}}\right|_{\x=\zero}.
591: \end{equation}
592: Observe that
593: \begin{equation}
594: \ \Delta_\alpha(\x^\beta)
595:      = \left\{
596:           \begin{array}{ll}
597:             1, & \alpha=\beta \\
598:             0, & \alpha\neq\beta.
599:           \end{array}
600:        \right.
601: \end{equation}
602: We then define the local \emph{dual space}
603: of differential functionals $D_\zero[I]$ as
604: \begin{equation}
605:   D_\zero[I] = \{ L\in \Span\{\Delta_\alpha\ |\
606:                  \alpha\in\bZ_{\geq 0}^n\} |\
607:           L(f)=0 \mbox{ for all } f\in I\},
608: \end{equation}
609: 
610: \begin{example}[Dual space of running example 1] {\rm
611: For the ideal defined by the polynomials in
612: the system~(\ref{equ-running}) we have
613: \begin{equation}
614: \begin{array}{ccc}
615:   D_\zero[I] = \Span\{ &
616:    \underline{\Delta_{(4,0)}}-\Delta_{(3,1)},\ \underline{\Delta_{(3,0)}},\ \underline{\Delta_{(2,1)}},\ \underline{\Delta_{(1,2)}},& \\ % nontrivial part: degree 3 and 4 
617:   &\underline{\Delta_{(2,0)}},\ \underline{\Delta_{(1,1)}},\ \underline{\Delta_{(0,2)}},\ 
618:       \underline{\Delta_{(1,0)}},\ \underline{\Delta_{(0,1)}},\
619:     \underline{\Delta_{(0,0)}} &\}.
620: \end{array}
621: \end{equation}
622: Notice that here the basis of the dual space is chosen in such a
623: way that the (underlined) leading terms with respect to the weight
624: order $\geq_{(2,1)}$ correspond to the monomials under the
625: staircase in Example \ref{exa-running} for the order
626: $\geq_{(-2,-1)}$. We will show that it is not a coincidence later
627: in this section.\qex
628: }
629: \end{example}
630: 
631: \subsection{Dual Bases versus Standard Bases}
632: 
633: Since both local dual bases and initial ideals w.r.t. local orders
634: describe the same, there exists a natural correspondence between the two.
635: 
636: Let $\geq$ be an order on the nonnegative integer lattice
637: $\ZZ_{\geq 0}^n$ that defines a local monomial order and let
638: $\succeq$ be the opposite of $\geq$: i.e. $\alpha \succeq \beta
639: \Leftrightarrow \alpha \leq \beta$. (Note: $\succeq$ defines a
640: global monomial order.)
641: 
642: For a linear differential functional $L = \sum c_\alpha
643: \Delta_\alpha$ define the \emph{support}: $\supp(L) = \{
644: \alpha\in\ZZ_{\geq 0}^n \ |\ c_\alpha \neq 0 \}.$
645: For the dual space, $\supp (\D0[I]) = \bigcup_{L\in \D0[I]} \supp(L)$.
646: 
647: Using the order $\succeq$ we can talk about the leading or
648: \emph{initial term} of $L$: let $\IN_\succeq(L)$ be the maximal
649: element of $\supp(L)$ with respect to $\succeq$. Define the
650: \emph{initial support} of the dual space as $\IN_\succeq(\D0[I]) =
651: \{ \IN_\succeq(L)\ |\ L\in \D0[I]\}$. The initial support is
652: obviously contained in the support, in our running example the
653: containment is proper:
654: \begin{eqnarray*}
655: \IN_{(2,1)}(\D0[I])
656:    & = &  \{ (i,j)\ |\ i+j\leq 3 \} \cup \{ (4,0) \} \\
657:    & \subset & \{ (i,j)\ |\ i+j\leq 3 \} \cup  \{ (4,0) \cup (3,1) \} = \supp(\D0[I]).
658: \end{eqnarray*}
659: 
660: \begin{theorem}
661: The number of elements in the initial support equals the dimension
662: of the dual space, therefore, is the multiplicity. Moreover, with
663: the above assumptions on the orders $\geq$ and $\succeq$, the
664: standard monomials w.r.t. the local order $\geq$ are $\{\x^\alpha\
665: |\ \alpha \in \IN_\succeq(\D0[I]) \}$.
666: \end{theorem}
667: 
668: \noindent {\em Proof.}
669: Pick $L_\beta\in \D0[I], \beta\in\IN_\succeq(\D0[I])$ such that
670: $\IN_\succeq(L_\beta) = \beta$. One can easily show that
671: $\{L_\beta\}$ is a basis of $\D0[I]$.
672: 
673: Take a monomial $\x^\alpha \in \IN_\geq(I)$, then there is $f \in
674: I$ such that $\x^\alpha = \IN_\geq(f)$. Next, take any linear
675: differential functional $L$ with $\IN_\succeq(L) = \alpha$. Since
676: the orders $\geq$ and $\succeq$ are opposite, there are no similar
677: terms in the tail of $L$ and the tail of $f$, therefore, $L(f) =
678: \IN_\succeq(L)(\IN_\geq(f)) \neq 0$.
679: 
680: It follows that, $L\notin \D0[I]$, which proves that the set of
681: standard monomials is contained in the initial support of
682: $\D0[I]$. They are equal since they both determine the dimension.~\qed
683: 
684: Consider the ring of linear differential operators $\mathcal D=
685: \bC[\bfp]$ with the natural action (denoted by ``$\cdot$'') on
686: polynomial ring $R=\bC[\x]$.
687: 
688: \begin{lemma} \label{lem-drop}
689: Let $Q \in \bC[\bfp]$ and $f \in \bC[\x]$ such that
690: $\IN_\succeq(Q) \succeq \IN_\geq(f)$ (in $\ZZ_{\geq 0}^n$).
691: 
692: Then $\IN_\geq (Q\cdot f) = \IN_\geq(f) - \IN_\succeq(Q) \in
693: \ZZ_{\geq 0}^n$.
694: \end{lemma}
695: 
696: \section{Computing the Multiplicity Structure} \label{sec-computing-mult}
697: 
698: Let the ideal $I$ be generated by $f_1,f_2,\ldots,f_N$.
699: Let $\D0^{(d)}[I]$ the part of $\D0[I]$ containing functionals of
700: order at most $d$. We would like to have a criterion that for the
701: differential functional $L$ of degree at most $d$ guarantees $L\in
702: \D0^{(d)}[I]$.
703: 
704: Below we describe two such criteria referred to as
705: \emph{closedness conditions}; their names are arranged to match
706: the corresponding computational techniques of
707: Dayton-Zeng~\cite{DZ05} and Stetter-Thallinger~\cite{ST98}
708: that we will describe later respectively as the DZ and ST algorithms.
709: 
710: A functional $L = \sum c_\alpha \Delta_\alpha$ with $c_\alpha \in
711: \bC$ of order $d$ belongs to the dual space $\D0[I]$ if and only if
712: 
713: \begin{itemize}
714: 
715: \item \textbf{(DZ-closedness)} $L(g\cdot f_i) = 0$
716:       for all $i = 1,2,\ldots,N$ and polynomials $g(\x)$
717:       of degree at most $d-1$.
718: 
719: \item \textbf{(ST-closedness)} $L(f_i) = 0$ for all $i$ and
720:       $\sigma_j(L) \in \D0[I]$ for all $j = 1,2,\ldots,n$,
721:       where $\sigma_j : \D0[I] \to \D0[I]$ is a linear map such that
722: \begin{equation}
723:   \sigma_j(\Delta_\alpha)
724:    = \left\{ \begin{array}{cl}
725:                 0, &\mbox{ if } \alpha_j=0,\\
726:                 \Delta_{\alpha-e_j}, &\mbox{ otherwise}.
727:              \end{array}
728:      \right.
729: \end{equation}
730: 
731: \end{itemize}
732: 
733: The basic idea of both DZ and ST algorithms is the same:
734: build up a basis of $\D0$ incrementally by computing $\D0^{(d)}$ for
735: $d=1,2,\ldots$ using the corresponding closedness condition.
736: The computation stops when $\D0^{(d)} = \D0^{(d-1)}$.
737: 
738: \begin{example}[Running example 2]\label{exa-small}
739: {\rm
740: Consider the system in $\bC[x_1,x_2]$ given by three polynomials
741: $f_1 = x_1x_2$, $f_2 = x_1^2-x_2^2$, and $f_3 = x_2^4$,
742: which has only one isolated root at~$(0,0)$.~\qex
743: }
744: \end{example}
745: 
746: \subsection{The Dayton-Zeng Algorithm}
747: 
748: We shall outline only a summary of this approach,
749: see~\cite{DZ05} for details.
750: 
751: If $\zero$ is a solution of the system,
752: then $\D0^{(0)} = \Span\{\Delta_\zero\}$.
753: 
754: At step $d>0$, we compute $\D0^{(d)}$.
755: Let the functional
756: \begin{equation}
757:    L = \sum_{|\alpha|\leq d,\ \alpha\neq \zero} c_\alpha
758:    \Delta_\alpha
759: \end{equation}
760: belong to the dual space $\D0^{(d)}$.
761: Then the vector of coefficients $c_\alpha$ is in the kernel of the
762: following matrix $M_{DZ}^{(d)}$ with $N B(d-1)$ rows and $B(d)-1$
763: columns, where $B(d)=\binom{n+d}{n}$ is the number of monomials in
764: $n$ variables of degree at most $d$.
765: 
766: The rows of $M_{DZ}^{(d)}$ are labelled with $x^\alpha f_j$, where
767: $|\alpha| < d$ and $j=1,2,\ldots,N$.
768: The columns correspond to
769: $\Delta_\beta$, where $\beta\neq\zero,\ |\beta|\leq d$.
770: \begin{equation}
771: \mbox{[The entry of $M_{DZ}^{(d)}$ in row $x^\alpha f_j$ and
772: column $\Delta_\beta$]} = \Delta_\beta(x^\alpha f_j).
773: \end{equation}
774: 
775: At the step $d=3$ we have the following $M_{DZ}^{(3)}$
776: $${\small
777: \begin{array}{c||cc|ccc|cccc}
778:  & \Delta_{(1,0)} & \Delta_{(0,1)} & \Delta_{(2,0)}
779:  & \Delta_{(1,1)} & \Delta_{(0,2)} & \Delta_{(3,0)}
780:  & \Delta_{(2,1)} & \Delta_{(1,2)} & \Delta_{(0,3)} \\ \hline \hline
781: f_1 & 0 & 0 & 0 & 1 &  0 & 0 & 0 & 0 & 0  \\
782: f_2 & 0 & 0 & 1 & 0 & -1 & 0 & 0 & 0 & 0  \\
783: f_3 & 0 & 0 & 0 & 0 &  0 & 0 & 0 & 0 & 0  \\ \hline
784: x_1f_1 & 0 & 0 & 0 & 0 & 0 & 0 & 1 & 0 & 0 \\
785: x_1f_2 & 0 & 0 & 0 & 0 & 0 & 1 & 0 & -1 & 0 \\
786: x_1f_3 & 0 & 0 & 0 & 0 & 0 & 0 & 0 & 0 & 0 \\
787: x_2f_1 & 0 & 0 & 0 & 0 & 0 & 0 & 0 & 1 & 0 \\
788: x_2f_2 & 0 & 0 & 0 & 0 & 0 & 0 & 1 & 0 & -1 \\
789: x_2f_3 & 0 & 0 & 0 & 0 & 0 & 0 & 0 & 0 & 0 \\ \hline
790: x_1^2f_1  & 0 & 0 & 0 & 0 & 0 & 0 & 0 & 0 & 0   \\
791: \vdots & \vdots & \vdots & \vdots & \vdots & \vdots
792: & \vdots & \vdots & \vdots  & \vdots
793: \end{array}
794: }%end\small
795: $$
796: Note that the last block of 9 rows is entirely zero.
797: 
798: Analyzing the kernel of this matrix one sees that there are no
799: functionals of degree 3 in the dual space, which is then is equal
800: to $\D0^{(2)}[I]$
801: \begin{equation}
802: \D0[I] = \Span\{\Delta_{(0,0)}, \Delta_{(1,0)}, \Delta_{(0,1)},
803: \Delta_{(2,0)} + \Delta_{(0,2)}\}.
804: \end{equation}
805: 
806: \subsection{The Stetter-Thallinger Algorithm}
807: 
808: The matrix $M_{ST}^{(d)}$ is a matrix consisting of $n+1$ blocks
809: stacked on top of each other:
810: 
811: \begin{itemize}
812: \item The top block contains the first $N$ rows of $M_{DZ}^{(d)}$;
813: 
814: \item For every $j=1,2,\ldots,n$, let $S_j^{(d)}$ be the
815: $(B(d-1)-1)\times (B(d)-1)$-matrix for the linear map
816: \begin{equation}
817:   \sigma_j : \D0^{(d)}/\Span\{\Delta_\zero\} \to
818: \D0^{(d-1)}/\Span\{\Delta_\zero\}
819: \end{equation}
820: w.r.t. standard bases of functionals.
821: 
822: The block $M_{ST}^{(d-1)}S_j$ represents the closedness condition
823: for the ``anti-derivation'' $\sigma_j$.
824: \end{itemize}
825: 
826: Let us go through the steps of the algorithm for the Example
827: \ref{exa-small}.
828: 
829: \noindent \textbf{Step 1.} At the beginning we have $M_{ST}^{(1)}$
830: equal to
831: $$
832: \begin{array}{c||cc}
833: 
834:     & \Delta_{(1,0)} & \Delta_{(0,1)}\\
835: \hline \hline
836: f_1 & 0              & 0             \\
837: f_2 & 0              & 0             \\
838: f_3 & 0              & 0             \\
839: 
840: \end{array}
841: $$
842: Therefore, $\D0^{(1)} = \Span \{ \Delta_{(0,0)}, \Delta_{(1,0)},
843: \Delta_{(0,1)} \}$.
844: 
845: 
846: \noindent \textbf{Step 2.} Since $M_{ST}^{(1)}S_j^{(2)}=0$ for all
847: $j$, the matrix $M_{ST}^{(2)}$ is
848: $$
849: \begin{array}{c||cc|ccc}
850: 
851:     & \Delta_{(1,0)} & \Delta_{(0,1)} & \Delta_{(2,0)} & \Delta_{(1,1)} & \Delta_{(0,2)}\\
852: \hline \hline
853: f_1 & 0 & 0 & 0 & 1 & 0  \\
854: f_2 & 0 & 0 & 1 & 0 & -1 \\
855: f_3 & 0 & 0 & 0 & 0 & 0  \\ \hline
856:     & 0 & 0 & 0 & 0 & 0  \\
857: \vdots & \vdots & \vdots & \vdots & \vdots & \vdots
858: \end{array}
859: $$
860: Therefore, $\D0^{(2)} = \Span \{ \Delta_{(0,0)}, \Delta_{(1,0)},
861: \Delta_{(0,1)}, \Delta_{(2,0)} + \Delta_{(0,2)} \}$.
862: 
863: We can ``prune'' the matrix $M_{ST}^{(2)}$ by row-reducing it to
864: the following matrix with the same kernel:
865: $$
866: \tilde M_{ST}^{(2)} = \left[
867: \begin{array}{ccccc}
868: 0 & 0 & 0 & 1 & 0  \\
869: 0 & 0 & 1 & 0 & -1 \\
870: \end{array}
871: \right]
872: $$
873: 
874: 
875: \noindent \textbf{Step 3.} Compute $S_1^{(3)}$ that represents
876: $\sigma_1$:
877: $${\small
878: \begin{array}{c||cc|ccc|cccc}
879: 
880:                & \Delta_{(1,0)} & \Delta_{(0,1)} & \Delta_{(2,0)} & \Delta_{(1,1)} & \Delta_{(0,2)} & \Delta_{(3,0)} & \Delta_{(2,1)} & \Delta_{(1,2)} & \Delta_{(0,3)}\\
881: \hline \hline
882: \Delta_{(1,0)} & 0              & 0              & 1              & 0              & 0              & 0              & 0              & 0              & 0               \\
883: \Delta_{(0,1)} & 0              & 0              & 0              & 1              & 0              & 0              & 0              & 0              & 0               \\
884: \hline
885: \Delta_{(2,0)} & 0              & 0              & 0              & 0              & 0              & 1              & 0              & 0              & 0               \\
886: \Delta_{(1,1)} & 0              & 0              & 0              & 0              & 0              & 0              & 1              & 0              & 0               \\
887: \Delta_{(0,2)} & 0              & 0              & 0              & 0              & 0              & 0              & 0              & 1              & 0               \\
888: \end{array}
889: }%end\small
890: $$
891: The matrix $S_2^{(3)}$ can be defined similarly.
892: 
893: The top block of the matrix $M_{ST}^{(3)}$ is
894: $${\small
895: \begin{array}{c||cc|ccc|cccc}
896: 
897:     & \Delta_{(1,0)} & \Delta_{(0,1)} & \Delta_{(2,0)} & \Delta_{(1,1)} & \Delta_{(0,2)} & \Delta_{(3,0)} & \Delta_{(2,1)} & \Delta_{(1,2)} & \Delta_{(0,3)}\\
898: \hline \hline
899: f_1 & 0              & 0              & 0              & 1              & 0                         & 0              & 0              & 0              & 0               \\
900: f_2 & 0              & 0              & 1              & 0              & -1                        & 0              & 0              & 0              & 0               \\
901: f_3 & 0              & 0              & 0              & 0              & 0                         & 0              & 0              & 0              & 0               \\
902: \end{array}
903: }%end\small
904: $$
905: 
906: Despite the last 4 columns being 0, there are no new elements of
907: order 3 in the dual space due to the other two blocks: $ \tilde
908: M_{ST}^{(2)} S_1^{(3)}$:
909: $${\small
910: \begin{array}{c||cc|ccc|cccc}
911:    & \Delta_{(1,0)} & \Delta_{(0,1)} & \Delta_{(2,0)} & \Delta_{(1,1)}
912:    & \Delta_{(0,2)} & \Delta_{(3,0)} & \Delta_{(2,1)} & \Delta_{(1,2)}
913:    & \Delta_{(0,3)}\\
914: \hline \hline
915: x_1f_1 & 0              & 0              & 0              & 0              & 0              & 0              & 1              & 0              & 0               \\
916: x_1f_2 & 0              & 0              & 0              & 0              & 0              & 1              & 0              & -1             & 0               \\
917: \end{array}
918: }%end\small
919: $$
920: and $ \tilde M_{ST}^{(2)} S_2^{(3)}$:
921: $${\small
922: \begin{array}{c||cc|ccc|cccc}
923:        & \Delta_{(1,0)} & \Delta_{(0,1)} & \Delta_{(2,0)} & \Delta_{(1,1)} & \Delta_{(0,2)} & \Delta_{(3,0)} & \Delta_{(2,1)} & \Delta_{(1,2)} & \Delta_{(0,3)}\\
924: \hline \hline
925: x_2f_1 & 0              & 0              & 0              & 0              & 0              & 0              & 0              & 1              & 0               \\
926: x_2f_2 & 0              & 0              & 0              & 0              & 0              & 0              & 1              & 0              & -1               \\
927: \end{array}
928: }%end\small
929: $$
930: 
931: \medskip
932: 
933: Comparing to DZ algorithm, in step 3, we managed to avoid the
934: computation of 9 last zero rows of $M_{DZ}^{(3)}$ in this
935: particular example.  We now also see how its 4 last nonzero rows
936: show up in the ``closedness condition'' blocks of $M_{DZ}^{(3)}$.
937: 
938: \section{Proofs and Algorithmic Details}\label{sec-general-deflation}
939: 
940: In this section we justify the main theorems stated before and
941: give details about the algorithms presented above.
942: 
943: \subsection{First-Order Deflation}\label{sec-old-deflation}
944: 
945: In this section we summarize our deflation method introduced in
946: \cite{LVZ06}. Not only it is done for the convenience of the reader,
947: but also for our own convenience as we plan to build a
948: higher-order deflation algorithm in Section
949: \ref{sec-general-deflation} using the algorithm following the
950: pattern established in this section.
951: 
952: \medskip
953: 
954: \noindent \textbf{One deflation step with fixed $\bfl$.} The basic
955: idea of the method is relatively simple. Let $\bfl\in\bC^n$ be a
956: nonzero vector in $\ker(A(\x^*))$, then the equations
957: \begin{equation}
958:    g_i(\x)= \bfl\cdot\nabla f_i(\x) = \sum_{i=1}^{n} \lambda_j
959: \frac{\partial f_i(\x)}{\partial x_j}, \quad i=1,2,\ldots,N
960: \end{equation}
961: have $\x^*$ as a solution. Moreover,
962: 
963: \begin{theorem}\label{thm-fixed-lambda}
964: The augmented system
965: \begin{equation}
966: G(\x) = (f_1,\ldots,f_N,g_1,\ldots,g_N)(\x)=\zero
967: \end{equation}
968: of equations in $\bC[\x]$ is a {{\em deflation}} of the original
969: system $F(\x)=\zero$ at $x^*$, i.e.  $G(\x^*)=0$ and the
970: multiplicity of the solution $x^*$ is lower in the new system.
971: \end{theorem}
972: 
973: The original proof of this statement in \cite{LVZ06} uses the notion
974: of a standard basis of the ideal $I = (f_1,f_2,\ldots,f_N)$ in the
975: polynomial ring $R = \bC[\x]$ w.r.t. a local order; this tool of
976: computational commutative algebra can be used to obtain the
977: multiplicity of $\x^*$, which is defined as the $\bC$-dimension of
978: the local quotient ring $R_\x / R_x I$.
979: 
980: On the other hand it is in correspondence with another way of
981: looking at multiplicities -- dual spaces of local functionals, so
982: the proof can be written in that language as well
983: (see Section \ref{sec-multiplicity}).
984: 
985: \noindent \textbf{One deflation step with indeterminate $\bfl$.}
986: Without loss of generality, we may assume $\corank(A(\x^*))=1$;
987: consult \cite{LVZ06} to see how the general case is reduced to this.
988: Consider $N+1$ additional polynomials in $\bC[\x,\bfl]$ in $2n$
989: variables:
990: \begin{equation}
991: g_i(\x,\bfl) = \bfl\cdot\nabla f_i(\x) = \sum_{j=1}^{n} \lambda_j
992: \frac{\partial f_i(\x)}{\partial x_j},\ (i=1,2,\ldots,N)
993: \end{equation}
994: \begin{equation}
995: h(\bfl) = \sum_{j=1}^{n} b_j \lambda_j - 1,
996: \end{equation}
997: where the coefficients $b_j$ are random complex numbers.
998: 
999: \begin{theorem} \label{thm-deflation-step}
1000: Let $\x^*\in\bC^n$ be an isolated solution of $F(\x)=\zero$ (in
1001: $\bC[\x]$).
1002: 
1003: For a generic choice of coefficients $b_j$, $j=1,2,\ldots,n$, there
1004: exists a unique $\bfl^*\in\bC^n$ such that the system
1005: \begin{equation}
1006: G(\x,\bfl) = (f_1,\ldots,f_N,g_1,\ldots,g_N,h)(\x,\bfl)=0
1007: \end{equation}
1008: of equations in $\bC[\x,\bfl]$ has an isolated solution at
1009: $(\x^*,\bfl^*)$.
1010: 
1011: The multiplicity of $(\x^*,\bfl^*)$ in $G(\x,\bfl)=\zero$ is lower
1012: than that of $\x^*$ in $F(\x)=\zero$.
1013: \end{theorem}
1014: 
1015: \noindent {\em Proof.} Follows from Proposition 3.4 in \cite{LVZ06}.~\qed
1016: 
1017: Theorem \ref{thm-deflation-step} provides a recipe for the
1018: deflation algorithm: one simply needs to keep deflating until the
1019: solution of the augmented system corresponding to $\x^*$ becomes
1020: regular.
1021: 
1022: As a corollary we have that the number of deflations needed to
1023: make a singular isolated solution $\x^*$ regular is less than the
1024: multiplicity of~$\x^*$.
1025: 
1026: \subsection{Higher-Order Deflation with Fixed Multipliers}
1027: 
1028: We use the deflation operator to define an augmented system.
1029: 
1030: \begin{theorem}\label{thm-fixed-lambda-general}
1031: Let $f_1,f_2,\ldots,f_N$ form a standard basis of $I$ w.r.t. the order
1032: opposite to $\succeq$.  Consider the system $G^{(d)}(\x) = \zero$
1033: in $\bC[\x]$, where
1034: \begin{equation}
1035: G^{(d)}(\x) = \left\{\begin{array}{rc}
1036: f_j(\x) &(j=1,2,\ldots,N)\\
1037: g_{j,\alpha}(\x) &(j=1,2,\ldots,N,\ |\alpha|<d)\\
1038: \end{array}\right..
1039: \end{equation}
1040: \begin{description}
1041: \item{(a)} The system $G^{(d)}(\x) = \zero$ is a deflation of the
1042: original system $F(\x)=\zero$ at~$\x^*$.
1043: \item{(b)} Let $I = (F)$ and $J = (G^{(d)})$ be the ideals generated by
1044: polynomials of the systems and $\succeq$ be a global monomial
1045: order on $\ZZ_{\geq 0}^n$.
1046: Then the following relation holds for initial supports
1047: \begin{equation}
1048: \IN_\succeq(\D0[J]) \subset \{\beta-\beta_Q\ |\
1049: \beta\in\IN_\succeq(\D0[I])\} \cap \ZZ_{\geq 0}^n,
1050: \end{equation}
1051: where $\beta_Q$ is the maximal element of the set
1052: $\IN_\succeq(\D0[I])\cap\{\beta : |\beta|\leq d \}$.
1053: \end{description}
1054: 
1055: \end{theorem}
1056: 
1057: \noindent {\em Proof.}
1058: Let $\bfl \in \ker (A^{(d)}(\x^*))$ be the vector used above to
1059: construct the operator $Q \in \bC[\bfp]$ and the equations
1060: $g_{j,\alpha}(\x)=0$.
1061: 
1062: First of all, $g_{j,\alpha}(\x^*) = (Q\cdot (\x^\alpha
1063: f_j))|_{\x=\x^*} = 0$ provided $|\alpha| < d$ (by construction),
1064: hence, $\x^*$ is a solution to $G^{(d)}(\x) = \zero$.
1065: 
1066: To prove (a), it remains to show that the multiplicity drops,
1067: which follows from part (b) that is treated in the rest of this proof.
1068: 
1069: We shall assume for simplicity that $\x^*=\zero$. This is done
1070: without the loss of generality using a linear change of
1071: coordinates: $\x\mapsto\x+\x^*$. It is important to note that in
1072: the new coordinates polynomials $Q\cdot(\x^\alpha f_j(\x+\x^*))$
1073: generate the same ideal as the polynomials
1074: $Q\cdot((\x-\x^*)^\alpha f_j(\x+\x^*))$.
1075: 
1076: Recall that $I = \langle F \rangle = \langle f_1,f_2,\ldots,f_N \rangle$,
1077: let $J = \langle G^{(d)} \rangle \supset I$ be the ideal generated
1078: by the polynomials in the augmented system. The reversed
1079: containment holds for the dual spaces: $\D0[I] \supset \D0[J]$.
1080: 
1081: There is a 1-to-1 correspondence between linear differential
1082: operators and linear differential functionals:
1083: \begin{equation}
1084: \sum \lambda_\beta\bfp^\beta \longleftrightarrow \sum
1085: \lambda_\beta\beta!\Delta_\beta.
1086: \end{equation}
1087: Let $\phi: \bC[\bfp] \to \D0$ and $\tau: \D0 \to \bC[\bfp]$ be the
1088: corresponding bijections.
1089: 
1090: As in Section \ref{sec-multiplicity} we order terms $\Delta_\beta$
1091: with $\succeq$, a global monomial order. Notice that since the
1092: choice of coefficients of the operator $Q$ is generic, $\beta_Q =
1093: \IN_\succeq(Q) = \IN_\succeq(\phi(Q))$ is the maximal element of
1094: the set $\IN_\succeq(\D0[I])\cap\{\beta : |\beta|\leq d \}$.
1095: 
1096: Next, we use the condition that $f_i$ form a standard basis. Since
1097: the corners of the staircase correspond to the initial terms of
1098: $f_i$, by Lemma \ref{lem-drop} the staircase created with the
1099: corners at $\IN_\geq(Q\cdot(\x^\alpha f_i))$ bounds the set
1100: $\{\beta-\beta_Q\ |\ \beta\in\IN_\succeq(\D0[I])\} \cap \ZZ_{\geq
1101: 0}^n$, which, therefore, contains the initial support of $\D0[J]$.~\qed
1102: 
1103: \begin{corollary}
1104: If there exist a local monomial order $\geq$ such that the minimal
1105: (standard) monomial in the set $\{\x^\alpha \notin \IN_\geq(I) :
1106: |\alpha|\leq d \}$ is minimal in the set of all standard
1107: monomials, then $\x^*$ is a regular solution of $G^{(d)}(\x) =
1108: \zero$.
1109: \end{corollary}
1110: 
1111: Ideally we would like to be able to drop the assumption of the
1112: original polynomials forming a standard basis, since computing
1113: such a basis is a complex symbolic task, whereas our interest lies
1114: in the further numericalization of the approach. The following
1115: weaker statement works around this restriction.
1116: 
1117: Assuming $\x^*=\zero$, let $\supp(F) = \bigcup_{j=1,2,\ldots,N}
1118: \supp(f_j)$.
1119: 
1120: \begin{proposition}\label{prop-corank-drop}
1121: Assume $A(\zero) = \zero$. Let  $d_0 = \min\{|\alpha| : x^\alpha
1122: \in \supp(F) \}$.
1123: 
1124: Then, in the notation of Theorem \ref{thm-fixed-lambda-general},
1125: for a generic deflating operator $Q$ the system $G^{(d)}(\x) =
1126: \zero$, where, $d<d_0$ is a deflation of the original system
1127: $F(\x)=\zero$ at the origin.
1128: 
1129: Moreover, if $d = d_0-1$ then the Jacobian of $G^{(d)}(\zero)$ is
1130: not equal to zero.
1131: \end{proposition}
1132: 
1133: \noindent {\em Proof.}
1134: Fix a local monomial ordering that respects the degree. With the
1135: above assumptions, the initial ideal $\IN (\langle F \rangle)$
1136: will contain monomials of degree at least $d_0$. On the other
1137: hand, for a generic choice of the deflating operator $Q$ the
1138: support $\supp(G^{(d)})$ would contain a monomial of degree less
1139: than $d_0$. Therefore, there exists a monomial in
1140: $\IN(\langle\supp(G^{(d)})\rangle)$ that is not in $\IN (\langle F
1141: \rangle)$, hence, $G^{(d)}$ is a deflation.
1142: 
1143: If $d = |d_0|-1$, then there is such monomial of degree 1, which
1144: means that the Jacobian of the augmented system is nonzero.~\qed
1145: 
1146: \begin{remark}{\rm \label{rem-homogeneous}
1147:   Note that if the deflation order $d$ is as in
1148:   Proposition \ref{prop-corank-drop}, then it suffices to take an
1149:   arbitrary \emph{homogeneous} deflation operator of order $d$.
1150: }
1151: \end{remark}
1152: 
1153: Next we explain the practical value of
1154: Proposition~\ref{prop-corank-drop}. Let $K = \ker A(\zero)$ and $c
1155: = \corank A(\zero) = \dim K$. Without a loss of generality we may
1156: assume that $K$ is the subspace of $\bC^n$ has
1157: $\{x_1,\ldots,x_c\}$ as coordinates.
1158: 
1159: Now consider the system $F'(x_1,\ldots,x_c) =
1160: F(x_1,\ldots,x_c,0,\ldots,0)$. This system has an isolated
1161: solution at the origin, and Proposition \ref{prop-corank-drop} is
1162: applicable, since the Jacobian is zero. Moreover, if we take the
1163: deflation of order $d=d_0-1$ of the original system $F$, with
1164: $d_0$ coming from the Proposition, the corank of the Jacobian the
1165: augmented system $G^{(d)}$ is guaranteed to be lower than that
1166: of~$A(\zero)$.
1167: 
1168: \medskip
1169: 
1170: Let us go back to the general setup: an arbitrary isolated
1171: solution $\x^*$, the Jacobian $A(\x^*)$ with a proper kernel $K$,
1172: etc. Algorithm~\ref{alg_MinOrderForCorankDrop}
1173: is a practical algorithm that can be executed numerically knowing
1174: only an approximation to~$\x^*$.
1175: 
1176: \noindent {\em Proof.} [Proof of correctness of
1177: Algorithm~\ref{alg_MinOrderForCorankDrop} for $\x^0 = \x^*$.]
1178: We can get to the special setting
1179: of Proposition \ref{prop-corank-drop} in two steps. First, apply
1180: an affine transformation that takes $\x^*$ to the origin and $\ker
1181: A(\x^*)$ to the subspace $K$ of $\bC^n$ spanned by the first
1182: $c=\corank A(\x^*)$ standard basis vectors. Second, make a new
1183: system $F'(x_1,\ldots,x_c)=0$ by substituting the $x_i=0$ in $F$
1184: for $i>c$.
1185: 
1186: Let $\gamma' =(\gamma'_1,\ldots,\gamma'_c)\in K$ be the image of
1187: the generic vector $\gamma$ under the linear part of the affine
1188: transform. Then $H(t)=F'(\gamma'_1 t,\ldots,\gamma'_c t)$.
1189: 
1190: Since $\gamma'$ is generic, the lowest degree $d_0$ of the
1191: monomial in $\supp(F')$ is equal to $\min\{ a\ |\ t^a \in \supp
1192: H(t) \}$. According to the Proposition \ref{prop-corank-drop} and
1193: the discussion that followed, $d=d_0-1$ is the minimal order of
1194: deflation that will reduce the rank of the system.~\qed
1195: 
1196: \begin{remark}{\rm \label{rem-truncated-deflation-matrix}
1197:   In view of Remark \ref{rem-homogeneous} it would be enough to use any
1198:   \emph{homogeneous} deflation operator of order $d$:
1199: \begin{equation}
1200:     Q = \sum_{|\beta| = d}
1201:         \lambda_\beta\partial^\beta \ \in \bC[\bfp],
1202: \end{equation}
1203: such that the vector $\bfl$ of its coefficients is in the kernel of the
1204: \emph{truncated deflation matrix}, which contains
1205: only the rows corresponding to the original polynomials $F$ and only
1206: the columns labelled with $\partial^\beta$ with $|\beta|=d$.
1207: }
1208: \end{remark}
1209: 
1210: \subsection{Indeterminate Multipliers}
1211: 
1212: As in Section \ref{sec-old-deflation}, we now consider
1213: indeterminate $\lambda_\beta$. Now we should think of the
1214: differential operator $L(\bfl) \in \bC[\bfl, \partial]$ and of
1215: additional equations $g_{j,\alpha}(\x, \bfl) \in \bC[\x,\bfl]$ as
1216: depending on $\bfl$.
1217: 
1218: \noindent {\em Proof of Theorem~\ref{thm-deflation-step-general}.}
1219: Picking $m = \corank(A^{(d)}(\x^*))$ generic linear equations
1220: $h_k$ guarantees that for $\x = \x^*$ the solution for $\bfl$
1221: exists and is unique; therefore, the first part of the statement
1222: is proved.
1223: 
1224: The argument for the drop in the multiplicity is similar to that
1225: of the proof of Theorem \ref{thm-deflation-step}.~\qed
1226: 
1227: \section{Computational Experiments}
1228: 
1229: We have implemented our new deflation methods in
1230: PHCpack~\cite{V99} and Maple.  Below we report on two examples.
1231:  
1232: One crucial decision in the deflation algorithm is the determination
1233: of the numerical rank, for which we may use SVD or QR in the rank-revealing
1234: algorithms.  Both SVD and QR are numerically stable.  We summarize the
1235: result from~\cite[page~118]{Dem97} for the problem of solving an
1236: overdetermined linear system $A \x = b$.  The solution obtained by
1237: QR or SVD minimizes the residual
1238: $|| (A + \delta A) \widetilde{\x} - (b + \delta b) ||_2$ where
1239: the relative errors have the same magnitude as the machine
1240: precision~$\epsilon$:
1241: \begin{equation}
1242:    {\rm max}\left( \frac{||\delta A||_2}{||A||_2} ,
1243:                    \frac{||\delta b||_2}{||b||_2} \right) = O(\epsilon).
1244: \end{equation}
1245: 
1246: \subsection{Running Example 1}
1247: 
1248: To find initial approximations for the roots
1249: of the system~(\ref{equ-running}), we must first make the system
1250: ``square'', i.e.: having as many equations as unknowns, so
1251: we may apply the homotopies available in PHCpack~\cite{V99}.
1252: Using the embedding technique of~\cite{SV00}
1253: (see also~\cite{SW05}), we add one
1254: slack variable~$z$ to each equation of the system,
1255: multiplied by random complex constants
1256: $\gamma_1$, $\gamma_2$, and $\gamma_3$:
1257: 
1258: \begin{equation} \label{equ-embed-running}
1259:   E(\x,z)
1260:   = \left\{
1261:        \begin{array}{c}
1262:           x_1^3 + x_1 x_2^2 + \gamma_1 z = 0 \\
1263:           x_1 x_2^2 + x_2^3 + \gamma_2 z = 0 \\
1264:           x_1^2x_2 + x_1x_2^2 + \gamma_3 z = 0.
1265:        \end{array}
1266:     \right.
1267: \end{equation}
1268: Observe that the solutions of the original system $F(\x) = \zero$
1269: occur as solutions of the embedded system $E(\x,z) = \zero$
1270: with slack variable~$z = 0$.
1271: At the end points of the solution paths defined by a homotopy
1272: to solve $E(\x,z) = \zero$, we find nine zeroes close to the origin.
1273: These nine approximate zeroes are the input to our deflation algorithm.
1274: 
1275: The application of our first deflation algorithm in~\cite{LVZ06}
1276: requires two stages.
1277: The Jacobian matrix of $F(\x) = \zero$ has rank zero at $(0,0)$.
1278: After the first deflation with one multiplier, the rank of the
1279: Jacobian matrix of the augmented system $G(\x,\bfl_1) = \zero$
1280: equals one, so the second deflation step uses two multipliers.
1281: After the second deflation step, the Jacobian matrix has full
1282: rank, and~$(0,0)$ has then become a regular solution.
1283: Newton's method on the final system then converges again quadratically
1284: and the solution can be approximated efficiently with great accuracy.
1285: Once the precise location of a multiple root is known,
1286: we are interested in its multiplicity.
1287: The algorithm of~\cite{DZ05} reveals that the multiplicity
1288: of the isolated root equals seven.
1289: 
1290: Starting at a root of low accuracy, at a distance of $10^{-5}$
1291: from the exact root, the numerical implementation of
1292: Algorithm~\ref{alg_MinOrderForCorankDrop} predicts two as the
1293: order, using $10^{-4}$ as the tolerance for the vanishing of the
1294: coefficients in the univariate interpolating polynomial.  The
1295: Jacobian matrix of the augmented system $G^{(2)}$ has full rank so
1296: that a couple of iterations suffice to compute the root very
1297: accurately.
1298: 
1299: \subsection{A Larger Example}
1300: 
1301: The following system is copied from~\cite{Lec02}:
1302: \begin{equation}
1303:    F(\x) =
1304:    \left\{
1305:      \begin{array}{c}
1306:         2 x_1 + 2 x_1^2 + 2 x_2 + 2 x_2^2 + x_3^2 - 1 = 0 \\
1307:         (x_1 + x_2 - x_3 - 1)^3 - x_1^3 = 0 \\
1308:         (2 x_1^3 + 2 x_2^2 + 10 x_3 + 5 x_3^2 +5)^3-1000 x_1^5 = 0.
1309:      \end{array}
1310:    \right.
1311: \end{equation}
1312: Counted with multiplicities, the system has 54 isolated solutions.
1313: We focus on the solution $(0,0,-1)$ which occurs with multiplicity~18.
1314: 
1315: Although Algorithm~1 %\ref{alg-MinOrderForCorankDrop}
1316: suggests that the first-order deflation would already lower the
1317: corank of the system, we would like to search for a homogeneous
1318: deflation operator $Q$ of order two.
1319: 
1320: To this end we construct the (truncated) deflation matrix $\bar
1321: A(x_1,x_2,x_3)$ with has 12 rows and only 6 columns, which
1322: correspond to $\{\partial_1^2, \partial_1\partial_2,
1323: \partial_1\partial_3,
1324: \partial_2^2, \partial_2\partial_3, \partial_3^2\}$.
1325: 
1326: The kernel of $\bar A(0,0,-1)$ is spanned 
1327: by $(1, 6, 8, -3, 0, 4)^T$ and $(0, 3, 3, -1, 1, 2)^T$.
1328: The operator corresponding to the former,
1329: \begin{equation}
1330:     Q = \partial_1^2 + 6 \partial_1\partial_2
1331:      + 8 \partial_1\partial_3 - 3 \partial_2^2 + 4 \partial_3^2,
1332: \end{equation}
1333: regularizes the system, since the equations
1334: \begin{equation}
1335:   \left\{
1336:      \begin{array}{rcrcrcrcrcl}
1337:        Q\cdot(x_1f_1) &=& 8 x_1 & + & 24 x_2 & + & 16 x_3 & + & 16 & = & 0 \\
1338:        Q\cdot(x_2f_1) &=& 24 x_1 & - & 24 x_2 &   &        &   &    & = & 0 \\
1339:        Q\cdot(x_3f_1) &=& 32 x_1 &   &        & + & 16 x_3 & + & 16 & = & 0.
1340:      \end{array}
1341:   \right.
1342: \end{equation}
1343: augmented to the original equations, give a system with the
1344: full-rank Jacobian matrix at $(0,0,-1)$.
1345: 
1346: \section{Conclusion}
1347: 
1348: In this paper we have described two methods of computing the
1349: multiplicity structure at isolated solutions of polynomial
1350: systems.  We have developed a higher-order deflation algorithm that
1351: reduces the multiplicity faster than the first-order deflation 
1352: in~\cite{LVZ06}.
1353: 
1354: In our opinion, one of the main benefits of the higher order deflation
1355: for the numerical algebraic geometry algorithms is the possibility to 
1356: regularize the system in a single step. 
1357: For that one has to determine the minimal order of such a deflation or,
1358: even better, construct a sparse ansatz for its deflation operator.
1359: Predicting these numerically could be a very challenging task, 
1360: which should be explored in the future.
1361:    
1362: \bibliographystyle{plain}
1363: \bibliography{hod}
1364: 
1365: \end{document}
1366: 
1367: \begin{thebibliography}{10}
1368: 
1369: \bibitem{ABHJ99}
1370: E.L. Allgower, K.~B{\"{o}}hmer, A.~Hoy, and Janovsk{\'{y}}.
1371: \newblock Direct methods for solving singular nonlinear equations.
1372: \newblock {\em ZAMM Z.\ Angew.\ Math.\ Meth.}, 79(4):219--231, 1999.
1373: 
1374: \bibitem{BPS06}
1375: D.J. Bates, C.~Peterson, and A.J. Sommese.
1376: \newblock A numerical-symbolic algorithm for computing the multiplicity of a
1377:   component of an algebraic set.
1378: \newblock {\em J.\ Complexity} 22(4): 475--489, 2006.
1379: 
1380: \bibitem{DZ05}
1381: B.H. Dayton and Z.~Zeng.
1382: \newblock Computing the multiplicity structure in solving polynomial systems.
1383: \newblock In M.~Kauers, editor, {\em Proceedings of the 2005 International
1384:   Symposium on Symbolic and Algebraic Computation}, pages 116--123. ACM, 2005.
1385: 
1386: \bibitem{Deu04}
1387: P.~Deuflhard.
1388: \newblock {\em Newton Methods for Nonlinear Problems. Affine Invariance and
1389:   Adaptive Algorithms}.
1390: \newblock Springer-Verlag, 2004.
1391: 
1392: \bibitem{Gov00}
1393: W.J.F. Govaerts.
1394: \newblock {\em Numerical Methods for Bifurcations of Dynamical Equilibria}.
1395: \newblock SIAM, 2000.
1396: 
1397: \bibitem{GP96}
1398: G.-M. Greuel and G.~Pfister.
1399: \newblock Advances and improvements in the theory of standard bases and
1400:   syzygies.
1401: \newblock {\em Arch. Math.}, 66:163--196, 1996.
1402: 
1403: \bibitem{GP02}
1404: G.-M. Greuel and G.~Pfister.
1405: \newblock {\em A Singular Introduction to Commutative Algebra}.
1406: \newblock Springer-Verlag, 2002.
1407: 
1408: \bibitem{GPS01}
1409: G.-M. Greuel, G.~Pfister, and H.~Sch\"onemann.
1410: \newblock {\sc Singular} 2.0.
1411: \newblock {A Computer Algebra System for Polynomial Computations}, Centre for
1412:   Computer Algebra, University of Kaiserslautern, 2001.
1413: \newblock {\tt http://www.singular.uni-kl.de}.
1414: 
1415: \bibitem{Kun96}
1416: P.~Kunkel.
1417: \newblock A tree-based analysis of a family of augmented systems for the
1418:   computation of singular points.
1419: \newblock {\em {IMA} J. Numer. Anal.}, 16:501--527, 1996.
1420: 
1421: \bibitem{Lec02}
1422: G.~Lecerf.
1423: \newblock Quadratic {N}ewton iteration for systems with multiplicity.
1424: \newblock {\em Found. Comput. Math.}, 2:247--293, 2002.
1425: 
1426: \bibitem{LVZ06}
1427: A.~Leykin, J.~Verschelde, and A.~Zhao.
1428: \newblock Newton's method with deflation for isolated singularities of
1429:   polynomial systems.
1430: \newblock {\em Theoretical Computer Science} 359(1-3): 111-122, 2006.
1431: 
1432: \bibitem{LVZ05}
1433: A.~Leykin, J.~Verschelde, and A.~Zhao.
1434: \newblock Evaluation of {J}acobian matrices for {N}ewton's method with
1435:   deflation to approximate isolated singular solutions of polynomial systems.
1436: \newblock In D.~Wang and L.~Zhi, editors, {\em SNC 2005 Proceedings.
1437:   International Workshop on Symbolic-Numeric Computation. Xi'an, China, July
1438:   19-21, 2005}, pages 19--28, 2005.
1439: 
1440: \bibitem{Lij04}
1441: Y.~Lijun.
1442: \newblock On the generalized {L}yapunov-{S}chmidt reduction.
1443: \newblock {\em ZAMM Z. Angew. Math. Mech.}, 84(8):528--537, 2004.
1444: 
1445: \bibitem{Macaulay2}
1446: D. Grayson and M. Stillman.
1447: \newblock {Macaulay 2, a software system for research in algebraic geometry}.
1448: \newblock {Available at http://www.math.uiuc.edu/Macaulay2/}
1449: 
1450: \bibitem{Mac16}
1451: F.S. Macaulay.
1452: \newblock {\em The Algebraic Theory of Modular Systems}.
1453: \newblock Cambridge University Press, 1916.
1454: \newblock Reissued with an Introduction by Paul Roberts in the Cambridge
1455:   Mathematical Library 1994.
1456: 
1457: \bibitem{Mor82}
1458: F.~Mora.
1459: \newblock An algorithm to compute the equations of tangent cones.
1460: \newblock In J.~Calmet, editor, {\em Computer Algebra. EUROCAM'82, European
1461:   Computer Algebra Conference. Marseille, France, April 1982.}, volume 144 of
1462:   {\em Lecture Notes in Computer Science}, pages 158--165. Springer-Verlag,
1463:   1982.
1464: 
1465: \bibitem{Mou97}
1466: B.~Mourrain.
1467: \newblock Isolated points, duality and residues.
1468: \newblock {\em Journal of Pure and Applied Algebra}, 117/118:469--493, 1997.
1469: 
1470: \bibitem{OWM83}
1471: T.~Ojika, S.~Watanabe, and T.~Mitsui.
1472: \newblock Deflation algorithm for the multiple roots of a system of nonlinear
1473:   equations.
1474: \newblock {\em J.\ Math.\ Anal.\ Appl.}, 96:463--479, 1983.
1475: 
1476: \bibitem{SV00}
1477: A.J. Sommese and J.~Verschelde.
1478: \newblock Numerical homotopies to compute generic points on positive
1479:   dimensional algebraic sets.
1480: \newblock {\em J.\ of Complexity}, 16(3):572--602, 2000.
1481: 
1482: \bibitem{SW05}
1483: A.J. Sommese and C.W. Wampler.
1484: \newblock {\em The Numerical solution of systems of polynomials arising in
1485:   engineering and science}.
1486: \newblock World Scientific, 2005.
1487: 
1488: \bibitem{Ste04}
1489: H.J. Stetter.
1490: \newblock {\em Numerical Polynomial Algebra}.
1491: \newblock SIAM, 2004.
1492: 
1493: \bibitem{ST98}
1494: H.J. Stetter and G.T. Thallinger.
1495: \newblock Singular systems of polynomials.
1496: \newblock In O.~Gloor, editor, {\em Proceedings of the 1998 International
1497:   Symposium on Symbolic and Algebraic Computation}, pages 9--16. ACM, 1998.
1498: 
1499: \bibitem{Tha98}
1500: G.T. Thallinger.
1501: \newblock {\em Zero Behavior in Perturbed Systems of Polynomial Equations}.
1502: \newblock PhD thesis, Tech.\ Univ.\ Vienna, 1998.
1503: 
1504: \bibitem{V99}
1505: J.~Verschelde.
1506: \newblock Algorithm 795: {PHC}pack: A general-purpose solver for polynomial
1507:   systems by homotopy continuation.
1508: \newblock {\em ACM Trans. Math. Softw.}, 25(2):251--276, 1999.
1509: \newblock Software available at {\tt http://www.math.uic.edu/{\~{}}jan}.
1510: 
1511: \bibitem{VZ04}
1512: J.~Verschelde and A.~Zhao.
1513: \newblock Newton's method with deflation for isolated singularities.
1514: \newblock Poster presented at ISSAC'04, 6 July 2004, Santander, Spain.
1515:   Available at {\tt http://www.math.uic.edu/{\~{}}jan/poster.pdf} and at {\tt
1516:   http://www.math.uic.edu/{\~{}}azhao1/poster.pdf}.
1517: 
1518: \end{thebibliography}
1519: 
1520: \end{document}
1521: