Quantifier elimination

Quantifier elimination is a concept of simplification used in mathematical logic, model theory, and theoretical computer science. Informally, a quantified statement "$\exists x$ such that $\ldots$" can be viewed as a question "When is there an $x$ such that $\ldots$?", and the statement without quantifiers can be viewed as the answer to that question.

One way of classifying formulas is by the amount of quantification. Formulas with less depth of quantifier alternation are thought of as being simpler, with the quantifier-free formulas as the simplest. A theory has quantifier elimination if for every formula $\alpha$, there exists another formula $\alpha _{QF}$ without quantifiers that is equivalent to it (modulo this theory).

Examples

An example from high school mathematics says that a single-variable quadratic polynomial has a real root if and only if its discriminant is non-negative:

$\exists x\in \mathbb {R} .(a\neq 0\wedge ax^{2}+bx+c=0)\ \ \Longleftrightarrow \ \ a\neq 0\wedge b^{2}-4ac\geq 0$

Here the sentence on the left-hand side involves a quantifier $\exists x\in \mathbb {R}$, whereas the equivalent sentence on the right does not.

Examples of theories that have been shown decidable using quantifier elimination are Presburger arithmetic, algebraically closed fields, real closed fields, atomless Boolean algebras, term algebras, dense linear orders, abelian groups, random graphs, as well as many of their combinations such as Boolean algebra with Presburger arithmetic, and term algebras with queues.

Quantifier eliminator for the theory of the real numbers as an ordered additive group is Fourier–Motzkin elimination; for the theory of the field of real numbers it is the Tarski–Seidenberg theorem.

Quantifier elimination can also be used to show that "combining" decidable theories leads to new decidable theories (see Feferman–Vaught theorem).

Algorithms and decidability

If a theory has quantifier elimination, then a specific question can be addressed: Is there a method of determining $\alpha _{QF}$ for each $\alpha$? If there is such a method we call it a quantifier elimination algorithm. If there is such an algorithm, then decidability for the theory reduces to deciding the truth of the quantifier-free sentences. Quantifier-free sentences have no variables, so their validity in a given theory can often be computed, which enables the use of quantifier elimination algorithms to decide validity of sentences.

Related concepts

Various model-theoretic ideas are related to quantifier elimination, and there are various equivalent conditions.

Every first-order theory with quantifier elimination is model complete. Conversely, a model-complete theory, whose theory of universal consequences has the amalgamation property, has quantifier elimination.

The models of the theory of the universal consequences of a theory $T$ are precisely the substructures of the models of $T$. The theory of linear orders does not have quantifier elimination. However the theory of its universal consequences has the amalgamation property.

Basic ideas

To show constructively that a theory has quantifier elimination, it suffices to show that we can eliminate an existential quantifier applied to a conjunction of literals, that is, show that each formula of the form:

$\exists x.\bigwedge _{i=1}^{n}L_{i}$

where each $L_{i}$ is a literal, is equivalent to a quantifier-free formula. Indeed, suppose we know how to eliminate quantifiers from conjunctions of literals, then if $F$ is a quantifier-free formula, we can write it in disjunctive normal form

$\bigvee _{j=1}^{m}\bigwedge _{i=1}^{n}L_{ij},$

and use the fact that

$\exists x.\bigvee _{j=1}^{m}\bigwedge _{i=1}^{n}L_{ij}$

is equivalent to

$\bigvee _{j=1}^{m}\exists x.\bigwedge _{i=1}^{n}L_{ij}.$

Finally, to eliminate a universal quantifier

$\forall x.F$

where $F$ is quantifier-free, we transform $\lnot F$ into disjunctive normal form, and use the fact that $\forall x.F$ is equivalent to $\lnot \exists x.\lnot F.$

Relationship with decidability

In early model theory, quantifier elimination was used to demonstrate that various theories possess properties like decidability and completeness. A common technique was to show first that a theory admits elimination of quantifiers and thereafter prove decidability or completeness by considering only the quantifier-free formulas. This technique can be used to show that Presburger arithmetic is decidable.

Theories could be decidable yet not admit quantifier elimination. Strictly speaking, the theory of the additive natural numbers did not admit quantifier elimination, but it was an expansion of the additive natural numbers that was shown to be decidable. Whenever a theory is decidable, and the language of its valid formulas is countable, it is possible to extend the theory with countably many relations to have quantifier elimination (for example, one can introduce, for each formula of the theory, a relation symbol that relates the free variables of the formula).

Example: Nullstellensatz for algebraically closed fields and for differentially closed fields.

See also

• Cylindrical algebraic decomposition
• Elimination theory
• Conjunction elimination

References

• Brown, Christopher W. (July 31, 2002). "What is Quantifier Elimination". Retrieved 30 August 2023.

• Cooper, D.C. (1972). Meltzer, Bernard; Michie, Donald (eds.). "Theorem Proving in Arithmetic without Multiplication" (PDF). Machine Intelligence. 7. Edinburgh: Edinburgh University Press: 91–99. Retrieved 30 August 2023.

• Enderton, Herbert (2001). A mathematical introduction to logic (2nd ed.). Boston, MA: Academic Press. ISBN 978-0-12-238452-3.

• Fried, Michael D.; Jarden, Moshe (2008). Field arithmetic. Ergebnisse der Mathematik und ihrer Grenzgebiete. 3. Folge. Vol. 11 (3rd revised ed.). Springer-Verlag. ISBN 978-3-540-77269-9. Zbl 1145.12001.

• Grädel, Erich; Kolaitis, Phokion G.; Libkin, Leonid; Maarten, Marx; Spencer, Joel; Vardi, Moshe Y.; Venema, Yde; Weinstein, Scott (2007). Finite model theory and its applications. Texts in Theoretical Computer Science. An EATCS Series. Berlin: Springer-Verlag. ISBN 978-3-540-00428-8. Zbl 1133.03001.

• Hodges, Wilfrid (1993). Model Theory. Encyclopedia of Mathematics and its Applications. Vol. 42. Cambridge University Press. doi:10.1017/CBO9780511551574. ISBN 9780521304429.

• Kuncak, Viktor; Rinard, Martin (2003). "Structural subtyping of non-recursive types is decidable" (PDF). 18th Annual IEEE Symposium of Logic in Computer Science, 2003. Proceedings. pp. 96–107. doi:10.1109/LICS.2003.1210049. ISBN 0-7695-1884-2. S2CID 14182674.

• Monk, J. Donald (2012). Mathematical Logic (Graduate Texts in Mathematics (37)) (Softcover reprint of the original 1st ed. 1976 ed.). Springer. ISBN 9781468494549.

• Nipkow, Tobias (2010). "Linear Quantifier Elimination" (PDF). Journal of Automated Reasoning. 45 (2): 189–212. doi:10.1007/s10817-010-9183-0. S2CID 14279141. Retrieved 2022-11-12.

• Presburger, Mojżesz (1929). "Über die Vollständigkeit eines gewissen Systems der Arithmetik ganzer Zahlen, in welchem die Addition als einzige Operation hervortritt". Comptes Rendus du I congrès de Mathématiciens des Pays Slaves, Warszawa: 92–101., see Stansifer (1984) for an English translation

• Stansifer, Ryan (Sep 1984). Presburger's Article on Integer Arithmetic: Remarks and Translation (PDF) (Technical Report). Vol. TR84-639. Ithaca, New York: Dept. of Computer Science, Cornell University.

• Szmielew, Wanda (1955). "Elementary properties of Abelian groups". Fundamenta Mathematicae. 41 (2): 203–271. doi:10.4064/fm-41-2-203-271. MR 0072131.

• Jeannerod, Nicolas; Treinen, Ralf. Deciding the First-Order Theory of an Algebra of Feature Trees with Updates. International Joint Conference on Automated Reasoning (IJCAR). doi:10.1007/978-3-319-94205-6_29.

• Sturm, Thomas (2017). "A Survey of Some Methods for Real Quantifier Elimination, Decision, and Satisfiability and Their Applications". Mathematics in Computer Science. 11 (3–4): 483–502. doi:10.1007/s11786-017-0319-z. hdl:11858/00-001M-0000-002C-A3B5-B.