Logic of graphs

In the mathematical fields of graph theory and finite model theory, the logic of graphs deals with formal specifications of graph properties using logical formulas. There are several variations in the types of logical operation that can be used in these formulas. The first order logic of graphs concerns formulas in which the variables and predicates concern individual vertices and edges of a graph, while monadic second order graph logic allows quantification over sets of vertices or edges.

A sentence $S$ may be true for some graphs, and false for others; a graph $G$ is said to model $S$, written $G\models S$, if $S$ is true of the vertices and adjacency relation of $G$. The algorithmic problem of model checking concerns testing whether a given graph models a given sentence. The algorithmic problem of satisfiability concerns testing whether there exists a graph that models a given sentence. Although both model checking and satisfiability are hard in general, several major algorithmic meta-theorems show that properties expressed in this way can be tested efficiently for important classes of graphs.

Other topics of research in the logic of graphs include investigations of the probability that a random graph has a property specified within a particular type of logic, and methods for data compression based on finding logical formulae that are modeled by a unique graph.

First order

In the first-order logic of graphs, a graph property is expressed as a quantified logical formula whose variables represent graph vertices, with predicates for equality and adjacency testing.

Examples

For instance, the condition that a graph does not have any isolated vertices may be expressed by the sentence

$\forall u\exists v(u\sim v)$

where the $\sim$ symbol indicates the adjacency relation between two vertices. This sentence can be interpreted as meaning that for every vertex $u$ there is another vertex $v$ that is adjacent to $u$.

The subgraph isomorphism problem for a fixed subgraph H, asks whether H appears as a subgraph of a larger graph G. It may be expressed by a sentence that states the existence of vertices (one for each vertex of H) such that, for each edge of H, the corresponding pair of vertices are adjacent. As a special case the clique problem (for a fixed clique size) may be expressed by a sentence that states the existence of a number of vertices equal to the clique size all of which are adjacent.

Axioms

For simple undirected graphs, the first order theory of graphs includes the axioms

$\forall u{\bigl (}\lnot (u\sim u){\bigr )}$ (the graph cannot contain any loops), and

$\forall u\forall v(u\sim v\Rightarrow v\sim u)$ (edges are undirected).^[1]

Other types of graphs, such as directed graphs, may involve different axioms, and logical formulations of multigraph properties require having separate variables for vertices and edges.

Zero-one law

The Rado graph, an infinite graph that models exactly the first-order sentences that are almost always true of finite graphs

Fagin (1976) proved a zero–one law for first-order graph logic using the compactness theorem. According to Fagin's result, every first-order sentence is either almost always true or almost always false for random graphs in the Erdős–Rényi model. That is, let S be a fixed first-order sentence, and choose a random n-vertex graph G_n uniformly at random among all graphs on a set of n labeled vertices. Then in the limit as n tends to infinity the probability that G_n models S will tend either to zero or to one:

$\lim _{n\to \infty }\operatorname {Pr} [G_{n}\models S]\in \{0,1\}.$

Moreover, there is a specific infinite graph, the Rado graph R, such that the sentences modeled by the Rado graph are exactly the ones for which the probability of being modeled by a random finite graph tends to one:

$R\models S\quad \Longleftrightarrow \quad \lim _{n\to \infty }\operatorname {Pr} [G_{n}\models S]=1.$

For random graphs in which each edge is included independently of the others with a fixed probability, the same result is true, with the same sentences having probabilities tending to zero or to one.

The computational complexity of determining whether a given sentence has probability tending to zero or to one is high: the problem is PSPACE-complete.^[2] If a first order graph property has probability tending to one on random graphs, then it is possible to list all the n-vertex graphs that model the property, with polynomial delay (as a function of n) per graph.^[1]

A similar analysis can be performed for non-uniform random graphs, where the probability of including an edge is a function of the number of vertices, and where the decision to include or exclude an edge is made independently with equal probability for all edges. However, for these graphs the situation is more complicated. In this case, a first-order property may have one or more thresholds, such that when the edge inclusion probability is bounded away from the threshold then the probability of having the given property tends to zero or one. These thresholds can never be an irrational power of n, so random graphs where the edge inclusion probability is an irrational power obey a zero-one law analogous to the one for uniformly random graphs. A similar zero-one law holds for very sparse random graphs that have an edge inclusion probability of n^−c with c > 1, as long as c is not a superparticular ratio.^[3] If c is superparticular, the probability of having a given property may tend to a limit that is not zero or one, but this limit can be calculated efficiently.^[4] There exist first-order sentences that have infinitely many thresholds.^[5]

Parameterized complexity

If a first-order sentence includes k distinct variables, then the property it describes can be tested in graphs of n vertices by examining all k-tuples of vertices; however, this brute force search algorithm is not particularly efficient, taking time O(n^k). The problem of checking whether a graph models a given first-order sentence includes as special cases the subgraph isomorphism problem (in which the sentence describes the graphs that contain a fixed subgraph) and the clique problem (in which the sentence describes graphs that contain complete subgraphs of a fixed size). The clique problem is hard for W(1), the first level of a hierarchy of hard problems from the point of view of parameterized complexity. Therefore, it is unlikely to have a fixed-parameter tractable algorithm, one whose running time takes the form O(f(k) n^c) for a function f and constant c that are independent of k and c.^[6] More strongly, if the exponential time hypothesis is true, then clique-finding and first-order model checking would necessarily take time proportional to a power of n whose exponent is proportional to k.^[7]

On restricted classes of graphs, model checking of first-order sentences can be much more efficient. In particular, every graph property expressible as a first-order sentence can be tested in linear time for the graphs of bounded expansion. These are the graphs in which all shallow minors are sparse graphs, with a ratio of edges to vertices bounded by a function of the depth of the minor. Even more generally, first-order model checking can be performed in near-linear time for nowhere-dense graphs, classes of graphs for which, at each possible depth, there is at least one forbidden shallow minor. Conversely, if model checking is fixed-parameter tractable for any hereditary family of graphs, that family must be nowhere-dense.^[8]

Data compression and graph isomorphism

A first order sentence S in the logic of graphs is said to define a graph G if G is the only graph that models S. Every graph may be defined by at least one sentence; for instance, one can define an n-vertex graph G by a sentence with n + 1 variables, one for each vertex of the graph, and one more to state the condition that there is no vertex other than the n vertices of the graph. Additional clauses of the sentence can be used to ensure that no two vertex variables are equal, that each edge of G is present, and no edge exists between a pair of non-adjacent vertices of G. However, for some graphs there exist significantly shorter formulas that define the graph.^[9]

Several different graph invariants can be defined from the simplest sentences (with different measures of simplicity) that define a given graph. In particular the logical depth of a graph is defined to be the minimum level of nesting of quantifiers (the quantifier rank) in a sentence defining the graph.^[10] The sentence outlined above nests the quantifiers for all of its variables, so it has logical depth n + 1. The logical width of a graph is the minimum number of variables in a sentence that defines it.^[10] In the sentence outlined above, this number of variables is again n + 1. Both the logical depth and logical width can be bounded in terms of the treewidth of the given graph.^[11] The logical length, analogously, is defined as the length of the shortest formula describing the graph.^[10] The sentence described above has length proportional to the square of the number of vertices, but it is possible to define any graph by a formula with length proportional to its number of edges.

All trees, and most graphs, can be described by first order sentences with only two variables, but extended by counting predicates. For graphs that can be described by sentences in this logic with a fixed constant number of variables, it is possible to find a graph canonization in polynomial time (with the exponent of the polynomial equal to the number of variables). By comparing canonizations, it is possible to solve the graph isomorphism problem for these graphs in polynomial time.^[12]

Satisfiability

It is undecidable whether a given first-order sentence can be realized by a finite undirected graph.^[13]

There exist first-order sentences that are modeled by infinite graphs but not by any finite graph. For instance, the property of having exactly one vertex of degree one, with all other vertices having degree exactly two, can be expressed by a first order sentence. It is modeled by an infinite ray, but violates Euler's handshaking lemma for finite graphs. However, it follows from the negative solution to the Entscheidungsproblem (by Alonzo Church and Alan Turing in the 1930s) that satisfiability of first-order sentences for graphs that are not constrained to be finite remains undecidable.

Second order

In the monadic second-order logic of graphs, the variables represent objects of up to four types: vertices, edges, sets of vertices, and sets of edges. There are two main variations of monadic second-order graph logic: MSO₁ in which only vertex and vertex set variables are allowed, and MSO₂ in which all four types of variables are allowed. The predicates on these variables include equality testing, membership testing, and either vertex-edge incidence (if both vertex and edge variables are allowed) or adjacency between pairs of vertices (if only vertex variables are allowed). Additional variations in the definition allow additional predicates such as modular counting predicates.

Examples

As an example, the connectivity of an undirected graph can be expressed in MSO₁ as the statement that, for every partition of the vertices into two nonempty subsets, there exists an edge from one subset to the other. A partition of the vertices can be described by the subset S of vertices on one side of the partition, and each such subset should either describe a trivial partition (one in which one or the other side is empty) or be crossed by an edge. That is, a graph is connected when it models the MSO₁ formula

$\forall S{\Bigl (}\forall x(x\in S)\vee \forall y{\bigl (}\lnot (y\in S){\bigr )}\vee \exists x\exists y{\bigl (}x\in S\wedge \lnot (y\in S)\wedge x\sim y{\bigr )}{\Bigr )}.$

However, connectivity cannot be expressed in first-order graph logic, nor can it be expressed in existential MSO₁ (the fragment of MSO₁ in which all set quantifiers are existential and occur at the beginning of the sentence) nor even existential MSO₂.^[14]

Hamiltonicity can be expressed in MSO₂ by the existence of a set of edges that forms a connected 2-regular graph on all the vertices, with connectivity expressed as above and 2-regularity expressed as the incidence of two but not three distinct edges at each vertex. However, Hamiltonicity is not expressible in MSO₁, because MSO₁ is not capable of distinguishing complete bipartite graphs with equal numbers of vertices on each side of the bipartition (which are Hamiltonian) from unbalanced complete bipartite graphs (which are not).^[15]

Although not part of the definition of MSO₂, orientations of undirected graphs can be represented by a technique involving Trémaux trees. This allows other graph properties involving orientations to be expressed as well.^[16]

Courcelle's theorem

According to Courcelle's theorem, every fixed MSO₂ property can be tested in linear time on graphs of bounded treewidth, and every fixed MSO₁ property can be tested in linear time on graphs of bounded clique-width.^[17] The version of this result for graphs of bounded treewidth can also be implemented in logarithmic space.^[18] Applications of this result include a fixed-parameter tractable algorithm for computing the crossing number of a graph.^[19]

Seese's theorem

The satisfiability problem for a formula of monadic second-order logic is the problem of determining whether there exists at least one graph (possibly within a restricted family of graphs) for which the formula is true. For arbitrary graph families, and arbitrary formulas, this problem is undecidable. However, satisfiability of MSO₂ formulas is decidable for the graphs of bounded treewidth, and satisfiability of MSO₁ formulas is decidable for graphs of bounded clique-width. The proof involves using Courcelle's theorem to build an automaton that can test the property, and then examining the automaton to determine whether there is any graph it can accept.

As a partial converse, Seese (1991) proved that, whenever a family of graphs has a decidable MSO₂ satisfiability problem, the family must have bounded treewidth. The proof is based on a theorem of Robertson and Seymour that the families of graphs with unbounded treewidth have arbitrarily large grid minors. Seese also conjectured that every family of graphs with a decidable MSO₁ satisfiability problem must have bounded clique-width; this has not been proven, but a weakening of the conjecture that extends MSO₁ with modular counting predicates is true.^[20]

Notes

1. Goldberg (1993).
2. Grandjean (1983).
3. Shelah & Spencer (1988); Spencer (2001).
4. Lynch (1992).
5. Spencer (1990).
6. Downey & Fellows (1995).
7. Chen et al. (2006).
8. Nešetřil & Ossona de Mendez (2012), 18.3 The Subgraph Isomorphism Problem and Boolean Queries, pp. 400–401; Dvořák, Kráľ & Thomas (2010); Grohe, Kreutzer & Siebertz (2014).
9. Pikhurko, Spencer & Verbitsky (2006).
10. Pikhurko & Verbitsky (2011).
11. Verbitsky (2005).
12. Immerman & Lander (1990).
13. Parys (2014) writes that this undecidability result is well known, and attributes it to Trahtenbrot (1950) on the undecidability of first order satisfiability for more general classes of finite structures.
14. Fagin, Stockmeyer & Vardi (1995).
15. Courcelle & Engelfriet (2012); Libkin (2004), Corollary 7.24, pp. 126–127.
16. Courcelle (1996).
17. Courcelle & Engelfriet (2012).
18. Elberfeld, Jakoby & Tantau (2010).
19. Grohe (2001); Kawarabayashi & Reed (2007).
20. Courcelle & Oum (2007).

References

• Chen, Jianer; Huang, Xiuzhen; Kanj, Iyad A.; Xia, Ge (2006), "Strong computational lower bounds via parameterized complexity", Journal of Computer and System Sciences, 72 (8): 1346–1367, doi:10.1016/j.jcss.2006.04.007
• Courcelle, Bruno (1996), "On the expression of graph properties in some fragments of monadic second-order logic" (PDF), in Immerman, Neil; Kolaitis, Phokion G., Proc. Descr. Complex. Finite Models, DIMACS, 31, Amer. Math. Soc., pp. 33–62, MR 1451381.
• Courcelle, Bruno; Engelfriet, Joost (2012), Graph Structure and Monadic Second-Order Logic: A Language-Theoretic Approach, Encyclopedia of Mathematics and its Applications, 138, Cambridge University Press, ISBN 9781139644006, Zbl 1257.68006.
• Courcelle, Bruno; Oum, Sang-il (2007), "Vertex-minors, monadic second-order logic, and a conjecture by Seese" (PDF), Journal of Combinatorial Theory, Series B, 97 (1): 91–126, doi:10.1016/j.jctb.2006.04.003, MR 2278126.
• Downey, R. G.; Fellows, M. R. (1995), "Fixed-parameter tractability and completeness. II. On completeness for W[1]", Theoretical Computer Science, 141 (1–2): 109–131, doi:10.1016/0304-3975(94)00097-3.
• Dvořák, Zdeněk; Kráľ, Daniel; Thomas, Robin (2010), "Deciding first-order properties for sparse graphs", Proc. 51st Annual IEEE Symposium on Foundations of Computer Science (FOCS 2010), pp. 133–142, MR 3024787.
• Elberfeld, Michael; Jakoby, Andreas; Tantau, Till (October 2010), "Logspace Versions of the Theorems of Bodlaender and Courcelle" (PDF), Proc. 51st Annual IEEE Symposium on Foundations of Computer Science (FOCS 2010), pp. 143–152, doi:10.1109/FOCS.2010.21.
• Fagin, Ronald (1976), "Probabilities on finite models" (PDF), Journal of Symbolic Logic, 41 (1): 50–58, doi:10.1017/s0022481200051756, MR 0476480.
• Fagin, Ronald; Stockmeyer, Larry J.; Vardi, Moshe Y. (1995), "On monadic NP vs monadic co-NP", Information and Computation, 120 (1): 78–92, doi:10.1006/inco.1995.1100, MR 1340807.
• Goldberg, Leslie Ann (1993), "Polynomial space polynomial delay algorithms for listing families of graphs", Proceedings of the Twenty-fifth Annual ACM Symposium on Theory of Computing (STOC '93), New York, NY, USA: ACM, pp. 218–225, doi:10.1145/167088.167160, ISBN 0-89791-591-7.
• Grandjean, Étienne (1983), "Complexity of the first-order theory of almost all finite structures", Information and Control, 57 (2-3): 180–204, doi:10.1016/S0019-9958(83)80043-6, MR 742707.
• Grohe, Martin (2001), "Computing crossing numbers in quadratic time", Proceedings of the Thirty-third Annual ACM Symposium on Theory of Computing (STOC '01), pp. 231–236, doi:10.1145/380752.380805.
• Grohe, Martin; Kreutzer, Stephan; Siebertz, Sebastian (2014), "Deciding first-order properties of nowhere dense graphs", Proceedings of the 46th Annual ACM Symposium on Theory of Computing (STOC '14), New York: ACM, pp. 89–98, arXiv:1311.3899, doi:10.1145/2591796.2591851, ISBN 978-1-4503-2710-7.
• Immerman, Neil; Lander, Eric (1990), "Describing graphs: a first-order approach to graph canonization", in Selman, Alan L., Complexity Theory Retrospective: In honor of Juris Hartmanis on the occasion of his sixtieth birthday, New York: Springer-Verlag, pp. 59–81, doi:10.1007/978-1-4612-4478-3_5, MR 1060782.
• Kawarabayashi, Ken-ichi; Reed, Bruce (2007), "Computing crossing number in linear time", Proceedings of the Thirty-ninth Annual ACM Symposium on Theory of Computing (STOC '07), pp. 382–390, doi:10.1145/1250790.1250848.
• Libkin, Leonid (2004), Elements of finite model theory, Texts in Theoretical Computer Science: An EATCS Series, Springer-Verlag, Berlin, doi:10.1007/978-3-662-07003-1, ISBN 3-540-21202-7, MR 2102513.
• Lynch, James F. (1992), "Probabilities of sentences about very sparse random graphs", Random Structures & Algorithms, 3 (1): 33–53, doi:10.1002/rsa.3240030105, MR 1139487.
• Nešetřil, Jaroslav; Ossona de Mendez, Patrice (2012), Sparsity: Graphs, Structures, and Algorithms, Algorithms and Combinatorics, 28, Springer-Verlag, doi:10.1007/978-3-642-27875-4, ISBN 978-3-642-27874-7, MR 2920058.
• Parys, Paweł (2014), "First-order logic on CPDA graphs", Computer science—theory and applications, Lecture Notes in Computer Science, 8476, New York: Springer-Verlag, pp. 300–313, doi:10.1007/978-3-319-06686-8_23, MR 3218557.
• Pikhurko, Oleg; Spencer, Joel; Verbitsky, Oleg (2006), "Succinct definitions in the first order theory of graphs", Annals of Pure and Applied Logic, 139 (1-3): 74–109, doi:10.1016/j.apal.2005.04.003, MR 2206252.
• Pikhurko, Oleg; Verbitsky, Oleg (2011), "Logical complexity of graphs: a survey", in Grohe, Martin; Makowsky, Johann A., Model Theoretic Methods in Finite Combinatorics (AMS-ASL Joint Special Session, January 5-8, 2009, Washington, DC), Contemporary Mathematics, 558, American Mathematical Society, pp. 129–180.
• Seese, D. (1991), "The structure of the models of decidable monadic theories of graphs", Annals of Pure and Applied Logic, 53 (2): 169–195, doi:10.1016/0168-0072(91)90054-P, MR 1114848.
• Shelah, Saharon; Spencer, Joel (1988), "Zero-one laws for sparse random graphs", Journal of the American Mathematical Society, 1 (1): 97–115, doi:10.2307/1990968, MR 924703.
• Spencer, Joel (1990), "Infinite spectra in the first order theory of graphs", Combinatorica, 10 (1): 95–102, doi:10.1007/BF02122699, MR 1075070.
• Spencer, Joel (2001), The Strange Logic of Random Graphs, Algorithms and Combinatorics, 22, Springer-Verlag, Berlin, doi:10.1007/978-3-662-04538-1, ISBN 3-540-41654-4, MR 1847951.
• Trahtenbrot, B. A. (1950), "The impossibility of an algorithm for the decision problem for finite domains", Doklady Akad. Nauk SSSR (N.S.), 70: 569–572, MR 0033784.
• Verbitsky, Oleg (2005), "The first order definability of graphs with separators via the Ehrenfeucht game", Theoretical Computer Science, 343 (1-2): 158–176, doi:10.1016/j.tcs.2005.05.003, MR 2168849.