Measure-preserving dynamical system

(Redirected from Kolmogorov–Sinai entropy)

In mathematics, a measure-preserving dynamical system is an object of study in the abstract formulation of dynamical systems, and ergodic theory in particular. Measure-preserving systems obey the Poincaré recurrence theorem, and are a special case of conservative systems. They provide the formal, mathematical basis for a broad range of physical systems, and, in particular, many systems from classical mechanics (in particular, most non-dissipative systems) as well as systems in thermodynamic equilibrium.

Definition

edit

A measure-preserving dynamical system is defined as a probability space and a measure-preserving transformation on it. In more detail, it is a system

 

with the following structure:

  •   is a set,
  •   is a σ-algebra over  ,
  •   is a probability measure, so that  , and  ,
  •   is a measurable transformation which preserves the measure  , i.e.,  .

Discussion

edit

One may ask why the measure preserving transformation is defined in terms of the inverse   instead of the forward transformation  . This can be understood intuitively.

Consider the typical measure on the unit interval  , and a map  . This is the Bernoulli map. Now, distribute an even layer of paint on the unit interval  , and then map the paint forward. The paint on the   half is spread thinly over all of  , and the paint on the   half as well. The two layers of thin paint, layered together, recreates the exact same paint thickness.

More generally, the paint that would arrive at subset   comes from the subset  . For the paint thickness to remain unchanged (measure-preserving), the mass of incoming paint should be the same:  .

Consider a mapping   of power sets:

 

Consider now the special case of maps   which preserve intersections, unions and complements (so that it is a map of Borel sets) and also sends   to   (because we want it to be conservative). Every such conservative, Borel-preserving map can be specified by some surjective map   by writing  . Of course, one could also define  , but this is not enough to specify all such possible maps  . That is, conservative, Borel-preserving maps   cannot, in general, be written in the form  .

  has the form of a pushforward, whereas   is generically called a pullback. Almost all properties and behaviors of dynamical systems are defined in terms of the pushforward. For example, the transfer operator is defined in terms of the pushforward of the transformation map  ; the measure   can now be understood as an invariant measure; it is just the Frobenius–Perron eigenvector of the transfer operator (recall, the FP eigenvector is the largest eigenvector of a matrix; in this case it is the eigenvector which has the eigenvalue one: the invariant measure.)

There are two classification problems of interest. One, discussed below, fixes   and asks about the isomorphism classes of a transformation map  . The other, discussed in transfer operator, fixes   and  , and asks about maps   that are measure-like. Measure-like, in that they preserve the Borel properties, but are no longer invariant; they are in general dissipative and so give insights into dissipative systems and the route to equilibrium.

In terms of physics, the measure-preserving dynamical system   often describes a physical system that is in equilibrium, for example, thermodynamic equilibrium. One might ask: how did it get that way? Often, the answer is by stirring, mixing, turbulence, thermalization or other such processes. If a transformation map   describes this stirring, mixing, etc. then the system   is all that is left, after all of the transient modes have decayed away. The transient modes are precisely those eigenvectors of the transfer operator that have eigenvalue less than one; the invariant measure   is the one mode that does not decay away. The rate of decay of the transient modes are given by (the logarithm of) their eigenvalues; the eigenvalue one corresponds to infinite half-life.

Informal example

edit

The microcanonical ensemble from physics provides an informal example. Consider, for example, a fluid, gas or plasma in a box of width, length and height   consisting of   atoms. A single atom in that box might be anywhere, having arbitrary velocity; it would be represented by a single point in   A given collection of   atoms would then be a single point somewhere in the space   The "ensemble" is the collection of all such points, that is, the collection of all such possible boxes (of which there are an uncountably-infinite number). This ensemble of all-possible-boxes is the space   above.

In the case of an ideal gas, the measure   is given by the Maxwell–Boltzmann distribution. It is a product measure, in that if   is the probability of atom   having position and velocity  , then, for   atoms, the probability is the product of   of these. This measure is understood to apply to the ensemble. So, for example, one of the possible boxes in the ensemble has all of the atoms on one side of the box. One can compute the likelihood of this, in the Maxwell–Boltzmann measure. It will be enormously tiny, of order   Of all possible boxes in the ensemble, this is a ridiculously small fraction.

The only reason that this is an "informal example" is because writing down the transition function   is difficult, and, even if written down, it is hard to perform practical computations with it. Difficulties are compounded if there are interactions between the particles themselves, like a van der Waals interaction or some other interaction suitable for a liquid or a plasma; in such cases, the invariant measure is no longer the Maxwell–Boltzmann distribution. The art of physics is finding reasonable approximations.

This system does exhibit one key idea from the classification of measure-preserving dynamical systems: two ensembles, having different temperatures, are inequivalent. The entropy for a given canonical ensemble depends on its temperature; as physical systems, it is "obvious" that when the temperatures differ, so do the systems. This holds in general: systems with different entropy are not isomorphic.

Examples

edit
 
Example of a (Lebesgue measure) preserving map: T : [0,1) → [0,1),  

Unlike the informal example above, the examples below are sufficiently well-defined and tractable that explicit, formal computations can be performed.

Generalization to groups and monoids

edit

The definition of a measure-preserving dynamical system can be generalized to the case in which T is not a single transformation that is iterated to give the dynamics of the system, but instead is a monoid (or even a group, in which case we have the action of a group upon the given probability space) of transformations Ts : XX parametrized by sZ (or R, or N ∪ {0}, or [0, +∞)), where each transformation Ts satisfies the same requirements as T above.[1] In particular, the transformations obey the rules:

  •  , the identity function on X;
  •  , whenever all the terms are well-defined;
  •  , whenever all the terms are well-defined.

The earlier, simpler case fits into this framework by defining Ts = Ts for sN.

Homomorphisms

edit

The concept of a homomorphism and an isomorphism may be defined.

Consider two dynamical systems   and  . Then a mapping

 

is a homomorphism of dynamical systems if it satisfies the following three properties:

  1. The map   is measurable.
  2. For each  , one has  .
  3. For  -almost all  , one has  .

The system   is then called a factor of  .

The map   is an isomorphism of dynamical systems if, in addition, there exists another mapping

 

that is also a homomorphism, which satisfies

  1. for  -almost all  , one has  ;
  2. for  -almost all  , one has  .

Hence, one may form a category of dynamical systems and their homomorphisms.

Generic points

edit

A point xX is called a generic point if the orbit of the point is distributed uniformly according to the measure.

Symbolic names and generators

edit

Consider a dynamical system  , and let Q = {Q1, ..., Qk} be a partition of X into k measurable pair-wise disjoint sets. Given a point xX, clearly x belongs to only one of the Qi. Similarly, the iterated point Tnx can belong to only one of the parts as well. The symbolic name of x, with regards to the partition Q, is the sequence of integers {an} such that

 

The set of symbolic names with respect to a partition is called the symbolic dynamics of the dynamical system. A partition Q is called a generator or generating partition if μ-almost every point x has a unique symbolic name.

Operations on partitions

edit

Given a partition Q = {Q1, ..., Qk} and a dynamical system  , define the T-pullback of Q as

 

Further, given two partitions Q = {Q1, ..., Qk} and R = {R1, ..., Rm}, define their refinement as

 

With these two constructs, the refinement of an iterated pullback is defined as

 

which plays crucial role in the construction of the measure-theoretic entropy of a dynamical system.

Measure-theoretic entropy

edit

The entropy of a partition   is defined as[2][3]

 

The measure-theoretic entropy of a dynamical system   with respect to a partition Q = {Q1, ..., Qk} is then defined as

 

Finally, the Kolmogorov–Sinai metric or measure-theoretic entropy of a dynamical system   is defined as

 

where the supremum is taken over all finite measurable partitions. A theorem of Yakov Sinai in 1959 shows that the supremum is actually obtained on partitions that are generators. Thus, for example, the entropy of the Bernoulli process is log 2, since almost every real number has a unique binary expansion. That is, one may partition the unit interval into the intervals [0, 1/2) and [1/2, 1]. Every real number x is either less than 1/2 or not; and likewise so is the fractional part of 2nx.

If the space X is compact and endowed with a topology, or is a metric space, then the topological entropy may also be defined.

If   is an ergodic, piecewise expanding, and Markov on  , and   is absolutely continuous with respect to the Lebesgue measure, then we have the Rokhlin formula[4] (section 4.3 and section 12.3 [5]): This allows calculation of entropy of many interval maps, such as the logistic map.

Ergodic means that   implies   has full measure or zero measure. Piecewise expanding and Markov means that there is a partition of   into finitely many open intervals, such that for some  ,   on each open interval. Markov means that for each   from those open intervals, either   or  .

Classification and anti-classification theorems

edit

One of the primary activities in the study of measure-preserving systems is their classification according to their properties. That is, let   be a measure space, and let   be the set of all measure preserving systems  . An isomorphism   of two transformations   defines an equivalence relation   The goal is then to describe the relation  . A number of classification theorems have been obtained; but quite interestingly, a number of anti-classification theorems have been found as well. The anti-classification theorems state that there are more than a countable number of isomorphism classes, and that a countable amount of information is not sufficient to classify isomorphisms.[6][7]

The first anti-classification theorem, due to Hjorth, states that if   is endowed with the weak topology, then the set   is not a Borel set.[8] There are a variety of other anti-classification results. For example, replacing isomorphism with Kakutani equivalence, it can be shown that there are uncountably many non-Kakutani equivalent ergodic measure-preserving transformations of each entropy type.[9]

These stand in contrast to the classification theorems. These include:

Krieger finite generator theorem[14] (Krieger 1970) — Given a dynamical system on a Lebesgue space of measure 1, where   is invertible, measure preserving, and ergodic.

If   for some integer  , then the system has a size-  generator.

If the entropy is exactly equal to  , then such a generator exists iff the system is isomorphic to the Bernoulli shift on   symbols with equal measures.

See also

edit

References

edit
  1. ^ a b Walters, Peter (2000). An Introduction to Ergodic Theory. Springer. ISBN 0-387-95152-0.
  2. ^ Sinai, Ya. G. (1959). "On the Notion of Entropy of a Dynamical System". Doklady Akademii Nauk SSSR. 124: 768–771.
  3. ^ Sinai, Ya. G. (2007). "Metric Entropy of Dynamical System" (PDF).
  4. ^ The Shannon-McMillan-Breiman Theorem
  5. ^ Pollicott, Mark; Yuri, Michiko (1998). Dynamical Systems and Ergodic Theory. London Mathematical Society Student Texts. Cambridge: Cambridge University Press. ISBN 978-0-521-57294-1.
  6. ^ Foreman, Matthew; Weiss, Benjamin (2019). "From Odometers to Circular Systems: A Global Structure Theorem". Journal of Modern Dynamics. 15: 345–423. arXiv:1703.07093. doi:10.3934/jmd.2019024. S2CID 119128525.
  7. ^ Foreman, Matthew; Weiss, Benjamin (2022). "Measure preserving Diffeomorphisms of the Torus are unclassifiable". Journal of the European Mathematical Society. 24 (8): 2605–2690. arXiv:1705.04414. doi:10.4171/JEMS/1151.
  8. ^ Hjorth, G. (2001). "On invariants for measure preserving transformations". Fund. Math. 169 (1): 51–84. doi:10.4064/FM169-1-2. S2CID 55619325.
  9. ^ Ornstein, D.; Rudolph, D.; Weiss, B. (1982). Equivalence of measure preserving transformations. Mem. American Mathematical Soc. Vol. 37. ISBN 0-8218-2262-4.
  10. ^ Halmos, P.; von Neumann, J. (1942). "Operator methods in classical mechanics. II". Annals of Mathematics. (2). 43 (2): 332–350. doi:10.2307/1968872. JSTOR 1968872.
  11. ^ Sinai, Ya. (1962). "A weak isomorphism of transformations with invariant measure". Doklady Akademii Nauk SSSR. 147: 797–800.
  12. ^ Ornstein, D. (1970). "Bernoulli shifts with the same entropy are isomorphic". Advances in Mathematics. 4 (3): 337–352. doi:10.1016/0001-8708(70)90029-0.
  13. ^ Katok, A.; Hasselblatt, B. (1995). "Introduction to the modern theory of dynamical systems". Encyclopedia of Mathematics and its Applications. Vol. 54. Cambridge University Press.
  14. ^ Downarowicz, Tomasz (2011). Entropy in dynamical systems. New Mathematical Monographs. Cambridge: Cambridge University Press. p. 106. ISBN 978-0-521-88885-1.

Further reading

edit
  • Michael S. Keane, "Ergodic theory and subshifts of finite type", (1991), appearing as Chapter 2 in Ergodic Theory, Symbolic Dynamics and Hyperbolic Spaces, Tim Bedford, Michael Keane and Caroline Series, Eds. Oxford University Press, Oxford (1991). ISBN 0-19-853390-X (Provides expository introduction, with exercises, and extensive references.)
  • Lai-Sang Young, "Entropy in Dynamical Systems" (pdf; ps), appearing as Chapter 16 in Entropy, Andreas Greven, Gerhard Keller, and Gerald Warnecke, eds. Princeton University Press, Princeton, NJ (2003). ISBN 0-691-11338-6
  • T. Schürmann and I. Hoffmann, The entropy of strange billiards inside n-simplexes. J. Phys. A 28(17), page 5033, 1995. PDF-Document (gives a more involved example of measure-preserving dynamical system.)