Steinhaus–Johnson–Trotter algorithm

The Steinhaus–Johnson–Trotter algorithm or Johnson–Trotter algorithm, also called plain changes, is an algorithm named after Hugo Steinhaus, Selmer M. Johnson and Hale F. Trotter that generates all of the permutations of $n$ elements. Each two adjacent permutations in the resulting sequence differ by swapping two adjacent permuted elements. Equivalently, this algorithm finds a Hamiltonian cycle in the permutohedron, a polytope whose vertices represent permutations and whose edges represent swaps.

The Hamiltonian cycle in the Cayley graph of the symmetric group generated by the Steinhaus–Johnson–Trotter algorithm

Wheel diagram of all permutations of length $n=4$ generated by the Steinhaus-Johnson-Trotter algorithm, where each permutation is color-coded (1=blue, 2=green, 3=yellow, 4=red).

This method was known already to 17th-century English change ringers, and Robert Sedgewick calls it "perhaps the most prominent permutation enumeration algorithm". A version of the algorithm can be implemented in such a way that the average time per permutation is constant. As well as being simple and computationally efficient, this algorithm has the advantage that subsequent computations on the generated permutations may be sped up by taking advantage of the similarity between consecutive permutations.

Algorithm

The sequence of permutations generated by the Steinhaus–Johnson–Trotter algorithm has a natural recursive structure, that can be generated by a recursive algorithm. However the actual Steinhaus–Johnson–Trotter algorithm does not use recursion, instead computing the same sequence of permutations by a simple iterative method. A later improvement allows it to run in constant average time per permutation.

Recursive structure

The sequence of permutations for a given number $n$ can be formed from the sequence of permutations for $n-1$ by placing the number $n$ into each possible position in each of the shorter permutations. The Steinhaus–Johnson–Trotter algorithm follows this structure: the sequence of permutations it generates consists of $(n-1)!$ blocks of permutations, so that within each block the permutations agree on the ordering of the numbers from 1 to $n-1$ and differ only in the position of $n$. The blocks themselves are ordered recursively, according to the Steinhaus–Johnson–Trotter algorithm for one less element. Within each block, the positions in which $n$ is placed occur either in descending or ascending order, and the blocks alternate between these two orders: the placements of $n$ in the first block are in descending order, in the second block they are in ascending order, in the third block they are in descending order, and so on.

Thus, from the single permutation on one element,

1

one may place the number 2 in each possible position in descending order to form a list of two permutations on two elements,

1 2

2 1

Then, one may place the number 3 in each of three different positions for these two permutations, in descending order for the first permutation 1 2, and then in ascending order for the permutation 2 1:

1 2 3

1 3 2

3 1 2

3 2 1

2 3 1

2 1 3

The same placement pattern, alternating between descending and ascending placements of $n$, applies for any larger value of $n$. In sequences of permutations with this recursive structure, each permutation differs from the previous one either by the single-position-at-a-time motion of $n$, or by a change of two smaller numbers inherited from the previous sequence of shorter permutations. In either case this difference is just the transposition of two adjacent elements. When $n>1$ the first and final elements of the sequence, also, differ in only two adjacent elements (the positions of the numbers $1$ and $2$), as may be proven by induction.

This sequence may be generated by a recursive algorithm that constructs the sequence of smaller permutations and then performs all possible insertions of the largest number into the recursively-generated sequence. The same ordering of permutations can also be described equivalently as the ordering generated by the following greedy algorithm. Start with the identity permutation $1\;2\;\ldots \;n$. Now repeatedly transpose the largest possible entry with the entry to its left or right, such that in each step, a new permutation is created that has not been encountered in the list of permutations before. For example, in the case $n=3$ the sequence starts with $1\;2\;3$, then flips $3$ with its left neighbor to get $1\;3\;2$. From this point, flipping $3$ with its right neighbor $2$ would yield the initial permutation $1\;2\;3$, so the sequence instead flips $3$ with its left neighbor $1$ and arrives at $3\;1\;2$, etc. The direction of the transposition (left or right) is always uniquely determined in this algorithm. However, the actual Steinhaus–Johnson–Trotter algorithm does not use recursion, and does not need to keep track of the permutations that it has already encountered. Instead, it computes the same sequence of permutations by a simple iterative method.

Original version

As described by Johnson, the algorithm for generating the next permutation from a given permutation $\pi$ performs the following steps.

• For each $i$ from 1 to $n$, let $x_{i}$ be the position where the value $i$ is placed in permutation $\pi$. If the order of the numbers from 1 to $i-1$ in permutation $\pi$ defines an even permutation, let $y_{i}=x_{i}-1$ otherwise, let $y_{i}=x_{i}+1$.
• Find the largest number $i$ for which $y_{i}$ defines a valid position in permutation $\pi$ that contains a number smaller than $i$. Swap the values in positions $x_{i}$ and $y_{i}$.

When no number $i$ can be found meeting the conditions of the second step of the algorithm, the algorithm has reached the final permutation of the sequence and terminates. This procedure may be implemented in $O(n)$ time per permutation.

Trotter gives an alternative implementation of an iterative algorithm for the same sequence, in lightly commented ALGOL 60 notation.

Because this method generates permutations that alternate between being even and odd, it may easily be modified to generate only the even permutations or only the odd permutations: to generate the next permutation of the same parity from a given permutation, simply apply the same procedure twice.

Even's speedup

A subsequent improvement by Shimon Even provides an improvement to the running time of the algorithm by storing additional information for each element in the permutation: its position, and a direction (positive, negative, or zero) in which it is currently moving (essentially, this is the same information computed using the parity of the permutation in Johnson's version of the algorithm). Initially, the direction of the number 1 is zero, and all other elements have a negative direction:

1 −2 −3

At each step, the algorithm finds the greatest element with a nonzero direction, and swaps it in the indicated direction:

1 −3 −2

If this causes the chosen element to reach the first or last position within the permutation, or if the next element in the same direction is greater than the chosen element, the direction of the chosen element is set to zero:

3 1 −2

After each step, all elements greater than the chosen element (which previously had direction zero) have their directions set to indicate motion toward the chosen element. That is, positive for all elements between the start of the permutation and the chosen element, and negative for elements toward the end. Thus, in this example, after the number 2 moves, the number 3 becomes marked with a direction again:

+3 2 1

The remaining two steps of the algorithm for $n=3$ are:

2 +3 1

2 1 3

When all numbers become unmarked, the algorithm terminates.

This algorithm takes time $O(i)$ for every step in which the greatest number to move is $n-i+1$. Thus, the swaps involving the number $n$ take only constant time; since these swaps account for all but a $1/n$ fraction of all of the swaps performed by the algorithm, the average time per permutation generated is also constant, even though a small number of permutations will take a larger amount of time.

A more complex loopless version of the same procedure suitable for functional programming allows it to be performed in constant time per permutation in every case; however, the modifications needed to eliminate loops from the procedure make it slower in practice.

Related structures

Permutohedron

The set of all permutations of $n$ items may be represented geometrically by a permutohedron, the polytope formed from the convex hull of $n!$ vectors, the permutations of the vector $(1,2,\dots n)$. Although defined in this way in $n$-dimensional space, it is actually an $(n-1)$-dimensional polytope; for example, the permutohedron on four items is a three-dimensional polyhedron, the truncated octahedron. If each vertex of the permutohedron is labeled by the inverse permutation to the permutation defined by its vertex coordinates, the resulting labeling describes a Cayley graph of the symmetric group of permutations on $n$ items, as generated by the permutations that swap adjacent pairs of items. Thus, each two consecutive permutations in the sequence generated by the Steinhaus–Johnson–Trotter algorithm correspond in this way to two vertices that form the endpoints of an edge in the permutohedron, and the whole sequence of permutations describes a Hamiltonian path in the permutohedron, a path that passes through each vertex exactly once. If the sequence of permutations is completed by adding one more edge from the last permutation to the first one in the sequence, the result is instead a Hamiltonian cycle.

Gray codes

A Gray code for numbers in a given radix is a sequence that contains each number up to a given limit exactly once, in such a way that each pair of consecutive numbers differs by one in a single digit. The $n!$ permutations of the $n$ numbers from 1 to $n$ may be placed in one-to-one correspondence with the $n!$ numbers from 0 to $n!-1$ by pairing each permutation with the sequence of numbers $c_{i}$ that count the number of positions in the permutation that are to the right of value $i$ and that contain a value less than $i$ (that is, the number of inversions for which $i$ is the larger of the two inverted values), and then interpreting these sequences as numbers in the factorial number system, that is, the mixed radix system with radix sequence $(1,2,3,4,\dots )$ For instance, the permutation $(3,1,4,5,2)$ would give the values $c_{1}=0$, $c_{2}=0$, $c_{3}=2$, $c_{4}=1$, and $c_{5}=1$. The sequence of these values, $(0,0,2,1,1)$, gives the number $$0\times 0!+0\times 1!+2\times 2!+1\times 3!+1\times 4!=34.$$ Consecutive permutations in the sequence generated by the Steinhaus–Johnson–Trotter algorithm have numbers of inversions that differ by one, forming a Gray code for the factorial number system.

More generally, combinatorial algorithms researchers have defined a Gray code for a set of combinatorial objects to be an ordering for the objects in which each two consecutive objects differ in the minimal possible way. In this generalized sense, the Steinhaus–Johnson–Trotter algorithm generates a Gray code for the permutations themselves.

History

The method was known for much of its history as a method for change ringing of church bells: it gives a procedure by which a set of bells can be rung through all possible permutations, changing the order of only two bells per change. These so-called "plain changes" or "plain hunt" were known by circa 1621 for four bells, and the general method has been traced to an unpublished 1653 manuscript by Peter Mundy. A 1677 book by Fabian Stedman lists the solutions for up to six bells. More recently, change ringers have abided by a rule that no bell may stay in the same position for three consecutive permutations; this rule is violated by the plain changes, so other strategies that swap multiple bells per change have been devised.

The algorithm is named after Hugo Steinhaus, Selmer M. Johnson and Hale F. Trotter. Johnson and Trotter rediscovered the algorithm independently of each other in the early 1960s. A 1958 book by Steinhaus, translated into English in 1964, describes a related impossible puzzle of generating all permutations by a system of particles, each moving at constant speed along a line and swapping positions when one particle overtakes another. A 1976 paper by Hu and Bien credited Steinhaus with formulating the algorithmic problem of generating all permutations, and by 1989 his book had been (incorrectly) credited as one of the original publications of the algorithm.

See also

• Heap's algorithm, a different method for listing all permutations
• Fisher–Yates shuffle, a method for generating random permutations

References

• Bird, Richard (2010), "Chapter 29: The Johnson–Trotter algorithm", Pearls of Functional Algorithm Design, Cambridge University Press, pp. 251–257, doi:10.1017/cbo9780511763199, ISBN 9780511763199
• Dershowitz, Nachum (1975), "A simplified loop-free algorithm for generating permutations", Nordisk Tidskr. Informationsbehandling (BIT), 15 (2): 158–164, doi:10.1007/bf01932689, MR 0502206, S2CID 121353303
• Dijkstra, Edsger W. (1976), "On a gauntlet thrown by David Gries" (PDF), Acta Informatica, 6 (4): 357–359, doi:10.1007/BF00268136, MR 0426492, S2CID 7085805. Although Dijkstra does not cite any prior literature, an earlier draft EWD502 reveals that he knew of Trotter (1962).
• Ehrlich, Gideon (1973), "Loopless algorithms for generating permutations, combinations, and other combinatorial configurations", Journal of the ACM, 20 (3): 500–513, doi:10.1145/321765.321781, S2CID 21493963
• Even, Shimon (1973), Algorithmic Combinatorics, Macmillan
• Hu, T. C.; Tien, B. N. (October 1976), "Generating permutations with nondistinct items", The American Mathematical Monthly, 83 (8): 629–631, doi:10.1080/00029890.1976.11994195, JSTOR 2319890
• Johnson, Selmer M. (1963), "Generation of permutations by adjacent transposition", Mathematics of Computation, 17 (83): 282–285, doi:10.1090/S0025-5718-1963-0159764-2, JSTOR 2003846, MR 0159764
• Lenstra, J. K.; Rinnooy Kan, A. H. G. (September 1979), "A recursive approach to the implementation of enumerative methods", Proceedings of the School on Analysis and Design of Algorithms in Combinatorial Optimization, Udine, Italy (PDF), Technical report 8003/0, Erasmus University Rotterdam; see Section 2.1, "A minimum-change generator", pp. 3–8
• Knuth, Donald (2011), "Section 7.2.1.2: Generating All Permutations", The Art of Computer Programming, volume 4A: Combinatorial Algorithms, Part 1
• McGuire, Gary (2003), Bells, motels and permutation groups, CiteSeerX 10.1.1.6.5544
• Ruskey, Frank (1989), "Transposition generation of alternating permutations", Order, 6 (3): 227–233, doi:10.1007/BF00563523, MR 1048093
• Savage, Carla (1997), "A survey of combinatorial Gray codes", SIAM Review, 39 (4): 605–629, Bibcode:1997SIAMR..39..605S, CiteSeerX 10.1.1.39.1924, doi:10.1137/S0036144595295272, JSTOR 2132693, MR 1491049
• Sedgewick, Robert (1977), "Permutation generation methods", ACM Comput. Surv., 9 (2): 137–164, doi:10.1145/356689.356692, S2CID 12139332
• Stedman, Fabian (1677), Campanalogia, or, The art of ringing improved, London: W. Godbid – via Early English Books Online Text Creation Partnership
• Steinhaus, Hugo (1964), One hundred problems in elementary mathematics, New York: Basic Books, pp. 49–50, MR 0157881
• Trotter, H. F. (August 1962), "Algorithm 115: Perm", Communications of the ACM, 5 (8): 434–435, doi:10.1145/368637.368660, S2CID 1013826
• White, Arthur T. (November 1996), "Fabian Stedman: the first group theorist?", The American Mathematical Monthly, 103 (9): 771–778, doi:10.1080/00029890.1996.12004816, JSTOR 2974446
• Williams, Aaron (2013), "The Greedy Gray Code Algorithm", in Dehne, Frank; Solis-Oba, Roberto; Sack, Jörg-Rüdiger (eds.), Algorithms and Data Structures - 13th International Symposium, WADS 2013, London, ON, Canada, August 12-14, 2013. Proceedings, Lecture Notes in Computer Science, vol. 8037, Springer, pp. 525–536, doi:10.1007/978-3-642-40104-6_46