Computably Enumerable Sets: Creative and Simple Sets
Anchor (Master): Soare 2016 *Turing Computability: Theory and Applications* (Springer) Ch. 2-4 and the historical notes (the normal-form and projection theorems; Myhill's theorem $1\text{-complete} = \text{creative} = \text{recursively isomorphic to } K$; Post's construction of a simple set, the immune and hyperimmune complements, the lattice $\mathcal E$ of c.e. sets and the hypersimple / hyperhypersimple / maximal hierarchy); Rogers 1967 *Theory of Recursive Functions and Effective Computability* (McGraw-Hill) Ch. 7-8, 11 (productive and creative sets, the recursion-theoretic productive function, Myhill's theorem, the reducibility lattice $\le_1, \le_m, \le_{tt}, \le_T$); Odifreddi 1989 *Classical Recursion Theory, Volume I* (North-Holland) Ch. II-III, V (the structure of $\mathcal E$, Post's program, the relation of productiveness to incompleteness)
Intuition Beginner
There are two ways a set of numbers can be "known to a computer," and the gap between them runs through this whole subject. The strong way is to decide the set: a program that, given any number, answers yes or no — is it in or out? — and always stops. The weak way is only to list the set: a program that keeps printing members, one after another, and is guaranteed to eventually print every member, but never has to announce that some number is not coming. A set you can list this way is called computably enumerable, or c.e. for short.
Listing is genuinely weaker than deciding. If you are listing a set and the number has not appeared yet, you cannot conclude is out — maybe it shows up at step a million, maybe never, and you have no way to tell which. The halting set from the previous unit is the headline example: you can list all the programs that stop on their own code by running them all a little at a time and printing each one as it halts, but you cannot decide membership, because that would solve the halting problem.
Inside the listable-but-undecidable sets there turn out to be two very different personalities. Some, like the halting set, are "creative": they actively resist being pinned down. Any time you try to describe what their complement contains, the set hands you back a fresh number you missed — a built-in counterexample machine. Others are "simple": they are tame in a precise sense, their complement is thin and holds no listable infinite pattern, and they sit strictly between the decidable sets and the creative ones. The discovery that both kinds exist is where the structure of computation opens up.
Visual Beginner
A c.e. set is what an enumerator prints. Picture a machine with an output tape that runs forever, occasionally adding a number to a growing list. The set is everything that will ever appear; non-members are simply the numbers that never appear, and nothing flags them.
enumerator for a c.e. set A, running over time:
stage 1 : 3
stage 2 : 3 8
stage 3 : 3 8 8 (repeats are fine)
stage 4 : 3 8 8 15
stage 5 : 3 8 8 15 2
... -> A = {2, 3, 8, 15, ...}
Is 7 in A? It has not appeared by stage 5.
But it might appear at stage 5000, or never.
The list never says "7 is OUT". That one-sided
silence is the whole difference from DECIDING A.Now contrast the two personalities of an undecidable c.e. set by how their complements behave:
| set type | the set is | its complement is | the complement holds... |
|---|---|---|---|
| computable | listable both ways | also listable | a full decision either way |
| creative (like the halting set) | listable | not listable | a recipe handing you a missed number |
| simple | listable | not listable | no infinite listable pattern at all |
Read the bottom two rows as opposites of texture. The creative complement is rich enough to power a counterexample machine; the simple complement is so thin that no infinite listable family fits inside it. Both are undecidable, yet they sit at different places in the landscape.
Worked example Beginner
We show concretely that "listable" is weaker than "decidable," using a set everyone can picture: the set of numbers such that the program numbered eventually prints the digit when run on input .
Step 1. List . Run a master loop over stages . At stage , simulate each of the first programs for steps on input . Whenever you find that program has printed a within its allotted steps, add to your output list. Every program that ever prints a will be caught at some finite stage, so this loop lists exactly . So is c.e.
Step 2. Try to decide , and watch it fail. To decide you would need, for a program that has not yet printed a , to say whether it ever will. But a program might run for a billion steps in silence and then print a , or run forever and never print one. Waiting longer never settles the "never" case.
Step 3. Make the failure sharp. Suppose you had a decider for . Take any program ; build a new program that simulates and prints a exactly if halts. Then this new program is in precisely when halts — so deciding would decide halting, which the previous unit showed is impossible.
What this tells us: is a perfectly ordinary set you can enumerate by brute simulation, yet no amount of waiting turns the enumeration into a decision. The one-sided nature of listing is not a weakness of your method; it is the actual boundary of what programs can know about other programs.
Check your understanding Beginner
Formal definition Intermediate+
Fix the standard enumeration of unary partial computable functions and the universal function from 42.04.01, with meaning the computation halts. Write for the -th computably enumerable set; is the canonical enumeration of all c.e. sets, with stage approximations (the computation halting in steps), so and each is a finite set computable uniformly in .
A set is computably enumerable (c.e.) if any one of the following equivalent conditions holds [Soare Ch. 2]: for some ; or for a total computable ; is the projection of a computable relation ; is -definable, with a bounded-quantifier (computable) formula. The normal-form theorem gives the projection witness uniformly: with the Kleene predicate computable. A set is computable if is computable.
For the reducibilities, (many-one) means a total computable with ; (one-one) adds that is injective; (truth-table) allows a computable map from to a finite Boolean query of ; and (Turing, developed in co-produced 42.04.04) allows an oracle algorithm. These strengthen leftward: . A c.e. set is -complete (-complete) if () for every c.e. .
A set is productive if there is a partial computable function (a productive function) such that whenever , then and . A c.e. set is creative if is productive. An infinite set is immune if it contains no infinite c.e. subset; a c.e. set is simple if is infinite and immune.
Counterexamples to common slips Intermediate+
"c.e. means the range of a computable function, so every c.e. set is infinite." The empty set is c.e. (domain of the everywhere-undefined function), and finite sets are c.e. The range characterisation needs the clause " or ": a total has nonempty range, so is the lone exception, not a counterexample to c.e.-ness.
"A productive set is c.e." Productiveness is a property forcing a set to be very non-c.e.: a productive set has an infinite c.e. subset structure it always escapes, so it is never c.e. The creative sets are c.e.; their complements are the productive ones. The roles of and must be kept straight.
"Simple just means undecidable." Simplicity is a specific structural property of the complement — infinite but immune. It implies undecidable and non--complete, but most undecidable c.e. sets ( itself) are not simple. Simplicity is a deliberate construction, not a default.
" and give the same complete sets." They give the same complete c.e. degree by Myhill's theorem, but is strictly finer as a preorder in general; the coincidence at the top (creative -complete -complete) is a theorem, not a definition.
Key theorem with proof Intermediate+
The organising results are Post's complementation theorem, which fixes exactly when listability upgrades to decidability, and the creativity of , which certifies that the halting set is -complete by a productive function rather than by an ad-hoc reduction.
Theorem (Post's complementation theorem; is creative). A set is computable if and only if both and are computably enumerable. The halting set is creative: the identity function is a productive function for .
Proof. If is computable then is computable, so where halts iff , and likewise ; both are c.e. Conversely, suppose and . To decide , dovetail: run the stage approximations and for until appears in one of them. Since , the number lies in exactly one, so it enters or at some finite stage; output "yes" if it entered , "no" if . This is a total computable decision procedure, so is computable.
For creativity, is c.e. (it is for ). I claim the identity is a productive function for : if , then . Indeed means would have to be checked — and , so . If then would give and at once, impossible; hence , i.e. . As also forces , so , the value lands in exactly as required. Thus is productive and is creative.
Bridge. Post's complementation theorem is the foundational reason c.e.-ness and computability are two genuinely different levels rather than one: a set is decidable precisely when both it and its complement are listable, so the asymmetry of the halting set — listable, with an unlistable complement — is the only way undecidability can happen for a c.e. set. The identity-as-productive-function calculation is exactly the diagonal of 42.04.02 read as a counterexample generator: where the previous unit ran the diagonal once to defeat a decider, here the same self-application is packaged as a uniform procedure that, given any attempted c.e. approximation to , returns a witness it missed. This builds toward Myhill's theorem, where creativity is shown to pin down the entire -complete degree, and it appears again in the productiveness of arithmetic provability, where the productive function becomes the engine of Gödel incompleteness (cross-ref 42.01.09 pending). The central insight is that creativity is effective resistance to enumeration, so putting these together the halting set's hardness is not an accident of its definition but a structural feature certified by a single computable function.
Exercises Intermediate+
Advanced results Master
Creativity and simplicity bound the c.e. sets from above and from the middle: every creative set is a copy of , simplicity produces a c.e. set provably below the complete degree, and the lattice of c.e. sets organises the refinements that Post hoped would force an intermediate Turing degree. The results below develop the isomorphism theorem, the simple-set hierarchy, and the productiveness that turns this structure theory into a proof of incompleteness.
Theorem 1 (Myhill's isomorphism theorem). For c.e. sets the three notions coincide: is creative is -complete is -complete, and any two creative sets are recursively isomorphic — there is a computable permutation of with [Rogers Ch. 7]. In particular every creative set is recursively isomorphic to . The forward implications run creative -complete (the productive function drives any c.e. set into ) and creative -complete (the reduction can be made injective by padding the productive function's outputs to distinct values); the isomorphism is an effective Cantor-Schröder-Bernstein construction interleaving the two one-one reductions and into a single computable bijection. Myhill's theorem is the precise sense in which is the halting set: not merely -equivalent to every other complete c.e. set, but literally a relabelling of it.
Theorem 2 (productiveness and incompleteness). Let be a consistent, computably axiomatised theory extending a weak base for arithmetic, and let be its (c.e.) set of theorems. The set of (codes of) true sentences refuted-or-unprovable is productive, and concretely restricted to true sentences is productive: a productive function, applied to any c.e. set of sentences proves, returns a true sentence does not prove [Odifreddi Ch. III]. This is Gödel's first incompleteness theorem read recursion-theoretically: because (halting is expressible and provable-when-true) while the set of true sentences is productive, no c.e. axiomatisation captures all arithmetic truth — the productive function exhibits the missed truth uniformly, and that truth is the Gödel sentence (cross-ref 42.01.09 pending). Productiveness is thus the structural form of incompleteness: a set that no enumeration can exhaust, with the escape witness computed from the attempted enumeration.
Theorem 3 (the simple-set hierarchy). Post refined simplicity to weaken the complement further. A c.e. set is hypersimple if is infinite and hyperimmune — its principal function (the increasing enumeration of ) is not dominated by any computable function — and hyperhypersimple if is infinite and the c.e. sets disjoint from have no infinite c.e. "array" covering them; a maximal set is a c.e. whose complement is as thin as possible, with no c.e. set splitting into two infinite pieces [Soare Ch. 4]. These form a strict hierarchy maximal hyperhypersimple hypersimple simple, each a structurally definable class in the lattice of c.e. sets under inclusion modulo finite difference. Friedberg's maximal-set theorem (every c.e. degree above that is high contains a maximal set, and maximal sets exist) shows has a rich definable structure.
Theorem 4 (Post's program and its outcome). Post's program sought a structural (lattice-theoretic) property of a c.e. set guaranteeing — an intermediate Turing degree — thereby solving "Post's problem" of whether such a degree exists without constructing one directly [Soare Ch. 4]. Simplicity blocks -completeness but not Turing-completeness; hypersimplicity blocks truth-table completeness () but a hypersimple set can still be Turing-complete; even maximality does not bound Turing degree below . The program in its original form does not reach an intermediate Turing degree: the gap between the , structure that lattice properties control and the structure is real. Post's problem was finally settled by the priority method of Friedberg and Muchnik (co-produced 42.04.06), constructing two c.e. sets of incomparable Turing degree directly, both strictly between and .
Theorem 5 (Dekker's theorem; simple sets in every degree). Every nonzero c.e. Turing degree contains a simple set [Rogers Ch. 8]. Given any c.e. of nonzero degree with an injective computable enumeration , the deficiency set — stages later improved upon — is simple and Turing-equivalent to . Thus simplicity is not a degree-theoretic restriction at all: it constrains the structure (no simple set is -complete) while imposing nothing on Turing degree, the cleanest illustration of why Post's program could not succeed on its own terms.
Synthesis. The c.e. sets are where computability acquires structure, and creativity versus simplicity is the foundational reason that structure is two-dimensional rather than one. Myhill's theorem collapses the top: every creative set is recursively isomorphic to , so -completeness, -completeness, and creativity are one phenomenon, and this is exactly the productive function of the Key theorem read as a universal source — the diagonal of 42.04.02 turned into a relabelling map. Putting these together with Post's complementation theorem, undecidability for a c.e. set is the unlistability of its complement, and the complement's texture splits the undecidable c.e. sets into the creative (productive complement, a counterexample engine) and the simple (immune complement, no infinite c.e. pattern at all). The simple-set hierarchy and Dekker's theorem show this -stratification is dual to the Turing structure rather than parallel to it: simplicity bounds many-one and truth-table hardness yet leaves Turing degree free, which is the central insight behind the failure of Post's program and the bridge to the priority method 42.04.06 that builds the intermediate Turing degrees by direct construction. The productiveness theorem is the load-bearing connection outward — incompleteness 42.01.09 pending is the productiveness of provability, and the arithmetical hierarchy 42.04.05 that classifies these sets by quantifier complexity relativises the whole picture to oracles, with as the base of the jump and the c.e. sets as the projections that populate its first level.
Full proof set Master
Proposition 1 (equivalent characterisations of c.e.). For , the following are equivalent: (i) for some ; (ii) or for total computable ; (iii) for computable .
Proof. (i)(iii): by the normal-form theorem, so take . (iii)(ii): if done; else fix via a witness pair and define on the computable set of pairs with by , padding to a total function with value off the witness set; then . (ii)(i): if it is of the everywhere-undefined function; else define to search for and halt when found, so . Each step is uniform, giving the equivalence.
Proposition 2 (Post's complementation theorem). is computable iff and are both c.e.
Proof. () If is computable, with , and with ; both c.e. () Let , . The procedure: on input , compute and for and halt at the first with . Since and , enters exactly one at a finite stage; output if , else . This computes .
Proposition 3 ( is creative; complementation gives non-c.e. complement). is productive with productive function ; consequently is not c.e.
Proof. If , then . Were , then (by ) and , contradiction; so , hence (as ). Thus , so is productive for . A productive set is never c.e.: if for some , then holds, so , impossible. Hence is not c.e. (recovering, via Proposition 2, that is not computable).
Proposition 4 (creative -complete). If is creative then every c.e. satisfies .
Proof. Let be productive for and . By the s-m-n and recursion theorems there is a total computable with if and if (the construction enumerates into exactly when , using its own index supplied by the recursion theorem). If : , so , i.e. . If : ; were we would need to invoke productiveness, but applied earlier forces whenever — so , giving . Hence is total computable with , so .
Proposition 5 (Post's simple set). There is a c.e. set with infinite and immune.
Proof. Enumerate , . At stage : for the least with unsatisfied, if some has and , put the least such into and mark satisfied. is c.e. Immunity: if is infinite it contains an , found at some stage, so is met by enumerating an element of into ; hence , so no infinite c.e. is contained in . Infinitude of : each adds at most one element, exceeding , so , leaving elements of in for every . So is infinite. is simple.
Proposition 6 (simple not -complete). No simple set is -complete.
Proof. Suppose is simple and -complete; then is not what we have, so argue via productiveness. An -complete c.e. set is creative (it is -complete by the padding in Theorem 1, hence creative by Exercise 7), so would be productive. A productive set contains an infinite c.e. subset: iterate from an index for to get , then an index for to get , and inductively an infinite c.e. set . This contradicts the immunity of . Hence is not -complete.
Proposition 7 (Dekker's deficiency set is simple). If is c.e., infinite, and not computable, with injective computable enumeration (so ), then the deficiency set is simple and .
Proof. is c.e.: is witnessed by finding with , a c.e. search. The complement consists of the "true stages" where the enumeration reaches a new running minimum-from-here; these are infinite (the enumeration takes infinitely many record-low values among its tail minima). Immunity of : an infinite c.e. subset of would let one compute, for each , a true stage past which the enumeration of never dips below , yielding a computable enumeration of in increasing order and hence computable — contradicting that is not computable. So is immune and is simple. Finally : from one decides by the c.e. definition with a halting bound read off , and from one recovers the increasing enumeration of , so each computes the other.
Connections Master
The halting problem and recursion theorem
42.04.02supply the diagonal this unit converts into structure: the self-application that defeats a decider becomes the identity productive function for , the s-m-n and recursion theorems drive the creative-to--complete reduction (Proposition 4) and the simple-set construction (Proposition 5), and enters here as the canonical creative set. That unit owns the undecidability of and the many-one theory; this unit owns the c.e. structure theory — the equivalent characterisations, Post's complementation, creativity, and simplicity — built on top of it.Turing reducibility and the c.e. degrees
42.04.04, co-produced, refine the relation of this unit to : the reducibility zoo introduced in the Formal definition is completed there, where becomes the canonical object and the gap exposed by Dekker's theorem (Proposition 7) — simplicity constrains but not — motivates the degree structure. This unit owns the simple/creative dichotomy in the world; that unit owns the Turing-degree refinement.The priority method and Post's problem
42.04.06, co-produced, resolves the question this unit's Theorem 4 leaves open: Post's program could not force an intermediate Turing degree by a structural property of c.e. sets, and the Friedberg-Muchnik construction builds two c.e. sets of incomparable Turing degree directly, both strictly between and . The simple-set construction of Proposition 5 is the historical and technical seed of the finite-injury method developed there.Gödel incompleteness
42.01.09pending is the productiveness of provability (Theorem 2): because while the set of true arithmetic sentences is productive, no c.e. axiomatisation captures all truth, and the productive function returns the Gödel sentence as the missed truth. The arithmetical hierarchy42.04.05classifies the c.e. sets of this unit as and relativises productiveness and creativity to oracles to build the jump hierarchy above .
Historical & philosophical context Master
The theory of computably enumerable sets is Emil Post's creation. In his 1944 paper "Recursively enumerable sets of positive integers and their decision problems" Post named the c.e. sets, proved the complementation theorem identifying the decidable sets as those whose complement is also c.e., and introduced the creative sets — c.e. sets whose complements carry a productive function that, given any attempted enumeration of the complement, returns a witness it omits [Rogers Ch. 8]. Post recognised that and the complete sets are all creative and that this was the recursion-theoretic content of Gödel's 1931 incompleteness theorem: the set of provable sentences of a consistent axiomatic arithmetic is c.e. but its true-sentence complement is productive, so the theory is incomplete by the very mechanism that makes the halting set creative. In the same paper Post constructed the first simple set, a c.e. set whose complement is infinite yet contains no infinite c.e. set, establishing a c.e. set that is undecidable but provably not many-one complete — the opening move of what became Post's problem.
John Myhill proved in 1955 that the creative sets are exactly the -complete (equivalently -complete) c.e. sets and that all of them are recursively isomorphic to , an effectivisation of the Cantor-Schröder-Bernstein theorem that fixed as the canonical complete c.e. set up to computable relabelling [Soare Ch. 4]. Post's program — to find a lattice-theoretic property of a c.e. set forcing its Turing degree strictly between and — drove the development of the simple, hypersimple, hyperhypersimple, and maximal sets and the study of the lattice of c.e. sets through the 1940s and 1950s. The program did not reach an intermediate Turing degree by structural means, and Post's problem was solved instead by Richard Friedberg and Albert Muchnik in 1956–1957 with the independently discovered priority (finite-injury) method, constructing two c.e. sets of incomparable Turing degree directly. James Dekker's deficiency-set construction showed every nonzero c.e. degree contains a simple set, separating the many-one structure that simplicity controls from the Turing structure it leaves free.
Bibliography Master
@article{post1944recursively,
author = {Post, Emil L.},
title = {Recursively enumerable sets of positive integers and their decision problems},
journal = {Bulletin of the American Mathematical Society},
volume = {50},
number = {5},
year = {1944},
pages = {284--316}
}
@article{myhill1955creative,
author = {Myhill, John},
title = {Creative sets},
journal = {Zeitschrift f\"{u}r mathematische Logik und Grundlagen der Mathematik},
volume = {1},
number = {2},
year = {1955},
pages = {97--108}
}
@article{friedberg1957solution,
author = {Friedberg, Richard M.},
title = {Two recursively enumerable sets of incomparable degrees of unsolvability (solution of {Post's} problem, 1944)},
journal = {Proceedings of the National Academy of Sciences},
volume = {43},
number = {2},
year = {1957},
pages = {236--238}
}
@article{muchnik1956unsolvability,
author = {Muchnik, Albert A.},
title = {On the unsolvability of the problem of reducibility in the theory of algorithms},
journal = {Doklady Akademii Nauk SSSR},
volume = {108},
year = {1956},
pages = {194--197}
}
@article{dekker1954selection,
author = {Dekker, James C. E.},
title = {A theorem on hypersimple sets},
journal = {Proceedings of the American Mathematical Society},
volume = {5},
number = {5},
year = {1954},
pages = {791--796}
}
@article{friedberg1958maximal,
author = {Friedberg, Richard M.},
title = {Three theorems on recursive enumeration. {I}. Decomposition. {II}. Maximal set. {III}. Enumeration without duplication},
journal = {The Journal of Symbolic Logic},
volume = {23},
number = {3},
year = {1958},
pages = {309--316}
}
@book{soare2016turing,
author = {Soare, Robert I.},
title = {Turing Computability: Theory and Applications},
series = {Theory and Applications of Computability},
publisher = {Springer},
year = {2016}
}
@book{rogers1967theory,
author = {Rogers, Hartley},
title = {Theory of Recursive Functions and Effective Computability},
publisher = {McGraw-Hill},
year = {1967}
}
@book{odifreddi1989classical,
author = {Odifreddi, Piergiorgio},
title = {Classical Recursion Theory, Volume I},
series = {Studies in Logic and the Foundations of Mathematics},
volume = {125},
publisher = {North-Holland},
year = {1989}
}
@book{cutland1980computability,
author = {Cutland, Nigel},
title = {Computability: An Introduction to Recursive Function Theory},
publisher = {Cambridge University Press},
year = {1980}
}