Where the Time Hierarchy Theorem Matters

Introduction

Every computer program runs in some amount of time. But does more time mean more problems solved, or do the same problems keep cycling back no matter how long you wait?

The Time Hierarchy Theorem — proved by Hartmanis and Stearns in 1965 — gives the definitive answer: strictly more time buys strictly more computational power. There is a problem solvable in $O(n^2)$ steps that is provably impossible in $O(n)$ steps. No clever algorithm can close that gap.

The proof is one of computer science's most elegant tricks: diagonalization. A machine is built that reads any algorithm as input and then deliberately does the opposite of what that algorithm would do — using the extra time to stay one step ahead of any contender. The result is a problem that permanently sits just out of reach of the smaller time budget.

This is the theorem that turned complexity theory from philosophy into mathematics. It confirmed that the hierarchy of complexity classes you see in textbooks — $\mathrm{DTIME}(n)$ , $\mathrm{DTIME}(n^2)$ , $\mathrm{DTIME}(2^n)$ — is not an illusion. Those classes are genuinely, provably different.

Try It

The demo below shows the core idea of diagonalization in action. There is a finite list of small algorithms (each one returns 0 or 1 for a given input). A diagonal machine reads each algorithm as input and deliberately returns the opposite answer — ensuring it disagrees with every listed algorithm on at least one input.

<!-- Diagonalization demo for the Time Hierarchy Theorem -->
<p class="hint">Each row is a small algorithm that outputs 0 or 1 for inputs 0–4. The <b>diagonal machine D</b> looks at what algorithm A&#x1D62; returns on input <i>i</i> (the shaded diagonal cell) and flips it. D therefore disagrees with <i>every</i> listed algorithm on at least one input — so no listed algorithm can equal D. That is the problem D solves that sits outside the smaller time class.</p>
<div id="matrix-wrap">
  <table id="matrix" aria-label="Diagonalization matrix">
    <thead>
      <tr>
        <th>Algorithm</th>
        <th title="Input value">Input 0</th>
        <th title="Input value">Input 1</th>
        <th title="Input value">Input 2</th>
        <th title="Input value">Input 3</th>
        <th title="Input value">Input 4</th>
        <th class="diag-col" title="Diagonal machine output for this row index">D(i)</th>
      </tr>
    </thead>
    <tbody id="tbody"></tbody>
  </table>
</div>
<div class="status" id="status">Click "Run diagonal" to see the disagreements.</div>
<div class="btns">
  <button id="btn-run" type="button">Run diagonal</button>
  <button id="btn-reset" type="button" class="ghost">Reset</button>
</div>

/* Styles for the diagonalization matrix */
* { box-sizing: border-box; }
body { font-family: system-ui, sans-serif; color: #222; margin: 0; }
.hint { font-size: .88rem; color: #444; margin: 0 0 .7rem; line-height: 1.5; }
#matrix-wrap { overflow-x: auto; }
table { border-collapse: collapse; font-size: .9rem; margin-bottom: .7rem; }
th, td { padding: .35rem .55rem; border: 1px solid #cdd9e3; text-align: center; }
th { background: #e8eef3; font-weight: 700; color: #1d3557; }
td.algo-name { text-align: left; font-style: italic; white-space: nowrap; }
td.cell-0 { background: #f0f4f8; color: #555; }
td.cell-1 { background: #d4edda; color: #155724; font-weight: 600; }
td.diag-col { background: #fff3cd; font-weight: 700; }
td.diag-col.flip { background: #e63946; color: #fff; }
td.diag-agree { background: #c3e6cb; }
td.diag-disagree { background: #f5c6cb; }
tr.diag-row td { background: #fffbe6; font-weight: 700; }
tr.diag-row td.diag-col { background: #ffc107; color: #222; }
.status { font-size: .95rem; font-weight: 600; margin: .4rem 0; min-height: 1.4em; }
.status.ok { color: #0a7d33; }
.status.info { color: #1d3557; }
.btns { display: flex; gap: .5rem; flex-wrap: wrap; }
button { font: 600 14px system-ui, sans-serif; padding: .45rem .9rem;
         border: 1px solid #1d3557; background: #1d3557; color: #fff;
         border-radius: 8px; cursor: pointer; }
button.ghost { background: #fff; color: #1d3557; }

const i18nFmt = (s, v) => s.replace(/%(\w+)%/g, (_, k) => String(v[k] ?? ''));
// Small algorithms A1..A5, each mapping an input number to 0 or 1.
// In a real proof these would be Turing machines enumerated by index.
const ALGOS = [
  { name: 'A₁', fn: n => (n % 2 === 0 ? 1 : 0) },
  { name: 'A₂', fn: n => (n < 3 ? 1 : 0) },
  { name: 'A₃', fn: n => 1 },
  { name: 'A₄', fn: n => (n === 2 || n === 4 ? 1 : 0) },
  { name: 'A₅', fn: n => 0 }
];
const INPUTS = [0, 1, 2, 3, 4];

// The diagonal machine flips the output of algorithm i on input i.
function diagonal(i) {
  return ALGOS[i].fn(i) === 1 ? 0 : 1;
}

let ran = false;

function buildTable(showDiag) {
  const tbody = document.getElementById('tbody');
  tbody.innerHTML = '';
  // Build one table row per algorithm
  for (let i = 0; i < ALGOS.length; i++) {
    const tr = document.createElement('tr');
    const nameCell = document.createElement('td');
    nameCell.className = 'algo-name';
    nameCell.textContent = ALGOS[i].name;
    tr.appendChild(nameCell);
    for (let j = 0; j < INPUTS.length; j++) {
      const td = document.createElement('td');
      const val = ALGOS[i].fn(INPUTS[j]);
      td.textContent = val;
      td.className = 'cell-' + val;
      // Highlight the diagonal cell (row i, input i) that D reads and flips
      if (j === i && showDiag) {
        td.className += (val === 1 ? ' diag-disagree' : ' diag-agree');
      }
      tr.appendChild(td);
    }
    // Last column shows what D returns for this row index
    const diagTd = document.createElement('td');
    diagTd.className = 'diag-col';
    if (showDiag) {
      const d = diagonal(i);
      diagTd.textContent = d;
      diagTd.classList.add('flip');
    } else {
      diagTd.textContent = '?';
    }
    tr.appendChild(diagTd);
    tbody.appendChild(tr);
  }
  // Extra row shows D's full output across all inputs
  const diagRow = document.createElement('tr');
  diagRow.className = 'diag-row';
  const dLabel = document.createElement('td');
  dLabel.className = 'algo-name';
  dLabel.textContent = 'D (diagonal)';
  diagRow.appendChild(dLabel);
  for (let j = 0; j < INPUTS.length; j++) {
    const td = document.createElement('td');
    td.className = 'diag-col';
    if (showDiag) {
      td.textContent = diagonal(j);
    } else {
      td.textContent = '?';
    }
    diagRow.appendChild(td);
  }
  const cornerTd = document.createElement('td');
  cornerTd.className = 'diag-col';
  cornerTd.textContent = '';
  diagRow.appendChild(cornerTd);
  tbody.appendChild(diagRow);
}

function run() {
  ran = true;
  buildTable(true);
  const disagreeCount = ALGOS.length;
  document.getElementById('status').textContent = i18nFmt('Diagonal machine found — disagrees with all %n% algorithms on their diagonal cell.', { n: disagreeCount });
  document.getElementById('status').className = 'status ok';
}

function reset() {
  ran = false;
  buildTable(false);
  document.getElementById('status').textContent = 'Click "Run diagonal" to see the disagreements.';
  document.getElementById('status').className = 'status info';
}

document.getElementById('btn-run').addEventListener('click', run);
document.getElementById('btn-reset').addEventListener('click', reset);
buildTable(false);
document.getElementById('status').className = 'status info';

<!-- Diagonalization demo for the Time Hierarchy Theorem -->
<p class="hint">Each row is a small algorithm that outputs 0 or 1 for inputs 0–4. The <b>diagonal machine D</b> looks at what algorithm A&#x1D62; returns on input <i>i</i> (the shaded diagonal cell) and flips it. D therefore disagrees with <i>every</i> listed algorithm on at least one input — so no listed algorithm can equal D. That is the problem D solves that sits outside the smaller time class.</p>
<div id="matrix-wrap">
  <table id="matrix" aria-label="Diagonalization matrix">
    <thead>
      <tr>
        <th>Algorithm</th>
        <th title="Input value">Input 0</th>
        <th title="Input value">Input 1</th>
        <th title="Input value">Input 2</th>
        <th title="Input value">Input 3</th>
        <th title="Input value">Input 4</th>
        <th class="diag-col" title="Diagonal machine output for this row index">D(i)</th>
      </tr>
    </thead>
    <tbody id="tbody"></tbody>
  </table>
</div>
<div class="status" id="status">Click "Run diagonal" to see the disagreements.</div>
<div class="btns">
  <button id="btn-run" type="button">Run diagonal</button>
  <button id="btn-reset" type="button" class="ghost">Reset</button>
</div>

/* Styles for the diagonalization matrix */
* { box-sizing: border-box; }
body { font-family: system-ui, sans-serif; color: #222; margin: 0; }
.hint { font-size: .88rem; color: #444; margin: 0 0 .7rem; line-height: 1.5; }
#matrix-wrap { overflow-x: auto; }
table { border-collapse: collapse; font-size: .9rem; margin-bottom: .7rem; }
th, td { padding: .35rem .55rem; border: 1px solid #cdd9e3; text-align: center; }
th { background: #e8eef3; font-weight: 700; color: #1d3557; }
td.algo-name { text-align: left; font-style: italic; white-space: nowrap; }
td.cell-0 { background: #f0f4f8; color: #555; }
td.cell-1 { background: #d4edda; color: #155724; font-weight: 600; }
td.diag-col { background: #fff3cd; font-weight: 700; }
td.diag-col.flip { background: #e63946; color: #fff; }
td.diag-agree { background: #c3e6cb; }
td.diag-disagree { background: #f5c6cb; }
tr.diag-row td { background: #fffbe6; font-weight: 700; }
tr.diag-row td.diag-col { background: #ffc107; color: #222; }
.status { font-size: .95rem; font-weight: 600; margin: .4rem 0; min-height: 1.4em; }
.status.ok { color: #0a7d33; }
.status.info { color: #1d3557; }
.btns { display: flex; gap: .5rem; flex-wrap: wrap; }
button { font: 600 14px system-ui, sans-serif; padding: .45rem .9rem;
         border: 1px solid #1d3557; background: #1d3557; color: #fff;
         border-radius: 8px; cursor: pointer; }
button.ghost { background: #fff; color: #1d3557; }

const i18nFmt = (s, v) => s.replace(/%(\w+)%/g, (_, k) => String(v[k] ?? ''));
// Small algorithms A1..A5, each mapping an input number to 0 or 1.
// In a real proof these would be Turing machines enumerated by index.
const ALGOS = [
  { name: 'A₁', fn: n => (n % 2 === 0 ? 1 : 0) },
  { name: 'A₂', fn: n => (n < 3 ? 1 : 0) },
  { name: 'A₃', fn: n => 1 },
  { name: 'A₄', fn: n => (n === 2 || n === 4 ? 1 : 0) },
  { name: 'A₅', fn: n => 0 }
];
const INPUTS = [0, 1, 2, 3, 4];

// The diagonal machine flips the output of algorithm i on input i.
function diagonal(i) {
  return ALGOS[i].fn(i) === 1 ? 0 : 1;
}

let ran = false;

function buildTable(showDiag) {
  const tbody = document.getElementById('tbody');
  tbody.innerHTML = '';
  // Build one table row per algorithm
  for (let i = 0; i < ALGOS.length; i++) {
    const tr = document.createElement('tr');
    const nameCell = document.createElement('td');
    nameCell.className = 'algo-name';
    nameCell.textContent = ALGOS[i].name;
    tr.appendChild(nameCell);
    for (let j = 0; j < INPUTS.length; j++) {
      const td = document.createElement('td');
      const val = ALGOS[i].fn(INPUTS[j]);
      td.textContent = val;
      td.className = 'cell-' + val;
      // Highlight the diagonal cell (row i, input i) that D reads and flips
      if (j === i && showDiag) {
        td.className += (val === 1 ? ' diag-disagree' : ' diag-agree');
      }
      tr.appendChild(td);
    }
    // Last column shows what D returns for this row index
    const diagTd = document.createElement('td');
    diagTd.className = 'diag-col';
    if (showDiag) {
      const d = diagonal(i);
      diagTd.textContent = d;
      diagTd.classList.add('flip');
    } else {
      diagTd.textContent = '?';
    }
    tr.appendChild(diagTd);
    tbody.appendChild(tr);
  }
  // Extra row shows D's full output across all inputs
  const diagRow = document.createElement('tr');
  diagRow.className = 'diag-row';
  const dLabel = document.createElement('td');
  dLabel.className = 'algo-name';
  dLabel.textContent = 'D (diagonal)';
  diagRow.appendChild(dLabel);
  for (let j = 0; j < INPUTS.length; j++) {
    const td = document.createElement('td');
    td.className = 'diag-col';
    if (showDiag) {
      td.textContent = diagonal(j);
    } else {
      td.textContent = '?';
    }
    diagRow.appendChild(td);
  }
  const cornerTd = document.createElement('td');
  cornerTd.className = 'diag-col';
  cornerTd.textContent = '';
  diagRow.appendChild(cornerTd);
  tbody.appendChild(diagRow);
}

function run() {
  ran = true;
  buildTable(true);
  const disagreeCount = ALGOS.length;
  document.getElementById('status').textContent = i18nFmt('Diagonal machine found — disagrees with all %n% algorithms on their diagonal cell.', { n: disagreeCount });
  document.getElementById('status').className = 'status ok';
}

function reset() {
  ran = false;
  buildTable(false);
  document.getElementById('status').textContent = 'Click "Run diagonal" to see the disagreements.';
  document.getElementById('status').className = 'status info';
}

document.getElementById('btn-run').addEventListener('click', run);
document.getElementById('btn-reset').addEventListener('click', reset);
buildTable(false);
document.getElementById('status').className = 'status info';

Result

Console

The diagonal machine uses its extra simulation budget to stay one step ahead. No algorithm in the list can match it on every input — that is precisely the problem that sits outside the smaller time class. Click Run diagonal to see the disagreements light up.

The Real Complexity

The theorem says: if $f(n)$ and $g(n)$ are time-constructible functions and $f(n) \cdot \log f(n) = o(g(n))$ , then

\mathrm{DTIME}(f(n)) \subsetneq \mathrm{DTIME}(g(n))

In everyday terms: any sufficiently larger time budget unlocks problems the smaller budget cannot touch.

How the proof works — diagonalization:

Enumerate all Turing machines (there are only countably many — list them $M_1, M_2, M_3, \dots$ ).
Build a diagonal machine $D$ : on input $\langle i, x \rangle$ (read: "machine number $i$ , input $x$ "), simulate $M_i$ on $x$ for up to $f(n)$ steps. If $M_i$ accepts, $D$ rejects; otherwise $D$ accepts. $D$ uses time $O(g(n))$ — the larger budget — to run the simulation.
The language $L(D)$ is decided by $D$ in time $O(g(n))$ , so $L(D) \in \mathrm{DTIME}(g(n))$ .
No machine in the list can decide $L(D)$ : machine $M_i$ disagrees with $D$ on the input $\langle i, x_i \rangle$ by construction. So $L(D) \notin \mathrm{DTIME}(f(n))$ .

The "time-constructible" condition is a technicality: we need $D$ to be able to count to $f(n)$ without using more than $f(n)$ time itself.

The classic corollary: $\mathrm{P} \subsetneq \mathrm{EXPTIME}$ . There are problems a polynomial-time machine cannot solve but an exponential-time machine can — and this is proved, not just conjectured (unlike the famous P vs NP question). Another corollary: the halting problem can be decided with enough time, but it cannot be decided in any fixed time bound — the hierarchy stretches to infinity.

Where It Matters

The Time Hierarchy Theorem is not a curiosity — it is the scaffolding on which all of complexity theory rests:

Separating complexity classes: $\mathrm{P} \subsetneq \mathrm{EXPTIME}$ is one of the few unconditional separations we have. Most class separations (like P vs NP) remain open conjectures; this one is a proven fact.
Lower bound methodology: diagonalization was the first tool for proving that no algorithm, however clever, can solve a problem within a given time bound. It launched the entire field of computational lower bounds.
Understanding what "harder" means: without this theorem, the hierarchy of classes ( $\mathrm{L}$ , $\mathrm{P}$ , $\mathrm{NP}$ , $\mathrm{PSPACE}$ , $\mathrm{EXPTIME}$ , …) could conceivably collapse. The theorem proves at least the outermost shells are genuinely distinct.
Algorithm design intuition: if a problem is known to require $\Theta(n^2)$ time, no amount of ingenuity can push it below $o(n^2 / \log n)$ — the theorem tells you where to stop searching.
Cryptography and hardness: many hardness arguments borrow the flavor of diagonalization to show that breaking a scheme requires strictly more computation than building it.

Diagonalization is the same technique Cantor used to show the reals outnumber the integers. Hartmanis and Stearns brought it into computation and proved that the passage of time itself creates genuinely new territory — a beautiful import from pure mathematics into engineering.

Conclusion

The Time Hierarchy Theorem delivers something rare in complexity theory: a proof rather than a conjecture. While the question of P vs NP remains open after half a century, the gap between polynomial and exponential time is settled — those classes are genuinely different, separated by a diagonal argument elegant enough to fit on a napkin.

The lesson is both technical and philosophical. Computationally, time is a real resource: spending more of it lets you solve problems that were simply unreachable before. Philosophically, diagonalization shows that self-reference — a machine that reads and refutes itself — is one of the most powerful tools in all of mathematics.

Every time you see a complexity class diagram with nested rings, the Time Hierarchy Theorem is the guarantee that at least some of those rings are not the same ring in disguise.

Comments

Loading comments...

https://www.kipuhub.com/en/article/time-hierarchy-theorem/Content licensed under CC BY-NC 4.0.

Cookies & privacy

The Time Hierarchy Theorem

Why giving a computer more time always unlocks new problems