<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:content="http://purl.org/rss/1.0/modules/content/"><channel><title>Explorative Thoughts on My Hugo Project</title><link>https://ostensible-paradox.pages.dev/en/categories/explorative-thoughts/</link><description>Recent content in Explorative Thoughts on My Hugo Project</description><generator>Hugo</generator><language>en</language><lastBuildDate>Tue, 19 May 2026 03:30:00 +0800</lastBuildDate><atom:link href="https://ostensible-paradox.pages.dev/en/categories/explorative-thoughts/index.xml" rel="self" type="application/rss+xml"/><item><title>From Boolean Verdicts to Quantitative Witnesses: Why DAG Topology Needs a Trail Semantics</title><link>https://ostensible-paradox.pages.dev/en/posts/from-boolean-verdicts-to-quantitative-witnesses/</link><pubDate>Tue, 19 May 2026 03:30:00 +0800</pubDate><guid>https://ostensible-paradox.pages.dev/en/posts/from-boolean-verdicts-to-quantitative-witnesses/</guid><description>&lt;p>Since Pearl (2009), causal inference on DAGs has crystallized around a powerful but austere toolkit: boolean d-separation and do-calculus. Does evidence flow? Full stop. Does it flow after an intervention? Full stop. This framework is sufficient for causal &lt;em>identification&lt;/em>—determining whether an effect is estimable from observed data. But it is curiously silent on a question that seems equally natural: &lt;strong>how much&lt;/strong> flows, &lt;strong>through which channels&lt;/strong>, and with &lt;strong>what residual structure&lt;/strong>?&lt;/p></description><content:encoded><![CDATA[<p>Since Pearl (2009), causal inference on DAGs has crystallized around a powerful but austere toolkit: boolean d-separation and do-calculus. Does evidence flow? Full stop. Does it flow after an intervention? Full stop. This framework is sufficient for causal <em>identification</em>—determining whether an effect is estimable from observed data. But it is curiously silent on a question that seems equally natural: <strong>how much</strong> flows, <strong>through which channels</strong>, and with <strong>what residual structure</strong>?</p>
<p>I want to argue that this silence is not a minor gap; it is a symptom of two communities talking past each other. And the bridge between them is a rigorous notion of <em>trail as witness</em>.</p>
<hr>
<h2 id="the-boolean-trap">The Boolean Trap</h2>
<p>Traditional DAG analysis gives you a verdict at the endpoints. $X$ is d-separated from $Y$ given $Z$: True or False. The intervened distribution $P(y \mid do(x))$ is identifiable: Yes or No. This is the &ldquo;full stop&rdquo; regime.</p>
<p>But a boolean verdict discards the path. It tells you that water reaches the tap, but not whether it travelled through lead pipes, detoured through a cistern, or was siphoned off midway. To know the <em>texture</em> of a causal chain—to distinguish a default association from a derived conclusion, or to know whether an observed correlation persists because of the presence of one variable or the absence of another—you need to traverse the trail in slow motion, node by node, junction by junction.</p>
<p>Trail traversal gives the texture of causal chains; endpoint booleans do not.</p>
<hr>
<h2 id="two-communities-one-missing-link">Two Communities, One Missing Link</h2>
<p>Remarkably, two intellectual neighborhoods have been circling this problem from opposite ends without quite meeting in the middle:</p>
<p><strong>The Causal Inference community (Pearl et al.)</strong> is structurally obsessed. It abstracts the world into absolute black-and-white: if d-separation holds, the answer is True; otherwise, False. They are plumbers who care only whether the pipe is open, not what contaminant rides the flow. After 2009, the field&rsquo;s theoretical engine on this particular front seems to have stalled—perhaps because every remaining graph-theoretic challenge starts to look like the Four Color Problem, solvable only by brute force unless a new representational insight appears.</p>
<p><strong>The Quantitative Information Flow (QIF) community (Alvim, Palamidessi, Smith et al.)</strong> is capacity-obsessed. They compute leakage in bits, bound it with Shannon capacity, and seek KKT certificates for optimality. But their channel models are often toy simplifications, stripped of topological depth. They measure the volume of water without being able to trace the pipe&rsquo;s winding route through the labyrinth.</p>
<p>Both communities study DAGs plus information flow. Yet:</p>
<ul>
<li>Causal inference has the topology but no quantitative bound.</li>
<li>QIF has the quantitative machinery but no trail-level topological witness.</li>
</ul>
<p>No one has connected them. Why? Because the causal side asks &ldquo;Is it identifiable?&rdquo; and the QIF side asks &ldquo;How many bits leak?&quot;—and neither side has a formalism that answers both at once while retaining the path as a first-class object.</p>
<hr>
<h2 id="lemma-1-the-collider-ancestor-leak--rerouting">Lemma 1: The Collider Ancestor Leak &amp; Rerouting</h2>
<p>Consider a collider $u \rightarrow w \leftarrow v$. Textbook d-separation says evidence can pass through $w$ only when $w$ or a descendant is observed. But this description conflates two distinct phenomena.</p>
<p>Suppose we are testing whether $X$ and $Y$ are d-separated given $Z$. If a descendant of $w$ leads <em>only</em> to $X$ or $Y$ and <strong>not</strong> to $Z$, then the collider is not &ldquo;activated by $Z$&rdquo; in any global sense. It is activated because it creates a connected route from a source to a destination. The conditioning set is, locally, a red herring.</p>
<h3 id="path-normalization--rerouting">Path Normalization / Rerouting</h3>
<p><strong>Claim:</strong> If a descendant of $w$ leads to $X$, the original long path was never necessary; the descendant path itself provides a shorter route.</p>
<p><em>Proof sketch.</em> Take any active trail passing through collider $w$ and reaching $X$ via descendant $d$. Replace the subpath from $w$ to $X$ with $w \leadsto d \leadsto X$. By minimality of active trails (or induction on cutset size), the rerouted path is no longer than the original and preserves endpoint connectivity. The original trail was therefore non-minimal, containing a redundant detour shortcuttable through the collider&rsquo;s own descendant. ∎</p>
<p>The upshot: collider &ldquo;activation&rdquo; is often just topological connectivity leaking outward, not a special global event mediated by the conditioning set.</p>
<hr>
<h2 id="lemma-2-the-junction-obligation-problem">Lemma 2: The Junction Obligation Problem</h2>
<p>If we accept that trails matter, we need a local criterion for their validity that does not require re-scanning the entire graph at every step.</p>
<h3 id="decompiling-the-trail">Decompiling the Trail</h3>
<p>Decompose an active trail into a stateful path type—call it <code>ActiveRoute</code> or <code>BayesBallPathT</code>. Each traversal step carries a direction tag:</p>
<ul>
<li><strong><code>outOf</code></strong>: leaving via an outgoing edge.</li>
<li><strong><code>into</code></strong>: entering via an incoming edge.</li>
</ul>
<p>These tags are not bookkeeping; they encode the <em>obligation</em> imposed by the junction just traversed.</p>
<h3 id="global-topology--local-type-constraints">Global Topology → Local Type Constraints</h3>
<p>In the global formulation, a junction $(A, B, C)$ is valid only after inspecting the whole graph and the conditioning set. Under the state-machine view:</p>
<ol>
<li><strong>Obligations are pushed to interfaces.</strong> The direction label at a boundary encodes what junction type is expected on the other side.</li>
<li><strong>Composition is type checking.</strong> Concatenating two path segments requires only that the output state of the first matches the input obligation of the second. No global inspection needed.</li>
<li><strong>Local consistency implies global consistency.</strong> If every adjacent pair of segments satisfies their shared interface obligation, the entire trail is valid by construction.</li>
</ol>
<p>The global topological constraint of d-separation becomes a <strong>local type-system constraint</strong> on path segments. The type of a segment is its pair of boundary states; composition is well-typed iff obligations align.</p>
<hr>
<h2 id="what-is-still-missing">What Is Still Missing</h2>
<p>Lemmas 1 and 2 give us a cleaner, more local way to reason about <em>whether</em> a trail is active. But they do not yet answer the quantitative question:</p>
<blockquote>
<p>Not &ldquo;does information flow?&rdquo; but &ldquo;how many bits flow through this specific trail?&rdquo;</p></blockquote>
<p>That question requires machinery that currently lives only in QIF:</p>
<ul>
<li><strong>Channel capacity</strong> between observables and secrets along a specific topological route.</li>
<li><strong>KKT conditions</strong> to certify that a given leakage bound is optimal under the graph&rsquo;s structural constraints.</li>
<li><strong>Shannon bounds</strong> that respect the DAG&rsquo;s conditional-independence structure rather than assuming a flat channel matrix.</li>
</ul>
<p>What does not yet exist—and what I am groping toward—is a framework where:</p>
<ol>
<li>The DAG provides the topological syntax.</li>
<li>The trail provides the witness (the specific path whose capacity we measure).</li>
<li>KKT + channel capacity provide the quantitative certificate.</li>
<li>A proof assistant (Lean4, Coq) checks both the topological type constraints (Lemma 2) and the information-theoretic bounds.</li>
</ol>
<hr>
<h2 id="takeaway">Takeaway</h2>
<p>Pearl&rsquo;s boolean tools are not wrong; they are <em>insufficient</em> for anyone who wants to know the texture of a causal chain. QIF&rsquo;s quantitative tools are not wrong; they are <em>topologically blind</em>. The missing piece is a <strong>trail semantics</strong> that makes the path a first-class object—so that we can ask not only whether an intervention opens a channel, but how wide that channel is, what contaminants it carries, and whether the leakage is bounded.</p>
<p>We need to move from &ldquo;full stop&rdquo; to &ldquo;slow-motion replay.&rdquo; The trail is the witness.</p>
]]></content:encoded></item><item><title>Constructing El Gamal &amp; Kim Proof Chain for CutSetBound.lean</title><link>https://ostensible-paradox.pages.dev/en/posts/constructing-el-gamal-kim-proof-chain-for-cutsetbound-lean/</link><pubDate>Fri, 15 May 2026 10:00:00 +0800</pubDate><guid>https://ostensible-paradox.pages.dev/en/posts/constructing-el-gamal-kim-proof-chain-for-cutsetbound-lean/</guid><description>&lt;h1 id="reconstructing-the-relay-channel-modernizing-the-cut-set-bound-and-degraded-capacity-proofs">Reconstructing the Relay Channel: Modernizing the Cut-set Bound and Degraded Capacity Proofs&lt;/h1>
&lt;p>When aiming to &amp;ldquo;extract dependencies and compress proof chains,&amp;rdquo; few starting points are as effective as the core results from Chapter 16 of El Gamal and Kim: the &lt;strong>cut-set upper bound for general discrete memoryless relay channels&lt;/strong> and the &lt;strong>capacity theorem for physically degraded relay channels&lt;/strong>. These results, originating from the landmark 1979 Cover–El Gamal paper, hold immense historical significance but carry a structural &amp;ldquo;debt&amp;rdquo; that allows for substantial modernization and simplification.&lt;/p></description><content:encoded><![CDATA[<h1 id="reconstructing-the-relay-channel-modernizing-the-cut-set-bound-and-degraded-capacity-proofs">Reconstructing the Relay Channel: Modernizing the Cut-set Bound and Degraded Capacity Proofs</h1>
<p>When aiming to &ldquo;extract dependencies and compress proof chains,&rdquo; few starting points are as effective as the core results from Chapter 16 of El Gamal and Kim: the <strong>cut-set upper bound for general discrete memoryless relay channels</strong> and the <strong>capacity theorem for physically degraded relay channels</strong>. These results, originating from the landmark 1979 Cover–El Gamal paper, hold immense historical significance but carry a structural &ldquo;debt&rdquo; that allows for substantial modernization and simplification.</p>
<h3 id="why-reconstruct">Why Reconstruct?</h3>
<p>The achievability proof in the original 1979 paper relies on a &ldquo;random partition + ambiguity set intersection&rdquo; strategy. While elegant for its time, it is no longer the shortest path to the result.</p>
<p>If our goal is simply to reach the same Decode–Forward rate, we can employ a more direct &ldquo;降维打击&rdquo; (dimensionality reduction) through <strong>regular encoding and backward decoding</strong>. This approach entirely eliminates the need for random partitioning, binning analysis, and the lengthy Slepian–Wolf style derivations. Simultaneously, the converse can be modularized into three clear steps: two applications of Fano&rsquo;s inequality, a causal Markov chain argument, and a single-letterization lemma via concavity.</p>
<p>The core logic of this reconstruction is that degradedness is not a prerequisite for achievability. The Decode–Forward construction holds for general relay channels; the degradedness assumption is only required in the final step of the converse to tighten the bound.</p>
<h3 id="selecting-theorems-where-is-the-room-for-compression">Selecting Theorems: Where is the Room for Compression?</h3>
<p>Within the landscape of network information theory, I have selected several candidates for modular reconstruction. The criterion is not just the fame of the conclusion, but the potential for the proof chain to be further abstracted and streamlined.</p>
<table>
  <thead>
      <tr>
          <th style="text-align: left">Candidate Theorem</th>
          <th style="text-align: left">Text Location</th>
          <th style="text-align: left">Core Statement</th>
          <th style="text-align: left">Simplification Potential</th>
      </tr>
  </thead>
  <tbody>
      <tr>
          <td style="text-align: left"><strong>Capacity of Physically Degraded Relay Channels</strong></td>
          <td style="text-align: left">§16.4, p.386</td>
          <td style="text-align: left">$C = \max \min {I(X_1;Y_2</td>
          <td style="text-align: left">X_2), I(X_1,X_2;Y_3)}$</td>
      </tr>
      <tr>
          <td style="text-align: left"><strong>Cut-set Bound for General Relay Channels</strong></td>
          <td style="text-align: left">§16.2, p.384</td>
          <td style="text-align: left">The outer bound for capacity</td>
          <td style="text-align: left"><strong>High</strong>. Causality arguments can be modularized without coupling to specific coding schemes.</td>
      </tr>
      <tr>
          <td style="text-align: left"><strong>Gel&rsquo;fand–Pinsker Theorem</strong></td>
          <td style="text-align: left">§7.6, p.178</td>
          <td style="text-align: left">Capacity with non-causal state information at the encoder</td>
          <td style="text-align: left"><strong>High</strong>. The auxiliary variable selection and Csiszár sum identity offer excellent room for abstraction.</td>
      </tr>
  </tbody>
</table>
<h3 id="reorganizing-the-logical-chain">Reorganizing the Logical Chain</h3>
<p>We compress the entire proof into the following logical path:</p>
<ol>
<li><strong>The Two-Cut Converse</strong>:
<ul>
<li><strong>Cut 1</strong>: At the receiver, using Fano&rsquo;s inequality to bound $I(X_1, X_2; Y_3)$.</li>
<li><strong>Cut 2</strong>: In an &ldquo;enhanced&rdquo; system where the relay&rsquo;s observations are shared, bounding $I(X_1; Y_2, Y_3 | X_2)$.</li>
<li>This relies only on Fano, causality, and memorylessness—no degradedness required.</li>
</ul>
</li>
<li><strong>Achievability via Backward Decoding</strong>:
<ul>
<li>Utilize block-Markov superposition coding.</li>
<li>The relay decodes forward (block-by-block), while the destination decodes backward.</li>
<li>The &ldquo;magic&rdquo; of backward decoding is that once the next block&rsquo;s message is known, the current block&rsquo;s decision becomes a standard single-user problem, bypassing the need for binning.</li>
</ul>
</li>
<li><strong>Specializing to Degraded Channels</strong>:
<ul>
<li>Introduce the physical degradedness Markov chain $X_1 \to (X_2, Y_2) \to Y_3$.</li>
<li>The second cut&rsquo;s mutual information term collapses, closing the gap between the upper and lower bounds.</li>
</ul>
</li>
</ol>
<h3 id="next-steps-toward-formalization">Next Steps: Toward Formalization</h3>
<p>The current proof draft is mathematically closed. The remaining refinements involve a detailed bookkeeping of the $\delta(\varepsilon)$ terms in the typicality analysis and a formalization of the notation for extending the three-node model to general time-expanded Directed Acyclic Graphs (DAGs).</p>
<p>For formal verification projects like Lean, the most elegant path is to decompose this into three independent lemmas: the <strong>Two-Cut Converse Lemma</strong>, the <strong>Backward Decoding Achievability Lemma</strong>, and the <strong>Additive Decomposition for Orthogonal Networks</strong>. This represents the purest and most modular form of these classic information-theoretic results.</p>
]]></content:encoded></item></channel></rss>