LATENT REFERENCES / TAG1
Shannon Entropy
Original title: シャノンエントロピー
This reference note belongs to Tag1 in Latent References, an archive curated by Keigo Yoshida. Its archive region is Theoria. The note preserves its source text and links so that readers can trace the material behind the 3D map.
- Collection
- Tag1
- Archive region
- Theoria
Archived reference note
English translation of the archived note. JP shows the original text. Source links and literal code are retained; the translation does not update or independently verify the source claims.
Shannon entropy (information entropy) quantifies the “degree of uncertainty” or “average amount of information contained” in information theory. The less probable an event, the more information is gained from it.
#list
シャノンエントロピー（情報エントロピー）とは、情報理論における「不確実性の度合い」または「含まれる情報の平均量」を定量化した指標です。事象が起こる確率が低いほど、その事象から得られる情報量は大きくなります。
#list
Source updated 2026-09-11 · Snapshot 2026-10-08
Source links and calculated neighbors
Cosine values measure shared lexical features, not truth, agreement or identical meaning. Original reference links are labeled separately.
- Shannon EntropyComputed lexical cosine similarity 0.684 · shared title, text, tags and references
- Jensen–Shannon DivergenceComputed lexical cosine similarity 0.202 · shared title, text, tags and references
- surf on entropyComputed lexical cosine similarity 0.089 · shared title, text, tags and references