Editing Entropy and Information (section)

== <span style="color: #FFFFFF;">Remembering</span> ==
* '''Information Theory''' — The mathematical study of the quantification, storage, and communication of information.
* '''Claude Shannon''' — The "Father of Information Theory" who defined the mathematical bit.
* '''Entropy (H)''' — The measure of uncertainty or randomness in a set of data.
* '''Bit''' — The basic unit of information (a Binary Digit), representing a choice between two equally likely options (0 or 1).
* '''Redundancy''' — The fraction of a message that is unnecessary and can be removed without losing information.
* '''Source''' — The entity that generates a message (like a person or a computer).
* '''Channel''' — The medium used to send information (like a wire, air, or fiber-optic cable).
* '''Noise''' — Random interference that can corrupt a message during transmission.
* '''Surprise''' — The mathematical property where rare events provide more information than common ones.
* '''Binary Logarithm (log₂)''' — The mathematical tool used to calculate the number of bits needed to represent a choice.
</div>

<div style="background-color: #006400; color: #FFFFFF; padding: 20px; border-radius: 8px; margin-bottom: 15px;">