2024-2025 Academic Catalog 
    
    Nov 18, 2024  
2024-2025 Academic Catalog

PHYS 169 - Information Theory, Inference, and Networks


This course will explore the basic concepts of Information theory – a topic that lies at the heart of many exciting areas of contemporary science and engineering – and its applications to statistical inference and network theory. Topics covered in the course include entropy as a measure of information, mutual information, information transmission and communication through noiseless or noisy channels, maximum likelihood methods for data analysis, and neural network models. The basic concepts developed will be applied to examples from a wide range of academic fields such as data compression and storage, biophysics, signal processing, neuroscience, machine learning, and finance, where information theory can be related to the theory of optimal investment in the stock market. Finally we will discuss how methods from information theory can be used to study and quantify interaction networks, a subject that lies at the heart of the modern science of complex systems.

Prerequisites: MATH 120  or MATH 124  , and MATH 121  or MATH 125  

Anticipated Terms Offered: varied