MO3.R4.4

Estimation of Rate-Distortion Function for Computing with Decoder Side Information

Heasung Kim, Hyeji Kim, Gustavo De Veciana, The University of Texas at Austin, United States

Session:
Rate Distortion Theory 1

Track:
9: Shannon Theory

Location:
Omikron II

Presentation Time:
Mon, 8 Jul, 15:35 - 15:55

Session Chair:
Wenyi Zhang,
Abstract
There has been growing interest in computing rate-distortion functions for real-world data, as they can provide a theoretical benchmark for compression problems. However, a generalized form of rate-distortion that includes side information and coding for computing has been underexplored, despite its relevance in modern compression problems. To address this gap, we propose a new method for estimating the rate-distortion function for computing with side information, using a Lagrangian framework with neural network-parametrized encoding and decoding strategies. This approach enables targeting specific points on the rate-distortion curve through gradient-based optimization. Our methodology is validated in synthetic environments where rate-distortion functions are known, ensuring accuracy in estimation. Additionally, we extend its application to practical, high-dimensional channel state information compression scenarios. We provide rate-distortion estimation results on these scenarios, which in turn enables us to quantify the usefulness of side information in the practical scenarios.
Resources