Nicolas Gagne ; Prakash Panangaden - A categorical characterization of relative entropy on standard Borel spaces

lmcs:7621 - Logical Methods in Computer Science, November 9, 2023, Volume 19, Issue 4 - https://doi.org/10.46298/lmcs-19(4:10)2023
A categorical characterization of relative entropy on standard Borel spacesArticle

Authors: Nicolas Gagne ; Prakash Panangaden

We give a categorical treatment, in the spirit of Baez and Fritz, of relative entropy for probability distributions defined on standard Borel spaces. We define a category suitable for reasoning about statistical inference on standard Borel spaces. We define relative entropy as a functor into Lawvere's category and we show convexity, lower semicontinuity and uniqueness.


Volume: Volume 19, Issue 4
Published on: November 9, 2023
Accepted on: August 9, 2023
Submitted on: June 25, 2021
Keywords: Computer Science - Information Theory
Funding:
    Source : OpenAIRE Graph
  • Funder: Natural Sciences and Engineering Research Council of Canada

Consultation statistics

This page has been seen 3058 times.
This article's PDF has been downloaded 668 times.