Nicolas Gagne ; Prakash Panangaden - A categorical characterization of relative entropy on standard Borel spaces

lmcs:7621 - Logical Methods in Computer Science, November 9, 2023, Volume 19, Issue 4 - https://doi.org/10.46298/lmcs-19(4:10)2023
A categorical characterization of relative entropy on standard Borel spacesArticle

Authors: Nicolas Gagne ; Prakash Panangaden

    We give a categorical treatment, in the spirit of Baez and Fritz, of relative entropy for probability distributions defined on standard Borel spaces. We define a category suitable for reasoning about statistical inference on standard Borel spaces. We define relative entropy as a functor into Lawvere's category and we show convexity, lower semicontinuity and uniqueness.

    https://doi.org/10.46298/lmcs-19(4:10)2023
    Source: arXiv.org:1703.08853
    Volume: Volume 19, Issue 4
    Published on: November 9, 2023
    Accepted on: August 9, 2023
    Submitted on: June 25, 2021
    Keywords: Computer Science - Information Theory
    Licence: Attribution 4.0 International (CC BY 4.0)
    Funding:
      Source : OpenAIRE Graph
    • Funder: Natural Sciences and Engineering Research Council of Canada

    Share and export

    Consultation statistics

    This page has been seen 2822 times.
    This article's PDF has been downloaded 574 times.