Convexity of mutual information along the Ornstein-Uhlenbeck flow

arXiv (Cornell University)(2018)

引用 3|浏览51
暂无评分
摘要
We study the convexity of mutual information as a function of time along the flow of the Ornstein-Uhlenbeck process. We prove that if the initial distribution is strongly log-concave, then mutual information is eventually convex, i.e., convex for all large time. In particular, if the initial distribution is sufficiently strongly log-concave compared to the target Gaussian measure, then mutual information is always a convex function of time. We also prove that if the initial distribution is either bounded or has finite fourth moment and Fisher information, then mutual information is eventually convex. Finally, we provide counterexamples to show that mutual information can be nonconvex at small time.
更多
查看译文
关键词
Mutual information,Entropy,Stochastic processes,Heating systems,Random variables,Atmospheric measurements,Particle measurements
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要