facebookresearch/decodable_information_bottleneck

We characterize representations that are ``optimal'' -- in terms of test loss -- for a given functional family (e.g. 2 layer MLP) by proposing notions of sufficiency (being able to predict the labels) and minimality (not being able to distinguish between examples with the same labels) with respect to that functional family.

语言：Shell · GitHub 星标：9 · Fork：1

在 GitHub 上查看原仓库