Great but Manageable Expectations

Posted on 2019-03-14

This is Part 2 of a two-part blog post on differential privacy. Continuing from Part 1, I discuss the Rényi differential privacy, corresponding to the Rényi divergence, a study of the moment generating functions the divergence between probability measures to derive the tail bounds.

Continue reading

A Tail of Two Densities

Posted on 2019-03-13

This is Part 1 of a two-part post where I give an introduction to differential privacy, which is a study of tail bounds of the divergence between probability measures, with the end goal of applying it to stochastic gradient descent.

Continue reading

Raise your ELBO

Posted on 2019-02-14

In this post I give an introduction to variational inference, which is about maximising the evidence lower bound (ELBO).

Continue reading

Discriminant analysis

Posted on 2019-01-03

In this post I talk about the theory and implementation of linear and quadratic discriminant analysis, classical methods in statistical learning.

Continue reading

Shapley, LIME and SHAP

Posted on 2018-12-02

In this post I explain LIME (Ribeiro et. al. 2016), the Shapley values (Shapley, 1953) and the SHAP values (Strumbelj-Kononenko, 2014; Lundberg-Lee, 2017).

Continue reading

older posts