Sparse Bayesian kernel logistic regression

In this paper we present a simple hierarchical Bayesian treatment of the sparse kernel logistic regression (KLR) model based MacKay's evidence approximation. The model is re-parameterised such that an isotropic Gaussian prior over parameters in the kernel induced feature space is replaced by an isotropic Gaussian prior over the trans- formed parameters, facilitating a Bayesian analysis using standard meth- ods. The Bayesian approach allows the selection of "good" values for the usual regularisation and kernel parameters through maximisation of the marginal likelihood. Results obtained on a variety of benchmark datasets are provided indicating that the Bayesian kernel logistic regres- sion model is competitive, whilst having one less parameter to determine during model selection.