On Bayesian learning from Bernoulli observations