Probability on a Budget