Beginners to breast binding often make the mistake of going far too gently, it actually requires quite tight binding to form a kind of groove around the breast to hold the binding in place. With rubber bands just adding one will not provide enough tension and so they tend to roll off. Instead try using several at the same time or much stronger bands.
For more specific instructions it would help to know your breast size, you can post it here or if comfortable pm me.