If you don't breastfeed, your body will stop making milk. (That's just how it works.) You'll have to go through the engorgement phase first. It will probably hurt, but it shouldn't last more than a day or two. At this time, some moms swear by doubled-up sports bras and other boobie-restricting clothes. Ice packs and pain relievers might help too. Once your breasts have deflated, they might still leak for a few days before drying up.
Plus, more from The Bump: