I do everything online and have done so for at least 15 years. Saves time, saves the paper hassle, saves postage. I get an e-mail saying my xyz bill is ready and go to the xyz website and pay the bill. Quick as can be, no paper all over the place, no postage and no worrying about whether my payment got somewhere on time (I get an e-mail back saying "we've received your payment") and that's all there is to it.
I used to keep all that paper (paid bills, etc. ) and then I asked myself "when was I EVER asked to produce a paper copy of a bill I paid 5 years ago?" And the answer was "never." So I got rid of all that paper. During my work life I figure I must have kept track of 10 zillion tons of paper. I hate piles and files of paper. If I want to see payment history or anything else for whatever reason, I can just pull up my xyz account online and see whatever I want to see. And in the unlikely event that I should ever need a copy of a 5 year old bill, I can pull said bill online and print it.
It's really quite freeing.