I would make sure that you don't have iTunes set to automatically sync. I think a lot of people have the default setting enabled. And when they try to downgrade and install what they think is their iOS 6 backup, they quickly find out that when they were installing iOS 7, that is became the backup.
Just a thought, for what its worth.