Have you tried to pocket a 6" phone personally?
Yes, have you? Obviously not...
I Feel like that really may not be very comfortable when sitting and wearing anything other than cargo pants…
No, they fit just fine in non-Cargos. Go to a high school game and pay attention. Little teenage kids in teenage fashions seem to have no trouble pocketing big-screened Android phones. This "obstacle" is invented, likely by those who "feel" but...
I haven't tried though so I am not sure.
So go try. It's easy to imagine eight-tenths of 1 inch DIAGONAL as being a huge behemoth that "requires new pants with bigger pockets" but it's not that big of a difference. Go to a store that sells phones not branded with a fruit and you can see screen sizes up to 6" today. See if they'll fit non-cargo pants, etc. It's easy.
My thinking on this 5.5" vs. 4.7" thing is simple. Those who use an iPhone mostly for non-phone functions (browser, email, reading, texting, games, etc) are probably going to have the 5.5" "kind of grow on me" when they can see both (after Apple officially endorses both as the new "perfect" sizeS). Those who are absolutely committed to one-hand use or are relatively small people or who use an iPhone much more as a phone than as an "everything" device (probably also owning an iPad for bigger screen wants or needs) will probably favor the 4.7".
Personally, I don't even know why "we" care so much about it as long as Apple rolls out both sizes. With both, the 4.7"-or-bust crowd gets what they want and the 5.5"-or-bust crowd gets what they want too. The existence of the other size "we" don't want for ourselves doesn't harm us- just let's more people join our party. For those that are more stockholders or imaginary employees/management, both are better for Apple too as they can sell phones that bite into the whole, bigger-screen smart phone market instead of just about half of it.