I had this issue on two of my ATV's ( 4K, and ATV4 ), and found that when it slowed down ( even streaming locally would be painful ), the ATV's would be on 2.4Ghz as opposed to 5Ghz. I'm running Amplifi HD's, so installed an additional node ( an Instant, instead of a mesh point, as they're horrid ), and that seems to have cured the issue. I initially had two nodes, and I think that the ATV's were picking the furthest one when waking from sleep.