I suspended my plot adherence for stretches in season 1 also. The problem is when it becomes so untethered and sporadic the narrative suffers. And when the narrative suffered, it appeared to become too self-indulgent. TheRinger wrapped up my thoughts better than I probably can.
It reminded me a lot of the mistakes of True Detective's second season but with different styles. The people making it thought what worked was the bits and not the narrative, so they ran the bits into the ground around a flimsy story and thought the schtick would carry the show. It doesn't. The schtick works when the story does, not the reverse. Legion's second season failed for the same reason for me: too much schtick and not enough story.