Having messed more time around with the lobby matches, a connection bar will appear on the left side of each player in the lobby room. It will also appear before the character screen appears.
I thought that might happen since it does that in persona 4, where you have to wait for the connection bar to appear. Look back in rank to see if it does it there too.
Also how were matches after finally knowing your opponent's connection?