I think the point is that when learning EM, it's a lot about developing intuition by visualizing in your head how the E and B fields behave in different situations, and how charges interact with them etc. You know, a lot of holding your right hand in the "physicist handshake" position and twisting it.

Sure, the same information is contained in the F tensor, but it doesn't have a similar straightforward geometric intuition.