At the tail end of Karpathy's presentation, he said something that reminded me of why Peter Norvig decided to join Google: because that's where the data is. In Tesla's case, they have a unique and likely accelerating advantage in having the best source of data up on which to train their models. I think this forms the basis of an enduring moat relative to their other competitors, none of which are collecting data at the same scale.
Is Tesla collecting that data? I've looked at their earnings and didn't see any big expenses related to datacenters. Amount of data they would need to store and process is massive, that would for sure show up in earnings, as one of the biggest costs.
