A smaller battery would be limited to a lower output power (as max battery power is defined as a function of battery capacity), so reducing the battery size would make it slower. The fastest it could be would be for most of the mass of the car to be battery, at which point it could theoretically have 5000+ horsepower, although there are practical limitations of course of transmitting that to the road.