There are ups and downs. If the size gives increased passenger capacity that can be the difference between needing one or two vehicles for a trip.

Big vehicles means more weight though, which means bigger batteries to get range at even more weight. The Hummer EV for example weighs 4.5t with 1400kg of that being battery. That means extra wear on tires (as well at reinforced sidewalls), roads, and additional considerations for parking garages or bridges etc