I have 3 330W panels on my trailer. So far my trailer has about 6.5k miles on it, including a few trips down some washboard dirt roads. So far my panels still look new. I was also very worried about large panels bouncing and vibrating while driving. To help, I have my panels mounted using the 4 main bolted mounting holes plus 3 additional solar panel clamps on each long side of each panel. One in the center and one near each end.
As long as the panel is an inch or more above the roof surface, having a deflector along one side of the panel should only have a minor impact on cooling. I think the safety improvement of the deflector far outweighs its (minor) impact on cooling.