I am in the exact same situation as you when it is summer - I just HATE suits that are not "easy and fast" to put on/off.
But I dont get why you want pants ???
If you got pants, you also need either a lycra or a 1mm shirt on top.
Then the advantage dissapears totally...
For me, in summer, it is, with decreasing air/water temperature:
Shorts only, when hot.
Shorts and a lycra shirt as a rashguard.
Shorts and a 1mm neoprene shirt when not as hot.
Summer shorty (short legs short arms)
Summer suit (2/2 or 3/2 long legs short arms)
Full suit (3/2 long legs long arms)
Full winter suit (5/4/3)
My point is, having neoprene pants and a top, takes longer than putting on a summer shorty
And pants only, makes no sense at all (for me...)
Or do you need those for a very specific purpose maybe ?
I actually GOT a pair of neoprene shorts and have used them earlier, but never use them anymore, as it does not make much sense, is my experience after many years.