Most of the pro-brexit multi-millionaires have millions of pounds in tax havens that the EU is targeting.