No getting out is not foolish.
Having a referendum in a state in which popular voting is not very important is foolish.
Referendums in the UK are binding by Constitutional tradition.
Leaving the EU is not optional at this point, the only question is how.
The Tory voting base would blow a gasket at an attempt to cancel leaving the EU. That betrayal would guarantee a Labour government under Jeremy Corbyn.