As already answered here, there’s no point in having access to speed-e if you are closing the account linked to it. Will there be any problem, I don’t think so. But you can check with the NSDL team once on this.
it’s your call at the end of the day.