Hey, my understanding on this is that the only country that you have to worry about is Ireland - if you were banned there, then you'd be banned here too.
I think you're fine here. That's my understanding anyway. I'd probably call the DVLA anonymously and ask them a 'hypothetical' question, unless someone on here has a definitive answer that is.