My husband left the UK voluntarily as he was an over-stayer please advise me!!!?

My boyfriend was an over-stayer from Pakistan he came to UK in 2006 as a visitor and did not return back... however in 2009 he got caught drinking and driving and was asked to leave voluntarily (not deported).. He left so voluntarily.. Now I want to call him to join me in the UK as I secretly got married to him last year (Islamic way) as I love him... how long before could he come and get a VIsa for UK? Is it possible to call him over? The solicitor said he could come and the Home office said there are no restrictions placed on his record.. is that true? PLEASE HELP ME! I am a Pakistani girl myself...