The answer is no. He never leaves us though we, in our minds and hearts, may leave Him.