No, he does not believe in literal heaven and personal God.
The writer of that poem believed that the 'God' that most religious people believe is the nature itself.
So rather than using blind faith to examine the nature, he believe that we should use critical thinking instead.