The where do we come from and go question will have different answer depending on the religious beliefs of the person who answers. Some people believe in reincarnation, some don't. Some people believe in heaven and some don't.
I just read "90 Minutes in Heaven" by Don Piper. So that I don't give away the details of the story in case anyone wants to read it - he was declared dead after a car accident by emergency personnel but was found to be alive 90 minutes later. He talked about the 90 minutes he spent in heaven.
After Steve Jobs died, I read an article by his sister. Apparently the last words he said before he died were: 'Oh wow. Oh wow. Oh wow.' That makes me think he must have seen something wonderful.
As for the remembering part... you may want to read "The Little Soul and the Sun" by Neale Donald Walsch. It's a kid's book but will answer that question.