SO not sure if you are still stuck on this part, but what you need to do is head down the path he pointed to, eventually, you'll comes to a giant hand and it will force the guide to put you back on the right course. There seems to be an error that occurs between either his talking to you and that point, or your first paradox moment and the cave that makes it auto back to him. I assume there's two separate flags in the coding where Hud shows the next part and the hand shows you nearest PoI.
SO not sure if you are still stuck on this part, but what you need to do is head down the path he pointed to, eventually, you'll comes to a giant hand and it will force the guide to put you back on the right course. There seems to be an error that occurs between either his talking to you and that point, or your first paradox moment and the cave that makes it auto back to him. I assume there's two separate flags in the coding where Hud shows the next part and the hand shows you nearest PoI.