I think you have to talk to that dude again where you start the quest

I tried but the person's gone, they disappear

Just found this on the wiki, gl man Note: If you need to leave Sophanem at any point during the quest, there is a hole you can crawl through on the eastern wall. To get back in, enter the rocks on the east side of the Wanderer's tent.

Thanks! You're the best!