You need to take him down in order to acquire the Thunder Helm. To return to the Gerudo ... Entrance to the Yiga Clan pit in Zelda BOTW can only be accessed after starting the Vah Noboris main ...