To get to the Mystery Shore through the caves you should complete the relative quest. Note that it will appear only when you will be ready to leave the Marble Fiord. To figure out what cave you should explore open the quest window and tap the Find button there. The game will show you the cave where you can find the necessary items.