Baxian Cave, both geological wonder and prehistorical remains, is located on a cliff facing the ocean in Changbin Township, Taitung County. There is more than a dozen of naturally formed sea caves, which were originally on the sea surface, but are now scattered on the 150-meter-high mountain wall. This is because the waves eroded the softer part of the rock wall during the uplift of Earth's crust on the East Coast. Baxian Cave currently has trails leading to various sea caves. The largest among them is Lingyan Cave. The highest cave, Kuenluen Cave, is about 130 meters high. In addition, there are Chienyuan Cave, Joucheng Cave, Hailei Cave, Chaoyin Cave, Yongan Cave, and Shuilian Cave. Due to that these caves were originally used as shrines, they all possess a religious vibe.
Baxian Cave is also an important archaeological site of prehistorical remains. A rich reserve of pre-pottery culture of Palaeolithic Age was found here and subsequently named "Changbin Culture." It is the oldest pre-historical remain discovered in Taiwan, recognized as a first-class national archaeological site for its significance.