The clue is the "Gemini" sign. The two rooms are nearly-identical, but the top room has 5 rocks which are extra in comparison to the bottom room. Those 5 rocks, when removed, create a winding path to the end and will cause the pillar to be removed.
This is a fun little game with cute artwork though being unable to understand japanese had me trapped on the second boss. It has a shield that makes it immune to certain damages each time I fight it and sometimes it breaks and sometimes it doesn't, I have no clues as to what attacks to use but...