The population started to come down because the Greeks had fighting among the kingdoms and they weren't getting anything done. Then trading stopped and farmers could only grow enough to fill their own families bellies. People stopped writing and inventing. This is why historians call this time the Dark Age.
Since so many people left the Mycenaean civilization, Greeks started to make colonies and expanding their culture. The population increased.