It is dark matter, not ordinary matter, that drives galaxy formation; ordinary matter just comes along with it.

In fact, dark matter is in some sense more important because it can collapse more readily than ordinary matter because ordinary matter has radiative forces, which makes it hard to collapse on small scales. Actually it’s dark matter that drives galaxy formation and then ordinary matter comes along with it.