Why do we believe baryon asymmetry?

The question is that how can we make sure that our universe is baryon asymmetric? I mean, is it possible that there are antimatter domains beyond some very large scale. Yes, if that kind of domains exist, the scale must be very large. But does such constraint bring any problems such that we prefer to believe the baryon asymmetry?