Correct to a certain point, predators are also a main factor. Small islands small quantity of food available smaller animals survive therefore that gene pool dominates.
The American Bison was fine until white man arrived then it was a double hit in a very short time.