I used to think that way. Then I had a student who trained in collegiate wrestling, greco-roman wrestling, and Jiu-Jutsu try to take me to the ground.
I never hit the ground so hard, and so fast.
When you are playing against someone who practices nothing but a specific skill set, he will beat you with that skill 9 times out of 10.
Now that I am also training in seut-gohk, (Chinese throwing and grappling)I learned that once you develop some skills, it is much harder to be taken down, and much easier to take down someone who does not train this skill set.
Standing in a horse against someone who knows their technique is a sure way to hit the ground-hard. Sure, you might strongarm a sweep, but the rigidity of the horse is its downfall when the game is changed from striking to that of grappling and throwing.
My Seut-Gohk teacher, includes vital point striking as a set-up for grappling and throwing, something that I am just starting to learn.(lucky me-ouch) As he is a Hung Kuen practitioner, his strikes are from Hung Kuen-fast, hard, and accurate, and then lead into his throws.
Suet-Gow, Seut-Gok, Shuai-Jiao, BJJ,Greco-Roman, etc they are worthwhile tools to have in your toolbox.