I think the counterargument would be that part of getting to the level where you are even thinking about college/med school is much, much more likely when you have people in your life encouraging you and showing you the way to get to college.

So for example, you're a smart kid with loads of potential but maybe you fucked around in school because that's what everybody did and zero or few parents/mentors were there to show you the way.

Too often we think of equal opportunity as being simply a matter of whether or not some organization would want you assuming you are qualified. But equal opportunity also has to refer to equality of opportunities and advantages at every step of your life. This part is tricky because it's not like we can advocate for taking away opportunities from some people in order to make things equal. But we have to at the very least be aware that people in upper classes or with connections have major advantages that have nothing to do with whether or not their race or socioeconomic status has advantages only at the level of admittance.