Indeed, older does "run the show". I live in an area with a LOT of wild deer, and we have daily "visits" with a good portion of the local herd, both bucks and does. We can observe them year-round and can identify most individuals easily. There typically are small groups that hang together throughout the year but will mingle when encountering other groups. We have noticed certain does have better fawn survival than others, and their offspring tend to carry on that trait, while others appear to be poor mothers, leaving fawns for extended times in harsh weather, or "nannying" them with younger does altogether. Those Nannies are often "udderless", leaving the fawn to starve, (which we have seen many times).
The older "lead" does use not only caution but pay acute attention to their surroundings, which they know intimately. The smallest thing out of place, (in our case, a wheelbarrow that was moved, or a new bird house for example), is instantly noticed, and evaluated as "threat-no threat".
Most of our small "groups" that consist of a mature doe, last year's fawns, (now yearlings), and this year's fawns may also consist of one or two mature does that are subordinate to the lead, and maybe even this years fawns of the subordinate does.
If the lead doe is killed, regardless of cause, the rest of that group is now at a dis-advantage, as survivability to each member goes. They have counted on that doe for warning of danger, reliable food sources,
locations to survive weather elements, and myriad other learned behaviors that increase the herds chances at surviving and multiplying. They have now been denied any further opportunity to learn from that matriarch, so what they garner from that point on will be self-learned, which may or may not be beneficial.
The same goes for bucks. Those bachelor groups you see in late summer and into fall teach young bucks the same lessons, as well as sparring techniques that will be important during rut.
Harvesting the biggest doe, or the mightiest buck might be good for the EGO, but not so much for the herd.