There were some people who starved to death in ancient times but have been admired ever since for their virtue; there were others who were kings but have been despised ever since for their lack of virtue.
So learners worry about not being imbued with virtue, they do not worry about not being in positions of power and authority.