No, it isn't. It can be socially impolite to yawn unexcused, when someone is talking to you, as it has come to be interpreted as boredom rather than tiredness or similar. But it isn't inherently impolite to, for instance, yawn when walking down the street, or in a setting where someone isn't talking to you.

Because you don’t know what detrimental means in this context and clearly don’t understand evolutionary timescales?

That depends. It can still affect genetic fitness if it affects an individual's ability to confer benefits on their descendants. Of note: most of the most wealthy and influential people in our society are beyond their reproductive years (not technically true for men, but mostly true in practice).