The statement, "I'm too damn handsome to be speaking to you," can be interpreted as arrogant and disrespectful regardless of the gender involved. It implies that the person making the statement believes they are superior to the other person based on their appearance. Such a statement is not only rude but also objectifies the other person and dismisses their worth based on superficial criteria.
It's essential to treat others with respect and kindness, regardless of their gender or appearance. Making derogatory comments or belittling someone based on their looks is never appropriate and can be hurtful. Healthy and respectful interactions are the foundation of positive relationships and social dynamics.