Just as many words, there are multiple meanings. For instance:

vir·gin ( P ) Pronunciation Key (vûrjn)
n.
A person who has not experienced sexual intercourse.

In my mind, sexual intercourse is a lot different than a sexual act, as you put it. You chose the loss of purity definition, I chose this one. Same word, different meanings, or contexts/interpretations for the meaning.