Sex drive, for instance, is associated with the hormone testosterone in both men and women