Realistically it probably depends on the sport. Y chromosomes, being exposed to certain levels of testosterone in utero (unless one is resistant or unresponsive to the hormone), being exposed to certain levels of testosterone in puberty and maintaining certain levels of testosterone all do things to the body than could effect performance and that's all still mostly just focused on the one hormone. How much each of those things has an impact (if any) is going to depend entirely on the nature of the sport in question.