On the contrary, I think it illuminates the complexity of the problem. Sexual orientation has traditionally referred to gender preferences, you are correct. However, orientation is the perfect word to describe what true pedophiles have. Their brains are literally oriented to desire children. Whereas sexual preference refers to choices one makes within the confines of ones orientation.
If there is another word that more accurately describes it, I would be interested in hearing it.