Will perch pick on fancy goldfish?

I have a small pond containing several comets and 2 wild perch. The perch don't mess with the comets but I am concerned that it might be different with a fancy goldfish. It is larger than the perch but has long flowing fins and, like other fancies, "waddles" rather than darts through the water. Is it a bad idea to add him to the pond?