The symmetry properties of outer product coupling coefficients for the symmetric group and of Clebsch-Gordan coefficients for the unitary group and of the corresponding isoscalar factors are discussed. A simple rule is given for determination of a phase factor of outer reduction symmetry of S_n and U(N). The rule is provided with a relationship between the phase factor of a Young diagram with its subdiagrams.