Mossbauer spectra obtained from powder and single-crystal samples of the insulating compound FeMgBO₄ shown distributions in the nuclear quadrupole parameters. The sign of the quadrupole splitting Delta is found to be positive, and a probability distribution P( Delta ) is determined, with the mean value Delta =0.83 mm s^-1 at 30K. The mean electric field gradient has asymmetry eta =0.58+or-0.05, and its principal axis lies preferentially in the crystallographic a-b plane.