Page "Gravitational potential" Paragraph 5

where m is the mass of the object.

Potential energy is equal ( in magnitude, but negative ) to the work done by the gravitational field moving a body to its given position in space from infinity.

If the body has a mass of 1 unit, then the potential energy to be assigned to that body is equal to the gravitational potential.

So the potential can be interpreted as the negative of the work done by the gravitational field moving a unit mass in from infinity.