This puzzle is an old riddle (perhaps older than Henry Dudeney, the author I acredit).

With thieves I consort,
With the vilest, in short,
   I'm quite at my ease in depravity;
Yet all divines use me,
And savants can't lose me,
   For I am the center of gravity.