Arriving a bit late here, but:
I'm fairly confident that anything in Swarfega is as safe as any make-up or toiletries.
That's because the place that the chap/people that started DEB used, I believe, to work in a company that produced pharmaceutical standard oil-based products - things like baby oil and pharmaceutical petroleum jellies (often known as Vaseline). Customers included many of the top-names in the cosmetic industry.
Swarfega would, I'm sure, have been formulated to the same standards.