The joke as I heard it in the 80's -- and I have no reason to think it was new then -- went something like: Physics is just applied math, chemistry is applied physics, etc...

I've always liked the view that Physics is just experimental discovery of the axioms "chosen" for our universe. Physics without experimentation just being a specific subset of math.