It is not necessarily true that expensive experiments are not worthwhile doing but there are plenty of rather cheap experiments which are certainly worth doing.
In all life one should comfort the afflicted, but verily, also, one should afflict the comfortable, and especially when they are comfortably, contentedly, even happily wrong.
A mathematician, like a painter or poet, is a maker of patterns. If his patterns are more permanent than theirs, it is because they are made with ideas.