This enables users to have several build directories like
build-clang, build-gcc5, build-debug, and still get all
of them ignored.

(cherry picked from commit e5cb0bc4)