Filter out tests paths and warn if not a directory