I would be looking for crevices and holes through the masonry resulting from lost/eroded mortar or damaged stones/bricks. If the house has cavity walls then its possible that strong winds could induce draughts considerable distances from the external point of entry.What should i be looking at cracks in the mortar?