The Scots and my Bavarian ancestors were welcomed — as speed bumps on the frontier against the French and Spanish