Prince Harry was the first member of the Royal Family to leave Scotland following the death of Queen Elizabeth II