James Oliver Wild (Conservative Party), Minister of Parliament for North West Norfolk