Duncan Charles Baker (Conservative Party), Minister of Parliament for North Norfolk