Ancestor missing in 1851 and 1871 census

I have hit a brick wall with my ancestor named George Ricketts, he was born in London 1821. At some stage he moved to Derby and worked for Midland Railway. He married a Hannah Fletcher in 1848, on the marriage certificate he was a Pointer on the Railway but he then became a Valet/Butler. I cannot find him anywhere on the 1851 census and is not listed with Hannah. However I know he came home as he was there for the death of a child in 1853. I also cannot find him in 1871 but in 1861 he was at home with Hannah. I have tried everything. My question really is - is there a list of people in service and can I find him any other way? I also cannot find him in 1841 but do not know alot about him before he moved to Belper in Derby. Any help would be gratefully received.

Ancestor missing in 1851 and 1871 census