Oakley Court House, Benson, can be demolished and a new house built in its place, says South Oxfordshire District Council.