Observational Challenges In Deep Imaging Probes Of Cosmology