Understanding and Improving Reliability of Inference Dynamics in Deep Neural Networks