When calculating the residuals, consider all track candidates instead of only the first track.  Moreover, eliminate the instances when there was no hit in a plane then the residual was returned as zero.