This presentation, given at the 2003 Large Scale Assessment Conference, outlines a major issue with NCLB accountability designs that must be rectified: The law requires that Adequate Yearly Progress designations be made validly and reliably, yet the safe harbor provision of the law makes it nearly impossible to reliably determine whether schools have failed to make AYP.