Floating Metrics and the Race to the Top

The US Department of Education is uniquely focused on performance measurement as they consider education funding through the stimulus package. As we review the metrics that have been offered for comment for both the Race to the Top and School Improvement Grant applications, we think it critical that the department tie the data requests to specific outcomes.

For example, in the proposed metrics for School Improvement Grants authorized under Section 1003(g) of Title I of the Elementary and Secondary Act of 1965, as amended, the Department has separated Achievement Indicators for Leading Indicators. Without knowing what outcomes these indicators are driving toward, however, we lack clarity in whether the indicators are in fact achievement, leading, lagging, or process indicators.

Furthermore, there is a false dichotomy suggested between achievement and leading indicators. In fact, an achievement indicator can itself be a leading indicator, depending on what outcomes you are try to achieve. For example, graduation rate is listed as an achievement indicator, which seems perfectly reasonable, unless your desire outcome is actually college enrollment, in which case graduation is a leading as well as achievement indicator.

By not tying the potential indicators to solid outcomes, we are lost in understanding what in fact to do with the results and they merely become a piece of data to report rather than a true indicator from which we can make decision and guide future strategy.

Our suggestion to the Department would be to start with the end in mind. Determine what outcomes, for students, teachers, building leadership, districts, and states they hope to achieve through this funding and then develop indicators against those outcomes.

An outcomes-based measurement approach to Race to the Top and School Improvement Grant applications ensure that states, districts, and schools are collecting and reporting data with a purpose, rather than just for compliance. The Department is off to a great start. However, the indicators offered need to be tied to an outcome so that we know why we are collecting the data and we have a story of success to share.