Wednesday, March 3, 2010

Teacher Merit Pay: Beyond the Rhetoric

The Canadian education blogs were buzzing last month about Erin Anderssen’s commentary on merit pay for teachers, published in The Globe and Mail. Too often merit pay generates polarized rhetoric rather than thoughtful discussion. To Anderssen’s credit, she introduces some of the research and contextual issues that frame the debate about this reform strategy.

Anderssen notes, for instance, that merit pay, which rewards individual teachers for higher levels of performance, is not particularly popular with teacher unions. Unions have long argued that individual incentive plans force teachers to compete, rather than cooperate, creating a disincentive for teachers to share information and teaching techniques (National Education Association, undated). Frank Bruseker, president of the Alberta Teachers Association, also has argued that compensation for student achievement will remove the incentive for teachers to work with struggling students (Mendleson, 2009).

The unions have some evidence on their side, since research on individual compensation pay plans is mixed. In an Israeli study reported in 2002, Lavy did find a correlation between an individual incentive program and student performance on standardized tests. He evaluated a particular incentive program experiment, in which teachers were rewarded with cash bonuses for improvements in their students’ performance on high school matriculation exams. His analysis supported the hypothesis that teachers’ monetary performance incentives had a significant effect on students’ achievement in English and math. However, other studies have not been as complimentary to merit pay schemes. Eberts, Hollenbeck, and Stone (2002), for instance, presented case study evidence from a U.S. county where one high school had piloted a pay for performance system to reward student retention. Comparing this high school with another in the same county that used a traditional compensation system, the researchers found that individual incentive programs for teachers were associated with a significant fall in drop-out rates, but were also associated with no apparent effect on students’ grade point averages, reduced average daily attendance, and an increased percentage of students who failed.

Teachers generally favor school- or group-based performance award programs, in which performance is measured and rewarded at the school or group level (National Governors Association, undated), since this approach is more consistent with the social norms of equality and collegiality in the teaching profession. Group goals are established, especially in the areas of student achievement (level or growth), and graduation and attendance rates, and bonuses are paid to teachers and other staff according to the degree of goal attainment. Typically, the single salary structure remains intact (Heneman, Milanowski & Kimball, 2007).

There are some applied research findings that appear to offer support for use of group-based compensation plans to improve student achievement. Lavy (2002b) matched Israeli schools eligible for a school-based incentive program with schools in similar communities. The study’s empirical results suggest that group monetary incentives contributed to significant gains in many dimensions of students' outcomes (Lavy, 2002b). Glewwe, Ilias and Kremer (2003) studied the effects of a school-based teacher incentive experiment in rural Kenya, where every teacher in grades 4 to 8 in a winning school got the same bonus. The authors demonstrated that students in treatment schools had higher test scores. However, there was little evidence that students in treatment schools retained these gains after the end of the program, consistent with the authors’ hypothesis that teachers seeking performance bonuses focused on manipulating short-run scores.

Knowledge- and skill-based compensation plans reward individual teacher behaviors or competencies thought to be linked to high-quality teacher performance (Heneman, Milanowski & Kimball, 2007). Teachers receive bonuses or increases in base salary for the acquisition of new competencies, classroom performance mastery, and/or certification by the National Board for Professional Teaching Standards (NBPTS). Often, changes are made to the single salary structure when this approach is utilized. For example, the number of steps in the salary structure may be reduced (Heneman, Milanowski & Kimball, 2007).

Knowledge- and skill-based pay plans are often based on the premise that teacher knowledge and competencies are positively correlated to student achievement. However, research on this relationship has produced mixed results. National Board certification, for example, has recently come under research scrutiny. A study of more than 300 fifth-grade teachers in North Carolina found that the distinction of being a National Board Certified Teacher does not necessarily translate into greater student success in the classroom. McColskey, Stronge, and colleagues (2006), for instance, found no significant relationship between National Board certification status and student achievement gains in the classroom. Another study, also conducted in North Carolina, produced quite different results. Using more than 600,000 student records from North Carolina schools, Goldhaber and Anthony (2004) demonstrated that students of National Board Certified Teachers improved on elementary math and reading tests more than pupils whose teachers did not achieve National Board Certification. The effects of NBCTs on students who were younger or low-income were even greater.

The success of a merit pay plan depends, in large part, on a reliable and valid system for measuring performance. Knowledge-based incentive systems require the simplest measurement system; in most cases, all that is required is documentation that the teacher has completed a professional development activity or achieved certification. Individual- and group-based compensation systems require a more complex measurement system that assesses teachers’ classroom performance, such as a standards-based evaluation system, and to varying degrees, correlates teacher performance to student achievement. This type of system typically utilizes a comprehensive set of standards and rubrics with the intention of enhancing instruction and strengthening educational accountability (Danielson, 1996).

A related measurement issue not frequently discussed within our borders is the efficient tracking of data related to teacher performance and student achievement. Many states south of the border, including Florida, Georgia, and South Carolina, have already taken steps to add teacher data to existing student unit record systems, making it simpler to track this information on a state- or school board-level. These systems also make it possible to identify which students and which courses are being taught by teachers with different levels and types of preparation, certification, professional development, and seniority and how these experience levels are related to the academic growth of the students. The federal government in the U.S. is making substantial investments in these enhanced data systems, seeing them as the foundation from which states and school boards can make data-driven decisions to improve student learning, as well as to facilitate research to increase student achievement.

Too many commentators glibly push (or decry) merit pay for teachers as the best (or the worst) thing to improve education. Anderssen, to her credit, takes the higher road and attempts to sketch the complexity of the issue—the range of merit pay strategies and the interrelated issues of measurement and data systems. It is time to open a richer discussion on merit pay, drawing upon international experience in merit pay to inform a new-generation Canadian experiment in rewarding teacher performance.

Tuesday, January 5, 2010

On the Bottom Rung: Canada’s Early Care and Learning

Early care and learning should be one of Canada’s most significant educational policy issues in this new decade. Why? Because we are so very bad at providing high-quality early learning environments for our youngest citizens and the rest of the world knows it. It was less than two years ago when UNICEF issued a report card in 2008 that compared government policy and results for young children and their families in 25 developed countries. Canada ranked in last place, achieving only one benchmark out of ten (for staff training in child care programs) while missing benchmarks for measurements of child poverty, parental leave, access to essential child health services, and quality early childhood education and care programs. Similarly, the OECD’s 2006 international study of early childhood education, Starting Strong II, also ranked Canada’s approach to child care last among the over 20 countries included in its study, noting that our nation had the lowest public investment, the lowest access rates, and among the highest parent fees in the world.

Responsibility for early care and learning, like its primary and secondary education counterparts, is primarily a provincial responsibility. There have been many attempts, dating back to the late 1980s through the present, to develop a national approach to early care and learning, but the abolishment of the Canada Assistance Program in 1996 and the establishment of the Canada Health and Social Transfer block fund asserted the provinces’ primacy in this policy area. With the exception of Quebec, which expanded its early learning and child care programs beginning in 1997 to ensure better access to families, child care in the majority of the Canadian provinces is primarily a fee-paying service with many families not able to access services due to costs. While fee subsidies are available in all jurisdictions, limitations on subsidies exclude some eligible parents or the subsidy itself is insufficient to cover the child care fee. It is not unusual for middle class or modest income families to fail to qualify for a fee subsidy. Quebec alone offers a flat fee for child care at an impressively low $7/day.

These policy strategies ignore the human capital arguments that support government investments in early care and learning. Human capital theory suggests that a well-educated population is able to innovate and more readily adapt to technological changes, contributing to the society’s capability to produce wealth. The educational process happens over multiple time periods, and the stock of skills generated in one period depends critically on the stock of skills that served as a foundation in the previous period. Therefore, investments in human capital early in a child’s life cycle are likely to be more efficient than investments made at older ages.

Economic arguments citing positive social outcomes of early childhood education also support the idea of government investments. Knudsen, Heckman, Cameron, and Shonkoff (2006) cited evidence of positive economic, neurobiological, and behavioral outcomes to support their argument that providing early child education to disadvantaged children was the most efficient strategy for strengthening the future workforce and improving its quality of life. Karoly, Kilburn, and Cannon (2005) presented a similar range of outcomes, including increased high school graduation, college attendance, and labor force and participation, and decreases in socially negative behaviors such as crime, substance abuse, and teenage pregnancy.

Cost-benefit analysis in particular has been applied to provide evidence that investments in early care and learning have the potential to generate government savings and produce returns to society that outpace most public and private investments. The best-known early care and education cost-benefit analysis was the High/Scope Perry Preschool Project study in the United States. Utilizing random assignment of its 123 low-income, African-American participants to control and intervention groups with virtually no attrition during the almost 40 year-period under study, this study showed a consistent pattern of causes and effects from preschool to adulthood. In summary, this study provided solid evidence that children living in poverty who attend good preschool programs experience a series of positive effects that stretches from improvements in early childhood intellectual performance and disposition towards learning, to reduced need for placement in special education classes in later childhood, to higher school achievement and commitment in early adolescence, to lower rates of high school dropout, arrests, and welfare assistance and higher earnings and wealth in later adolescence and early adulthood. Significantly, most of the outcome gains accruing to program participants were maintained over the longer term—even as late as age 40.

Other economic studies of early care and learning programs reached similar conclusions to the Perry Preschool study. A random-assignment study of the Abecedarian program, conducted in North Carolina in the 1970s, focused on African-American children at risk of social and cognitive problems. The program delivered full-day high quality child care services from infancy to 5 years of age. By the time children had reached the age of 21, the total public benefits were calculated as $2.69 for each public dollar invested. A benefit-cost study conducted in Canada by Cleveland and Krashinsky in 1998 found that the incremental benefits of a universal high-quality early care and learning program for two to five year old children across the nation would be twice as high as the costs.

Given evidence from these studies, it is not unreasonable to presume that cost savings for provincial governments could be large enough to not only repay the initial costs of investments in early care and learning, but also to generate savings to the provinces as a whole several times greater than the costs. These findings move early care and learning policy from being strictly a social-service policy and philanthropic endeavor to help children from low-income families to also being considered an economic development strategy.

There are encouraging signs across the country that more provinces recognize the benefits of investing in early care and learning. Starting in September of this year, Ontario will provide a full day of learning to four- and five-year-olds as part of the province's plan to build a stronger school system and a well-educated workforce. British Columbia, guided by its Early Learning Framework, will make full day kindergarten available to up to half of its eligible five year olds this September, with access to all eligible children by September 2011. And Manitoba’s five-year policy agenda, Family Choices, commits Manitoba to maintaining the second lowest child care fees in Canada, after Québec, among many other innovative policy strategies.

Still, the lack of federal leadership on early care and learning is a hindrance to major policy improvements. In 2006, the authors of the OECD international report on early childhood education noted that almost all governments in Canada recognize that the lack of coherent early learning policies across the country was problematic and that collaborative action was needed. While there have been several sputtering attempts at the federal level during the past three decades to develop a national approach to early care and learning, nearly all have failed to gain traction. The previous Liberal government, under Prime Minister Paul Martin, had made the most successful effort, having negotiated bi-lateral agreements with all ten provincial governments. While there was some variation in the provinces’ agreements, all provinces committed to developing detailed Action Plans based on the four principles of Quality, Universality, Accessibility and Developmental [programming] that formed the basis of the Liberals’ national early learning and child care framework. All agreements also included provincial commitment to collaborative infrastructural work in areas such as a national quality framework and data systems. This was all cancelled by the minority Harper government, which opted to replace this commitment in favour of a $1,200 annual allowance to parents with children under six years of age and a capital funding initiative to support the creation of child care spaces by employers and communities through tax credits. The latter initiative has yet to meet its goal of creating 250,000 new child care spaces. Instead, federal funding cuts threaten to close more subsidized spaces, with child care advocates in Ontario stating that as many as 15,000 spaces are at risk when federal funding runs out in 2010.

Early care and learning in Canada has progressed little since the UNICEF report card and OECD report were issued, guaranteeing us a bottom rung position on this critical quality of life indicator should these studies be repeated in the near future. Given our current understanding of the positive societal benefits of investments in early care and learning, we cannot turn a blind eye toward this policy issue any longer. Our federal leaders need to work with the provinces and territories to create a nationally coordinated, publicly funded early learning and care system that ensures that Canadian families have universal access to quality child care.

Monday, June 22, 2009

Gates Funds to Support Improvement of College Completion Rates in Virginia

The recent grants announcement by the Bill & Melinda Gates Foundation included $1,786,000 for Virginia, providing support to expand groundbreaking remedial education programs that experts say are key to dramatically boosting the college completion rates of low-income students and students of color. Approximately $300,000 of this funding will support research in Virginia to identify obstacles to completion, factors that correlate with student success, and high and low performing institutions to inform statewide goals for community colleges. Danville Community College and Patrick Henry Community College will also receive program funding over a three year period.

Tuesday, June 16, 2009

Bill and Melinda Gates Foundation Supports Postsecondary Retention Policy Research Initiatives

Over $6.4 million in grants to leading national policy organizations were announced today by the Bill & Melinda Gates Foundation. These grants support new efforts to identify why many young Americans drop out of college and to propose new policies and practices necessary to help low-income, African American, and Hispanic students complete their educations.

Grants Announced Today:
• American Enterprise Institute (AEI) will receive $1.25 million to launch a significant new research project, which will include commissioned papers, major conferences, and a book about accountability in higher education. These projects will be data-driven and non-ideological, and will be designed to encourage a national conversation about postsecondary accountability. Founded in 1943, AEI sponsors research, conferences, and publications on issues of government, economics, and social welfare. The Institute is committed to expanding liberty, increasing individual opportunity, and strengthening free enterprise. www.aei.org

• The Center for American Progress (CAP) will receive $800,000 to study and report on more than a dozen topics related to college completion. CAP’s work will result in policy recommendations that would bring coherence to a fractured national system of higher education institutions, give low-income students the targeted assistance they need to complete their educations, and bring accountability to institutions that are receiving evermore public money but graduating fewer and fewer of their students. CAP was founded in 2003 and is headed by John D. Podesta, former chief of staff to President Bill Clinton and professor at the Georgetown University Law Center. CAP is designed to provide long-term leadership and support to the progressive movement. www.cap.org

• Center for Law and Social Policy (CLASP) will receive $1.5 million to support a new Center on Postsecondary and Economic Success within its organization. The Center will promote federal and state policy innovation to help low-income students, including working students, out-of-school youth, and other nontraditional students earn marketable postsecondary credentials through research, analysis, educational activities, and technical assistance to states and anti-poverty organizations. CLASP develops and advocates for policies at the federal, state, and local levels that improve the lives of low-income people. www.clasp.org

• The College Board will receive $675,000 to create the Center for Innovation and Advocacy. The Center will study policies and programs that increase college access and success, with a focus on increasing college completion among traditionally underrepresented students. For example, the Center will support the College Board’s ongoing Rethinking Student Aid project, which aims to redesign the federal student aid system to make it simpler, more efficient, and more focused on encouraging college success. The College Board is a national not-for-profit education association comprised of more than 5,600 college, university, and school members driven by a simple but powerful mission statement: To connect students to college success and opportunity. Each year the College Board serves 7 million students and parents, 23,000 high schools, and 3,800 colleges through major programs in college admissions, guidance, assessment, financial aid, enrollment, teaching, and learning. www.collegeboard.org

• Excelencia in Education will receive $600,000 to raise awareness about the significance of accelerating Latino college completion rates to meet the country’s human capital needs through a new campaign, Enhancing America’s Future. This campaign will be developed through high-level meetings with postsecondary policy leaders, benchmarking national and state level Latino college degree completion, and an outcomes-driven focus on dissemination of promising practices. Launched in 2004, Excelencia in Education is a national not-for-profit that links research, policy, and practice to support higher educational achievement for Latino students and all students. www.excelencia.org

• Institute for Higher Education Policy will receive $1.58 million over three years to support research to improve policies related to academic excellence and degree attainment by publishing reports, issue briefs, and fact sheets as well as connecting that research to policy and practice. Key beneficiaries of this work will be federal and state policymakers, media, higher education funders and organizations, institutional leaders, and researchers. The Institute for Higher Education Policy is an independent, nonprofit organization dedicated to improving access and success in postsecondary education around the world. www.ihep.org

Saturday, June 6, 2009

Economics of Early Childhood

One of my personal areas of advocacy is improving the quality of early childhood education. As a working parent seeking high-quality daycare and preschool services, I was frustrated by the lack of information about the quality of these services. I was, after all, leaving my child--my most precious possession--in the hands of these providers. For this reason, I now contribute my services to a local coalition dedicated to raising the quality of early childhood education. Coalitions like these are emerging across the country and have gained support through the use of economic arguments that declare the cost effectiveness of early childhood education.

Perhaps no other area of educational policy has benefited more from economic analyses than early childhood education. The landmark cost-benefit study of the High/Scope Perry Preschool Project, conducted over a forty-year period, provided empirical evidence of a host of social and economic outcomes. This type of evidence has shifted the terms of debate about early childhood education policy in the United States. While early arguments in support of early childhood programs focused on equity and promoting individual well-being, advocates today focus on these programs as sound public investment that supports human capital and economic development and, in the long term, lowered government spending. These arguments have realized higher levels of state investment in early childhood care and education, including in my state of Virginia.

Economic arguments have cited several positive social outcomes of early childhood education beyond those typically described for secondary and postsecondary education. Knudsen, Heckman, Cameron, and Shonkoff (2006) cited evidence of positive economic, neurobiological, and behavioral outcomes to support their argument that providing early child education to disadvantaged children was the most efficient strategy for strengthening the future workforce and improving its quality of life. Karoly, Kilburn, and Cannon (2005) presented a similar range of outcomes, including increased high school graduation, college attendance, and labor force and participation, and decreases in socially negative behaviors such as crime, substance abuse, and teenage pregnancy.

Economists Rolnick and Grunewald (2003) calculated an internal rate of return for one of the best known early childhood education programs, the Perry Preschool program. Following the identification of costs and the monetization of benefits, the authors estimated the time periods in which benefits and costs in constant dollars were paid or received by program participants and society. Rolnick and Grunewald estimated the internal rate of return for the High/Scope Perry School program at 16 percent, which they argue makes early childhood education an excellent buy when compared with other public investments.

The findings from the Perry Preschool study have often been cited as part of an economic argument for funding early childhood education initiatives, especially at the state level. The general argument is that cost savings for government could be large enough to not only repay the initial costs of the program but also to possibly generate savings to government or society as a whole several times greater than the costs (Karoly, Kilburn, and Cannon, 2005). These findings moved early childhood education policy from being strictly a social-service policy and philanthropic endeavor to help children from low-income families to also being considered an economic development strategy (Clothier & Poppe, 2008; Stone, 2008).

The impact of these advocacy arguments is clear. Overall, states have been increasing investments in early childhood education. Child care state appropriations from combined state general fund and TANF sources increased by $482 million from FY 2007 to FY 2008. Prekindergarten appropriations increased by almost $540 million from FY 2007 to FY 2008, with total state appropriations to prekindergarten programs were $4.5 billion. States reported an increase in total appropriations to additional early learning strategies of $26 million from FY2007 to FY 2008, with total reported appropriations were $347 million (Clothier & Poppe, 2008). Significantly, school funding formulas are increasingly used as an effective way to protect and advance state pre-k by tying funding to the popular support for K-12 education. The growing popularity of pre-k programs has prompted state policymakers to take this action (Stone, 2008).

In the Commonwealth of Virginia, arguments for expanding preschool education have often centered on the long-term benefits of this strategy. Economic arguments for preschool have fostered support by state-level economic development and workforce development interest groups. This support has helped Virginia’s Governor Kaine increase state funding of early childhood education. Child care state appropriations from combined state general fund and TANF sources increased by $9,800,000, or by 18.6 percent, from FY 2007 to FY 2008. Prekindergarten appropriations, funded as the Virginia Preschool Initiative, increased by $6,900,000, or 14.9 percent, from FY 2007 to FY 2008, with FY2008 state appropriations to prekindergarten programs at $53,100,000 (Clothier & Poppe, 2008).

Sunday, September 21, 2008

Recommended ed policy blog

One of my recent blog finds is Dean Millot's blog on the Education Week website. Dean offers straight talk on a range of school improvement topics from a market-driven perspective. His critiques of school district requests for proposals (RFPs) on school improvement topics are usually dead on (and this comment is from yours truly -- someone who reviews RFPs on a daily basis). Check out this blog sometime.

Educational Policy Institute

Check out the Educational Policy Institute (EPI), a non-profit think tank dedicated to the study of educational opportunity. EPI research focuses primarily on the issues related to educational opportunity throughout the education continuum, from early childhood education to graduate and professional studies, including adult education and workforce development. Specifically, EPI focuses on academic preparation for, access to, and success through postsecondary education, since the global society increasingly demands skill sets that require learning and training past compulsory school. EPI is also committed to research which measures and improves the quality of education these students receive. www.educationalpolicy.org.