• No results found

It s Not a Matter of Time:

N/A
N/A
Protected

Academic year: 2021

Share "It s Not a Matter of Time:"

Copied!
42
0
0

Loading.... (view fulltext now)

Full text

(1)

It’s Not a Matter of Time:

Highlights from the 2011

Competency-Based Learning Summit

Written by:

Chris Sturgis

MetisNet

Susan Patrick

International Association for K-12 Online Learning

Linda Pittenger

Council of Chief State School Officers

This is one of two reports from the Competency-Based Learning Summit. See Cracking the Code: Synchronizing

(2)

It’s Not a Matter

of Time:

Highlights from the 2011

Competency-Based Learning

Summit

Written by: Chris Sturgis, MetisNet

Susan Patrick, International Association for K-12 Online Learning Linda Pittenger, Council of Chief State School Officers

July 2011

TOLL-FREE 888.95.NACOL (888.956.2265) DIRECT 703.752.6216 FAx 703.752.6201 EmAIL info@inacol.org wEb www.inacol.org

(3)

Acknowledgments

There are times when philanthropic leadership is invaluable in helping our country take innovative leaps. With the greatest appreciation, we want to thank the following foundations for their

leadership. It takes imagination, vision for the future of learning, risk-taking for catalyzing new policy waters, and a collaborative commitment to clearing the pathway together by making investments in competency-based learning. This pioneering spirit, drive for creative problem-solving and development of new designs are the very qualities that we want our children to have to be able to adapt to the global challenges before us.

We want to give a special thank you to the Nellie Mae Education Foundation. They are an example to all of us how a regional foundation can shape the national educational agenda. None of this work on competency-based learning would be possible without their vision and early investments.

(4)

Table of Contents

Introduction 4

What is Competency-Based Learning?

6

Time and Timing: Deconstructing the Time-Based System

8

Getting Started

10

Identifying Innovation Space: Autonomy and Non-Consumption 10 Transforming the Current System From Within 11 Lindsay Unified School District 12

New York City 14

New Hampshire 15

Oregon 15 Alabama 16

Tough Issues

18

Accountability: Putting the Customer First 18 Equity: Eliminating Our Tolerance for Inequality 19 Carnegie Unit: Creating Meaning for Students and Educators 20 Personalization: Co-Designing with Students 21 Management Information Systems: Re-Engineering for Results 22 Assessments: Where the Rubber Meets the Road 23 Synchronizing Policy and Practice: New Approaches to State Policy 24 Shared Vision: Investing in the Process 26 Higher Education: The Missing Partner 27

Unlocking the System

28

Alignment with the New Value Proposition 28 Different Ways to Move Forward 29 The Power of the Customer 29 Emerging Opportunities 30 Increasing the Rate of Innovation 31 The Federal Role in Unlocking the System 32

Conclusion 34

Appendices 35

Participant List 35

(5)

Introduction

F

rom Anchorage, Alaska, to Orlando, Florida, and from gray, Maine, to Yuma, Arizona, one hundred competency-based innovators gathered at the Competency-Based Learning Summit in March 2011. Sponsored by the Council of Chief State School Officers (CCSSO) and the International Association for K–12 Online Learning (iNACOL), the Summit was developed in response to the findings in the report “When Success Is the Only Option: Designing Competency-Based Pathways for Next generation Learning.” The 2010 scan of the field of competency-based innovation found that the pockets of innovation across the country were too often operating in general isolation. By bringing together the leaders in the field, CCSSO and iNACOL set out to expedite building the capacity to meet the growing demand for competency-based approaches. The Summit, the first step toward building the infrastructure to expedite competency-based

approaches, was designed around three goals: ƒ

ƒ Sharing expertise across and among innovators and policy leaders ƒ

ƒ Building a common working definition of competency-based learning ƒ

ƒ Enhancing the strategies and skills for advancing the establishment of competency-based options

Although it would be impossible to capture the Summit’s cascade of ideas, this paper highlights the key issues raised to support the advancement of competency-based learning. A complementary paper, “Cracking the Code: Synchronizing Policy and Practice for Performance-Based Learning,” provides a more in-depth look at the state policy issues discussed at the Summit.

Competency-based learning is going to be a central

component of the new systems. It is already anchored in. The first step was states coming together to adopt a Common Core of learning in English language arts and math... We are on a pathway for competency-based learning in the United States.

– Gene Wilhoit, Council of Chief State School Officers

(6)

A Note on Language

Several terms are used to describe competency-based learning, including performance-based, proficiency-based, and standards-based. Competency-based will be used in this paper because federal policy has incorporated the term in Race to the Top and other programs. However, in describing reform efforts, the terms used by the state or district will be used. The hope is that as long as a shared working definition is used to drive policy, the variations in the descriptive term will not be a barrier.

In a proficiency system, failure or poor

performance may be part of the student’s

learning curve, but it is not an outcome.

– Proficiency-Based Instruction and Assessment, Oregon Education Roundtable

(7)

What Is Competency-Based Learning?

Competency-based learning is not simply the elimination of seat-time. In fact, eliminating it

without replacing it with something else may increase inequities. The time-based system must be replaced with a learning-based or competency-based system that is fully aligned with students and what they need to educationally progress.

In “When Success Is the Only Option: Designing Competency-Based Pathways for Next generation Learning,” a working definition was proposed to guide the development of policies and practice. This is particularly important as the language varies among states, districts, and schools and includes “proficiency-” and “performance-based learning.” Summit participants strengthened the working definition to describe a high-quality competency-based system. The following is the revised working definition of competency-based learning approaches:

ƒ

ƒ Students advance upon mastery. ƒ

ƒ Competencies include explicit, measurable, transferable learning objectives that empower students.

ƒ

ƒ Assessment is meaningful and a positive learning experience for students. ƒ

ƒ Students receive timely, differentiated support based on their individual learning needs. ƒ

ƒ Learning outcomes emphasize competencies that include application and creation of knowledge, along with the development of important skills and dispositions.1

Competency-based efforts are certainly not a silver bullet; only high-quality implementation will produce meaningful results. All five components of the definition need to be successfully implemented to ensure equity and excellence.

1 Competency-based innovators design two sets of competencies: academic and skills that students need for college and career

preparation. Using different terms, innovators all include forms of applied learning competencies such as creativity, problem solving, and communication. Many include personal skills such as perseverance, cultural competency, and study skills. Those serving vulnerable stu-dents include social-emotional literacy and navigational skills that are particularly important for stustu-dents from low-income communities.

Students have been locked down by the concept of seat-time and locked out of the technological revolution that has transformed nearly every sector of American society, except for education.

– Jim Shelton, Assistant Deputy Secretary of Education

(8)

The conversations at the Summit were not based on

competency-based issues alone. Other concepts swept through the discussions, including student-centered, student co-design, anytime, everywhere learning opportunities, and the rapidly evolving digital learning tools. As innovations and policies emerge, it is important to remember that competency-based education is highly related but not exactly the same as other elements of next generation learning. Each of the concepts can be implemented independently of each other. For example, competency-based practices can be used in classrooms without access to computer-based instruction or online learning.

Teachers can design curriculum that is based on state standards without attention to student agency. However, learning is so much more powerful when it is personalized, individualized, and draws on expanded learning opportunities with 24/7 online learning and real-world experiences.

Next Generation Learning

Competency-based learning is often included in discussions about next generation learning models. This is much more than expanded use of digital tools. Working in partnership with seven states, the Council of Chief State School Officers has defined Next generation Learning as rooted in six critical attributes, or essential conditions:

ƒ

ƒ Personalizing learning, which calls for a data-driven framework to set goals, assess progress, and ensure students receive the academic and developmental supports they need; ƒ

ƒ Comprehensive systems of learning supports, which addresses social, emotional, physical, and cognitive development along a continuum of services to ensure the success of all students;

ƒ

ƒ World-class knowledge and skills, which require achievement goals to sufficiently encompass the content knowledge and skills required for success in a globally-oriented world;

ƒ

ƒ Performance-based learning, which puts students at the center of the learning process by enabling the demonstration of mastery based on high, clear, and commonly-shared expectations;

ƒ

ƒ Anytime, everywhere opportunities, which provide constructive learning experiences in all aspects of a child’s life, through both the geographic and the Internet-connected community; and

ƒ

ƒ Authentic student voice, which is the deep engagement of students in directing and owning their individual learning and shaping the nature of the education experience among their peers.

A competency-based system is one in which students advance upon mastery of essential skills and knowledge without regard to time or place.

– from small group discussions at the Summit

(9)

Time and Timing:

Deconstructing the Time-Based System

Time. It was part of every conversation throughout the Summit. As innovators explored more deeply what a learning-based system could look like, it became clearer exactly how assumptions about time and timing shape our education system. Here are some examples of how a competency-based system might think about time and timing differently.

ƒ

ƒ Timing Designed Around Student Needs:

Those who need more time get it. Students who want more time to accelerate learning get it. This means that learning does not stop at the end of the school day, school week, or semester. Students can complete courses at any time during the school year.

ƒ

ƒ Students Are Provided Supports They Need, When They Need It: The focus shifts to

unit recovery, rapidly supporting students when they are not grasping a specific learning objective, rather than credit recovery after a student has failed an entire semester. Schools no longer need to bear the cost of students repeating entire courses.

ƒ

ƒ Students Always Have the Opportunity for Mastery: In the current system, grade

point averages reflect an accumulation of achievement at different points in time. In a competency-based system, students always have the chance to build mastery. New metrics capturing the rate of learning reflect student perseverance, school effectiveness, and opportunities to learn outside of school.

ƒ

ƒ Students Attain Mastery Before Summative Assessment: Students are assessed after

they have mastered skills, not before. All summative tests, whether course-based or state accountability exams, are delivered when students are proficient, serving as a mechanism to ensure consistency of standards.

ƒ

ƒ Student Learning Drives Decisions: Learning, rather than time, becomes the basis of

determining job structures, scheduling, resource allocation, and budgets.

It’s a problem when policy communicates that learning starts in September and ends in June. We have to be thinking about year-round learning for kids. That doesn’t mean that a kid is in school all year round. It means that we support students learning all year round.

– Fred Bramante, New Hampshire Board of Education

(10)

And last, but not least… ƒ

ƒ Pacing Matters: Pacing guides are a mechanism to ensure that students are getting

the support they need, not simply moving through a curriculum over a period of time. Competency-based means that students who are struggling do not fall further behind. Principals and educators keep an eye on students’ pace in learning, using it as an opportunity to support effective instruction, engage parents, and allocate resources. What does this all mean? Bror Saxberg, Chief Learning Officer of Kaplan, Inc., shared his vision for how the combination of these changes can become the education system of the future.

What does competency-based flexibility really look like? Kids with different start and ending dates for courses; kids who are slower in some courses, faster in others; kids in online, hybrid, and classroom environments for different parts of the day; kids doing internships tied to learning outcomes (augmented with online homework to drive home conceptual and skill pieces tied to their daily internship experiences), etc.

What, then, is the interest of parents, employers, administrators, and ultimately the state in

understanding how mastery is developing in this newly fluid environment? It’s like a freeway for cars, or a roundabout, where the cars may be moving at different speeds, and entering and leaving at speed, rather than lots of stoplights gating the flow of traffic. You now need monitoring stations and data about flow and speed, with flags popping up when cars are stalled or moving too slowly (on an autobahn, safely moving fast is okay, too!). Your accountability “war room” is providing daily updates, with accumulating data about teachers, learning environments, internships, specific courses, comparing average rates of progress for cohorts of similar kids in one environment with rates of progress for the same kinds of kids in another; as the data accumulate to show a learning experience is going badly compared to how it should go, either for a cohort or an individual, flares should go up to visit/coach/ intervene/replace/support. A hard objective is being hit every week by large numbers of students, not just once a year—you can generate evidence about what works for mastering it (and what doesn’t) as fast as you can think, not just once per year.

All of this depends, then, critically on high-quality (ideally, embedded within activities) data flow on learning within the learning environments. This means formative assessment, not just summative assessment, has to be developed professionally, separately, and carefully validated—waiting for end-of-year results is way too long, and damaging to individuals and groups. It would be like counting dents on cars at the off-ramps of freeways, instead of monitoring the conditions actually on the road in real time. This means every state commissioner should wind up with an interactive map in his or her office, just like the folks running transit systems, color-coded to show all the experiences’ and environments’ learning status for students, every week—possibly every day, in some cases. Which innovations about mastering fraction equivalence are doing the best in your state THIS WEEK?

Most importantly, a competency-based system embraces student learning above all other social values. It operates on a new value proposition: By aligning all of our resources (in schools, the community, and online) around student learning to enable students to progress upon mastery, our country can increase productivity in the education system, while simultaneously raising achievement levels overall and reducing the achievement gap. This is an enormous cultural change after hundreds of years of our current assumptions of time, timing and tracking, A-F grades, age-based grouping, and 180-day school years.

(11)

Getting Started

Conversations flourished throughout the Summit on lessons learned about competency-based school designs and reforms. The following section describes key points in the discussion.

Identifying Innovation Space:

Autonomy and Non-Consumption

Many of the competency-based school developers took advantage of the policy reforms promoting autonomy to build their models, often relying on creativity to navigate the current policy

environment. School leaders shared a number of techniques they have used to operate competency-based approaches within a time-competency-based system.

ƒ

ƒ New Hampshire eliminated seat-time and embedded competency-based learning within redefined course structures.

ƒ

ƒ Diploma Plus and Big Picture Learning schools created crosswalks between their competencies and state standards.

ƒ

ƒ Some Asia Society schools use a two-diploma structure: the first represents the district’s requirements, and the second represents the global education competencies.

Competency-based education is not by definition a disruptive innovation because it is not a specific product or service. However, it certainly is disruptive when creating opportunities to challenge long-held practices that are constraining education reform. Building upon the theories of Clayton Christensen,2 innovators and policymakers should seek out areas of non-consumption in public

education as this is where competency-based approaches can thrive. Participants mentioned a number of areas of non-consumption or under-consumption where competency-based practices are or could make inroads.

ƒ

ƒ Alternative Education: Schools serving over-age, under-credited students are also a place

where competency-based learning is taking root. Diploma Plus and Youth Connections Virtual School are expediting student learning for those most at risk of aging-out of the K–12 system.

2 Clayton Christensen et al., Disrupting Class: How Disruptive Innovation Will Change the Way the World Learns (New York:

(12)

ƒ

ƒ Home and Hospital: Students with illnesses at home or in a hospital have benefited from

competency-based pathways. ƒ

ƒ Credit Recovery: There has been a rapid expansion of credit recovery courses using

technology. Students simply demonstrate that they have mastered the material without regard to how much time it took them.

ƒ

ƒ Insufficient Supply or Distribution Problems: Online courses can help address teacher

shortage issues such as serving students where a course is otherwise unavailable or where there are insufficient teachers in any given content area.

ƒ

ƒ Students with High Mobility: Competency-based approaches can enhance educational

continuity. Children in military families and those that are homeless or in foster care endure high rates of school transfer. Students with responsibilities to their families or communities require flexibility. Students placed into disciplinary education or juvenile detention require portable competency-based approaches so that they do not fall further and further behind. Michael Horn noted, “The budget crisis is increasing areas of non-consumption where you have to reach for other solutions. The nature and depth of the crises will create a spark for innovative solutions that look at reformulating how to deliver education at a much higher productivity level. So what the states have to do is create the space as solutions are introduced.”

Transforming the Current System from Within

Although the theories of disruptive innovation suggest that it cannot be expected for a monopolistic public system to be able to transform itself (described graphically as self-cannibalization by Michael Horn), the policy leaders at the Summit believe it intolerable to suggest otherwise. Simply put, the health of our families, communities, economy, and national security depend on finding a way to bring about comprehensive transformation.

The rapid transformation of the Chugach School District in Alaska has taken hold of the imagination of many educational leaders. By implementing a competency-based approach, this tremendously impoverished rural district produced sky-rocketing achievement gains. Within five years, Chugach School district saw the following results:3

ƒ

ƒ Over a five-year period, average student achievement on the California Achievement Test rose from the bottom quartile to the 72nd percentile.

ƒ

ƒ The percentage of students participating in college entrance exams rose from 0 percent to more than 70 percent by 2000.

ƒ

ƒ Between 1995 and 2000, teacher turnover was reduced to 12 percent; in the previous twenty-year history of the district, turnover was 55 percent yearly.

Furthermore, after three years of implementation, teachers valued the approach so highly that they requested that student achievement be included in their performance evaluations.

(13)

Below are updates from many of the innovative districts and states valiantly advancing competency-based learning. For more information on the efforts of states, please read “Cracking the Code: Synchronizing Policy and Practice for Performance-Based Learning.”

Lindsay Unified School District:

Building a Strategic Design for Performance-Based Learning

Lindsay Unified is located in the central San Joaquin Valley in the state of California and serves just over 4,000 students from Kindergarten to grade 12. The district has a large Hispanic/Latino (89.8%), socio-economically disadvantaged (75.0 %), English Language Learner (52.4%), and migrant (28.6%) population. Lindsay is in an

agricultural area where many residents are employed in farm labor. Most residents speak Spanish at home, and the average adult education level is fifth grade. After many years of low

achievement, the district recognized that it could not dramatically improve achievement within the constraints of the traditional system. Thus, the LUSD partnered with Schwahn Leadership Associates, Marzano Research Laboratory, and the Reinventing Schools Coalition to shape a performance-based educational system that would transform the way schooling is done in LUSD.

Tom Rooney, Assistant Superintendent of Curriculum and Instruction, described LUSD’s journey to a performance-based system. The first step was to create a District Strategic Design that was owned by all stakeholders and would serve as the foundation for transforming the district into a high-performing, performance-based system. During a district-wide community meeting in May 2007, it was discovered that all stakeholders essentially wanted the same thing for their children. With community support, LUSD developed a set of guiding principles that included the belief that students learn in different ways and in different time frames. Immediately the question was raised: Why doesn’t our education system honor this basic principle about how and when our children learn? Working with the teachers, administration,

students, and parents from different income levels, a set of lifelong learning standards were developed that describe the Lindsay graduate as a person who in difficult situations sets personal goals,

Guiding Principles about

Students and Learning

All students can learn. Students learn in different

ways and time frames. Successful learning breeds

continued success which influences esteem, attitude,

and motivation. Mistakes are inherent in the learning process. Learning and curiosity are basic human drives. Student learning requires

positive and validating relationships with teachers. Student learning is enhanced by meaningful, real-life experiences

requiring complex thinking. Learning is fun.

Student learning is fostered by frequent, formative feedback.

Student learning is future-focused.

(14)

monitors their own progress, is a globally responsible citizen, and embraces the power of cultural diversity. The district developed academic units of study in all content areas in K–12 that clearly defined the knowledge and skills required of Lindsay learners. These units of study, referred to as Measurement Topics, were developed in consultation with Marzano Research Laboratory and were fully implemented in the fall of 2009. The LUSD Measurement Topics are based on the California state standards and are supported by a comprehensive assessment system using multiple measures so that the LUSD learning community can “guarantee” what learners will know and be able to do before graduating from Lindsay High School.

The decision to roll out a performance-based system first at Lindsay High School in the fall of 2009 was based on the fact that the principal of that school fully embraced the vision of performance-based education and was ready to take on the leadership responsibilities. The performance-performance-based system was introduced to the incoming ninth grade class of that school year and learners in that class were required to demonstrate specific competencies in each unit of study prior to advancing to the next unit. Initially, students liked the idea of “learning at their own pace,” but many students realized in April 2010 that the school was serious about having them demonstrate competencies, and there was a “mass scramble” to demonstrate mastery near the end of that year. After the first year, over one quarter of the ninth graders failed to complete the required competencies; they were required to begin their sophomore year where they left off when their freshman year ended. By this time, the learners began to understand the performance-based system and the rigorous learning that was now expected of them. LUSD has rolled out the standards-based approach using the accordion method, introducing it in seventh grade and rolling it up to the tenth grade in the fall of 2010, with plans for having a K–11 performance-based system in place by the fall of 2011.

Rooney cautioned participants that they had to be ready to “blow out the norms of the master schedule at the secondary level.” In order to be responsive to learner needs, a school would have to “reshuffle students throughout the year. Some will work independently, some electronically, some with a teacher. Sometimes it requires organizing students homogenously by level.” Online learning can provide the flexibility to students that need remediation or want to move ahead.

Although it has only been one year, Lindsay High School had the highest growth among all the schools in the district with an impressive 45-point Academic Performance Index (API) gain. The highest performing students were the ninth graders, the same learners who engaged in performance-based education. Preliminary and non-public results from the Spring 2011 census assessment for all tenth graders shows that Lindsay High School will have a second year of high academic gains, far exceeding the 45-point gain in 2010. As LUSD continues to roll out the

approach, more data will be generated, providing a better understanding of the dynamics of a true performance-based system.

(15)

New York City: Creating Innovation Space

The New York City Department of Education (NYCDOE) has launched an ambitious effort to move its schools toward more student-centered, personalized learning models through its Innovation Zone (iZone). The iZone will include 160 schools this year that have committed to organizing their curriculum, instruction, staffing, scheduling, and resources around the needs, motivations, and strengths of individual students.

Arthur VanderVeen, CEO of the NYCDOE Office of Innovation, explained that the initiative is building on the creative energies of innovative schools that have been personalizing learning for years but have lacked the organized support, policy flexibility, and access to new technologies that are critical to rethinking traditional school structures in order to build schools that are student-centered, personalized, and engaging students in meaningful, rigorous learning.

iZone schools are drawing on the support of partners with experience in personalizing learning. Three partners—New Tech Network, Reinventing Schools Coalition, and Kunskapsskolan—are facilitating the schools’ work to envision a future state design aligned to the five design principles, develop a three-year roadmap, analyze capacity needs, and develop implementation and

professional development plans. School designs include online and blended learning, an emphasis on developing higher-order thinking skills through performance-based assessment, project-based learning, the use of e-portfolios, competency-based grading, strong advisory models focused on personalized learning plans, and flexible, student-centered scheduling.

NYCDOE has been working with the New York State Education Department to develop new policy proposals concerning seat-time and competency-based credit. It has also been working the United Federation of Teachers to increase scheduling flexibility and explore new teacher licenses related to online and blended teaching roles.

iZone Design Principles

Globally Competitive Standards

Personalized Learning Plans New Staff and Student Roles Competency-Based Learning

and Assessment Multiple Learning Modalities

(16)

New Hampshire: Boldly Going Where No One Has Gone Before

New Hampshire is leading the way by replacing seat-time with competency-based policies. It has kept the course structure, requiring students to master competencies to get credits. They have simultaneously increased expanded-learning opportunities so that students have more options for how they can build and apply skills. New Hampshire learned that enabling policy is insufficient: the initial policy provided districts with alternative options but virtually no districts took advantage of the flexibility. New Hampshire did not see substantial innovation until they required all schools to offer competency-based credits and provided regional supports to districts and schools.

New Hampshire’s Virtual Learning Academy Charter School (VLACS) is a statewide, competency-based virtual school designed to provide all students with a personalized education. Currently, the school has over 10,000 enrollments that span grades 6 through 12, including Advanced

Placement, dual-credit high school, and college courses. VLACS provides students with the ultimate in flexibility as students may enroll in courses at any time and complete coursework at a pace that matches their needs. The school moved to a competency-based approach earlier this year and now offers competency recovery, competency-based courses, and experiential learning opportunities (ELOs). ELOs are blended online courses where students meet many course competencies through internships or other workplace experiences and complete the remaining course competencies online. Student progress is measured by the completion of competencies and not through traditional

attendance-based measures. The method for determining state aid also supports the competency-based model as the school earns funding competency-based on the percentage of course completion of each student.

Oregon: Piloting Their Way to Proficiency

Oregon introduced enabling policies for proficiency-based credit in 2003. The strategy allowed both a proficiency-based system and a time-based system to operate in tandem without disrupting the financial model that is aligned with units of instruction based on seat-time. Similar to the experience in New Hampshire, districts and schools rarely took advantage to innovate. Options to the seat-time funding model developed during implementation of a 2005 statute enabling students sixteen years of age or older to attend public post-secondary institutions while still enrolled in their local school district. As a result, more out-of-class proficiency options have surfaced.

A seven-district pilot provided additional input from the field on implementation, resulting in a State Board of Education Task Force as a part of Oregon diploma revisions in 2008. In 2009, the Board approved policy revisions, and additional school districts have initiated various stages of implementation. In 2009, the Oregon Proficiency Project began with two pilot sites exploring

proficiency-based approaches. Statewide, nearly 2,000 teachers and administrators have participated in professional development for proficiency-based instruction through a partnership with the

Business Education Compact. With increased knowledge, the state is now exploring several policy issues that will increase the likelihood of proficiency-based approaches being adopted, including changes to grading and reporting rules, influencing teacher and administrator training to include proficiency-based instruction, and streamlining K–12 and higher-education funding so that students can accelerate their learning while still in high school.

(17)

Alabama: Combining Initiatives into a Transformational Strategy

Deputy State Superintendent Tommy Bice described Alabama’s process of drawing together online learning, credit recovery, and accelerated learning into a cohesive approach to transform the education system.

In 2005, Alabama’s online learning initiative, ACCESS, was launched. By 2009, it was contributing to Alabama’s significant gains in Advanced Placement (24% gains compared to 7% nationally). That same year, the system became statewide with all students having access to online learning.

In 2008, the Board of Education passed FIRST CHOICE, the Advanced Academic Endorsement to the Alabama High School Diploma. FIRST CHOICE is the default diploma for all entering ninth graders, beginning with the ninth grade class of 2008–2009, which includes a minimum requirement of Algebra II with Trigonometry, two years of a foreign language, and an online experience. To support FIRST CHOICE, academic tools are being implemented to help guide students through their high school careers with the most efficient use of time and ability, including:

ƒ

ƒ Credit recovery ƒ

ƒ Credit advancement ƒ

ƒ graduation coaches ƒ

ƒ Support systems for struggling students (PASS)

Credit recovery and credit advancement are both policies enabling competency-based credits. Starting in the 2009–2010 school year, students can take advantage of competency-based credits. Similar to other states, districts are hesitant to move forward on competency-based credits without further guidance from the state.

(18)
(19)

Tough Issues

Throughout the Summit, a number of tough issues were raised—issues that did not have a simple solution or even enough understanding of the landscape to seek a resolution. Many of these emerging issues are substantive. However, several were process issues, including synchronizing policy and practice, communication, and engaging critical partners.

Throughout the conversations, there was a constant reiteration that in order to ensure an effective and equitable competency-based system, students need to be put first and approached as customers. This requires aligning the system with 100% of the students, even those who may fall behind, fall off the track to graduation, or “stop out.” It requires the districts and schools to design around the educational needs (both academic and lifelong learning) of their students.

Accountability: Putting the Customer First

With the introduction of accountability as a critical element of education reform, our country has come to understand it as a top-down dynamic. The federal government holds the state accountable, the state holds districts, the districts hold schools, schools hold teachers, and teachers hold students. Yet, there is another way to think about it: we can think of students as customers. Accountability becomes quality management, and accountability systems become continuous improvement systems. Many of the conversations at the Summit veered into what can become possible once technologies are in place to increase the viability of this type of accountability model.

ƒ

ƒ The tools for learning become more important than ever. Validity of the assessment instruments is critical; if we don’t trust the validity, then the entire system is questioned. Teachers and students will need access to a rich set of learning tasks and assessment rubrics We have to stop thinking in

terms of courses and time because it really is about individual students and what it takes them to get through. What’s unacceptable at my schools is if students are not provided with supports.

– Ginger Blackmon, Highland Tech High

(20)

so that students can demonstrate that they have mastered a learning topic. Rubrics and consistent scales are a critical step in the development of high-quality, performance-based assessments. In addition, the mastery we are measuring must be transferable into other learning environments.4

ƒ

ƒ Mastery becomes the trigger for summative assessment, rather than the tests taking place at an arbitrary point on a calendar.

ƒ

ƒ Pace matters. In fact, pace becomes the mechanism to ensure that students are getting the supports they need. If students are not moving forward within a pace range, it is an indication that they are not getting served, served well enough, or that there are deeper issues that must be addressed. Falling off pace becomes the indicator for principal or district intervention with teachers and/or students.

ƒ

ƒ Adaptive online learning begins to play a vital role. The information on student learning— such as where they are having problems or where they need help—is invaluable. In addition, it serves as a validator in maintaining consistency in the understanding of proficiency across teachers and schools.

There were many questions about how to create prototypes of an accountability system designed to promote student learning, especially within the current policy framework.

Equity: Eliminating Our Tolerance for Inequality

Participants pointed out that the United States is producing the greatest inequalities to date, while we continue to propose that we are moving toward equality. Others raised the point that our country has a very high tolerance for inequality. Thus, as competency-based innovations and enabling policy conditions expand, equity must become an essential lens. To do otherwise runs the risk of reproducing the inequities of the time-based system.

Several aspects of ensuring equity were raised in conversations. ƒ

ƒ One of the concerns rippling throughout the Summit was that a personalized, competency-based approach may result in some students being left behind or an increase in the

achievement gap. Judy Jeffries from the Partnership for Next generation Learning described the problem: “If we’re not careful, we’ll create more inequities in the system then we currently have. We must rethink the interventions and supports rather than just saying we need more time.” Bror Saxberg expanded on this point—“Pace matters!”—with the suggestion that the goal should be to put students on their fastest path to results that matter. He suggested that as information systems develop in sophistication, data will drive an increasing rate of progression—students, teachers, and administrators should be, and can be, in a hurry.

4 EdSteps, a new web-based resource, is now available for measuring student growth. Developed by the Council of Chief State

School Officers, the centerpiece is a public library of student work samples in key skill areas, including writing, global competence, cre-ativity, problem-solving, and analyzing information. Student work is presented in a continuum—a gradual progression—from emerging to accomplished work or another searchable format. EdSteps will allow teachers, parents, and students themselves to measure individual students’ progress over time and answer questions about whether students are on track to success. The work samples will help answer a central question for student growth: Where is a particular student now, and what should he or she do to improve? www.EdSteps.org

(21)

ƒ

ƒ Although a problem in the time-based system as well as a competency-based approach, ensuring consistency in academic standards for all students and across schools, districts, and states is particularly important to those who advocate for the most underserved students. New Hampshire has developed a validation tool to maintain academic rigor and included it in school approval reviews. The validation rubric includes elements such as relevance to content area, enduring concepts, and cognitive demand.

ƒ

ƒ One of the potential benefits (although some perceive it as a challenge) of competency-based learning is that it may make explicit the actual costs to help low-income students learn at high standards. Thus, the next question becomes, if we are dedicated to educational equity, will we be willing to invest in the high-quality learning environments that allow children to succeed in school? These learning experiences may not be school-based it all; we may find that background knowledge, learning in other areas such as music, arts, and sports, or focusing on issues that are relevant to their current lives is what will help children progress in school.

ƒ

ƒ Concern with the lack of diversity within the Summit and within next generation learning forums in general was raised. Participants suggested that we need to intentionally invest in leadership development, thus increasing diversity and expertise by building bridges with communities of color and networks serving special populations such as English language learners and special education students. Most of all, as leaders we all need to take responsibility for reaching out across racial and ethnic boundaries so that we can build a movement that draws on the diversity of experience and insights across our country.

Carnegie Unit: Creating Meaning for Students and

Educators

As participants discussed the implications of de-constructing the Carnegie unit, there were many “aha’s” as to the multiple functions it serves within the education system. The Carnegie unit plays a powerful role in managing transactions within the education system. First, it provides a unit of exchange to allow different schools and institutions to relate to each other, especially the transition from high school to college.Second, the Carnegie unit is based upon the amount of time that a teacher is in front of a classroom. It doesn’t take into account how effective the teacher is, how much time and effort the teacher contributes outside the classroom, or how much time and effort students contribute.

Once the idea of eliminating the Carnegie unit is introduced, the discussion begins to focus on the changing role of educators rather than student learning outcomes. In Oregon, educators raised the fear that students graduating early would eliminate jobs, yet that only occurs if we operate on just one part of the value proposition. A state policy leader suggested that if we maintain the expectation that our students will continue on to even higher levels of academic work, even while

In a proficiency-based system, teachers flourish as much as students.

– Proficiency-Based Instruction and Assessment, the Oregon Education Roundtable

(22)

in high school, job reduction becomes less of an issue. The roles of educators become increasingly important for student-centered learning: coach, resource expert, facilitator, intervention expert, tutor, and even “concierge.” Oregon passed Bill 300 to ensure that students sixteen or older could pursue education at state universities and community colleges while in high school. At this point, there is no reason to believe it will reduce the number of jobs, but it certainly means that there will be different types of jobs and that teachers may be doing their work in different ways.

However, there is reason to believe that the roles and responsibilities of teaching will change. gloria Pineda from Diploma Plus described how competency-based approaches raise the bar. First, teachers are expected to help all students succeed in mastering academic skills, not just some of their students. Second, the scope of learning topics is expanded to include lifelong learning competencies. Thus, the job of teacher will change with greater emphasis on facilitating learning through assignment of learning tasks, performing formative assessment, and guiding students in the development of personal learning plans. It is likely that different types of jobs will develop as schools experiment with organizing human resources around student learning. New Hampshire is positioning itself for this possibility by replacing the word “teacher” with “educator” in its education policies. Another concern is who is able to grant competency-based credit? If students are learning in the community, who is responsible for ensuring that the learning is at appropriate levels? New Hampshire has handled this issue by ensuring that teachers are responsible for granting credit. Yet this raises another matter as teacher education programs are generally unprepared in assessing lifelong learning standards. Other ideas are being explored, including community-based credentialing that is similar to a merit badge system.

With this increased insight into the functions that the Carnegie unit plays in maintaining the current educational system, the question arises: What becomes the unit of exchange if we eliminate

the Carnegie unit? Do we need to look for another “container or unit of learning,” one based on mastery, not seat-time? Participants explored how the Carnegie unit captures a social value of the investment of teacher time toward student learning. How will teachers understand their effectiveness and their value if students move on with little effort from them? He suggested that it is important to take the time to clarify the social values we want for our country as we rethink how we value and evaluate learning. Thus, if another “container” or unit of learning is to be created, it must hold value for teachers and students alike.

In the short run, one idea is to not eliminate the Carnegie unit but simply to redefine it. Courses are converted into competencies and learning objectives; end-of-course exams serve as summative assessments. New Hampshire has demonstrated that maintaining the course structure is a viable method for moving forward.

Personalization: Co-Designing with Students

Competency-based learning is inherently personalized as students progress upon their learning trajectory in a way that is unique to them. In addition, competency-based approaches quickly hit a wall without student co-design. Deeper learning—the development and application of knowledge— requires real-world experiences or project-based learning. One participant emphasized, “It is

essential to bring student voice much more directly into the learning process.” Paul Leather asserted that student-centered approaches were critical, especially for designing “complex performance

(23)

assessment, where you can demonstrate deep, deep learning.” gerrita Postlewait of the Stupski Foundation emphasized that “keeping student voice central is essential to ensuring that the traditional system is not reproduced.” Participants repeated that student agency must be balanced with a clear focus on helping students achieve. The role of the educators will be critical in ensuring that students are progressing while still able to pursue the education that is most meaningful to them.

Even with a shared commitment to establishing student agency within a competency-based system, it will require creativity to fully integrate it into policy and standards of practice. New Hampshire tried to

take the first step of introducing personalized learning plans into policy. Fred Bramante explained that they failed to do so when education administrators balked, fearing it would translate into an IEP (Individual Education Plan) for every student. New Hampshire continues to work toward establishing a personal learning plan for every student as a key design element.

Management Information Systems:

Re-Engineering for Results

Some of the competency-based innovators started out with paper-based systems, soon finding it difficult to manage the abundant data generated on each competency and academic standard. As states and districts begin to think about scaling competency-based systems, the complexity of trying to build student-centered information management systems on top of the current top-down accountability information management systems arises. Cobbling together information systems leads to frustration, ongoing costs for troubleshooting, and inadequate feedback loops. Online learning providers, having the benefit of building information technology systems from scratch, developed more advanced technology infrastructure for competency-based learning. Virtual schools have content management systems tied to student data systems, many with abundant digital content resources and embedded online assessments.

Western governors University (WgU) had the luxury of designing their information systems from scratch. Even then they went through several iterations. Jim Schnitz, Vice-President of Institutional Research at WgU, provided an overview of their system.

It starts with a standards database. This is behind everything we do in competency-based learning. The competencies have to be validated externally by professionals. The next step is building the assessment objectives and learning resources. These are independently aligned. Assessments are never aligned with learning resources. Assessments are totally independent measures of competencies.

We use a customer relationship management system to recruit and enroll students. We also have a student information system with a student portal. The graduation plan drives the student learning plan so that everything they are doing is always tied to the goal of graduation.

When there is authentic student agency—not just let students choose from the options adults give them—we can learn about our students’ hopes and fears, what

motivates them, what shuts them down, and the future to which they aspire.

(24)

Other information systems designed for competency-based systems, including Educate used by Adams County School District 50 (Adams 50) and DP.net developed by Diploma Plus, have databases that teachers can use to select the competencies and learning objectives to design curriculum around. DP.net also does the translation to state standards and grading, easing the burden on teachers. Principals or coaches can quickly review and give feedback on curriculum. The information systems allow students to submit their work electronically and also offers virtual space for discussions between and among students, teachers, and principals.

Although the information systems integrate student information and standards-based learning, considerable challenges remain. First, schools must continue to interact with state reporting information systems. In Adams 50, teachers are required to use three different systems. The resources to integrate the systems have been difficult to come by. Many online and blended learning programs are well on their way toward integrated approaches that “plug and play.” Open architectures for learning include content and standards databases, student information databases that show their progress on competencies, assessment engines, and virtual learning environments. States and districts may want to consider a shared and open-architected platform that supports competency-based learning approaches.

Furthermore, we are at just the beginning of understanding what information systems can provide to enhance the ability to respond to student needs. What should learning maps look like? Florida Virtual School wants to be able to deliver a system that identifies learning styles, interests, current knowledge, and skill acquisition. Ideally, competency-based information systems will be designed to support students with high mobility, often the most vulnerable students, so that the receiving schools can support continued academic progress on the personalized learning plan rather than having the transition push the student further behind.

Assessments: Where the Rubber Meets the Road

Discussions about assessments streamed throughout all the sessions at the Summit. There was agreement that formative assessments increased in importance in a competency-based system. There was agreement that educators should be careful to design assessments on specifically what they want to measure. There was enthusiasm for embedding assessments into the curriculum. There was commitment to the idea that assessments would become part of the learning process, providing meaningful feedback and support so that students could overcome academic challenges.

Concerns were raised about the way summative assessments are currently structured to be given only once a year. It was proposed that summative assessments should actually occur after a student had mastered materials, serving as a validation mechanism to show that standards were consistent across teachers, schools, and districts. Similarly, it was proposed that summative assessments should be delivered “just in time”—as soon as students are ready. Some participants suggested that greater modularization would be helpful so that students could demonstrate the material they had mastered in shorter periods of time, allowing a sense of progress and portability for those with high mobility. Most of all, participants at the Summit raised concerns about whether the assessment consortia were taking into consideration the possibility of competency-based, next generation learning systems. Challenges were raised as well. A participant asked how a school could validate a competency for which no one in the school has the competency. He gave as an example a student learning Chinese

(25)

in an independent course and asking for credit for speaking a foreign language, yet no one in the school knows Chinese to determine that he had in fact mastered it.

One participant cautioned that assessing lifelong learning competencies can be complicated because of the personal and cultural bias that we all bring to our work. Teachers are not trained to assess this type of skill, nor do we all have the same idea of what it looks like. For children from different cultures or impoverished families, what could look like laziness to others might only be from not having a bed to sleep in and therefore trying to get by without enough sleep. What might look like poor attendance and irresponsibility could actually be taking responsibility for getting siblings fed and to school every morning.

Synchronizing Policy and Practice: New Approaches to

State Policy

gene Wilhoit, Executive Director of CCSSO, offered insights into how the quality of state policy differs between maintaining the traditional system and building the next generation of learning. Traditional education policy seeks clarity so that it can be effectively implemented and monitored. Policies that open the door to innovation will need to have new characteristics. Wilhoit outlined a new set of principles as a state policy framework for next generation learning.

ƒ

ƒ Drive Policy by Student Learning Outcomes: Focus on student learning and student

learning outcomes. First and foremost, policies should be made to support the needs of students.

ƒ

ƒ Guard High Academic Standards: States will need to be vigilant to ensure that academic

expectations do not slip, resulting in lower achievement for groups of students. Focus on equity with high expectations for all students.

ƒ

ƒ Expand Student Options: State policies should expand, not limit, the options that students

have to reach learning outcomes. ƒ

ƒ Create Shared Vision: Policy development cannot be top-down. It will be important to

keep communication open, inviting stakeholders to contribute to the vision and the steps to get there.

ƒ

ƒ Offer Districts and Schools Flexibility: Be clear about desired outcomes and then provide

incentives for educators to take different pathways to achieve the goal. Remove process rules and regulations in order to allow and encourage innovation.

ƒ

ƒ Commit to Continuous Improvement: Policy will need to evolve as we learn more about

the dynamics of next generation learning, requiring ongoing improvement efforts. All participants agreed that the introduction of competency-based learning and other elements of next generation learning cannot be done through top-down policies or by using compliance as leverage for change. Instead, states must create space for organic development and expansion of innovations. Furthermore, experiences from the leading states show that without incentives and supports, districts and schools may be hesitant to pursue innovations. Thus, states need to create peer learning networks, technical assistance, and rewards for taking risks.

(26)

States can use a variety of techniques to let innovation take hold: convening innovators, creating innovation zones, establishing cultures of continuous improvement, defining new performance metrics based on desired outcomes, and setting policies and funding formulas that create incentives for innovation and the desired behaviors.

There are five roles that the state can play that are critical to supporting innovative growth, ensuring that policy is informed by innovative practice, and guarding against slippage of academic standards and inequities.

ƒ

ƒ Create Innovation Space: The introduction of competency-based systems and other

elements of next generation learning cannot be done solely through top-down policies or by using compliance as leverage for change. Instead, states must create space for organic development and expansion of innovations. States can use a variety of techniques to let innovation take hold, including enabling the policies as described above: convening innovators, creating innovation zones, establishing cultures of continuous improvement, defining new performance metrics based on desired outcomes, and developing policies and funding formulas that create incentives for innovation and the desired behaviors.

ƒ

ƒ Provide Catalytic Support and Knowledge Transfer: Funds should be dedicated to

peer networks that can support rapid exchange of knowledge, leadership development, and technical assistance. These networks can also expedite creative work such as developing and disseminating options for lifelong learning competencies to reduce the cost of every district designing their own.

ƒ

ƒ Engage Communities: Communities need to be engaged early and often. They need to

understand the reasons, goals, and elements of the change to competency-based learning. Most of this work will be done at the district and school levels, but states can help by supporting the development of effective communication tools and providing a website that districts can use to help educate communities.

ƒ

ƒ Protect High Standards: States have the unique responsibility of guarding high academic

standards and ensuring that students are getting the supports they need to reach them. Developing mechanisms to ensure that there is consistency across schools and districts will be important in the long run, but it is absolutely critical in the early stages of innovations. ƒ

ƒ Offer Adaptive Leadership: State leadership can play a critical role in supporting innovative districts by using the bully pulpit, recognizing the leaders that are taking risks, and engaging statewide associations early on in vision-building. In addition, they can assist districts that need more time to build community support by offering flexibility in reporting. One of the most powerful roles a state can play is creating collaborative space for the development of competencies and learning objectives. As states come face-to-face with the implementation of the Common Core State Standards, many opportunities and questions arise. Several examples raised at the Summit are described below.

Well-Designed Competencies: given that the innovations are still at early stage of development, the field has not agreed upon what makes a well-designed competency. Although some attributes such as learning objectives need to be explicit and measurable are clearly agreed upon, others are less defined. Should competencies be designed to inspire students? Catalyze student agency?

(27)

Can they be designed to ignite creativity within our schools and our students’ minds? Are there ways of designing them around long-term measures of student success? Can they be positioned so that they are meaningful for the workplace, backing them into a progression of school-based levels? In creating competencies, states and districts may want to begin to move beyond a linear approach to standards. In offering more complex tasks, competency-based systems challenge the traditional, discrete and sequential notion of standards. It will be important to explore the natural clusters of standards that are highly related to each other.

If innovators and states are all designing their own competencies and learning topics, where does this leave us? It takes time and money to develop competencies, yet we want to make sure that each school identifies them as meaningful, not simply a bureaucratic document. What about students with high mobility, such as those who are migrant, homeless, in child welfare or juvenile justice systems, or simply poor? Can we create state or even national competencies that provide some portability?

Core Competencies: The number of academic standards that have been generated by national organizations and states can be overwhelming. David Yanoski of Marzano Research Laboratories (MRL) suggested that based on a study by MRL the system would need to be changed from a K–12 to a K–22 system in order to adequately teach all standards to mastery. This is certainly a recipe for failure. The Common Core creates a different starting point, focusing on the most important standards. The next step is to translate the standards into core competencies. States can be helpful in identifying a shared set of core competencies that all districts will be building upon. This is also helpful for establishing portability, a key ingredient for ensuring that students with high mobility will benefit directly from a competency-based system.

Lifelong Learning Competencies: The Common Core includes application of knowledge through high-order skills. However, there are other skills that are important to all students but particularly critical for students living in areas of concentrated poverty and/or violence. These include social-emotional and navigational skills that help them overcome trauma and engage others in helping them to manage highly complex dilemmas in their lives. In addition, workforce and career

development are critical for finding jobs to support families and increased motivation through the broadened horizons. For students that are first in their families to go to college, gaining knowledge about the college application and financial aid process is imperative. States can facilitate the

development of shared lifelong learning competencies, rubrics, and professional development so that educators and community members can work together to support students.

Shared Vision: Investing in the Process

Those state and district leaders that had substantial experience in creating competency-based systems constantly reminded us that we had to engage the communities early and often. The true cost of community engagement is rarely budgeted, placing it at risk of being less than adequate. Engaging parents and the broader community in thinking through what they want for their children was an important step. Participants agreed that there needed to be high levels of “buy-in” by schools and teachers before moving forward. Adams County 50 postponed implementation for a year until they had 80 percent of their teachers in support of the transition to standards-based learning.

(28)

Sustainability will always be an issue with competency-based learning, as it is in any education reform. Thus, constant leadership development will be necessary to ensure that elected officials continue their support. Participants agreed that it was important to explore ways to work together to create greater political commitment and political cover. In addition, participants wanted to learn how to communicate competency-based learning and the other elements of next generation learning to the broader community without causing confusion.

Higher Education: The Missing Partner

It is difficult enough to bring about changes within the K–12 system without simultaneously engaging higher education. Yet, Fred Bramante suggested that in reflecting on New Hampshire’s experience, they had made a mistake in their early stages of building a competency-based policy by not engaging higher education early in the process. There are four areas that should be considered in higher-education policy.

ƒ

ƒ Access to higher education: Students should have total access to college-level courses once they have demonstrated mastery of college-ready skills. This requires streamlining K–12 and higher-education funding and teacher qualification policies so that students can be well on their way in college credits by the time they complete high school. Several states are considering allowing state K–12 funding to follow the student into the first year of higher education.

ƒ

ƒ Admissions: Higher-education admissions policies and practices need to be revised to be compatible with competency-based transcripts. For example, current transcripts are unable to show advanced competencies within the seat-time-based gPA system.

ƒ

ƒ Teacher training: Teachers should be trained in competency-based practices, including assessing lifelong learning competencies. This will enable much more rapid implementation in schools and districts.

ƒ

ƒ Competency-based post-secondary courses: Higher-education programs can also benefit from based instruction. Developmental education should be competency-based so that students can rapidly fill their skill gaps and master the materials to let them into credit-bearing courses. Bill Evenson suggested that higher education can engage in the “tuning” process that clarifies the specific competencies students should know when they major in a subject.

Susanne Daggett from the Oregon Department of Education indicated that the state legislators are exploring ways to expand options for students. “The different funding streams do create a bit of a road block. But people are trying to think about how the money should follow students that are ready to move on to college-level courses.”

(29)

Unlocking the System

Facilitated by Susan Patrick, a panel offered a provocative set of insights and challenges into unlocking the education system. The panel members included:

ƒ

ƒ Jim Shelton, Assistant Deputy Secretary of Innovation and Improvement ƒ

ƒ Michael Horn, Executive Director of the Education Practice at Innosight Institute ƒ

ƒ gene Wilhoit, Director of Council of Chief State School Officers ƒ

ƒ Sajan george, CEO of Matchbook Learning

Alignment with the New Value Proposition

All the panelists agreed that aligning incentives with

the new value proposition was critical for driving the transformation of the education system. “The question is how to get student performance in the center of everyone’s incentives so they are focused on that one outcome and that’s the only one that matters,” offered Shelton. Michael Horn suggested that all the integrated providers of online learning “have assembled all of their processes, resources, and value propositions around a competency model. Seat-time just doesn’t make any sense when you talk about online learning.”

A new business model was proposed to help drive transformation. Horn suggested that the most powerful thing we can do is to incentivize the changes, not “rely on pure supply and demand based on price. We need to fill contracts based on the results that we want to see… Performance-based contracts naturally putting in the incentives to have constant and continuous improvement will really start to drive it. We’ve never had that before because our whole system is built on inputs.”

A competency-based system embraces student learning above all other social values. It operates on a new value proposition:

By aligning all of our resources (in schools, the community, and online) around student learning to enable students to progress upon mastery, our country can increase productivity in the education system, while simultaneously raising achievement levels overall and reducing the achievement gap.

References

Related documents

• Provides accurate schedule updates to the Master and Engineering, Construction, and Procurement schedules for engineering and design activities.. • Utilizes the published

The No Child Left Behind (NCLB) Act appears to be having an unintended negative impact upon the practice of hands-on science at the elementary and middle school levels in

A corporation would be liable for the acts of its Board of Directors and officers if the said acts were performed by them in accordance with powers granted to them under

The purpose of these procedures is to support schools, working with students and parents, to implement a programme so students can bring their own technology devices to school

In the section Rendition, I will discuss the interpreter’s most complex task, the representation of character and direction of address in the construction of the target text,

Tagged With: contoh, daftar, daftar lengkap, Intermediate, kata kerja, kata kerja beraturan, Pengertian, regular verb, regular verb dan artinya, regular verb list,

In order to investigate the effect of microphone array radius on the performance of the ANC system at different frequencies, as well as the differences between the potential

Todavia, nos anos 1800, essas práticas já não eram vistas com tanta naturalidade, pelos menos pelas instâncias de poder, pois não estava de acordo com uma sociedade que se