Fixing Education Initiatives In Crisis: 24 Go-To Strategies

Follow on Apple Podcasts · Spotify · YouTube · more apps

About Jim Marshall

James Marshall, PhD is Professor of Educational Leadership at San Diego State University, where he serves as the Senior Director for the Ed.D. program in PK-12 School Leadership. With over 200 publications to his credit, Dr. Marshall’s scholarship encompasses a diverse range of works that include empirical research, program evaluation efforts, and policy development.

Full Transcript

[00:01] Announcer:

Welcome to Principal Center Radio, helping you build capacity for instructional leadership. Here's your host, Director of the Principal Center, Dr. Justin Bader. Welcome, everyone, to Principal Center Radio.

[00:13] SPEAKER_00:

I'm your host, Justin Bader, and I'm honored to welcome back to the program Dr. James Marshall. Jim is Professor of Educational Leadership at San Diego State University, where he serves as the Senior Director for the EDD program in PK-12 School Leadership. With over 200 publications to his credit, Dr. Marshall's scholarship encompasses a diverse range of works that includes empirical research, program evaluation, and policy development. And we have talked on this program previously about his book, Right From the Start, The Essential Guide to Implementing School Initiatives.

[00:44]

And we're here today to talk about his new book, Fixing Education Initiatives in Crisis, 24 Go-To Strategies.

[00:53] Announcer:

And now, our feature presentation.

[00:55] SPEAKER_00:

Jim, welcome back to Principal Center Radio.

[00:57] SPEAKER_01:

Hey, thanks so much, Justin. It's great to be back and great to be here, and I'm excited for our chat.

[01:03] SPEAKER_00:

Well, I'm excited to speak with you about your new book and tap into your expertise in program evaluation and initiatives, because I think so often what we do in this profession, when an initiative is stalling out or failing or just somehow not getting the results we wanted it to or generating some controversy, so often... What we do is we abandon it and start a new one, or maybe two or three new ones. What did you see happening in the profession that prompted you to write this particular book?

[01:35] SPEAKER_01:

Oh, that is such a great question, and certainly your description there resonates with me about what I see when an initiative isn't going the way we had expected or wanted it to. And you're absolutely right, though I say it with a bit of a laugh, but, you know, oftentimes what happens is three more initiatives take its place. And honestly, one of the reasons I chose to write this book is all of my experience with program evaluation and seeing initiatives. I've not yet met the perfect initiative. Maybe it's out there. But as we know, programs and initiatives take time.

[02:12]

They take time to understand, to design, to implement. Now, in the book, you distinguish between a program and an initiative. Does that distinction matter for our purposes today? And how would you kind of distinguish between those?

[02:39]

You'll hear me in conversation use the two words interchangeably, but I, reflecting on kind of the state of education and what's happening in our schools these days, I believe we should all be striving for initiatives, and I differentiate the two in a fairly straightforward way, programs are just something perhaps you pull off the shelf and go out and do where an initiative, I argue, is what we should be doing, even if it's a program, in that we should have carefully understood what the need was, matched a solution to it, and implemented in a way that acknowledges the deep and sometimes challenging systems So, I believe in initiative, and in the book, I use the iceberg model, and I'm sure you're familiar and your listeners are with the iceberg model, but...

[03:41]

An initiative to me is that iceberg with the deep roots that maybe you don't see, but it's been carefully planned to hasten both its implementation and also giving it every chance of making the impact it was designed to do.

[03:58] SPEAKER_00:

Excellent. Well, let's talk about some of the ways that initiatives can go wrong, because I think we've all recognized maybe a situation where a new initiative is needed. We've all recognized situations where maybe an initiative was started when it was not needed. What are some of the warning signs that we need to do something and some of the ways that initiatives can go wrong?

[04:18] SPEAKER_01:

Yeah, so, in the book, I actually outline six different types of crises that I've encountered over my career and seen in programs, frankly, both I've run, as well as programs I've evaluated, and they span the life cycle of an initiative, but At the beginning, the first crisis, I call it the failing to get smart crisis, that really describes the initiative you just kind of described where you begin a program or implementing and you realize this isn't what we needed. So not taking the time upfront to really understand what the situation is, what the needs are. I always say what the strengths are, too, because the best way to address a need is often by building on a strength. And so, taking that time upfront is critical.

[05:10]

And, by the way, that's why the first book I authored is called Right From the Start, because that start is so important in terms of understanding, uh... understanding the need, the opportunity, the challenge, and being responsive to it. So the failing to get smart crisis really is just that one where the initiative begins to be implemented and people are saying things like, did they even ask anybody what we needed? And questions like that.

[05:37]

And this book on fixing initiatives in crisis really is predicated on the belief, and I do firmly believe this, that Initiatives are a continuous improvement pursuit. And, you know, not having data is another crisis that I described. But it is with data from the earliest stages through the early implementation to impact that you gauge the health of the initiative. the impact it's beginning to have and make those adjustments along the way. So each of these 24 strategies really is responsive to the need to make changes along the way and fixes you can do that maybe your initiative isn't even faltering. Maybe it's just not having the impact you want it to fully.

[06:27]

So different things you can do along the way to optimize both the implementation and then ultimately the impact.

[06:38] SPEAKER_00:

It makes perfect sense to start there, because if we're solving the wrong problem, or if we've come up with the wrong solution to the right problem, you know, we can't tweak our way out of that problem, right? Like, if we've got the wrong destination in the first place, you know, you don't need an oil change to help you go in the opposite direction, right? Like, we've gotta get our problems and solutions right, and get smart, as you say.

[07:00] SPEAKER_01:

Yeah, and I would just, I think that's a great analogy, and another one that often comes to my mind is, I've never walked into my doctor's office and had him begin by writing the prescription. So, first, the doctor always, or should always, figure out what's going on, ask some questions, and that really is, for us educators, the analogous needs assessment is exactly what's involved there.

[07:24] SPEAKER_00:

And then the second type of crisis you talk about in the book is around outcomes. And I wanted to get your perspective on how often this is a problem of unrealistic expectations. Like, I was looking into some research recently on, you know, how much of an impact on student learning various things can have and what the various contributors to student learning outcomes are. And it seems to me that, in general, we wildly overestimate the impact that any one little thing is going to have on student learning. Like, we want to make some change, and we expect to see the needle move dramatically in terms of measurable, you know, student test scores or something like that. I mean, are we right to want the needle to move on initiatives like that, or are we unrealistic?

[08:05] SPEAKER_01:

That's a great question, and I think we are right, always, to want the needle to move, but I think we have to think systemically about any initiative, and hopefully that's how we opened up today, uh, when we were talking about the difference between an initiative and a program, in terms, the way I look at it. I do think defining outcomes is critical, I do also remind people regularly, you get to do the defining. You know, so when you're being charged with running an initiative or designing an initiative, it's up to you to set realistic benchmarks. And I do agree with you. And I evaluate a lot of funded programs, and I think that's one of the catch-22s. To get the funding, you tend to, you know, define aggressive outcomes.

[08:58]

Uh, and then, when rubber meets road, sometimes those grand outcomes aren't achievable, and there is need to adjust back and set meaningful steps along the way. I've yet to see one where we abandon the end goal. Because usually, if there was a good needs assessment done, that end goal is still worthy of pursuing. I have seen, like, formative outcomes, intermediate outcomes, or in the evaluation biz, we sometimes call them outputs. I have seen those dialed back along the way just to get the team, if nothing else, back on track in that forward momentum that you lose when...

[09:43]

In situations where if all you have is that end outcome, it could take years to get there. So where is the faith that inputs the motivation to sustain you to that final outcome? And so a lot of times when it's flawed outcomes, it could be, an outcomes crisis could be because the outcomes are poorly defined. But as you suggest, perhaps you've defined the wrong outcomes or you've been too aggressive and only defining way down the road summative end goal outcomes and not planned carefully for intermediate outcomes that signal you're on the right track, we're doing good work, and this initiative needs time. As I say, time to bake. Time to do what it's doing.

[10:31]

Teachers get good at using a curriculum. Students get familiar with it and begin benefiting from it. You know, it's as simple as that. It takes time.

[10:41] SPEAKER_00:

Yeah, absolutely. I love cookie dough, but if you've ever tried to taste cake batter or brownie batter, like, they're just not good because they haven't baked yet, right? And I think we do that with initiatives. We don't give them the time. We don't ask ourselves, you know, what should this look like at this stage because it's not done baking yet. And I'm thinking about...

[11:04]

You know, curriculum adoptions, especially. And one of the messages that I got as a new principal when we had just adopted a new math curriculum, and then I came on board, I think, one year later as a principal... One of the things that our experts were very clear on is you are not going to see a big jump in your scores in year one, right? When your fifth graders have had one year of a six-year curriculum...

[11:25]

They are not going to have the full benefit that they're going to have, you know, in year six when they've had this curriculum all the way through. The teachers have had multiple years of professional development. Like, it is going to take time. How can leaders get that message across that change takes time, that we need to stick with it, that it's not a failure just because we're in one, you know, year one of a five-year process?

[11:46] SPEAKER_01:

I love that because there's so many strategies in this book designed to do just that. In fact, I would go so far as to say this book really assumes, in many ways, you have a good program, and it's about getting the most you can out of that program. And yes, sometimes the outcomes need adjusting, but that doesn't mean overall it's not a good program. The answer to your question for me lies in a couple of areas. One is having realistic expectations on the front end and communicating them like crazy. And by like crazy, I mean before, during, and after.

[12:24]

You, as leaders in schools and districts, we Establish buy-in for these initiatives. And then I think oftentimes we assume, okay, I don't need to worry about that anymore. Everybody agreed to it. Well, the bottom line is eventually somebody is going to ask, especially if the budget goes the wrong direction or a competing program comes up. Your job running a program includes being the PR agent. I say for the program, you should be along the way.

[12:56]

sharing information about accomplishments, even as simple, and I term them, and it's actually Jodi Spiro, formerly with Wallace Foundation, her term is early wins, and she defines little steps, like triumphs, in implementing, you gave a great example, a curriculum, implementing a lesson. Early wins can be even failing the implementation of a lesson, and what do we learn But I do think the plan for what to expect when is critical.

[13:46]

And further, I think also critical is always communicating what's happening with the initiative and the achievements, even if they're not outcome achievements, but they're implementation achievements. You've got to sustain the attention span of the people involved. And that to me is part and parcel of buying the time it takes. And I always say, and it's not based on research, but three years minimum for a toothy initiative to actually be up and running at pace.

[14:18] SPEAKER_00:

Love it. So you call that the attention span crisis, and you also talk about the data crisis. I'm thinking about the book that's popular for expecting parents. What to expect when you're expecting. It occurs to me that your book is essentially, you know, what to expect when you're expecting results, and how to deal with the fact that those results...

[14:36]

don't come in right away. Talk to us a little bit more about data and that kind of attention span issue, because, like I said at the beginning, I think so often we respond in our impatience by just starting a new initiative, right? We just, we say, okay, well, it's going to be a while before the test scores come up because of what we're doing right now, so let's start something else to look busy.

[14:57] SPEAKER_01:

Yeah, and I do agree that it's, there's a lot of abandoned initiatives out there that hadn't been given the true time they needed or a commitment to adjust them as they run to optimize both their implementation and impact. I think, uh, when it comes to data, and as a program evaluator, this one is near and dear to my heart, uh, data is the best friend of the initiative's PR agent. So, when you can disseminate information, and by data, it could just be how many, uh, teachers have been trained in the early stages of something. But just quantifying and instantiating what's happening with the initiative, how it's going, and ideally what you got out of that move by training this many teachers we now have.

[15:53]

They are ready on day one, week two of the school year to begin the first lesson of the new math curriculum. Just describing those kinds of things, and sometimes I think we don't think of that as data, but it truly is data because it is measurable and descriptive in terms of what's being done. So, I was always taught the end of initiative is not this time to start thinking about what data we should have. But, and I'm pretty sure everybody would agree with that groundbreaking statement. But I look all the way back to the beginning when we're planning, making a project plan, an implementation plan. When we're doing that work, what data can we get each step of the way that will contribute to our understanding of how it's going?

[16:41]

Initially, it's gonna be about implementation more than it is impact. Eventually, it will be more about impact than it is implementation. But you gotta have both, because that data about it getting used and it making a difference, both halves are necessary to truly understand what's going on and leverage the initiative to the true extent it was designed to produce change and impact.

[17:12] SPEAKER_00:

Talk to us, if you could, Jim, about understanding what's happening on the ground, because often, you know, especially in larger systems, there's a set of decisions that's made, maybe a set of purchases that's made, you know, there are some things put in place that seem like big action, that seem like things have taken place, but often there is a difference between what's happening at the decision-making level and what's happening on the ground. Right. Right.

[18:08]

So how does senior leaders and people who are responsible for initiatives get ahead of that tendency that everybody, and that incentive that everybody has to act like everything's going great?

[18:17] SPEAKER_01:

Well, I think the beginning of an answer to your question actually lies early, early on. If it is a shared decision... No, no, I don't want to plan, Jim.

[18:27] SPEAKER_00:

I just want, I don't want to plan anything.

[18:28] SPEAKER_01:

You don't want to plan, you just want to do? Well, I would argue you need to bring people on board. So even if it is a top-down decision, uh, that's made and it's, this is what's gonna happen, I think you still need to bring that, the site leadership and teacher leaders into the mix. You've got to help people understand why something is happening and how it connects. And so, I think when those things don't happen, you begin to have some of the crises in this book. The failure to get smart crises is a no-brainer here because if you haven't figured out how something fits in, it's going to...

[19:09]

undoubtedly suffer less implementation, let alone implementation challenges, but I think that is often the limitation that you're describing, and I think it's a tad more nuanced, perhaps, but the limitation you're talking about, where somebody doesn't want to be honest, there's a fear of being honest or transparent, perhaps is a better word, for what's going on there, because they don't feel they have that, the safe space to do that. I think the safe space comes in the rollout of the initiative and helping people understand the better state that initiative has been selected to bring about. If we agree on that better state, even if it's top-down decision, then I will want that for my teachers and my students, and when I'm not getting that, I am more likely to be vocal about it.

[20:00]

Ultimately, if the initiative is well-placed within the system that is already existing, then It will be more consequential if that initiative isn't going well because it will affect other things. If it's just another program off to the side and it doesn't go well, then nobody probably is going to notice. Unfortunate.

[20:24] SPEAKER_00:

Well, after we have made sure that we're solving the right problem, we have made sure that we're communicating with everyone and, you know, setting the right targets and setting the right expectations and getting everybody on board as to what we're doing and why and... Focusing on implementation. Eventually, we'll get to the point where we want to go bigger or we want to make sure that our efforts are sustainable. And you have a set of strategies in the book for scaling and sustaining.

[20:52]

Talk to us about some of those long-term issues after we've figured out some of the foundational pieces. How do we go big and how do we stay the course?

[21:01] SPEAKER_01:

It is inevitable that the successful initiative, especially if you've promoted it and kept, brought leaders along with you, somebody will do what I call the all my children move, which is all my children should have this, and so spread it across the district or the region or the state or, you know, the world. And so, I think the first question that must be asked when the All My Children statement is made is, is this really what everybody needs? You can quickly, if you're scaling a program that shouldn't be scaled, you can quickly end up with a fail-to-get-smart crisis starting all over because when it goes from your ideal, you know, impactful situation to another school with...

[21:51]

perhaps different needs, different opportunities, different strengths, you know, that transplant of the initiative may not take. And so one of the most important things about the idea of scaling a program is to carefully plan the context in which it's going to end up. And then an equally important part of that is if we're taking this program or initiative and we're deciding to scale it up, Does it have to go exactly as is? And that's one of the projects I'm talking about that I mentioned a minute ago. That's a big part of the work we're doing, is trying to figure out, with this successful initiative in one district, what are the pieces and parts of that initiative that are non-negotiable? They are key to the result.

[22:42]

And what are the pieces that are open to context, modification, some customization, some tailoring, without taking away from really what it is that's making this initiative tick? I, one of the tools that's in here is based on the Pareto principle that I imagine many people are familiar with, but the old 80-20 rule that says, and again, these are rough numbers, but that 80% of the results are caused by 20% of the effort. As educators and especially school leaders, I think we can relate to that a lot in terms of what, in our day, the 80 versus the 20. But I think that's key when you are scaling an initiative is determining what are the pieces that are contributing most to the results we're seeing and then streamlining it to the extent that is possible in terms of making it scalable and

[23:39]

To use another term, transplantable to new and novel settings.

[23:43] SPEAKER_00:

Well, Jim, that 80-20 rule reminds me of what our colleague Peter DeWitt calls de-implementation. And you talk about the importance of subtracting and not just adding things. And of course, there are certain incentives, as we've talked about, to come up with new initiatives. How do you think about subtracting and de-implementing?

[24:06] SPEAKER_01:

I think, and of course, I'm a big fan of Peter and his book. Both of my books have a bit of de-implementation in them because I think it's something that, as leaders, should constantly be on our mind for any number of reasons, but I'll name two. First off, I think, as leaders, we need to help de-implementation redefine its bad rap. It's not always about eradicating something from the face of a classroom or a school. I think we think of, often think of, de-implementation in the extreme, whereas successful de-implementation often involves changes in practice. Not doing something and maybe implementing something else.

[24:52]

Or... just removing something with that 80-20 rule as kind of an analogy, removing something that really isn't making a big contribution to the overall result. And if we take the time to understand these initiatives and watch them in action and listen to the people who are involved in them, I believe that we can pretty quickly come to an understanding, at least tentatively, about the relative contribution of an initiative's various components. The other thing with de-implementation that I see happen a lot is if we've added initiatives over the years, there often is duplication of effort, where multiple initiatives are being implemented while doing ostensibly the same thing.

[25:40]

or similar things, and so de-implementation may be as simple as connecting initiatives together, which in some cases can result in less work for everybody. And honestly, a more straightforward conceptualization of what we're even trying to accomplish. One of my favorite people and mentors on the face of this earth said to me in a meeting once where we were, I was evaluating an initiative that she was running. I put the data in front of her and, you know, we were scratching our heads. And after a couple of minutes, I looked over at her and I said, what are you doing? And she just looked at me and she goes, I'm trying to correct the dots.

[26:25]

And she didn't even mean to say correct. Of course, she meant to say connect the dots. in the, like, the data to the initiative, but she was right. We needed to correct the dots, and I believe de-implementation, and especially the, uh, combining of initiatives, if that's what it's called for, is a perfect example of correcting the dots that lead us back on a more efficient path to impact.

[26:53] SPEAKER_00:

I'm glad you're mentioning efficiency and kind of the cost-benefit or the relative value of different things, because if we're talking about de-implementing something, it's not that it was a bad thing to do. We're not talking about stopping something that's harmful or that was a bad idea in the first place. We're talking about stopping or winding down something that just no longer fits, right? Just no longer is worth the effort because of duplication or because of a change in focus. So we're essentially abandoning a good thing when we de-implement in most cases, right?

[27:21] SPEAKER_01:

I always think back to the best examples of de-implementation and from where I understand it to have originated was in medicine. And in particular, pediatric medicine. And so think of all the things we've learned in medicine Say from 20 years ago, we no longer do, or even more pronounced, the further you go back. And so, those may have been very successful practices in the day that we now know more about, or they may still be, for instance, a drug that's successful, but there's a better drug, maybe less side effects, for instance, or maybe it works faster, easier, less harmful to the system. So that's how I think of de-implementation within the medical context when it's applied to education. These may be very wonderful things that in their day had huge impact and really helped move us forward.

[28:14]

But as we look at them today, are they still worth the same investments? So the book is Fixing Education Initiatives in Crisis, 24 Go-To Strategies. James Marshall, thank you so much for joining me again on Principal Center Radio. It's been a pleasure.

[28:49]

I always enjoy our conversations, and I just love talking to initiatives. It is my pleasure.

Bring This Expertise to Your School

Interested in professional development, keynotes, or workshops? Send us a message below.

Inquire About Professional Development with Jim Marshall

We'll be happy to make an introduction.