Carolyn Zachry: All right. Well--

Veronica Parker: Go ahead.

Carolyn Zachry: Good afternoon, everyone. I can't believe that we're actually talking about three-year planning already. It seems like it was just yesterday that we were talking about this and meeting at SCOE at those tables and the great training space. But now we're doing this training virtually and we're glad that so many of you are here joining us today.

So as we embark on this three-year planning process that Jennie's really going to walk us through today for you to remember the importance of this plan. This plan is not meant to sit on a shelf. It's really meant to drive what's happening in your consortium. It's meant for you to look back over the last three years where your successes, where areas that you need to improve upon.

And then also looking at the changing-- perhaps the changing demographics in your area identifying educational workforce needs. We will likely have some census data, new census data that you can use for this. And then to define and develop your strategies and activities so that you can meet those goals over time. Of course, this plan isn't meant to be written by one single person. It's really meant to be collaborative through your whole consortium.

And I would hope that in these plans, we'll see some of the impact of what we've learned during the pandemic. So perhaps more opportunities for student learning through hybrid courses or on-demand courses, or thinking about those students that have an impact for a day or two and can't make it to class. We could jump in on a Zoom. So I'm hoping that your plans will encompass some of those areas and some of those great skills that you've all learned and techniques you've all learned over the last-- oh, my gosh, 18 months now.

So again, good luck with your three-year planning. I know that this is not new to many of you and you're developing goals for your region and for the success of the students in your region, and that's the piece that's most important. It's now my pleasure to introduce the dean who is the interim dean for CAEP from the California Community College Transfers Office and that is Gary Adams.

Gary Adams: Thank you, Carolyn. I also appreciate Carolyn's excellent summary of the purpose for today. I won't cover that territory again since she covered it so well. I am gratified that there's so many community colleges that I saw in the participants that registered in the chat. We will be reaching out to you from the Chancellor's Office.

It is our intent to become much more involved in noncredit and the adult Ed areas. And we're working hard to be a good partner to link our network up and then also to join hands with our friends at the California Department of Education in getting this important planning done. And with that, do we turn it back to Neil?

Neil Kelly: Yes. Thanks, Gary. Next slide, please. I think Carolyn covered this, so next slide, please. All right, let me just quickly kind of remind everyone about the Ed code that supports the planning. Its Ed code 84906 (a) (1). And so it says commencing with '19, '20 fiscal year, as this language was put in a couple of years ago. As a condition of receipt of apportionment of funds from this program for the fiscal year, the members of the consortium shall have a consortium-approved three-year adult education plan that addresses the three-year fiscal planning cycle.

The plan should be updated at least once a year that's part of the annual plan process on available data pertaining to requirements of subdivision (b). And so what they go on to say about what they like to see in the three-year plan process they cite, they want to see an evaluation of need, evaluation of current levels and types of education workforce services in the region, and an evaluation of funds available to consortium members.

Then he less action items or activities they want to see that addressed educational needs improving member effectiveness and improving the integration of services and improved transitions into post-secondary education and workforce. So those are kind of the marching orders that the legislature gave us regarding three-year planning, and you will see that the template and the guidance reflect that. It's all based on the legislation. So next slide, please.

So today what we'll be doing with the small amount of time we have, I'll be walking through the template, as well as toggling back and forth with the guidance document. We have the CAEP TAP, as well as Jennie Mollica here to assist if there's any questions that come up or researched tips they want to add. But I'll kind of be walking you through really at a high level. And hopefully, we'll have plenty of time to answer your questions that you might have.

So with that, let's go on to the next slide, I think was the guidance document. But let me share a screen really quick. We first bring up the template. So when you get into the document and I'm going to skip through the overview. So the first thing you'll see-- and this is in NOVA. Let me just back up just a little bit. So what will happen in NOVA by the end of the year, this template that you see in a word document will be actually in NOVA.

And so you'll be able to start putting information in there, but it won't become available, I think until after the preliminary allocations are loaded in February. And so when we at the state load, the preliminary allocations from the governor's budget. That will trigger the three-year planning in NOVA to be live. Then once you do your CFAD on May 2 and certify it, then that will also tell NOVA, these are the certifiers of the three-year planning document.

So just to back up, so we have the template here that we're giving you that you'll see in NOVA. We have the guidance document that was sent out this last week. We'll be doing professional development that we'll go over at the end of this presentation today. For the next three months, we'll be doing professional development around planning and long range planning. And then by the end of the year, you'll be able to see in NOVA the same template that you're seeing today. And then you'll be able to start working on it.

I think by sometime in February, you can start inputting information in it. And then by May, I want you to submit that CFAD, then your members can start certifying that three-year planning document. Because the CFAD in May 2 will trigger who's going to be certifying that, so that tells the NOVA system who are the certifiers for the year. And then you have until June 2 to get everything in there and certified and submitted to the state. And then, on August 15, you'll have the annual plan that you'll have to submit based on this three-year plan.

And what will allow the NOVA system to do is take all those activities that you submitted in the three-year plan will be available for you to choose from in the annual plan. So next year come August, you'll be selecting from your three-year plan you submitted in June, the activities that you want to work on for the coming year. And then your member districts will have the same opportunity to select on the consortium level activities that you brought in from the three-year plan. They'll select the ones that they want to work on for the upcoming year and they'll build their budget and submit that to the consortia.

So it all kind of cost can't cascades and it's kind of a logical sequence. And so hopefully that makes sense. So with that, let's dive into the template. And so that first section, it'll be a lot of just basic information about the consortia. The one thing that you will have to do as an executive summary of your plan. So you might want to leave that towards after you finish the plan and go back and write that executive summary. But that's kind of the main part of the first section.

So when you get into section 2, it asks for an overview of your assessment. And so in a regional alignment and priorities. And let me toggle to the guidance document because we have some props here that we want to show you. Let me get to that right now. So here is the guidance document and if you scroll down submission date, things like that, overview of program areas, of course. Then here's section 1, of course.

But then when you get into section 2, the assessment and you scroll down to the first evaluation that you have to do. You have to do an evaluation. Evaluate the educational needs of adults in the region. So the guidance document has these prompts or questions guiding questions and resources. Now you can do it however you want and answer the question about describe and evaluate the educational needs of adults in the region.

So we listed these prompts here. There's a whole bunch of questions that guide you through evaluating need. And then to the right of the column, we have all kinds of resources and links that you can use. Now this is just a guide. You can do it however you want, but we're giving you some resources and guidance if you choose to accept it. There's all kinds of questions here. And then let me ask Jennie. Jennie, did you have any comments on this section as far as the guidance or resources?

Jennie Mollica: Sure, Neil, just briefly. Well, I'm Jennie Mollica, I'm with High Road Alliance. I was invited by CAEP TAP to support a process of collaboratively gathering some of these resources together. And I came to this work as someone who wrote three-year plans for the last two cycles and was very involved in planning processes. And I felt very aware that those processes look different from consortium to consortium. You'll know what makes the most sense for you to TAP what sort of resources who to have at the table.

And yet at the same time, there were some kind of basic resources that really can help all of our consortia to have some basic information about our community. To make sure we're making the very most of the data collection that's done in the state and the resources that CAEP offers, as well as some just general things you'll find on the web.

So what we did is through a collaborative process like I said of CTE's involvement, CAEP, WestEd, CASAS really coming together and thinking, what are some guiding questions that the consortium might want to consider as you look at the requirements for the three-year plan? And then what are a few links where you might want to get started? So this may just be the beginning for you or you might find that it's sufficient.

You'll find here links to things like the adult ed pipeline launch board, but also things that kind of take you beyond the world of CAEP to the US Census, PEAC. Some of these more general resources out there. And I think you'll see us as we move through-- Neil, I don't know how detailed you want to get in the questions and things. I think each consortium will want to really read those over and see what stands out as most relevant for your consortium.

But the attempt here was just to get you started with a few links that can probably spark your group's thinking. So there might be some data points here or some information that you'll be able to bring back to your consortium to use for discussion and really guide your thinking about the strategies and activities you want to define down the road. So this need identification section is really important and we tried to put an especially large number of links here along with these guiding questions.

Neil Kelly: Great. Thank you, Jennie. And just a reminder when the CTE and the Chancellor's Office and CAEP TAP and Jennie and the other CAEP vendors that we have. We also did a vetting process. We had a focus group from the field and then we also-- once we have the guidance, we went back out to field consortia lead and had them read this through and provide input and edit. So there was a real lengthy in-depth vetting process that we went through.

And so there's still a few things that we're tweaking and that we'll update as we go through this process. But for the most part, this has been a thorough process to get here, so we appreciate all the help and the input that people have provided.

So let me just scroll down really quick in the same section. It asks for evaluate the current levels and types of education services for adults in the region. And so what we mean by types are your program areas. So your ESL, your adult basic Ed, your adult secondary Ed, your CTE, your adult with disability, your K-12 success programs, and then under your CTE, we have workforce readiness and pre-apprenticeship and short-term vocational.

And so those are the types and the levels. So as you know, we have students that are come in. They get services, maybe they don't get the instructional hours. So in some places, we do track the zero hours. Sometimes, they get into a classroom. We track one hours or more. And then to get into our outcome pot, you have to get-- or outcome pool, you have to get to the 12-hour mark.

So the 12-hour mark of instruction is called our participant count. And so that would be the levels of education and workforce services. And so that's what we'll be displaying and then scroll down just a little bit more in the box. And so what we'll be doing is bringing in the data from launch board. And you don't have to do anything, it'll be pre-populated in NOVA. It'll show for each member district the-- actually, it will show by, I think consortia, sorry.

So it'll show by consortia the amount of participants, so that's 12 hours or more by program area. And then we added an extra feature. So once that is brought in from launch board, you will also have the ability if you have other adult Ed providers that don't report through launch board. You could still add them.

So let's say you have a library literacy program or a community-based organization or nonprofit, or a workforce board or county social services, and they're enrolling students in maybe an ESL program or a CTE program or something like that. What you can do is you can-- NOVA will give you the ability to add that provider, and then you just check the box on what program they offer. You don't have to have the enrollment numbers.

When you're doing your report, it gives you an idea of who is providing services in the region and then what type of service they're providing. And then we'll bring in for the CAEP members, we'll bring in the enrollment numbers from launch board. Then we have these questions when you're doing that evaluation. Like Jennie said, here are some more guiding questions with some resources that you can look at. And let me just scroll down there. We're not going to review every single one of those. But Jennie, did you have any additional comments to add or suggestions on section 2 on the evaluation of types and levels of services?

Jennie Mollica: I wouldn't get into much more detail and each one, maybe just a note that you'll see hyperlinks where there's an obvious resource to link to. In some cases, you'll just see some resources listed like, for example, the WIOA program implementation survey. That would be something where if you had access to that for your consortium, you would access it on your own. It's not just a link on the web. But it's noted there just so that you recognize that that could be a resource to you.

Neil Kelly: OK. Great. Thank you. And so then we get into section 3. And section 3 is the metrics, barriers and metrics because we're looking at CAEP metrics, as well as student barriers. And I'm going to toggle back to the template just to show you-- and because NOVA has this in a drop down menu, it's difficult to visualize this because we couldn't put all the choices in via a drop down menu because the template didn't have that capability. But let me show you what we did.

So let me share back to the template. OK. So let me scroll through-- so they're set types and levels of services that you'll see, but then you get into metrics. And so let me see. So what you'll have the opportunity to do at the consortia level, we have two mandatory metrics. One is a number of adults served. And so the definition on that is one hour or more of instruction or receive services.

So if that student-- so if you go in the launch board and look at the total count, that's adult served and then there's the participant count, which is 12 hours or more. So we'll be looking at the numbers of adults served, that's one hours or more of instruction or receive services and launch board will have the last three years and then you'll be projecting out or targeting the next three years of what you think your concern or see level will be and that will be a number.

And then when we look at student barriers to employment, we picked four that we thought were important that are tied to the funding formula for CAEP. And so yellow is the English language layer, when you have low literacy, low income, and long-term unemployed. And then the consortium, we'll have the opportunity to pick at least one. So you can pick all four, you can do three, you can do two, but at a minimum, you have to have one.

And so you'll see from the last few years what the percentage of students with barriers has been in these categories, and then you'll project out based on the one you pick. Your project out of what your consortia is going to look like over the next three years. Just scroll down a little bit farther to look at the member level. So then we have metrics at the member level. And we forgot to add there's two mandatory metrics for the member districts. The first one is adult served to become participants, so that's a 12-hour mark that we were talking about.

And so that set outcome pool, so we really want to focus on that at the member level. And then we're also going to have a mandatory metrics around percentage of funds spent. And so that would be your active CAEP funds only. And so we would be tracking-- the system would come in and tell us, OK, the last few years, here's the percentage of funds spent and so we would list all those active years. And then you would project out over the next three years what your annual percentage of funds spend down would be all active funds.

And so we want to track that because we know there's carryover legislation coming out in the near future. And so that will be something that we want to keep our eyes on. So what we're going to update this to show that percentage of funds spent so you'll have that in the guidance document.

And then you'll have the option, you don't have to. But if you want to, we have 10 additional metrics at the member level that you can choose. So you don't have to pick any of these, but if you're an eager beaver, overachiever, you can pick as many as you want out of the optional metric. We'll bring in the data and so how you did in the past and you project out your targets for the next three years.

And so I'll just quickly go down, so we have a high school diploma or equivalency. We have educational functioning level gains for adult basic Ed, for adult secondary Ed and ESL. And then we have transitioned to post-secondary, which includes CTE. We have participants that earned a post-secondary credential, participants that transition to post-secondary and, of course, we have the employment and earnings, second quarter after exit, as well as earnings metrics median change in earnings.

And then finally, we have the immigrant integration milestone, which is based on the course completion or achievement of an EL Civics COAAP, which is a civics assessment. And I forget the exact term of COAAP, maybe someone could put that in the chat, but that's through TOPSpro Enterprise. And so if you have the ability to use the CASAS form, and CASAS will be rolling out the ability to use your Civics COAAPs for all CAEP members this year. And so look for that in the coming program year.

And so you'll be projecting out those targets. It'll kind of look like this, but it's through a drop down menu. So this doesn't really do it justice, but you can kind of see. You'll have your actuals for the last three years and then you'll have your targets. And it'll kind of look like that. And then we'll update those targets every year when we get the data.

Let's see. OK. So let me go back to the guidance. So I'm going to go back to the guidance. OK, so there are some prompts here, not as many as the last two sections or evaluations. And so Jennie, did you have any key points here for the resources or guiding questions for the metrics section?

Jennie Mollica: I don't think there's anything more to add there, Neil. Thanks.

Neil Kelly: OK. Thank you. OK, so you can see the guidance. We kind of go through the whole process lay it out. A lot of details here to walk you through this process and then we get into objectives. So section 4 on objectives and section 5 on activities and outcomes are definitely linked. And so what will happen is and you've kind of done this before. The legislature gives us three areas or action areas to address.

So they want us to address educational needs, they want us to address improving integration of services and transition. And they also want us to address improving effectiveness of services. So just like if you go back to the old days of AB 86 and the certification of eligibility where we had things like student acceleration, transition, professional development, leverage funds, closing regional gaps.

The legislature didn't recreate everything. They kind of used stuff from the AB 86 days and the certification of eligibility document. And you'll see that in the legislation that drives this three-year plan. So there's a continuity there between the start of AB 86 into AB 104 into the CAEP program.

And so if you scroll through the guidance document, you'll see there's questions on prompts to help you come up with objectives to address educational need, and there's quite a few questions there. And we also have objective 2, Improving Integration of Services and Transition. And there's questions there and resources to help you. And then the third section, of course, Improving Effectiveness of Services.

And then effectiveness is going to tie back to the metrics and targets that you just set up in section 3. And so, for instance, one of the questions is, what needs have been identified related to improving the effectiveness of services. And you could go back to your targets because that's all about effectiveness, or you might have some other ways you're defining effectiveness in your consortia.

And so these are some questions that you can ask. There's a lot of resources out there around that. And then, of course, getting into section 5, it ties back so you have your objectives and how you're defining that. And then section 5, lays out those activities and outcomes. And so section 5, we'll give you the ability to put in and how they break it out is short-term, intermediate, and long-term and so you can group your activities like that.

But when you do your annual plan, you'll have the option to select any kind of activity, whether it's short-term, intermediate, or long-term because some members might be working on short-term stuff and another member might be starting in intermediate activity and somebody might be starting a long range plan, but it'll vary between members. So you'll have the ability to select those things from your three-year plan and work on them and to build your annual plan, which cascades into your member work plan and budget.

And so you'll be able to check the box to say, I want to work on this activity. That was listed in my three-year plan that is also in my annual plan. And as a member district, I want to work on that this year and here's my budget to support that. And so then that goes through the approval process of your member work plan and budget, gets approved by the consortia and then you start spending down your funds and reporting that through NOVA as well. And so I don't know, I probably didn't do it justice. Jennie, do you have anything to offer? Maybe I went too fast on this, but we'll check in with you.

Jennie Mollica: Neil, the only thing I would add is that on section 4, you see just a whole assortment of links there. And the idea was really just to support those leading the planning processes to support the group's inspiration and creativity and thinking about the strategies and activities. And really using this as an opportunity if good ideas are popping up to just see what resources are out there, what research has been developed, what reports are already out there.

Many of these links take you right back to the CAEP website, because it's a huge repository of great resources. And actually, just browsing around there will get you quite far. But here, we try to guide you around each of the objectives to a few resources that might be helpful. You'll also see links there to the new advancing California Adult Education website, which includes quite a few model programs and some research briefs.

But again, this is really a beginning to get you thinking and support you and bringing the group together looking at some effective practices and research based practices. So you may well want to go far beyond this or you might find that this is sufficient to spark that creative thinking.

Neil Kelly: All right. Thanks, Jennie. And remember, you're the ones that are going to be approving your plan. And so you're writing this plan for your use, not to get some blessing from some higher power. But this is going to be a useful plan that will drive that change in your region. So just think about that that you're not trying to meet a deliverable as far as like, oh, I checked that box, this is actually a plan that will be useful for you to guide you over the next three years. So we want you to think about that in that context. Let me see if there's anything else here.

So here are those short-term, immediate, long-term and you can describe that and you group those activities by that and you put the responsible person. You show what metric and student barrier it's attached to, so you have the drop down menu there. And then the last section is evaluation of funds. And so what that is is the same drill that you go through into NOVA when you do your program area and leverage funds reporting. And so they're actually going to take the data that you submitted in the prior year into NOVA and bring that over into the three-year planning document, and then you just do an evaluation based on that funds.

So you're evaluating the leveraged funds that are reporting to NOVA. And let me just read there to evaluate the funds available critically review this data on the prior year leveraged funds from NOVA and the program area report to anticipate and assess how well the available funds will be addressed the educational needs of adults in the region over the next three years.

And so we're not evaluating who got more than who or why this person is getting this. We're not doing that drill. We're doing an evaluation of how it's going to help the meet the needs or address the needs of educational needs of adults in the region over the next three years. So we want you to stay away from that discussion about limited resource, scarce resources and get into the weeds on who got more this and that. But it's probably not a productive discussion for this exercise.

And I think that is-- I mean, there's some other guiding questions there that, of course, you have the preview and submit. But there's a whole host of resources, tons of resources. And it's like another 30 pages I would think of resources all that Jennie kind of explain the purpose of the appendix here with all the additional resources.

Carolyn Zachry: So before Jennie jumps in on that, I also wanted to add in about the continuous improvement plan. So all of the agencies that are WIOA Title II funded, you all had to do a continuous improvement plan. The hope is that you will bring those and share those within your consortium because you can align some of your goals from your SEAP into your three-year planning document. Just so that there's some continuity there, so you're not feeling like you're doing two different plans. So use your SEAP as another resource. It's one of those added resources that Jennie is going to share with us now.

Jennie Mollica: OK. Thanks, Carolyn. Yes, we moved quite a bit here into the appendix because the guidance document was getting heavy with so many wonderful links. But what we've done here, which hopefully you'll find helpful is group things in a few different areas. So appendix A is all your resource links related to the adult education pipeline.

Many these are links that you have seen before, their webinars you've seen before, their links you found on the CAEP website or in the newsletter. But here you'll find them compiled all in one place in an effort to make it as easy as possible for you to get the most out of the dashboard that could possibly benefit your planning process. So there are a lot of-- there's a link to the dashboard itself, and then there are some overviews of the basics, some cheat sheets.

There are also going to be some new resources that are just now being developed. So you'll want to be keeping your eye on those CAEP newsletters or on the website to see the resources in each of these areas where it indicates coming soon. Fortunately, for you though, there is here a little brief description so you'll be able to-- Neil, I'm still in appendix A, I don't know if you want to just sort of highlight that. There are these noted areas where something is coming soon.

You'll probably want to read over the brief description there, so you know to put a placeholder in for looking at those resources once they become available, they'll be really timely. I would say, yeah, there are a few other links here at the end that are sort of generally about using these data reports. I won't go into more detail there because there's lots for you to explore.

Appendix B now if you do want to scroll a little further, Neil. So this is meant to be your concise summary of resources coming from CASAS and TOPSpro Enterprise. So there are a few links here with some nicely organized bullets telling you what you can explore further there. So there are specific reports, and then toward the end there, there are some links to webinars. Like I said, you may have seen these already, but the idea was to bring them all in one place for easy reference.

And then if we scroll down to appendix C, here is meant to be a few other more general resource links along with a number of definitions. So whereas the main body of the document gives you guiding questions and resources, specifically related to each of those sections of the plan, as you move through NOVA and complete the plan. Here you'll find some other additional background all gathered together in one place.

So there on the screen you see some general guidance and support. You'll have the link to Ed code there in case you need to reference it, some general planning resources definitely worth browsing through those. And then we do go section by section with some of these definitions and general resources. So for example, the section on assessment will give you the definitions of WIOA if you want to look up your-- oh, this is actually the section on other plans.

So being very clear about which of those other plans that might be guiding your region that you would want to look for. And then some definitions related to those. So the definition of WIOA with definition. Many of these coming from Ed code or from the federal level definitions of what is meant by educational need or by your consortium members, just to have these all in one place.

And I don't think I'll go through section by section, I think each of the sections has a few of these links often organized around definitions. You'll see the tables that have definitions and then some resource links to back those up. And that's consistent all the way down through section 6.

Neil Kelly: All right. So I'm going to stop sharing and see if we had any questions. We have about 15 minutes or so. And then before we closed, I want the TAP to come back and share the professional development calendar that we have for three-year planning that will be happening this coming month and into October. So Veronica, Holly or Mandeley, did we have any questions? I wasn't monitoring the chat because I was having to multitask with the screen sharing.

Veronica Parker: No worries. There were several questions. The first is more like a comment than a question from Allan. He says it would be interesting to have planners describe emerging careers in their respective regions and/or the global market.

Neil Kelly: Great. Thank you.

Veronica Parker: And then there were several about NOVA and the template and the ability to add a formatted three-year plan, which I answered those. And then moving into question specific to the guidance from Kirsten. Our members wanted to know if the barriers to employment matrix will include standardized definitions or does CAPUs WIOA definitions.

Neil Kelly: So we use the federal WIOA definitions, and that'll be our standardized definition so it's consistent.

Veronica Parker: OK. And Allan asks, for employment and salary gains, are there a variety of research techniques to address these key issues?

Neil Kelly: So there's quite a few resources that you can use or you can access other ones. We saw through TOPSpro, we do the employment and earnings survey. And then through launch board, we have the base wage file. And then through community college, we have the noncredit-- what is it? Employment survey. And so I'm sure there's other data resources out there that can get an employment number. So there's a variety of resources you can use.

Just one thing to state. So if you wanted to develop a more comprehensive plan with graphs and pictures and other additional items for your local board or your stakeholders or your public officials. So NOVA, you'll have the ability to download an HTML what you've typed into NOVA. And then you can save that and work on it separately and use that for local purposes, whether it's presenting to a public official, your superintendent, your stakeholders, your consortium board, however you want to do that.

But just at a minimum, you just have to submit for the state's responsibility and deliverable. It's just what you type into the text boxes into NOVA, if that makes sense. OK. Sorry to interrupt, Veronica, were there any more questions?

Veronica Parker: Yes, there are. Michele asks, can you say more about how to set targets for barriers? For example, how do we set a target for low income or low literacy? Is it good to increase these numbers to serve more students or decrease these numbers to help more students, or are we just predicting the number we think we will have so we can address needs in our activities not clear about targets for barriers?

Neil Kelly: Right. Yeah, I think we're going to have some guidance on that, maybe some webinars coming up. But I would say, as your enrollment goes so goes your student, number of students that are showing that barrier. Because we know most of our students come with some type of barrier, whether it's a language barrier, an employment barrier, literacy barrier, things like that.

And so I don't know if you can control that, but if you do outreach and marketing, I would assume the more students you get in. Maybe your percentage is going to go up a little bit. I'm not sure how that works. And this is the first time we've been kind of setting targets on barriers, so we'll see how this goes. But we'll definitely set up some workshops and provide additional guidance on that. It is a little tricky, I must admit. But it's the first time and you're not going to be penalized for if you set your targets and it's off or anything like that.

And let me say that for all of the targets. They're targets. So if you don't meet your targets, there's no penalty. It's not related to your funding. And so this is just to give you kind of a roadmap of where you're going to start looking at the data to plan ahead for the next three years. So I'll pause there because we probably have more questions.

Veronica Parker: All right. Serena asks, how would you address the section? I believe she was referring to the leverage funds, I believe. But she said, how would you address this section if the instructional hours and budget bill reporting was done incorrectly? For example, one member and put it all potential hours for offered programming rather than actual hours.

Neil Kelly: Yeah. So the information from NOVA is just a helpful resource. If you want to put in something different that you think is more-- is better data quality, you can go ahead and do that. You don't have to automatically put in the information from NOVA, or when you do the evaluation, you can explain that. You have enough room in the text box to maybe explain that data.

And so I think you have flexibility in that of-- or you can go back in and correct that into the program area report because you'll have that opportunity starting what? September 1, your estimates are due in NOVA for your program area report and leverage funds and then your actuals will be certified on December 1. When you do your three-year plan, you'll actually be looking at the-- I think, yeah, it'll be the 2021 year of program area.

And so you'll have the ability now this fall to-- in Serena's case, upload more accurate data. And so even if the data still is a little wonky, you could explain that in your evaluation on that. So you have that flexibility. I hope that answers the question.

Veronica Parker: OK. And the next question is from Allan. Well, ultimately the higher ups commit to incentivizing outcomes.

Neil Kelly: We haven't had that discussion. So I can't say, yeah or nay on that because it's not tied to incentive in the legislation. So that's probably something I don't know that might take place in the future, but I haven't seen anything on that, so sorry.

Veronica Parker: All right. And Marina asks, for community colleges, a non-WIOA community colleges, is there a way to report on services? She doesn't think MIS is capturing or reporting service hours, is that correct?

Neil Kelly: That's correct. Yeah, we don't have the ability in COMIS to track services and the hours. I thought there was a way-- I don't know. We'll have to maybe on one of the follow-up webinars that we have with related to COMIS, we can try to address that. But I think there are some drawbacks to reporting services in COMIS, at least for the hours. And so it's probably-- I don't want to sound like an expert because I'm not too versed in how that works. But we definitely will have webinars covering that. So sorry if I didn't exactly respond to that question.

Veronica Parker: Right. And then the rest of the comments are expressions of gratitude and colleagues helping one another. All question just came in. Can you remind us when we can access this meeting tape on the state website? Some of our members registered, but the link went to spam. So it takes our third party vendor a few weeks to get it back to us remediated.

So I would say at least three weeks. We're three weeks out from this recording being remediated. But as soon as it is made available, TAP we'll send to all consortia leads members and everyone who registered for today's webinar, so everyone will have access to it. We'll also posted on the website and will be included in the newsletter for future reference.

Neil Kelly: Right. And then we'll also add in that member level metric that's mandated related to percentage of funds spent. So we'll also put that in there. So Veronica, do you want to share the professional development calendar related to the three-year plan as we're getting to the end here?

Veronica Parker: OK, did you state that question from Ryan?

Neil Kelly: No.

Veronica Parker: OK, so Ryan is asking, what is the current ALO perspective on the adult Ed in key data points they are focused on?

Neil Kelly: No, no I don't have regular conversations with ALO. So we'll see during the hearing process if those kind of questions come up or this fall when they're going to put the budget together for the next year what kind of questions we get. But right now, we haven't had any dialogue with ALO and adult Ed.

Veronica Parker: OK, and one last thing, Gary has requested the community college personnel at your name college and contact email, phone number in the chat. And I will go to sharing the PowerPoint, which highlights the upcoming professional development that will be offered. All is also included on the registration website. So starting September 1 next Wednesday, we will have the planning mindset.

And so this particular webinar is just to prepare all of you on undergoing this three-year planning process. So we want to just do this webinar to help with the planning mindset and kind of get you in gear to start the planning process if you haven't already done. So if you have, then it could be kind of a reaffirming process.

And then every Wednesday after-- starting September 1 every Wednesday, we will offer a PD webinar on the three-year planning process and then September 20 through 24 is the Directors' Event Week. We have taken the directors' event as a day as we know it into a week and, again, is focused on the three-year planning process. So on September 8, we will have the consortium program, quality self-assessment. And again, that is just to go over the program assessment that we have made available to all of you, as well as connect other self-assessment tools like the WASC, the CIP, et cetera.

And then on September 15, we will have a webinar on the building sustainable collaborative partnerships. And that is with a colleague out of Pennsylvania State University, KayLynn Hamilton. And again, that is just going through how to build a sustainable collaborative partnerships as you're going through this three-year planning process. So for each of these opportunities, we have provided the title, as well as who's going to be providing the webinar and the date and time. And again, all of these webinars are now open on the registration website.

And then on September 17, we'll have the CAEP Program Evaluation 101. So that's just going through the basics of program evaluation, and so this will be an introduction to terminology and concepts of logic modeling, as well as strategies and examples that you all can use to develop your smart objectives, your smart goals in short-term, intermediate, and long-term outcomes. Then we'll go into the Directors' Event Week, again, that's September 20 through 24.

And on September 28, we'll have a welcome to the CAEP Directors' Event Week from the CAEP office. And so they'll be providing updates, as well as kind reiterating what we're covering today in terms of the three-year planning process and the implementation phases. And then we'll have two days worth of program evaluation, one will be based on CASAS and TE program evaluation.

And then the other one is going to be based on the community college site, so that'll be provided by WestEd and they'll be going over program evaluation using the MIS data. And then other ways to collect and analyze your consortia demographic and program data.

Then we'll have on September 23, which is not necessarily a part of the three-year planning process, but it is going to be a part of the directors' event. On September 23, we will have the new consortium lead on board training. And so those of you who are on the call today, if you are a new consortium lead or you've been in the role for three years and you would like kind of a refresher in terms of onboarding tools and resources that are available to you. Please join us on September 23.

The registration link for that actual date is on the website. And then September 24, we'll have goal setting and targets, as well as community asset mapping and then we'll roll into our Wednesdays again. And on September 27, we'll have a webinar on logic modeling. And then on October 6, we'll do a live demonstration of the NOVA system and input in a three-year plan in the NOVA system.