Veronica Parker: We're on. All right, so next slide, please. So today's agenda, so we'll be covering the purpose of the three-year plan, providing a high-level overview of the purpose, taking every opportunity we can to reiterate that, and then providing a high-level overview of the three-year plan guidance and the template.

We did have a kickoff webinar back in August when the three-year planning guidance and template were released, but we'll just cover just a high-level overview and mainly honing in on the mandatory metrics section of those two documents. And then after that, we will move into the CAEP data for mandatory metrics.

And that's where I will turn the presentation over to our colleagues at WestEd and CASAS, and they will go over how to use CAEP data and TE as well as LaunchBoard and other resources in order to set those targets for the mandatory metrics. And the CAEP funds projections, we will have a webinar next week in NOVA-- excuse me, on the three-year plan in NOVA.

And at that time, we'll cover those funds projections because you utilize your NOVA information in order to set those. And then, we'll have a Q&A section of this webinar and then we'll talk about some upcoming professional learning, networking, and other resources that are available to you for your planning of your work through the three-year plan process.

So next section, please, or next slide. So the purpose of the CAEP three-year plan, here is the purpose statement that is listed in the documents. I will not go over that word for word, but just to highlight a few key areas. So the plan, as you all may know, will let the readers know what's happening in your consortium and what the consortium's future plans are to address the needs within the region.

The plan will highlight the three-year plan, the consortium-- excuse me, past three years' successes, areas of improvement, and the changing demographics. In the region, the plan will identify educational workforce needs. The plan will define and develop strategies and activities to meet goals over the next three years.

And then the plan is an opportunity to have a collaborative engagement across the consortium, so all members and partners working on this plan together. The purpose of the three-year plan, next slide, please. And then we go into the Ed Code. So the Ed Code is listed on this slide. Again, I will not read it word for word but just point out a few of the highlights.

So part of the Ed Code, the plan will evaluate need within the region. It will identify the current levels and types of education and workforce services provided to adults. And it will evaluate the funds available to consortium members. The plan will have actions needed to address educational needs. And then the plan will hope to improve member effectiveness as well as integration of services and transition to postsecondary and the workforce.

Next slide, please. So now, we're going to go to the actual guidance document as well as the template and talk about a few sections in there. Again, this is just to provide the high-level overview and kind of the reminder or a review of what was covered in that August webinar-- that kickoff webinar-- with Dr. Carolyn Zachary, Gary Adams, and Neil Kelley.

So we'll transition over to the guidance document and display that. And while we are transitioning to the guidance document, I will post a link to the actual guidance document. By this time, most of you, if not all of you have access to this document, but just in case. We want to provide the link to it now.

And Mandilee, if you can add that. Thank you. All right, so this is a three-year plan guidance document. I have posted a link to the guidance document in the chat. So if you do not have access to it, there's your access to it. The guidance document, it was released in August of 2022.

And it's a 30-page document that outlines the three-year plan starting with an overview of the three-year plan and different agencies' role as well as partners', et cetera, included in the three-year planning process. And if we scroll down a little bit, it also covers the actual three-year planning process, including the Ed Code associated with it.

The next portion of it goes through each of the sections and provide instructions for each of the sections, so the sections of the three-year plan, an overview of the three-year plan The assessment section, metrics, objectives, activities and outcomes, and the funds evaluation section.

And more information about the different types of data that you can use to support the three-year plan and the targets. And if you need technical assistance, definitely contact TAP.

And then it goes through-- it talks about the submission format and timeline. So for the first time ever, the three-year plan will be submitted in NOVA, and again, we'll cover what that looks like next week on December 8. And so we haven't registered for that webinar. We'll post a link so that you can register for that webinar next week December 8 beginning at 12 o'clock PM.

And the three-year plan, so it's not going to be available in NOVA until the CAEP office uploads to 2022-2023 allocations in NOVA. And then that will populate the three-year plan for you to begin inputting your information. And that will be done by February 28, 2022.

However, the template, you will not be able to submit the three-year year plan in NOVA until after the May 2nd CFAD certification. And so what's going to happen is once the CFAD is certified and all member representatives have signed off on the C CFAD, then it will populate whom the signers will be for the actual three-year year plan.

And so after that May 2nd deadline is when you'll be able to submit and approve the three-year plan in NOVA. And you will have until June 20, 2022, to submit your three-year year plan. And then it talks about some events that had taken place. And then it goes through the objectives.

And so we'll scroll to the metrics section of this document because, again, we are here to talk about metrics. And so within that section, in the section 3, the first link that is included in this particular section is a link to definitions. So each of the metrics are defined. And when you click on that link, it'll take you to the bottom of this document, which is page 27.

But we'll just go to actual section 3. So keep going, and it is coming up. Keep going. OK, here we are. So this is section 3 of the metrics section. Again, there is a document that's included as a part of this overall guidance document. It starts on page 27, and it'll give you definitions and resources for the metrics.

And then, it'll go into each of the types of metrics that you'll include including your three-year plan, starting with the CAEP barriers and metrics. And for each of these sections, you'll have a description of the metrics, what the metrics are, and some associating data that you can use.

And then the next section are guiding questions and resources. So for this particular section-- I believe there's only one guiding question. But it actually-- which barriers and metrics should we track to best measure the impact of our consortium's adult education services? So that question is provided to start the thought process of the different barriers and metrics that you should use to best track.

And then the next column over provides the data sources and other resources that are available to you-- to help you begin to set your targets for the three-year plan. And if you scroll down to the next page, it goes over the consortium-level metric targets, and what each of them are, and the associating data, and then the member district-level targets and what each of them are and associated data.

So we will go to the template. We will go into more detail about these different metrics. So if you can pull up the template-- and the template was again released in August. And it's a Word document. If you haven't accessed it already, it's a Word document that can be utilized to actually start inputting your information if you are ready to do so at this time.

But again, you will input everything into NOVA instead of uploading it like we had done in prior years. So if you want to scroll to section 3, Mandilee, that will be wonderful. So in this particular document, especially for the metric section, one thing that we want to call out is that in Nova-- and we'll look at this next week when we go through the Nova process-- but you have dropdown menus that will have each of the metrics listed.

But for here, we just have them listed in a table format, since we aren't able to do drop-downs inward, or at least we don't know how to up until this point. So section 3, again, provides you with a little bit of overview of what the section will be and the associated data. And then if you scroll down to the actual table, it outlines each of the metrics that you are to include in your three-year plan.

So starting with the consortium-level metrics. So there are two consortium-level metrics that are to be included. One being the Number of Adults Served, so that metric includes adult [audio out] obstruction, or receive services, and then the barriers that you are to identify.

And so CAEP have already identified four barriers that are associated with the funding for CAEP. And so those are ELL, low literacy, low income, and long-term employment. And so the consortium will pick at least one of the four metrics to include in the three-year plan. However, the consortium has the opportunity to pick up to four.

So if you want to address two, three, or even all four, you are able to. But you have to address at least one in your three-year plan. And then in NOVA, you will see the percentage of students in this category for the last three years, and you will project or set targets of what the consortium will look like for the next three years.

And so the next set of metrics that the consortium are to include are at the member level. So these are the member district metrics, and the first two being mandatory. One is the percent of funds spent, so that's active CAEP funds only to be included. And the NOVA system will show the percentage of active funds spent in NOVA.

And then the member will project the percentage of active funds spent down over the next three years. So all active CAEP funds and only CAEP funds. And the next metric that the member district will address is a mandatory metric. That's adult served who became participants, so those adults who meet the 12-hour mark and are a part of the outcome pool.

And then there are 10 additional optional metrics at the member level. Each member have the opportunity to address any of these 10, and so those are participants who are in a high school diploma or equivalency, participants with EFL gains, ABE, or participants with EFL gains, ASE, participants with EFL gains, ESL, so on and so forth.

And if we scroll to the next couple of pages, you'll see all of the optional metrics. There are notes associated with each of these metrics that will describe the metrics, so descriptions are provided, and then supporting data that can be used for these particular metrics in order for you to set your targets.

All that I have for this particular section, again, it was just to be a high-level overview or review of what was presented back in August. And so I will now turn it over to Blaire with WestEd who will get started on the WestEd piece of this presentation. Blaire.

Blaire Toso: Hi, welcome, everyone. We're delighted to have you here. And we are going to focus on the primary resources where we will help you find and identify the metrics that you are looking at and determining which ones you're going to use and then also ways to analyze and apply some thinking around how you might want to identify, then go about conducting the needs assessment.

So next slide, please. So first, I'd like to welcome my colleagues on here Randy and Jessica. You know Randy and me. We've been on several of these webinars. Jessica is new to our team and we're really delighted to have her here. I'm going to have her just come on camera, say a few words.

I think she'll be very useful in-- because she knows the system from the inside out. She's had experience with consortia data, TOPSpro, enterprise data, MIS data, and she has also served as a researcher for community college. Jessica.

Jessica Keach: Thanks, Blaire. Hi, everyone. My name is Jessica Keach, formerly Jessica Noel. I was with Southwestern Community College District before I joined WestEd a few weeks ago. So I'm really excited to be here. Like Blaire said, I had experience with our Adult Education Consortium as well as MIS data. So I'm excited to be here, and I look forward to working with all of you.

Blaire Toso: Thanks, Jessica. And I just want to note that I'm going to do the primary part of this presentation, but then I have to leave to go to another presentation. But Jessica and Randy will both be on in order to answer questions and dig into work or the questions that you might have. Next slide, please.

So just to reiterate what Veronica was talking about is and highlight the key components that were covered about, the purpose of the three-year planning, it's inclusive and collaborative process among your consortium members. It's a guide for over the three years. So when you're looking at setting it your targets, I know you get to go back and revisit them each year, but thinking long-term as well as just in the immediate that you're conducting an assessment-- needs assessment.

To determine both what you're currently offering and what you might want to offer in order to provide education and workforce services for adults. And then to identify some actions that you're going to take. And so we hope that we have created some resources that will support you in this process. Next slide, please.

So the first thing that you do-- how do you set your targets? And where do you start? And what do you want to do? And so like all of these questions. Do we want to increase the number of serve? Do we want to highlight identified populations? And one of the ways we're going to talk about is, how you want to go about this.

And we suggest that you look at your data and then make a decision as opposed to coming at it with an already formed question, so going sort of take that perspective of it. And if I'm fast, then we'll get to the data equity walk, which will help guide that process. Next slide, please.

So as I said, I think that we are all determined to use the data to inform our decisions. And we always think about data in three different ways at WestEd. There's the Interesting data, which helps us to notice that something's going on. There's Useful which really highlights structural issues and trends. And then there's Actionable data, which really helps to guide our decisions. It tends to help us answer the what and the why.

So we really reside in that interesting and useful, which will help provide some context and begin to answer some of those questions. But it's important that when we're talking about the data and the resources that we're using, you'll see where are-- we talk about the data and then we say and now push it a little bit further, and we'll provide you with some strategies for doing that so that you can look at what's happening.

So here are some of the highlighted and primary tools and resources that we have developed for this three-year process and ongoing and across the years. Today, we're really going to talk about the first three, which is the adult education pipeline dashboard. We'll show you the guide to using the adult education pipeline data, and then the CAEP fact sheet, which is also accompanied by a how-to guide.

The other three, the regional education workforce dashboard, the low-income policy map, and the ACS county commuting patterns, we'll cover in a deeper webinar, but they are important to be able to dig into those pieces. Up front, we're going-- this is a really quick overview. We have roughly 20 minutes given to us.

And just know that we are preparing longer webinars, and we'll also be developing some extended professional development, where we can really begin to walk through some of these resources and people can get their hands dirty and do some activities. So here is what we lay out sort of as a basic four-step process to guide your thinking as you begin to refine your targets and design the-- and make some decisions around what you want to offer or what you want to put in your three-year plan.

And that's the document. What's going on? Who are you serving? That's like, what's currently happening? What's needed is looking to the future and identifying successes and challenges, I mean, probably those gaps where you might want to go by asking, what's actually going on in our consortium?

And then, there's the gauge like, what are your community needs, what are your partner needs, bringing in that broader community of stakeholders. And then lastly, identifying the goals and then determining what you want to do, so the analysis to identify that. Slide. So we're going to get started with adult education pipeline, which offers a comprehensive look at your consortium data.

I think most of you already know what the adult education pipeline is. It really is key to offering you all the metrics you need for your three-year plan. And we also have designed it to provide drill-downs that allow you to explore aspects of your data, such as equity by gender, by age, by race, ethnicity, and also by program.

In other of our webinars, we would do a walk-through, but we're just going to just call that out and then identify a few feature resources that you can use to dig in. Next slide, please. So Veronica went over through those metrics, the four that you all need to address. We have created this resource, which is-- it's a very simple, straightforward.

It tells you the metrics that you need to address, and then where exactly you find them on the dashboard. I will pop a link into the chat so that you can access that. So that will list out exactly where you find those metrics on adult education pipeline as well as give you some strategies and some thinking questions to guide you through your three-year planning. Next slide.

The other thing that we think is really important is that the adult education pipeline allows you to really drill down into some of the-- to refine your thinking about the people who you're serving and what their outcomes are. And so we put together an infographic that explains how to use the filters on the adult education pipeline for the different metrics and how to begin to refine that.

So you're not just looking at a collective group, but you can drill down into the gender, race, ethnicity, as I said, and then student type and program type. And this really helps you be able to think more deeply and refine your thinking as opposed to just saying, oh, we're serving the Latinos really well.

Well, are you serving all Latinos? Or are you serving a subset of that? What is your-- what is the purpose? And who are you really serving, and through which programs are you serving them? And I will pop that link into the chat as well-- hang on, one second-- so that those resources are accessible.

And I'd like to mention that these are all on the adult education resource library through CAEP. And there are a host of other resources that we'll include how-to guides if you're looking for coding, if you want to have an overarching orientation to the adult education pipeline that aren't just looking at equity or they aren't just focused on the metrics. There are a lot of resources in that library.

I would take a moment to browse in through there. They're all downloadable and accessible and straightforward. So they can help guide you in other aspects of planning or orienting to some of the aspects of the adult education pipeline. So then, let's talk about the CAEP fact sheets, which is something that we have revised.

There's new updated data, and we've added some additional components to that dashboard. And most of you should be familiar with it. I will go ahead and pop that link into the chat as well. Well, it'll take me a minute. I must have dropped it out. While I'm talking-- all right, I'll pop it in a minute when I'm not trying to negotiate presentation at the same time. I apologize.

I thought I had it up and ready to go. But the CAEP fact sheets are-- we expanded them. And we'll walk through these for the four tabs and tell you a little bit about them. I did want to call your attention to that we have developed a how-to guide, which you can access through that question mark, as you can see within the red box.

If you click on that, it'll be dropped down and the how-to guide will be right up front there. And the how-to guide will provide you with the background information. So for example, I have a screenshot there that we'll talk about the key elements and what you can expect to find on the different tabs.

And there's some general information about how to use that, how to use each of the tabs, and what the information is, how to use the filters, as well as it'll provide you with some case scenarios, which you'll really be able to see how those are-- the contacts, there are contacts-different scenarios so that you can help analyze and make decisions based on the data that you have, that you're able to access through these pieces.

So the walk-through on the CAEP fact sheet, so we have the first tab is one that you all are familiar with, although the look is a little bit different. Tab 1 is your consortium demographics, and this is on the ACS data. I would like to say that currently it is the '15 through '19 ACS data.

We will be updating this in December as soon as the census data is released. So it will be updated into the newest-- into the most up-to-date demographic information. And as I said, that's supposed to be released in December. We're keeping our eye on it. And we have an analyst and our Tableau person ready to work through that.

Each of these pages are filterable by your consortium, so you can drill down. We're showing the statewide data, but you can look for your own consortium data for each of those. And really, if you take the top at a glance, these are your different population characteristics, which will-- once you click on them, you can filter to align to the target metric.

So for example, this one that's showing here is the overall population. But you can also look at and click on Adults With Disabilities, Foreign-Born, Limited English, Near Poverty, High School Attainment, Unemployed, and Disconnected Youth. These are key, and they align with some of the key metrics that you need to address. Once you click on one of those, the data refreshes and will show you just the information for that demographic, which will really help you identify areas of sub-service.

Tab 2 offers you a snapshot to quickly view your key demographic points on your consortium as compared to who you serve in your consortium. So on one side, we have that ACS data. The other is the data that pulls directly out of the adult education pipeline. And you can, again, filter that using those bars on the right-hand side, so you can look at some particular groups within your adult education pipeline data.

I will say that while this is new and we think it's a great add, it also is one that you'll want to go ahead and once you've identified some of these pieces, you'll really want to dig into it on the adult education pipeline, as I said, using some of those equity drill-downs that you can really think, have a more refined look at what's going on in your adult education programs.

So one of the reasons why we put these up here is because using these two data sets, you can ask questions, such as these that we've got on the slide to set your targets or hone in on some of your targets like, who are we reaching, who aren't we reaching, and then compare, are those learners representative of the most in-need of our consortium demographics.

And then-- and maybe you are, but how well are they doing, so you look at the in-need population and you look at the outcomes. And then from there, you can choose what kind of metrics that might be available, that you think would be important for your consortium to address. Next slide.

One of the things that we know that everybody has been working on is on transitions. And so we pulled out transitions to postsecondary here. And this is tab 3. Again, you can also use the filters there to look at more distinctly. But we wanted to help you see what kinds of transitions are being made and who is making them.

And this is a side by side view for a quick comparison. You can see the categories on the screen. And this will help you to more easily identify gaps and successes. And I did want to be clear that when we're talking about identifying targets, that will be-- they will be-- sorry, I totally got distracted by the question that popped up in the chat.

Yes, we will send an email once the CAEP fact sheets are updated, so thank you for that. That's a great question. So we'll get that posted probably into the CAEP newsletter. What this transitions will help you do is, look at them, dig into them, and then prompt some questions as you look at them as a full set of data.

And this is informed from the data that's on the adult education pipeline. So what we've done is drawn those in so that people can begin to see the consortium demo information next to your adult education um outcomes. Next slide. Lastly, to focus in on those workforce needs as part of your plan, we have an LMI Data tab.

And this will help you not only just identify what your community's needs are, but we also in the how-to guide prompt you how to think about-- how do you want to identify your targeted services, how do you want to create possible pathways that will help support those transitions either into employment or thinking about higher levels of postsecondary education.

And you can. The filter's up on here on the right-hand side will allow you to look at educational level, what experience is needed, and then whether there's on-the-job training.

And this is really to refine that. The lower piece really helps you think about the cost of living and living wage jobs so that you're not simply-- if you're thinking about one of those isn't necessarily a living wage job, this will hopefully prompt you to think about how those pathways will be able to be structured because you do have the ability to long-term plan across these three years

Any questions thus far? Super. All right, so next slide, please. Can we go back just one more? Sorry, Jessica, I didn't notice that it would already switch. You're faster than my brain. So this, we have not-- this was a board that one of our analysts created, where you can really dig into some more refined comparisons by consortium, by a select demographic, or a subgroup.

It is not part of our CAEP work, but we think it's important to share. And there are different ways that you can look at educational attainment. And there's really, for example, here are the barriers, which we know is one of the mandatory metrics. You can really begin to look at what's going on there.

And we particularly hope that it will offer both a side by side as well as a way to think about different populations and categories within those populations and to refine your thinking about, when you're setting a target who do you really want to target and be specific about those strategies that you're going to be able to come up with.

Ryan Whetstone: Blaire.

Blaire Toso: Yes, sir?

Ryan Whetstone: Was that one in LaunchBoard?

Blaire Toso: No, that one is not in LaunchBoard. That is work that WestEd did, not funded by CAEP. It was just when we were looking at some of the data and preparing both the LaunchBoard and particularly the CAEP Fact sheets, we thought there were some really interesting trends. But it wasn't part of the work that we were contracted to do. So that is really currently-- it's a set-aside.

Ryan Whetstone: Do you have a link to that?

Blaire Toso: But it's public. It's available to everyone to look at, but it's really quite interesting.

Ryan Whetstone: You have a link to that data set?

Blaire Toso: It is embedded in that AEP data story. Let me see if I can pull it up really quickly.

Ryan Whetstone: OK. OK.

Blaire Toso: Ryan, how about this? When I hand it over to Jay, I will post that link in there.

Ryan Whetstone: All good. All good.

Blaire Toso: OK, Thank you.

Ryan Whetstone: I just know. I wasn't familiar with that one.

Blaire Toso: No, it is brand new. And we have not really discussed it in any of our webinars. As we do something a little bit more about digging into it, we'll go into it further because there are some really interesting ways to use it. It's not necessarily the most intuitive, which is one of the reasons why we're just doing the brief overview.

But I really think it provides some important information, which is why it's plugged in into this webinar. But I will get that as soon as I get off screen and do that.

Ryan Whetstone: Thank you.

Blaire Toso: I just have few more slides. Yeah, absolutely. Yeah, it is interesting work. So I wanted to just talk a little bit about-- we talked about an approach. And so-- and coming at it instead of with an already set question is to use a data equity walk. And this will be something that we'll do more interactively in one of our longer professional developments.

But I did want to overview it for people who may not be able to attend that, have the time. But it's just a way to think about it. And this is really out of the work from the Education Trust-- West. And we have included a link to their toolkit if you want to explore it further. But it's really relevant for focusing on individual and collective exploration.

These are activities you can do within your consortium with your members, even if you're just working with your staff in an institution to explore things this way. And it's really relevant for exploring and discussing equity gaps, disparities. So I'm going to take you through it really fast. I think I'm coming to the end of my time, so let's go ahead and move through this.

So for example, what you might want to do is start with just looking at your demographics on the CAEP fact sheet on that first sign-- the first ACS page. And you would start looking at your data, for example. Just like looking at this and thinking, oh, look at that data, and who could benefit from adult education services. And Lori, I'll touch base on your question in just a sec.

Next slide, please. And then, you think, oh, well, look at that. There was a really high level of No High School Diplomas. So let's check on that. And when you click on that, as I said, it will refresh. And then you get the data on those who have no high school diploma. And so looking at this, what would you say is needed if you take a moment to look at this?

You can see that there are several opportunities available to you. If I look at it, I'm like, OK, look, there's two ends of that. What's going on in the 16 to 20? What's the opportunity on that? You probably wanted to dig into it and find out how many of those are out-of-school youth.

You can look at the English language Ability and wonder, where are we targeting that? And so you choose-- you look at it and you discuss, what are the opportunities? Without making judgment, just a thinking activity. Next slide, please.

Jodee Slyter: Blaire, you just said 16 to 20 on that previous slide?

Blaire Toso: Yeah, well, it could be-- I have to admit. Very small on my screen. I believe we did the '16 to '20 because I know a lot of the WIOA programs include those. And so we wanted to make sure that was inclusive and it's also the opportunity youth as far as the--

Jodee Slyter: Well, it says 19 or less. We're not talking about potential high school students or K-12, we're talking about only adults.

Blaire Toso: It should be-- it would be-- I believe it's-- now, you're challenging-- I have to go back and look. I believe that we did think about it as 16 to 19 because we wanted to be able to capture that population that might appear. But I would have to go back. I apologize. I will verify that.

But I believe our thinking was we wanted to include that. So yes, you would need to go back and see who actually is in school and who is out of school within that demographic.

Jodee Slyter: OK, because that's really confusing when you're looking at what the qualifier is, what the definition is there, 19 or less. So it's really not under 16-year-olds.

Blaire Toso: No, it is not. It is definitely not under 16-year-olds. So that aspect of-- yes, CAEP is 18 and older WIOA II is 16 plus. Again, trying to find that balance between what the field needs and how they want to look at their data. So thank you. It is an excellent question, and that was where we went with that.

And if we get a lot of feedback that the field would really only like 18, starting at 18, that would be great to know. And then, we can adjust that when we update the ACS data. We'll rerun those numbers.

Jessica Keach: Blaire, I have a question just real quick on that page, just a clarification . When you select a consortium, so let's say adult education pathways, and then overall population 36,000 pops up, that's for our county, correct? Not--

Blaire Toso: That would be for your consortium.

Jessica Keach: Consortium. OK.

Blaire Toso: It is for your consortium and there is a whole process that our data analyst did in order to set those. And if you are interested in knowing, email me and I will dig up the language and send that on to you.

Jessica Keach: OK, thank you. I just needed that clarification.

Blaire Toso: Yeah, and thanks, Paul. Yes, we'll clean up. We can look at that. This is lovely. This is the nice thing about refreshing all the data is that we found another error and we will update that. And then also we will be able to clean up some of those. So I made a note on that too, so we can be more specific like put 16 to 19.

All right, perfect. Thank you. So just quickly, then we go on. You can compare it to who you're serving and what you're doing by using the adult education pipeline data and then compare those. And then, you can dig into them. So for example, if you've chosen that you want to look at high school attainment, then you can dig into that piece and look at how you're doing, who do we want to target, what would indicate progress.

And you can compare. For example, here are this might be. This one looks at the race ethnicity. You can also then look at age. And when you're looking at those different ages in that population you're surveying that the percentage, do you want to dig in? And look at that opportunity, school youth.

We're kind of focused on that because we really think that that's going to be an area of need given COVID and what happened with educational attainment during that time and leave-taking from school. And so we were thinking that might be an interesting space to explore.

And so just returning to your setting of your targets and looking up but this four-step process and the resources that you can go through and help support that process. And I just wanted to address one of the questions about where the data on the adult education pipeline comes from. It comes from MIS data and the TOPSpro enterprise data.

What we do is we put together calculations that make these-- the different metrics equitable and use and then those get uploaded through to the dashboard.

Veronica Parker: All right. Thank you, Blaire, so much. And thank you all very much for engaging in this portion of the webinar. We will now transition over to Jay who will talk about CASAS data, and then we'll have time for more questions and answers. Jay.

Jay Wright: OK, hello, everybody. I just moved over to my PowerPoint. I guess if somebody has-- somebody can respond kind of one way or the other, can you see my PowerPoint or is it still something else that you see on the screen that's not my PowerPoint?

Veronica Parker: I can see it. We can see it.

Jay Wright: So wonderful. Everybody can see it. Trying to make a long story short here. There is an abridged version of this PowerPoint, and there is an unabridged version of this PowerPoint. I guess the good news for now is, today, we'll be covering the abridged version right here. So I'll go through this today.

A lot of you were at the meeting we had earlier this morning. So we did a few little bits and pieces of this one and the other one. And basically, we'll post some of this on our website here on Monday, I think, both the abridged and unabridged version. The difference, I'll just say, is this one kind of a-- we have limited time so there are some extra slides in the other one that provide a few more examples, provide a few more screen shots.

There is a lot of how to get there from here that I kind of leave out because we don't really have time to go step by step, but we are really just focusing on what these metrics are and then just trying-- for not all of them, but for most of them-- just give a concrete spot and see where you can find it and what on that report you could use to measure the different metrics.

So I'll start with this one. This one has been out there for a while. This is basically what Veronica just presented. There's the mandatory consortium metrics. There's the mandatory member metrics. And then there is that list of 10 optional metrics. So I'm starting by listing those out. We'll go in this order, cover what some of the metrics are.

There will be a few like percentage of funds spent that we'll obviously skip. But we'll try to go through at least some of these and point out here is at least what I think the report is and TE that you can use. I'll point out now before jumping in, as there's obviously probably multiple options for a lot of these metrics.

So if you know good and well, and looking at the participants list, I know some of you do know good and well that there's different ways of doing this. I'll just kind of stick to one that I think is pretty firm for each of these. So here's the two consortium-level metrics. Veronica brought this up. There's the four different student barriers.

You can choose one. You can choose all four. You can choose a number in between 1 and 4, if you prefer, and then looking at those with the one or more hours of instruction. So we'll start with barriers. You can look at barriers and aggregate. You can look at each barrier individually. There's two general reports in TE you could use.

There's an NRS, one that relates it to federal reporting. And then there's a CAEP Barriers to Employment. The format and basic information that these two reports, way closer to the same, that it is different, but it just looks at the different population. CAEP, for the state reporting group, obviously. NRS, limited just to VABEAS, ESL that are included in NRS.

The other key thing in TE to consider for barriers is the ad hoc NRS cross tab report. We talked a little bit about this one in the meeting we had earlier this morning. So this one, we suggest if you really want to focus in detail on one of those barriers and/or if you want to look at barriers in terms of outcomes, I would say these first two are mostly-- they are just to give you a bean counting.

You know what date. You know how many students with each barrier you're presently serving. If you want to look more specifically at how well individuals with barriers, they're doing on specific outcomes, you can potentially use this ad hoc and NRS cross tab report. Pretty much, any possible metric you might measure in TE beyond just what's in CAEP, beyond just what's in NRS.

You name it, it's pretty much there. You can just basically select what you want to serve as the x-axis. Select what you want to serve as the y-axis. And it's kind of a do-it-yourself report to look at individual categories. So again, this is an example we've been using in particular for if you want to focus on barriers in terms of how well they do with outcomes and not just the number of individuals with barriers you happen to be serving.

The next one we have is that enrollment criteria. That is we're looking at how many make it to a program or looking at how many get in to the one or more hours of instruction. So we're saying there's a relatively new report called TE Enrollees by Hours. I'll just say in the unabridged version, we get into this report a lot more. I'll keep it limited here.

Some of you know about this. I'll just say earlier this morning-- though, not as many of you know about this maybe as I thought. I'll just see there's two relatively new reports that measure attendance hours in TE. This one I'm showing on my screen, it's called TE Enrollees by Hours. There's another one called TE Service Enrollees by Hours.

These basically look at those three buckets that Veronica, Neil, and others have been talking about a lot here over the last several months. That is it's looking at those different areas we already have on the CAEP summary. And then, the Enrollees by Hours is not a consortium-level report the CAEP summary is.

So this is getting more to student-level agency data with this particular report right here. We're looking at maybe making that a consortium-level report. This one relies a lot on drill-down. So I've got to say that's a little bit of an "if" because we keep agency-level data out of that consortium-level level login for a lot of reasons, but we are looking at it.

In any case, this report basically looks at those three sections of the CAEP summary and then just kind of digs a little deeper into those three buckets. So it looks at outcomes and then itemized out how many have 12 or more, how many have 1 to 11, how many have 0 hours. It goes into the Services section and does the same thing, dividing it into those three buckets.

So that the answer here is, you can look at those right-hand two columns in the Services section to basically determine how many of those that are in services have at least one hour of instruction. We highlighted the columns you could potentially use. There is a slide that has math and, in effect, makes it a little bit better.

But you can see we've got the two columns. If you add those two columns, we've got 609 with 12 or more, 98 with the 1 to 11. So if you add those together and divide it into the total number, that shows that right now at this level of reporting, we have 82% of our students with at least one hour of instruction. So again, that's the TE Enrollees by Hours for this.

Those are the first two in that first category. Here's the member-level metrics. Percentage of funds, obviously, I'll skip this one. And then we're kind of taking that Enrollees by Hours to the next level at the member level to look at how many have the 12 or more hours of instruction and actually qualify for official CAEP reporting.

So we're going back to the same report called TE Enrollees by Hours. We're looking at a slightly different section of this report. That is, we're looking at the middle Outcome section of the report instead of the right-hand Services section. And so now, we're just saying, OK, how many stay long enough to get that 12 hours of instruction.

So we're looking at the same thing here. We're looking at that 580, looking at how many you get, so you can see we've got 92% of that 580 right now have at least 12 hours of instruction in this exam. So again, if you're not familiar with this report, I'll refer you again.