(DESCRIPTION) Presentation. Logo, Casas, Comprehensive Adult Student Assessment Systems, www.casas.org. California E.l. Civics Basics for CAEP Agencies presented by Portia La Ferla, CASAS Program Specialist, Lori Howard, CASAS program Specialist Coordinator. Copyright 2020 21 CASAS. Video feed in upper right, Portia La Ferla. (SPEECH) PORTIA LA FERLA: Well, thank you so much Penny. Welcome to the California EL Civics Basics for CAEP Agencies. I'm Portia La Ferla and I am one of the Program Specialists for CASAS. And this is Lori Howard. Lori? LORI HOWARD: I'm Lori Howard. I'm the CASAS Program Specialist Coordinator. Good to see you. (DESCRIPTION) Text, Lori Howard. (SPEECH) PORTIA LA FERLA: Yes, and thank you so much for joining us today. We're really happy to have the opportunity to present this information to you today. We hope that you'll consider using the California EL Civic System to demonstrate how effective your programs are with meeting the needs of your students and especially of your immigrant population. Next slide, Lori. (DESCRIPTION) Slide, Goals and Objectives. (SPEECH) These are our goals and objectives for this presentation. And by the end of the session, you should be able to see the relationship between El Civics COAAPs, or civic objectives, and the CAEP I-3, or Immigrant Integration Indicators. We're going to look at some reasons why you might want to use and we recommend that you use EL COAAPs instruction and assessment to measure the successes of your students. We're going to look at the ways to implement COAAPs and EL Civics-- I'm sorry, EL Civics COAAPs and CAEP Immigrant Integration Indicators successfully. And we're going to look at some resources that you can use to help you with curriculum and assessment. (DESCRIPTION) Slide, Poll. (SPEECH) Before we get started, we have a one question poll so we can get a picture of how familiar you are with California EL Civics. It's just one question. How familiar are you? Please answer in the poll. If you can't see the poll, you could put your answer in chat. So please go ahead and answer. LORI HOWARD: And your answer would be in the chat-- very familiar, somewhat familiar, or not at all familiar. Thank you. PORTIA LA FERLA: OK. Thank you so much. We have-- I think did you share the results of the poll? Melinda? There we go. Yeah, so it looks like most of you are somewhat familiar, but many of you are not familiar at all. And that's fine because we're going to really go through some very basic information. And then we'll also give you other resources to help you if you want to dig in deeper. And we're going to be-- if we've got time, we'll be able to answer any questions that you might have during this presentation. (DESCRIPTION) Slide, What is California E.L. Civics? Bullet points. (SPEECH) Next one, Lori. And now, Lori is going to give you some background information about EL Civics. Lori? LORI HOWARD: So great to see you everyone. Glad you're here with us. And we just want to go over this maybe a review for you but we want to make sure that you understand what is California EL Civics. Civics California English literacy and Civics Education incorporates English language and literacy instruction and civics education, and it promotes participation in civic and community life. And that's why it is such a great fit with the immigrant integration indicators. (DESCRIPTION) Slide, E.l. Civics A.E.F.L.A. W.I.O.A. 2 Funding. (SPEECH) And it's funded by the Adult Education and Family Literacy Act, acronym we say AEFLA. And the part of the AEFLA Act is the Workforce Innovation and Opportunity Act. We call it we WIOA Title II. So it's good to know where this funding comes from. (DESCRIPTION) Slide, E.l. Civics and W.I.O.A. (SPEECH) And in WIOA, EL Civics is defined as services that enable competency in English language and to help learners function effectively as parents, workers, and citizens in the United States. And in the new authorization in 2014, the workforce training element here bolded below was an emphasis. So that's one of our main areas of funding now. (DESCRIPTION) Slide, How does California E.L. Civics relate to CAEP? (SPEECH) So we want to talk about how it's related to EL Civics, how CAEP is related to EL Civics. And Portia is going to tell you about that. (DESCRIPTION) Slide, CAEP and E.l. Civics. (SPEECH) PORTIA LA FERLA: Thank you, Lori. So just before we get into this slide, California EL Civics has three focus areas, and they are civic participation, citizenship preparation, and integrated EL Civics, which also includes integrated training. We're going to mostly talk today about civic participation with some mentions of IELCE because they mostly have the same requirements. CAEP was authorized through AB2098, that was the original adult education block grant program. And in that legislation, it suggested that CAEP align with WIOA by encompassing WIOA outcomes. It wasn't limited to WIOA outcomes, but it encompassed WIOA outcomes. And early on within the field, there were some concerns about the limited outcomes that were being tracked for ESL students in particular. Some of the outcomes that were being tracked were level completion and other exit outcomes, like entering post-secondary, or getting a job. And those outcomes weren't tracking all of the essential learning that went on after an ESL student enrolled, but before they exited the program. So teachers were doing a lot of work with students to help them navigate life in the United States, but there was no credit in CAEP for their successes. So many of these learning milestones that teachers were already achieving with their students were summarized by the term immigrant integration. Adult education agencies and their organizations, their political organizations, professional organizations lobbied to expand CAEP outcomes to recognize these achievements that are successful to integrating immigrants into American society. And this result, this was-- so as a result, we're encouraging you to take advantage of the immigrant integration metrics and framework and to collect outcomes that show your successes for your immigrant students. The next one, Lori. (DESCRIPTION) Slide, New information. (SPEECH) So if you look closely at the language AB2098, there are items that they are in bold that directly relate to or align with EL Civics. And these would be to improve literacy skills, to increase participation in civic and community life, and for the completion of post-secondary certificates degrees or training programs. (DESCRIPTION) Slide, CAEP Immigrant Integration Indicators and E.L. Civics. (SPEECH) So this phrase-- to meet the needs of immigrant and refugee adults seeking integration, links CAEP outcomes and EL Civics. So EL Civics objectives and assessment plans correspond to the CAEP I-3 outcomes and the reported in TE. So again, I-3 is what we refer to as Immigrant Integration Indicators. (DESCRIPTION) Slide, Immigrant Integration Goal Areas. (SPEECH) There are 10 immigrant integration areas. The first seven that are listed in bold-- economic security, credentials and residency, health and well-being, education and career, children and family, civic and community participation, and digital literacy have specific EL civics objectives and assessment plans that are associated with them and they result in specific CAEP outcomes. I'm going to show you how that happens on the next slides. But the other three goal areas-- English proficiency, first language proficiency, self-efficacy and system-- excuse me, system navigation, are widely represented in the COAAPs, but they don't have specific objectives that are associated with them. (DESCRIPTION) Slide, CAEP I 3 and E.L. Civics. Table. (SPEECH) This is a chart-- this is-- I'm sorry, this is a chart that shows how the Immigrant Integration goal areas and the California EL Civics objectives align. So in this slide, the Immigrant Integration goal area is economic security. And in this slide, there are-- it shows you that there are six EL Civics COAAPs, or civic objectives, sorry, that align directly with economic security. And some examples of those are to resolve consumer complaints, develop a business plan, obtain housing, and to identify tenants' rights. Under credentials and residency, there are an additional, there are six other civic objectives that align with credentials and residency. And some examples of those are-- how to get an ID card, how to get-- how to find and access legal services, how to apply for ID cards. As you read through these, think about how important are these kinds of topics to your immigrant students. They might not only be useful, but they might be absolutely essential to their success as they navigate life in the United States. Next one, Lori. (DESCRIPTION) Slide, CAEP T.E. Summary Report. (SPEECH) This slide shows what the outcomes look like in TOPS Enterprise. So the immigrant integration outcomes are on column-- are listed in column F in this slide, or in this report. So if you look at this one, you can see that the-- ESL students, ABE students, ASE students, and CTE students can all get-- can all earn I-3 outcomes. And in this case, this agency has 1,000-- I'm sorry, 116,217 immigrant integration outcomes. That's a lot of outcomes. That's a really nice way of showing program success. And then next one. (DESCRIPTION) Slide, CAEP T.E. Report I 3 by class. (SPEECH) If you look more closely at the data, you can drill down into that TOPS Enterprise report, or you can run a different report and it shows you more specifically how these I-3 outcomes were earned. So for example, this student-- our student here has passed COAAP assessments in three immigrant integration goal areas. What are those three areas? Digital literacy, civic and community participation, education and career. And if you look at digital literacy, the student passed two different civic objective assessments. Number 47, which is safe-- internet safety, and number 48, which is effective online communication. The student has two under community participation, and one under education and career. So you can see how those goals align with those civic objectives. (DESCRIPTION) Slide, CAEP I 3 and E.L. Civics. (SPEECH) We need to go-- LORI HOWARD: Sorry. PORTIA LA FERLA: Yeah, it's all right. It's OK. So to summarize, the CAEP students can earn these I-3 outcomes by passing EL Civics COAAPs. And these outcomes are tracked in TOPS Enterprise. There are a lot of rules for implementing EL Civics. In the CAEP agencies, you don't have to follow these rules. You are not required to follow them, but we strongly recommend that you do follow them because they're what makes the COAAPs system of instruction successful. And the next one, Lori. (DESCRIPTION) Slide, Benefits, CAEP and E.L. Civics. (SPEECH) By following the guidelines, EL Civics requirements, not only will your implementation be more successful, but you'll be setting your students up to support your application for WIOA II funding should you choose to apply in the next grant cycle. Those applications should be out next year, and the funding will be for the years 2023-24. (DESCRIPTION) Slide, E.L. Civics Successes. (SPEECH) And then just a little bit of success data about EL Civics. More than half of the ESL students who participate in EL Civics in California, and after multiple instruction and assessment cycles, more than 90% of the students who take these assessments pass one or more of them. And just generally, it seems that students who participate in EL Civics programs achieve a higher percentage of level completions than students who do not. (DESCRIPTION) Slide, What questions do you have? Please ask or type in the chat. (SPEECH) OK. And we can take a little breather here. Are there any questions that you'd like to ask before we continue? You can put them in the chat or go ahead and unmute yourself and we'll be happy to answer those questions. LORI HOWARD: So before we start, I just wanted to say that it came up in the chat about our handouts. And I just want to let you know that we posted both our slides and the chart we showed you with the correlation between EL Civics objectives and Immigrant Integration Indicators on the CAEP website. So hopefully, at the end of our session, Melinda will show you how to access those. And then we are also going to give you a lot of resources at the end of the session and direct you to places on the CASAS website. So one of the questions here is-- do you create an assessment for each level of ESL? So I can answer that question. Thank you, Martha, for asking it. It depends on the COAAP. The COAAP descriptors ask you to-- sometimes it's one assessment for all the levels, and sometimes it is-- one assessment for beginning low and beginning high, and another one for intermediate low and advanced, and sometimes there are adjustments. So for example, intermediate low to advanced students, let's say they're doing a job interview. So they would be asked five basic questions, all of them. And then if they're intermediate high, perhaps you would add two questions for intermediate high, and perhaps two more difficult questions for advanced. But it's basically the same assessment. Each-- there are 170 about COAAPs assessment plans, so you'd have to look at each one to see. But in general, they can be developing one assessment with adjustments can make it the way you need it to be. And then is anyone able to share a sample lesson assessment and rubric? So we can do that at the end. But we're just trying to talk about the general ideas right now. So Martha, let's look at your question at the end and we can show you how you can do that. And actually, we have the EL Civics Exchange that we're going to give you a resource to, I hope. Portia, we did that? PORTIA LA FERLA: I don't think we did, Lori? LORI HOWARD: Oh, did we not? OK. PORTIA LA FERLA: We can. LORI HOWARD: Can you write that down as a note? EL Civics Exchange, we'll take you there and show you an example, exactly that, a sample. We can't share assessments with you because those are high stakes. In other words, WIOA agencies will be earning payment points for those. But you can contact an individual agency who can share an assessment with you if you promise to keep it secure. We're not allowed to put those on a website. And yes, we will show you a rubric too. Can a student take the same test year after year until passing it? Well, I wouldn't say year after year. We offer instruction related to the assessment. If the student doesn't pass it, we suggest you give further instruction. And then hopefully, the student will pass again. This is a system, I'm going to tell you in a minute, a performance based assessment. And so you're basically teaching to the test. I'm going to give you an example about that. You're teaching to the test, so your student should eventually pass if you're doing appropriate instruction. PORTIA LA FERLA: Lori, can I make a comment on the year after year. So a student may do the same COAAP in a different year, but they would probably do it at a different level. So their tasks would be progressively more difficult. So if the student is a beginning student this year and an intermediate student next year, they might have a very different assessment for the same civic objective. LORI HOWARD: Thank you. And Shoch asks, "Is there guidance available specifically for non-WIOA consortia planning to implement EL Civics?" And Shoch, that is exactly what we're trying to do with this presentation. And at the end of the presentation, we're asking a question if you need more training, and if you do, we would be happy to offer that training. So please, you know, let us know either in the chat or at the end, when we try to survey you about your needs. We would be happy to assist you. OK, I think that's all the questions. PORTIA LA FERLA: I think so. (DESCRIPTION) Slide, California E.L. Civics. (SPEECH) LORI HOWARD: So I'm going to talk about California EL Civics, again responding to Portia's suggestion that if you follow the rules, you'll do a better job at working with the COAAPs, and then your students would be more apt to pass and you'll be able to gain your outcomes that you need. And also for those of you who want to apply for WIOA II, as Portia said, you'll be better ready to implement that, and hopefully your requests for application will-- you'll be able to demonstrate you've already done a lot of the things and so you'd be more apt to get accepted. (DESCRIPTION) Slide, California E.L. Civics. (SPEECH) So again, reviewing California EL Civics, it's based on a system of civic objectives. And you saw some of them in the chart that Portia showed you. And civic objectives are the general competencies that help students access their community. And I know those of you who've been working with the CASAS competencies, they're similar to that. And some of them are very, very similar or the same, but these were written by agencies at the beginning of this program and around the year 2000. This is a 20-year-old program, at this point, and they were written by agencies and then put into a standardized system on our website. But all of the objectives and the COAAPs you're going to see all come from agencies like yourselves. So one of the civic objectives is CO, we call it, Civic Objective 33. And here, you see the objective-- "Identify and access employment and training resources to obtain and keep a job." I'm sure that kind of objective is very familiar to you, one you probably can find something similar in our CASAS competencies as well. So once we have a civic objective, we also have a system of civic objectives and additional assessment plans. It's called an additional assessment because it was additional to standardized testing. So a COAAP is a plan for performance-based assessment. In developing this program in the early 2000s, the state of California wanted to do something that would help students perform and access their community, perform in the community and access it by filling out a job application, having an interview, talking to a doctor, all the things. Not just being able to answer questions on a test, but actually doing things or simulating doing them. So we simulate a job interview, for example, but we can actually have students fill out a real job application. So a Civic Objective and Additional Assessment Plan, or COAAP, is a plan for performance-based assessment. And in the case of Civic Objective 33, one of the COAAPs usually has two tasks. One of them could be or is "complete a job application" and "demonstrate successful job interview techniques." So that's the performance. Students are eventually accessing their peer communities by learning how to do these tasks, these real life tasks. (DESCRIPTION) Slide, Coaap 33.7 Example. (SPEECH) So for example, the task I just mentioned, we have a COAAP 33.7. 33 is the civic objective and 7 is the number of the COAAP. So there are at least seven COAAPs for Objective 33. So task one says, "Complete a job application." This is a partial description of something you might see on the website. "Using a level-appropriate agency-created employment history, student will fill out an authentic job application." And one of the reasons we have students use an agency-created employment history so that we know whether the student is filling it out appropriately. If we let students use their own information, we don't necessarily know that information is true. Also we are sort of getting into the privacy of the student by taking their address and Social Security number and all those things that might be on the form. So we don't want to get into that, so we often ask for a level-appropriate, agency-created scenario or history, something like that. So that's task one, complete a job application. Tasks two, role-play a job interview. Again, in a simulated job interview, student will play the role of the applicant and the assessor will play the role of the employer. So this is describing what the assessment will look like. And then sample questions are given. Agencies are able to infuse the content that they have taught or they plan to teach into these assessments. So the assessment itself, the only thing that's coming from the state of California is the plan for it, but each agency can infuse whatever content is important to the students at your agency. So we often give sample questions, but you're free to use them or not. What you need to do is use the number of questions. So we might say, ask five questions. You need to ask five questions in order for the rubric to work. (DESCRIPTION) Slide, California E.L. Civics W.I.O.A. 2 Requirements. (SPEECH) And we will lead you later to a sample assessment. Here are the California EL Civics WIOA requirements. There are 6 for our basic EL Civics classes. The first one is to develop and administer a community student needs assessment. This was a crucial aspect of this program, when it started in the early 2000s-- not just teach what's in the textbook, but teach what students ask for or demonstrate the need for. So that's a crucial part of the program. Then agencies based on the needs assessment, select specific objectives and additional assessment plans. After a section of the plan, then they want to develop or borrow from another agency the actual assessment. Then planning an offering instruction to help the students pass the assessment, administering the additional assessment after inspection has happened, and then one of our requirements is also CASAS pre and post testing. (DESCRIPTION) Slide, Overview of California E.L. Civics W.I.O.A. 2 Requirements. (SPEECH) So I basically gave you this overview already. So here, when you have the slides, the overview of each of the items. The only thing we didn't talk about is the number of COAAPs. The CDE requires WIOA agencies to select between 3 and 10 COAAPs per year, but you can ask permission to select more or fewer, depending on the needs of your agencies. (DESCRIPTION) Slide, Continued. (SPEECH) And also a WIOA requirement-- but not a requirement for you-- is a minimum of 30 hours of instruction before an assessment is given. We believe that, for example, that the 33.7 I showed you would probably take about 30 hours of instruction. Some of them take a little bit less, but we have a list of language and literacy objectives that you can augment your instruction or use the instruction that you're already using in your ESL classes. I just want to mention also that-- and maybe this will come up later-- that the instruction isn't necessarily new instruction. You know, when you talk about job interview or job application, you probably have a unit in your textbook that addresses that. So you can use whatever textbook you're using with that content and then add in anything that would need to be added to that instruction you're already doing. (DESCRIPTION) Slide, California E.L. Civics Requirements. (SPEECH) OK, so as I mentioned, needs assessment is crucially important. We know from research that successful programs continually assess the needs, interests, and language skills of their learners. And so that is an important part of our program. We require it annually, a whole school assessment, and that informs the selection of COAAPs. (DESCRIPTION) Slide, New information. (SPEECH) I think I mentioned this already, about selecting civic objectives and additional assessment plans and then developing an assessment to give learners after the 30 hours of instruction. (DESCRIPTION) Slide, California E.L. Civics COAAPs. (SPEECH) As I may have mentioned, so there are multiple assessment plans or COAAPs for each civic objective. Most of them have at least 3. And as I mentioned before, each COAAP is numbered. The first number corresponds to the specific objective and the second is the number of COAAPs. So as I mentioned, 33.7 means there's at least probably seven COAAPs in the system. And each COAAP has at least two tasks, and the students need to complete all the tasks that are labeled for their level. So there may be more tasks in a COAAP, but you'll notice when you look closely that some are only for Beginning Low, Beginning High students. Some, perhaps, are only Intermediate Low to Advanced. But each student needs to complete at least two tasks. (DESCRIPTION) Slide, Select COAAPs. (SPEECH) So when you select COAAPs, you want to select those that match the needs of your students. So you might be asking about the needs in terms of jobs, more general terms, jobs, for example, or banking. But when you go in more depth, you might want to be selecting a COAAPs that more closely meets your students' needs. So you also want to consider the type of assessment. Do you want to do an oral or written, or role-play assessment? With remote instruction, we've had to make some changes in terms of whether it's easier to do oral assessments or written assessments remotely, and that, you can make a decision about. And you'll also want to look at the content. So for example, here, in Civic Objective 9, which is "locate and analyze preschool and child care services," there are two opportunities, 9.3 and 9.4. 9.3, "list characteristics of good quality child care," 9.4, "evaluate a child care facility." Or, in 9.4, "compare child care facilities and present an oral report." So the teachers, knowing the needs of their students and having the needs assessment, would select which COAAP to use with their students. (DESCRIPTION) Slide, After selecting a COAAP. (SPEECH) OK, and once the COAAP is selected, then the agencies develop or borrow a performance-based assessment, again, based on the selected COAAP. And then agencies develop 30 hours of topic-related ESL instruction to prepare learners for the assessment. We're going to go over Step 3 and Step 4 in the following slides. (DESCRIPTION) Slide, Performance based assessment. (SPEECH) So performance-based assessment measure students' ability to apply skills. So again, this is not just paper and pencil testing. It's application of the task or the skill. And we try to make it challenging, and students should be able to use their higher order thinking skills to create a product or complete a process. So these are challenging assessments, and we want to challenge our students more as the level increases. (DESCRIPTION) Slide, California E.L. Civics requirements. (SPEECH) So our additional assessments assess how well a learner can interact or access the community, and they directly relate to the Civic Objective and Additional Assessment Plan. And again, includes learners in tasks that they can perform in real life. And then we also want to choose whether it's, again, oral, written, or works on listening or reading. We suggest that, as in all ESL instruction, that all the language skills are utilized, but of course, there will be a focus depending on the skill. (DESCRIPTION) Slide, Develop additional assessments. (SPEECH) One thing that we're not allowed to use is these kinds of questions, true/false, things that would be associated with more paper and pencil testing. We do not ask true/false questions or multiple choice questions, or fill in, or matching, or have text boxes which offer students a list of options. We want students to be able to go out in the world and utilize what they've learned to communicate. And so when students go out into the world, they don't have a little box of words from which to choose, so students are tasked to learn these things that they need in the outside world. (DESCRIPTION) Slide, New information. (SPEECH) So again, agencies can develop their own assessments or they can borrow it from other agencies. One agency that has been very willing to share his Torrance Adult School. I think this link will take you to a lot of their instructional materials, and you can see, in their instruction materials, if you like them, you could contact them and ask to borrow their assessment. Remember, though, that when you borrow either instructional materials or an assessment from another agency, be sure to look them over. Just because another agency is using it doesn't mean it meets the needs of your students or even meets the requirements. So be sure that you look at them and make sure they're applicable to your students before you utilize them. And then in the cases of things that you find online, et cetera, you can adjust them to meet the needs of your students. (DESCRIPTION) Slide, California E.L. Civics Requirements. (SPEECH) So the instruction is for Beginning Low to Advanced ESL learners. And again, to prepare them to participate in real or simulated communication or interactions. So after the COAAP is written, again, we're sort of teaching to the test. So once we know what the test is going to be, we're developing our instruction to teach the skills students need to pass the test. (DESCRIPTION) Slide, Plan and offer instruction. (SPEECH) As I mentioned, it includes all four language skills and it's not limited to the objectives in the COAAP. So if you don't feel that what's in the assessment is robust enough for your instruction, you can add to it with-- and we have a whole list of language and literacy objectives for each civic objective. WIOA agencies are required to give 30 hours of topic specific instruction. You, again, are not required to do that. (DESCRIPTION) Slide, New information. (SPEECH) So if you were a WIOA agency, you'd develop a 30 hour instructional plan or borrow those materials. And then some different agencies do it differently. Some agencies rely on their instructors to plan the instruction, that 30 hours of instruction, and some agencies have a EL Civics coordinator who develops an instructional plan and instructional materials and hands them over to the teachers. So you can do it either way. And I did list here-- we did put the EL Civics Exchange. We are just developing now the EL Civics Exchange in cooperation with-- or collaboration with OTAN. And it's on the OTAN site, and we can go there afterwards, if you'd like. And we are putting up model EL Civics instructional materials on this site, www.elcivics.otan.us. (DESCRIPTION) Slide, C.A. E.L. Civics Requirements. (SPEECH) OK. So once the instruction happens, then you will give the assessment. And the assessment can be done by the teacher, the students' own teacher, or by an outside assessor. For oral assessments, we recommend that an outside assessor-- for example, the teacher next door or the principal-- come in and do the assessment, because the whole point is that students would be unable to perform in the outside world, and so they're more apt to be able to demonstrate that successfully if they're talking to someone that they don't talk to all the time. We all know that our students understand us as their teachers but may not understand other people. So we want to give them that experience of talking to someone new, if at all possible. And again, after appropriate instruction, the assessment can be given again. We mentioned that earlier. (DESCRIPTION) Slide, Administration of Additional Assessments. (SPEECH) I just want to mention that assessment is individual. So even if students have practiced a role-play, they can't do it with another student. It's never student to student. All the assessment is done student to assessor because we're evaluating the student as an individual. So written tests, of course, everybody is writing on a different paper, and that's an individual assessment. But for oral interviews, et cetera, it's always done with an assessor and evaluated as such. (DESCRIPTION) Slide, California E.L. Civics. (SPEECH) And as we said CASAS testing is one of the requirements of WIOA II. So if you're going to be part of the WIOA grant, then you would need to follow that requirement as well. (DESCRIPTION) Slide, What questions do you have? Please ask or type in the chat. (SPEECH) So what questions do you have? We tried to give you an overview of the requirements for WIOA. Again, you don't need to follow those, but we would hope you would consider them as you implement COAAPs in the CAEP programs. Any questions? It's a lot of information, I know. So feel free to ask questions. And also, you may want to review this again if you're hoping to follow these requirements. PORTIA LA FERLA: Lori, I have a leading question. LORI HOWARD: OK. PORTIA LA FERLA: Did you write all of these COAAPs? LORI HOWARD: Oh, no. Again, everything has come from agencies. So in the first year, the grant was put out to agencies and the CDE received-- I think 150 agencies applied for the grant and sent in their COAAPs as proof of what they had done that year. A state committee with representatives of many different districts got together and culled through them. And we found that, for example, health was a very popular topic. So rather than having 50 agencies be doing health in their own way and having to submit that every year, the state decided to cull the best of it and put it on the CASAS website as a possible selection, what we call pre-approved. One thing that's really great about our system is that although we do have pre-approved COAAPs and agencies can just select those COAAPs, as you are doing, agencies are also allowed to revise the COAAPs, with permission, and/or write new COAAPs as needs change. So this is a very flexible system. As Portia led me to say, it all came originally from agencies themselves and the needs of students. And now what you see on our CASAS website is just what has been used over the years by many agencies and implemented by many agencies, or even written by agencies. So questions-- "Do you have COAAPs specific to a particular job or career?" So when the 243 grant, the IELCE grant, came out we identified COAAPs that were already in place that relate to a career. Some of those are pharmacy for pharm tech, some of the health-related ones. So we already have some that relate specifically. There's some on soft skills, for example. But also, in the last few years, different agencies have written our new ones. They're numbered 70 to 75. Medical occupations is one of them, child care occupations, I think there's one on accounting, one on manufacturing, and technology. So those are the five specific workplace areas that we have so far, and we would welcome you to consider if you have other courses that you want to write a COAAP to, we can work with you to do that on other ones, if those 70 to 75 don't meet your needs. Construction, the one in construction is based on safety. But if you have specific things you want to work on, we could work with you on that because we want to be adding all the time new COAAPs that relate to training, especially. OK. And so-- yeah, we'll give you information. There is another webinar I'll point you to called Understanding COAAPs-- "EL Civics Basics, Understanding COAAPs." And that tells you information about how to write a new COAAP. And basically, what you'd be doing would be to write a brief description of the tasks that you think should be part of it, and then send that to me at lbhoward@casas.org, or you can send it to ELCivics@casas.org. We would ask you, though, first, that you look through what's already on the website and see if you can adjust any of what's already there to meet your needs. And Portia, can you put the EL Civics one also? I should be giving that one. Any other questions? (DESCRIPTION) Slide, Coaap selection process. (SPEECH) OK, let's move along here, and we'll have plenty of time for other questions. OK. So let's talk about the COAAPs selection process. So we have a website where you would select the COAAPs. And again, it's linked here, when you get the slides, and we'll take you to the website at the end. And then in order for-- and this is true for all of you now, whether you're using the WIOA system or not-- you need to select in the system, right, in order for it to count for you, and you need to download it into TE. And there are instructions on the CASAS website about how to download your COAAPs into TE so that then when you record your pass or fail, it will be recorded and then linked to your immigrant integration outcome. So that's very important that you do that. And you would be selecting in what we call Option One, the pre-approved COAAPs. Or if you think you need a revision, you could be contacting me or contacting ELCivics@casas.org to help you with revising or writing something new. (DESCRIPTION) Slide, Option 1 pre approved Coaaps. (SPEECH) So currently, there are 59 civic objectives and we have-- the numbers are a little bit funny. 1 to 54 are the basic, and then we left some space just in case we needed to add some general ones before we started the workplace ones, 70 to 75. And again, this doesn't matter for you now, but if you do decide to apply for the WIOA grant, all 59 of the civic objectives can be used for 231 funding, and 29 of them are for the 243 funding. Again, you don't need to know that right now if you're not WIOA agencies. But we do have a list of 231 and 243 funded items, if you're interested in that. And right now, this new document-- hopefully, this link still works-- we added the immigrant integration indicators to this document so that everything's all in one place. So as I mentioned, there are multiple COAAPs for each objective. There are 164 of them, and you can see them all on the pre-approved additional assessment plan list, which is sort of the first item on the CASAS website under EL Civics, and you can access them all there, and they are open to everyone. (DESCRIPTION) Slide, Options 2 and 3. Revised and new coaaps. (SPEECH) And again, if you want to select an Option Two or Three, revised or new COAAP, then you would contact me and I can help you do that. (DESCRIPTION) Slide, Coaap selection. (SPEECH) You have to be a designated person to select COAAPs. So again, whether you're-- CAEP agencies also need to designate someone. So just write to ELCivics@casas.org and say-- or write to your program specialist and ask them to be designated so that you can actually select the COAAPs for your agency. (DESCRIPTION) Slide, Casas E.L. Civics webpage. (SPEECH) So here's the CASAS website. And as I mentioned, this first item is the pre-approved civic objectives list, and that's where you can see all of the COAAPs, the assessment plans. And the second button, where the red arrow is pointing, that's where you select your COAAPs. So if you're the designated person and you want to select, you can go into the Select button. It would probably behoove you to look at the first button first to see all of them or see whichever ones you want to do, and then when you go into the Select button, you can actually make the selections for your agency. And if you are the person who's going to download, that happens in the third bullet. So that would give you instructions to download your COAAPs so that you can record your pass and fail. (DESCRIPTION) Slide, Selecting Coaaps. (SPEECH) OK, if you press on the Select Pre-approved COAAPs, you get to this area. And then again, you would just click on this first button, select Pre-approved COAAPs, and that would put you into the system to make your agency selections. (DESCRIPTION) Slide, California Coaap Selection Deadlines. (SPEECH) And the last day to make selections is April 30, so if you want-- any time you want to add, edit, or delete COAAPs, it just needs to be done before April 30 of the program year. So CAEP agencies and WIOA agencies need to follow all these selection processes. (DESCRIPTION) Slide, What questions do you have? (SPEECH) Any questions about selecting? OK. (DESCRIPTION) Slide, Your turn. (SPEECH) Portia, do you want to-- PORTIA LA FERLA: Yes, we can look at the resources. LORI HOWARD: OK. PORTIA LA FERLA: Wrong slide, though. LORI HOWARD: Did we-- this is 51 now. Do we want to ask-- PORTIA LA FERLA: Oh, OK. Yes, we did. So we're just curious as to whether anybody who's present right now has implemented EL Civics in a CAEP program, and if so, if you'd be willing to talk a little bit about your successes and your challenges. And again, you can unmute yourself, you can type in the chat, but we'd love to hear your experiences. I think they'd been informative for the other people that are participating in this workshop. LORI HOWARD: So Jacque, do you have any agencies in your consortium that is doing COAAPs? I'm looking at the participant list to see if there are anyone. MICHAEL SCOTT: Hi, this is Mike. This is Michael Scott. I am director of Adult Education at Coastline, and one thing that stood out to me-- we are doing the COAAPs, and you mentioned how some of the assessments could be done, for example, from the principal or someone else other than the instructor. And I think that's been a challenge at our organization because it's just the availability of someone else to test the students. But you making that point kind of backed up with the faculty members concern was, so I appreciate that point of the presentation because I'm going to follow up with the faculty member and try to get her more support so that she can have someone else test those students. Because she made the same exact point you made here, but kind of got some resistance from other faculty members. So I did appreciate that. I just wanted to point that out. LORI HOWARD: Thanks, Mike. I appreciate that. And you know, it can happen, just two teachers that are testing on the same day, they just switch classes. MICHAEL SCOTT: Yeah. LORI HOWARD: It can make it easy that way. Or sometimes, we do have a staff member who's trained, someone from the office could do it if they're trained to do it, or the principal, or someone else. Again, it's not a requirement, but it does really help see whether the student can access the community because they're listening to someone they don't often talk to. So thank you for considering doing that in your COAAP assessments. That's really a great idea. MICHAEL SCOTT: Thank you. Thank you for the presentation because I've been around this information for a while, but this really laid it out very cleanly. So thank you. LORI HOWARD: You're so welcome. Does anybody else have anything to share about how you're implementing COAAPs or implementing EL Civics in your agencies? OK, we just wanted to give you that opportunity. We realize-- again, we call this "basics," So we expect that many of you are just at the beginning, and that's totally terrific. But we just thought-- sometimes we get some old hands doing these things again, so we just thought we'd ask this question. But so now let's go on to the resources, and then we'll have plenty of time to answer your questions and go through the website and that kind of thing. (DESCRIPTION) Slide, California E.L. Civics resources. (SPEECH) So Portia's is going to tell you a little bit about the EL Civics resources that are available to you. PORTIA LA FERLA: Thank you. On the CASAS website, there's a page called "California Civic Participation, IELCE." And on that page, you can find so many resources to help you implement. I think just about every question is answered. There are the webinars that Lori mentioned with EL Civics basics, and that one is just some of what we presented today, but even more in depth about implementing an EL Civics program. And then the second EL Civics basics is about understanding, implementing, and revising COAAPs. So if you find a COAAP that doesn't quite meet your needs and you want to make some changes to it, there are instructions on how to do that. Or if you have a brand new COAAP that you need and there isn't one in existence, there are instructions about how to write a COAAP. And then there's one about planning and implementing an IET program and a remote testing webinar. There are documents, including the FAQs for Civic Participation and IELCE. There's the chart that shows the EL Civics and I3 immigrant integration metric goal area correlations. It's a really good place to get everything that you need. And then on top of that, Lori holds monthly EL Civics network meetings. They are highly attended. The participants are very active in these meetings. She usually gets somebody to present a best practice. We've had OTAN presenting. Penny's been presenting on how to make documents accessible. Any new information that comes up is covered at those meetings. And if you'd like to join those meetings, you can send an email to ELCivics@casas.org and Lori will add you to her mailing list. And you can go to CAAdultEdTraining.org to register for those civics network meetings. LORI HOWARD: Can I just mention, the next one is next Wednesday, November 4, from 1:00 to 2:30. So we would love to have you join us at that time, if you'd like more information. PORTIA LA FERLA: Do you have a special guest, Lori? LORI HOWARD: Penny may be presenting a more on accessibility sheet. The original conflicted with the CAEP conference. I just have to confirm with her that November 4 works. (DESCRIPTION) Slide, C.A. E.L. Civics resources continued. (SPEECH) PORTIA LA FERLA: And if you want more information on the value of incorporating EL Civics COAAP Instruction and Assessment into your CAEP programs, you should read Lori's article. She wrote a beautiful article for the COABE Journal, the issue that was on race and equity. And you can find that at the link that's in the slide. (DESCRIPTION) Slide, Questions. (SPEECH) And your CASAS program specialists are always available to answer any questions about instruction or assessment or data collection. And if you have questions about EL Civics, you can go to the page, or you can email ELCivics@casas.org. (DESCRIPTION) Slide, Review goals and objectives. (SPEECH) And to review our goals and objectives, we have identified the relationship between CAEP I3 indicators and EL Civics COAAPs. We've identified reasons to utilize EL Civics COAAPs and instruction to achieve your CAEP outcomes. We've identified the steps for successful implementation, and we've shown you EL Civics resources and where you can find them. (DESCRIPTION) Slide, What questions do you have? (SPEECH) LORI HOWARD: So any questions about the resources? And we have some extra time, so we will be taking to the website. But we just wanted to-- before we do that, is to go to our last polls. I think-- is that a good thing to do right now, Portia? PORTIA LA FERLA: Yeah, I think we should run the poll. (DESCRIPTION) Slide, Poll. (SPEECH) So if you can see the poll, please answer. If not, you could answer in chat. So the first question is, "How valuable do you think your civics instruction would be to your students?" And you can just answer very valuable, somewhat, or not. And the second one is, "How ready do you feel to begin using EL Civics instruction and assessment in your CAEP program?" And you could answer ready, somewhat ready, not ready. We'll give you just a couple more-- a few more seconds to respond. Just about halfway there. Just a few more. And we'll close the poll in about 5 seconds. OK. Thank you, Penny. I'm sorry-- LORI HOWARD: Melinda. PORTIA LA FERLA: I keep thinking Penny's here. I'm sorry, Melinda. MELINDA HOLT: It's quite all right. I've been called worse. I'm going to share the results now. PORTIA LA FERLA: Thank you. So as you can see from the results, those of you who responded, most of you recognize the value of implementing the COAAPs for I3 outcomes. And we've got ready and somewhat ready. We do understand that this is a little bit complex and we don't expect you to be experts at the end of this, but we are here to answer your questions, both now and in the future. And again, I think as Lori shares the website, that will also help to orient you a little bit as you move forward in implementing. We can stop sharing the poll. (DESCRIPTION) Slide, Training Survey. (SPEECH) LORI HOWARD: So also-- we're going to go to the website, but if you would like further training about CAEP and EL Civics, please put your email in the chat and we'll contact you about that. So we'd very much like to follow up if you need further training. And so put your email in the chat and we will contact you about that. (DESCRIPTION) Slide, Reflection. (SPEECH) And we just want to make sure that you share this information with your other staff members. We'd like you to just think about who might need this information and who might you share it with-- your other administrators, teachers, TOPSpro staff, or others. We'd like this not to just stop with you here, but to be shared at your agency. And let me go now to-- and thank you, Portia, for helping us with the resources. I think I've got the CASAS website here now. I think I shared it. So hopefully, you're seeing the CASAS website. PORTIA LA FERLA: It is the website, Lori. LORI HOWARD: Great. (DESCRIPTION) Website in browser. (SPEECH) OK, great. And thank you for your chats. And I just want to-- so when you go to the CASAS website, which I'm sure you're all familiar with, we like to scroll all the way down and go over here to the bottom left, California EL Civics. And you click on that, and then you get to this general information about California EL Civics. And over here on the left is a menu. If you need information about remote testing, click here. If you want to go directly to the EL Civics Exchange-- which we will in a little bit-- you can go there. This is for IELCE, their IELCE report. If you're doing-- well, you probably are not doing citizenship preparation, so you would be going to this page here, California Civic Participation and IELCE. So let me click on that. And this is the page we've been recommending to you that has all the information you need. And hopefully, this looks familiar. I showed you this before. I'm going to click on this very first thing, Pre-approved Additional Assessment Plan List. And you'll see that you get a menu. And so you can put in here the civic objective number. Make sure you're in the current year, because we revise these every year, and make sure you need to use the ones that are most up to date. So I'm going to put in 33 because that's the one we looked at. You click on the number 33, make sure the year is correct, and then hit go. And the system, although it's been around for 15 years, it works pretty well. And I'm going to scroll down. So you have each of the COAAPs. Remember, 33 is the civic objective about jobs. And then we have 1 actually through 10 in jobs. I'm going to go to 33.7 because that's what we talked about. You'll notice here are listed the language and literacy objectives that the assessment plan works on-- completing a job application, describing job duties, demonstrating interview techniques, job titles, responsibilities, all the things. Identifying personal weaknesses, strengths, past work experience, all the things that you would need to fill out a job application and do an appropriate interview. I'm going to go to the right and look a few details. And here, we see the actual COAAP or assessment plan. It has the number here, the appropriate year. It tells you that it's both oral and written. It tells you the level range, from Beginning Low to Advanced students. And here again you see the language and literacy objectives, and then the task. The task, which we've talked about already, and then the rubric. The rubric says 90% of the items assigned to Intermediate Low to Advance students are correct. And if they have that correct amount, they will get 21 points. Let's move on to the next task. The next task is the role-play interview. Again, Beginning Low to Advanced students. There's a lot of description here because it's delineated for each level. Each level does a little bit differently, but it's all there. And then the rubric for content, body language, and preparedness, because those are all important things on a job interview. And then at the end is a rating scale. So if advanced students get 45 out of 50, they pass. Intermediate High students need 40 out of 50, et cetera, et cetera. So that's all there for you. And then what needs to happen is either you borrow or you write an assessment that meets these criteria, again, with the information needed that your students need to learn. Any question about the COAAP itself? OK, let's go back. So if you've decided you want to use 33.7, then you would go to the Select Objectives and you would select the pre-approved. Let's see what happens here. You'll have to log in. So you have to have a CASAS log-in. For me, I get a lot of-- since I'm a super user, I get this big list. You won't get that. But I'm going to go down to Rolling Hills because that's our sample agency. Sorry. Sorry, I have so many here. There we go, Rolling Hills. Again, just your agency will show up for you. And you hit Submit. And then it takes you to this page that shows what I've already selected. But 33.7 is not here, so I can add that. (DESCRIPTION) Table. (SPEECH) And what I would do would be to go down to either the top or the bottom, it's a repeat. Or Add, Edit, or Delete selections. You can either return to the previous process. If you were in the middle and you went out before, or I'm going to disregard changes and start a new session because everything I have there is already there. Once you do that, you have to hit Add, Edit, and Delete again. (DESCRIPTION) Page re loads. (SPEECH) OK. And then-- it's a little bit repetitive, sorry. And then here, you have the choice of either adding a pre-approved or entering a revised. We're going to add a pre-approved because we want 33.7. And then it takes you to that screen we were just looking at, which is 33. Whoops. I'm trying to scroll down here. Let me see if I can do it this way. Oh, no. That's not what I wanted to do. There it is. So I'm going to go down to 33.7. And then you see it has the View Details that we looked at before in the other site, but here, I can select if I'm the designated user. I'm going to hit Select, and then it shows that 33.7 got added to my list, but nothing will be there unless you go to checkout. So be sure-- that's why it's in red-- that after you make a selection, you go to check out. Let's see if I can-- for some reason, my scroll is not working. Let's see if I can-- oh, there it is. Next, that's what I need. Sorry. Next. And then it shows me my details of what I've selected. So that's the selection process, and I've added 33.7. You can see the date here. Any questions about selecting COAAPs? (DESCRIPTION) Table of PDFs. (SPEECH) Let me just point out briefly that there's this whole section here of PDFs. We mentioned that there were a set of FAQs. We mentioned this list of goal areas correlation. And you can download any of these documents that can be helpful to you. Here is our list of webinars, so ESL Civics basic, the understanding implementing COAAPs, all of the webinars you can listen to and then get the slides for. We also have information on needs assessment and how to do a needs assessment here. And then we have the EL Civics Exchange. So why don't we just go ahead and go to the EL Civics Exchange? (DESCRIPTION) Website. (SPEECH) And this is the EL Civics Exchange. Open it up a little bit. And someone asked for-- sorry, I got out of it. There we go. Oh, am I sharing it? Maybe I'm not. Portia, can you see-- PORTIA LA FERLA: You are sharing it, Lori. LORI HOWARD: Perfect. OK, I'm going to scroll down a little bit. And you can see it here. Right now, we are still in the process of uploading materials. So we have one set of materials here that's active in community resources. I'm going to show it to you. And it happens to be on-- where was it? There it is. It's 48, which is digital literacy. And our great agency, Rancho Santiago Community College District submitted this material. And all you need to do is download it. This is available to anyone. If you want to teach 48.1, you could go here and access their practice packet for Beginning Low to Advanced. So that's available to you now, and we hope by the end of the year, that a number of other sets of instructional materials will be available to you. Remember, we can't post the assessments. So if you were using this, you would need to make up your own assessment, or you might try to contact Rancho Santiago and ask if they would be willing to lend it to you, their assessment. But remember, you have to keep it secure. Portia, any suggestions about where we should go at this point, or any questions about what you would like to see? PORTIA LA FERLA: Let's see. LORI HOWARD: Were there any questions-- PORTIA LA FERLA: I don't think you can show them how to submit the-- I'm sorry, how to put the COAAPs into TE, to download them? LORI HOWARD: No. PORTIA LA FERLA: Think you can't really-- I don't think they'll let-- LORI HOWARD: No, but I can-- if I can go here and just show you the instructions. (DESCRIPTION) Opens PDF and scrolls down. (SPEECH) Here's the-- it says "Download COAAPs for import to TOPSpro." When you click on that button, and then it gives you a set of instructions that shows you exactly how to do it. So I'm not going to presume-- I am not a TE wizard or TE superuser, so I would leave you to these instructions that will help you know how to download. PORTIA LA FERLA: It's very easy to do if you follow the instructions. But again, you have to be the person who has access to be able to do that. That's usually the hang up, is being the designated person, not actually-- the steps are pretty easy. LORI HOWARD: Right. PORTIA LA FERLA: Lori, do you want to show them where the EL Civics conference videos are? LORI HOWARD: Oh, yes. So every year, we do an EL Civics conference, and in the past, it has been in-person. But last year, our wonderful program specialist, Lynne Robinson, and with the help of Margaret Teske and others, put together a video conference. And so some of the same webinars that you see listed for your EL Civics are here, but a lot of other ones are not here-- are not on the regular website, but they're listed here. And so anyone you'd like to highlight? PORTIA LA FERLA: Well, no. Just in general, if they wanted to watch any of the videos about EL Civics and EL Civics implementation, they are there. LORI HOWARD: Right. Here's one about EL Civics Moodle courses. This is one from Penny at O10 about licensing and Creative Commons. Because anything put on the EL Civics Exchange needs to be accessible. Remote testing, if you would like to learn about that, there was a presentation by Corona-Norco. PORTIA LA FERLA: I saw that there's one by Burlington English. They do have EL Civics curriculum within their courses. LORI HOWARD: Uh-huh. Good. PORTIA LA FERLA: And the last thing, Lori, do you want to show them the pre-approved civic objective list, just in case they ever want to see the breadth of what's available? LORI HOWARD: Yes. (DESCRIPTION) Opens PDF. Table. Scrolls down. (SPEECH) So we do have a list, and that's in the downloadable portion here, the pre-approve civic objectives list, which shows you the civic objective. So let's go down to 33 just so we are talking about the same thing. So here's the pre-approved civic objective list. It shows you the civic objective, identifying access employment. But then it shows you all of the possible language and literacy objectives. Remember, when we looked at the language and literacy objective on the COAAP itself, there were just four listed because those are the four that you need to specifically write or pass the assessment for the learners. But here, there's a whole set of other things that you could use to make your instruction more robust. So these might be useful to you and also might give you an idea of other things you could do that might be useful to your students. PORTIA LA FERLA: And we're always looking for suggestions on how to make those better as well. LORI HOWARD: And we update all of the documents on the website every year. So every year, on July 1, everything's updated. We bold new items or new things we've done. So we've just completed a revision of all the civic objectives, all the COAAPs, all the language and literacy objectives over the last two years. And so some of them are listed in bold to show that we've made a change there. So just so you know, even though it started 20 years ago, we've been updating it every year so that it meets the needs. The things in italics are new objectives, and we've added a number of new ones that relate to the immigrant integration indicators. So you'll notice that these in italics this year are new. So "using employment service or professional networking website," those are in italics. Determine eligibility for participation and retirement plans, or for unemployment or disability benefits, or for employer-sponsored health care plans. All of those are new and we've gotten the idea for those very often from the immigrant integration indicators. So even though before-- maybe three years ago, before three years ago, we had about 95% connection to the immigrant integration indicators. Now we're getting closer to even higher percentage of correlation because we've added a lot of things from the Immigrant Integration Framework. PORTIA LA FERLA: And in that third column, it also shows you the correlation between the I3 focus area and the EL Civics focus area. LORI HOWARD: Right. So we see here, employment safety is the focus area, education and career. PORTIA LA FERLA: So it's just one other place where we made those correlations so you don't have to go hunting for them. LORI HOWARD: Right, thank you for pointing that out. So any other questions or anything that came up in the chat? PORTIA LA FERLA: Covered the things that we had made notes about. LORI HOWARD: OK. And those of you who asked questions, did we answer them? That was, I think-- Millie? Millie Vang? Did you get all your questions answered? OK. So let me go back to our slides to find the-- there we go. Oh, here it is. Sorry. (DESCRIPTION) Slide, Reflection. (SPEECH) Oh. Oh, there we go. (DESCRIPTION) Slide, Thank you for attending. For questions contact, Lori Howard, I.B. Howard @ casas dot org. Portia La Ferla, p la ferla @ casas dot org. You Tube, Visit the E.L. Civics conference 2020 2021 playlist. Facebook.com/casas system. Twitter @ Casas system. www.casas.org, casas@casas.org, 1-800-255-1036. (SPEECH) So here are our email addresses. Have any further questions-- again, if you want further training, you can contact us directly. If you want to put it in the chat that you'd like further or more specific training, we would be happy to help you with that. Portia, anything-- any last comments? PORTIA LA FERLA: No. Thank you so much, and I hope that you all see the value in incorporating that EL Civics objectives and assessment plans for your immigrant students in particular. I think it's a great opportunity to really show the strength of your programs and how you're helping your students. LORI HOWARD: Yes, and we're so lucky now that we can demonstrate that in our reports through the immigrant integration outcomes. So we're excited to be working with you. If you would like to be implementing COAAPs or needing assistance to do so, we'd be happy to help you, and you have our email addresses here. We really appreciate your focus and concentration on these topics. We realize it's a lot of information and we'd be happy to review it at any time. Thank you for your participation. Melinda? MELINDA HOLT: Yes. I'm going to go ahead and take-- well, I'm going to ask you to stop sharing here for a second. LORI HOWARD: OK. MELINDA HOLT: I am going to show everybody how to get to your presentation so they can have it for their very own. (DESCRIPTION) Website. A spacious virtual lobby with logos on the far wall. Exhibit hall to the left. Lounge to the right. Clicks on auditorium on the back wall. (SPEECH) When you are in the vFairs-- on the website, right? You're at the virtual summit. You're going to select-- well, there's a couple of ways to get there. We could go to the auditorium and it will open up here. Or you can click on the agenda link up at the top, you get to the same page. Either way, it's OK. Just make sure you select Day One. And then if you like scrolling, you can scroll down until you find Lori's name as the presenter. Or you can click right here-- this is the little search box, and I'm going to just type the words "el civ," boom. There she is. It comes up and you'll see that Session 10, "EL Civics Basics for CAEP Agencies--" or "cap," I'm not sure how to pronounce it-- is right underneath the calendar. So you click there, it will actually open up into a Google Drive folder, where there are PDFs that you can then download yourself. Real quick, there are also resources that are available from CASAS. So you do it the same way. You go to the top of the screen, click on the Resources button, go to Documents, and you can do a search by booth. Here we go. Here's CASAS. And there's an eTests information there that you can view. You can also add it to your swag bag. So that's how you get to the CASAS stuff, including the presentation that was given today. I hope all of you take the time to do the survey on this presentation, as well as do the evaluation that's also located on that website at the end of the day. Thank you all for attending. Lori and Portia, if you want the chat, now would be a good time for you to download it yourself because I'm not sure I get it. This is part of the vFairs package, so they actually control the Zoom stuff. OK? LORI HOWARD: OK. I saved it. Thank you so much, and-- MELINDA HOLT: Yeah. PORTIA LA FERLA: Thanks, Melinda. LORI HOWARD: Thanks, Melinda. MELINDA HOLT: You're very welcome. LORI HOWARD: Thanks again, everyone. Take care. PORTIA LA FERLA: Bye-bye. LORI HOWARD: Have a good rest of your conference. MELINDA HOLT: All right. I'm going to hit that big, red button. We're going to end. Thank you all for attending. Bye-bye. PORTIA LA FERLA: Bye-bye. LORI HOWARD: Thanks, Melinda, for your help. MELINDA HOLT: You bet.