[MUSIC PLAYING] Otan, Outreach and Technical Assistance Network. MARGARET TESKE: So welcome, we have our panel today myself, Margaret Teske from CASAS, Program Specialist. Used to be South Cal but now I'm Northern California as well now, but we actually cover the whole state all of us. Crystal Korbas is here with Pleasanton Adult and Career Education. She's the Assistant Director, has lots of good stuff to share with us, and she'll introduce herself a little bit later with more in-depth information. But she's a cool person. Gilbert Leos has tons of experience. He's at Pasadena City College in the Noncredit division right now, EL Civics Specialist and a technology specialist as well. He's done a lot for their program and today you'll hear more about him. I'd love to hear more about you and your agency. But before we get to that, just a second, the slide deck is posted in the chat. If you can't get it there, feel free to get it on our Google Drive. Let me see if it will copy here, so that you can get it. All copied into the chat real quick. So that you can all get it some people were having trouble. Not everybody's on their latest version of Zoom, so sometimes those files are hard to get if you're not on the latest version. OK, we'd love to hear from you in the chat at any time. We'd love to hear from you right now, if you could just let us know your name, your agency, your position, we kind of like to know who our audience is, so we know where to go fast where to go slow things like that. Don't be shy, I don't see anybody posting come on Cathleen. We'd love to hear from you, also we have set aside after each of our speakers some time for questions and answers. So feel free to join us then. And you can unmute that point and ask us questions or briefly share about your own experiences, OK. Thank you Amy. Thank you Cathleen. OK, well, today we're going to talk about CASAS Remote Testing, various procedures for remote testing, we're going to share about remote testing at the local level, Pleasanton Adult and Career Education. We'll be sharing how to start small and then build your expertise. And then part 3 is how they're doing it at PCC which is more of a larger agency, transforming from challenges into successes. Our intended outcomes are to provide an overview. Can't connect everything all at once but we're here to provide help and to reach out to you with our experience and to let you know what works, OK. Once you to hear from the field on tried and true techniques, then start thinking about how this can work for your school. You're able to express some concerns or ask questions. And discuss really what works at your school but of course, we have to keep that a little bit brief. We have 90 minutes, we we're going to try to do this in 60 but it didn't seem to work so we added and we added an extra half hour thanks to OTAN. And so we have that time, OK. I'm going to get started, unless anyone has a questions so far. Please continue to let us know who you are and what your jobs are. We have a remote testing person, personnel on the office, customer manager for Burlington OK Dinello thanks and Britt Peterson, records and report clerks. So some of you may be our proctors or you're dealing with orientation and registration you want to know more about what we're doing in eTests so and EL Civics so. Good and Laurie thanks for coming. So again, our presentation is posted in the chat just go to the very top of the chat. And if you can't get there, remember we have that Google Drive link. So I'll post that again. OK there are four main approaches to CASAS remote testing. And we'll call them approach one, two, three, and four. Remote control is the first one, that's one on one. Then the second and third one are one to one or one to multiple test takers. The first one is using Windows 10 PCs. The third down the list is-- Oh I missed and oral in there sorry, a one to one or multiple test takers using Chromebook or iPads. And the fourth approach has to do with oral responses. And all of a really good description of all the approaches is on a YouTube video and I posted that link there. Each approach really has their own unique requirements guidelines. So, I would recommend starting with the one to one remote control, especially for ESL beginners, people that are not very tech savvy and CASAS has some great examples that use Zoom. And Zoom breakouts are really great for approaches two and three. So if you can group your students by devices, integrate into Zoom sessions, that also helps and remember that one proctor per five students. You need to monitor and help your students. Each student goes to their own break out when they're ready to take the test. So I'll explain that a little bit more as we go. And if you have questions, please post. Our panels very happy to answer questions as we go. So one thing to remember about remote testing agreements is that you have to have about remote testings that you have to have an agreement and the first type of agreement called an Agency Remote Testing Agreement and there's one specifically for California that includes CASAS eTests, El Civics, and citizenship testing. So all three in one agreement. And that should be done once every year. Of course, you can change it and modify it as you go through the year both your program specialist and your CDE consultants should be given copies of those. And in addition to the school or agency remote testing agreement, also proctors need to be aware even if they're only EL Civics proctors, that they should do a product or remote testing agreement. OK now for CASAS eTests, they also need to have testing certification. It's not hard to do, it's online. All this is online, so it's pretty easy to do. Those are the links, so when you get a copy of the PowerPoint you can just click on the link OK. So for students, test agreements are a little different because they're not through the CASAS website or anything. What really helps is that you get students prepared or as much as you can before they have to take the test. So it helps you to set up some time to work with them one on one, that could take 30 to 45 minutes. But one of my local network schools Hacienda La Puente Adult School they wrote up their testing guidelines for students in the major languages that they have for students English, Spanish, Chinese, Korean. They put that together, and they helped their students once they wanted to get registered automatically getting into a Google Form and going through the rules and guidelines in these languages, so that they could understand what's expected of them for pre-test and how to do that pre-test. So they use sign up Genius for that and you'll hear, I think for Crystal later, how they use sign up Genius this is a Google Forms form that's used by Hacienda La Puente. This is kind of a dummy form I'm going to copy it for you right now and put it in the chat again. You can use that to kind of guide you as what might be possible. If you have questions, you can always contact Maria Tellez. If you don't know her email and you don't get this PowerPoint, you can email me and ask me for that OK. So preparation, you got to schedule your students and set up meetings. The first part is to get them ready for the test, and then the second part, part B is actual test. So sending meeting invitations to each test taker by email or text, you know your students best what works for them. And if you can include the Zoom link or whatever link you use to connect with them. And send them the speed test URL that will help them know how fast their computer is already, hoping that they use the same computer when they're doing the test, not always true but you've got to verify that, and expect that from the student by letting them know. You want to include a link for each eTest sampler, so that students have some practice and they feel more secure taking that test knowing ahead what's ahead. Adults we like to know what's coming up so. Meeting with the students prior to the test is-- that can take 15 minutes or more, depending on student tech abilities and also what you've sent them ahead of time. So basically, when you meet with them, you want to talk to them about the basic procedure for the test date. Ask them about what device they're using, and emphasize that they need to use the same device maybe tomorrow when they're giving the test when you're giving the test to them. Do the speed test together, if they haven't already done it. Make sure they have 2 Megabytes per second or faster. Usually faster is better. Check their desktop, you want to make sure that they don't have a lot of possible programs like Google where they can search for the answers open. You want to make sure everything's closed. And it's great time to confirm that they're still available for the test date and time. And then give them the URL link for the test for the appointment for the test not the actual test, OK. So approach one, one to one. So I know some of you have some experience with one to one. If you have comments about one to one, about remote control, please post those comments in the chat. We want to make this interactive as well. So, this is where the proctor gives remote control access to the test taker so that the test taker actually enters the responses on the Proctor's computer. And this works with the Windows 10 PC. The proctor's computer is registered for testing and is remotely shared through with this examples with Zoom. So it can be easily shared that way. Ok Cathleen's been doing it so Cathleen has it worked pretty well for you guys. It takes a lot of time one on one, yeah. CATHLEEN PETERSEN: Yeah is it OK to talk? MARGARET TESKE: Yes sure. CATHLEEN PETERSEN: Yeah we've been doing it. We've got one, two, three, four, five people and they only work part time so they're only getting two a day. So we're trudging along we got the help from the teachers. We're getting the teachers the list we had a list of students we get we're trying to get go for the post-test right now. And then we're also working on the pre-test for a high school diploma by remote. And it's hard enough to get the students to do one time, so we've been doing the part A and part B together in the same session. Because these are post testers, so they've already tested on in person on each test on a Chromebook so that's what we're doing. When we do the protesters I'm sure will we might have to do the second day because they're new to the school and they haven't taken they haven't taken the test yet. So-- MARGARET TESKE: Have the high school diploma students done better at doing it faster, a little faster? CATHLEEN PETERSEN: I don't know I haven't checked the results yet, but that's something all right, that's something I will check. MARGARET TESKE: Because that's what I've heard from the field that as the higher levels they just go faster not on the test of course but getting ready for the test. So the whole procedure goes faster. CATHLEEN PETERSEN: Oh yeah I understand that part now. OK oh yes it's so much easier and that's why we have when we have like one Vietnamese liaison. So she's calling in and talking to the students lower level students in their own language until they get to begin test. MARGARET TESKE: Yes, you can do that. So it's good CATHLEEN PETERSEN: That our school mostly has Vietnamese. So, there's more so we're letting the we're encouraging we're having our Non-Vietnamese speak proctors schedule and propter the higher levels of English. So that they would have more and more level and higher levels of digital-- MARGARET TESKE: Legal issues, yeah yeah. Great so, if you're new to this whole process it's great to watch this YouTube video. I'm not going to show it now because we're just-- it doesn't seem like you guys are that new according to the comments I've seen from Tamara and Amy. It's Amy, I think. So, great. If you need to look at it the YouTube links there there's guidelines there. This video just takes like seven minutes and it really helps train your proctors as well as get you ready, if you're doing it so it's great training for proctors I think. The more they start with one, on one the more comfortable they feel and then they can move into like approach two or approach three. And approach two, it's still you can do one on one but it's great if you can move up to doing like 5 to 12 students. So that's what they're working on in the field now is enlarging it from 5 to 12 so not every agency can do that it's kind of by special request at this time. So keep it to five but once you're comfortable with five that's not two a day, it's more like 10 a day. So that's great. And how it works is that the proctor is setting the students up in a private breakout room. And so they have five private breakout rooms and they work with the students in the main room and then they go to private breakout rooms check their ID, make sure their room looks great, and they get him started on the test. And then they come back to the main room, grab another student like that. So really it's very helpful if you have two people. Because one can be the moderator teacher person, and then the other Proctor person can take them into the breakout rooms. And so students have something to do in the main room while the proctors taking them enter the breakout rooms. They can also practice the sample test items when they're in the main room as well. So as you can see, if you had two proctors, in addition to the teacher or moderator you could do twice as many students so. The proctor's job is basically, we'll talk about it, but proctor's job is to monitor once they get them all set up, monitor how they're doing and circulate from breakout room to breakout room, OK. And I know Crystal and Gilbert will be talking about that a little bit more too. These are just the basic approaches. So you know what to do. For test takers on Chromebooks and iPads that have to be in a special mode, one is called kiosk mode, the others guided access mode. And again, you have to check they have to register their computers for each eTest, they have to have a certain speed for that. And again, you can do five test takers at a time. And same as above, in approach two. So it's very similar, it's just different devices. I mentioned registering the students computers. So that's done and again a special videos available on CASAS website, well on YouTube so go directly to YouTube if you like. Proctors work with the student to register his or her computer. If you're familiar with TE and eTesting there's a special code that you get and you give that code to the student, and they can register their computer. It's pretty easy to do as long as our speed is as good, and students understand, right? Approach four is basically for Windows 10 PC for the proctor and the proctor's computers registered for eTest. And then the proctor's screen is shared with the test taker but the student don't have the ability to do you like the remote control. So they tell the proctor the answer. And then the proctor writes down the answer for them. The test taker can use a tablet for that, Chromebook, Mac, PC or iPad as long as they have a webcam so you need to have a video on them. So and it's limited to one student at a time. If there's no webcam, you could use a smartphone camera as that-- there is some remote I call this approach 4.2 because it's used a lot with EL Civics for oral tests and for the citizenship oral interview and it's best to do using a video calling app. What's the most popular video app that your students use? I know what I've heard from the field but-- Oh good Cathleen's working on approach two, that's good to hear, it'll help. WhatsApp, yeah Vicky, that's it. WhatsApp is a very, very popular, especially with Asians I believe. But other people are getting into it too. It's really easy app to share with and it's more private I think than Facebook, but maybe I'm not up on privacy so much. But it works well with a small group that I work with. And it's actually we're working with cell phones in a pilot test right now for listening, the CASAS listening tests. So they're also working on it with goals testing so we'll see how that goes can the cell phone be big enough to read things. We're not sure yet. And to do math problems, I think for listening. It's pretty much a natural and it's working out so far. But there's another month of testing to come and we can cross our fingers because students have smartphones. So that might be the easiest way, we'll see. Probably will be out of COVID before all this is just like that. In the future students still want to do some online testing. So all right I'm at the end of my parts are there questions for me? Anything that you want to ask for me and of course, you'll have more questions as we go along from the experts in the field so. Any questions about-- because now is the time for the continuous improvement plan are you guys focusing on remote testing, what payment points are the most important for you to focus on, as part of your goals, let's say. CATHLEEN PETERSEN: We're just trying to get them. We're just trying to get paired scores. MARGARET TESKE: Yeah. CATHLEEN PETERSEN: We've been working on it, and like I said, we have a team of maybe 12, and we're just plugging along. But you know what, we're doing it. So that's going to be our narrative. MARGARET TESKE: That's good, that's good. And as you you'll get a lot out of Crystals' I know because you guys are starting small. And you want to grow a little bit with that, that's good. OK, all right. Well let's move on to Crystal, Crystal there you go. CRYSTAL KORBAS: Well thank you so much Margaret, I appreciate it and thank you for inviting me to be a part of this today. Hopefully everybody can hear me all right, I wanted to give you a little perspective before we dive deeper into what we did at our school just so you can kind of compare and get an idea of who we are and what we're doing. I came on as the assistant director this past year in October, so it hasn't been a long time, and the first thing my director said to me was we need a remote testing program and he is not a heavy adult Ed background, he's more on the career tech Ed and does a lot for K through 12, so it was all about me jumping in and doing this kind of work. And the great thing was I had some background coming into it and we'll talk a little bit more about that. But I will say I had 5 to six years, about six years of teaching ABE and ASC and being the Department chair at Castro Valley Adult. And from that experience, I was very comfortable with testing, of course in person that was not an issue, we did it all the time in our classrooms. We were smaller school too, so we just tested as students came in during a certain time of the year a couple of times a year. And so when I came to Pleasanton, I felt comfortable in the in-person testing and the one-on-one. I'd done quite a few sessions of the one-on-one testing over the summer, and at the end of last school year trying to make sure we got those gains. And so a little bit more about the school I'm currently at and what we were doing. So our school is one that had been swept and was reopened back in 2016, we are part of Pleasanton Unified School District, a K through 12, and we're in the East Bay San Francisco Bay Area. Our demographics, we are predominantly an Asian population in our area, and mostly ESL students, so the majority of our students are and you'll see that I think on the next slide. Age, predominantly 45 or over, and female is 84%. So we have a lot of women in our program and very highly educated in their home countries, and the percentage is really high of diplomas and degrees from outside of the United States. So very, very incredible group of people, very smart, very capable. An older group so may be a little bit needing of technology support, but anyway that goes through that slide. Thank you Margaret, I appreciate it. So I wanted to give you an overview of just how many students we're talking about. So last year we had about 326 ESL students, and right now we are down. We're about 192 ASE and ABE programs. We had about 12 last year, so not a lot of students in that program, but it is growing. And definitely with my background it's a priority that I'm looking at, I'm being able to support more students and moving some of our ESL students that need into our ABE program. And we also have started the ABE program this year, so that's adding a couple more people into our program as well. Really focusing on those students, so I see that growing more and more. So next. So some of our testing challenges. Like I'm sure many other small schools, especially those that didn't carry on over the time that funds have been swept by districts, we have testing challenges because we don't have classrooms that belong to us. In our case, we do not have any daytime classrooms that belong to us, we at night time use the local continuation school Village High School as our location when we're not in COVID. And we use a scheduled kind of shared district room for in-person testing. When I say shared I just mean we have to schedule it, and then it's our room. But we don't have a dedicated place that we can test people on our own, we have to make sure that it's available and there's up to 10 students that we figured out can be socially distanced in this room, and we use a Chromebook card and Chromebooks for testing at least in the in-person environment. We have an older student population as I mentioned. And so we needed to pursue remote testing because there was some vulnerability in that population, and people that were uncomfortable coming in. We have a lot of parents and grandparents in our community and they are really looking for that literacy and to support children and grandchildren, and so it's very important. But they also needed some technology support, and that was kind of a challenge as well to do that remotely but they needed that remote test environment. That is definitely one of our challenges. Next, OK so just to give you an idea of how many students we've tested, so I was actually really thrilled when I saw these numbers. So when I talk about it we've had 306 students tested, they might be duplicated because they pre and post tested with us in person this year, and they were using mostly Chromebooks, yeah, they would have been using all Chromebooks actually in our testing environments. And then when I switched to remote, which was when I come came on board in October and we started really working at this, I will talk to you more about how that took place and how the proctors were trained, but basically we started with one or two at a time and then worked our way up, and we've gotten to 83 students tested. Again, some pre and post tested, so they're duplicated in that number. So that's 25%, that's not bad that we've been able to get through. I will agree with Cathleen with the comment of you just have to keep working at it. It is not an easy thing, and you just have to say I'm going to try to get 10 people tested this week, or whatever it is. And recently we've gotten up to 10 people at a time and two proctors on, and actually we have three just to see if we were going to capture more than 10. So we can make it work but it is a challenge, every test is a challenge. Next one. So how did we handle our students sign-ups? And some of this is going to be more along the administrative side, I'm trying to touch on it, but honestly Margaret did such a great job of covering the different options. So I'm just going to kind of cover some of the things that might be helpful that we took away from the experience, but not try to go in-depth into every piece of the puzzle as far as testing. So each week we would send out emails to our students, not the entire student population but those that we saw had either not pretested or they had 40 hours of instruction or more and needed a post-test at that point. And so we would just gather that, our data person collected that information each week and send out a report, and then we would literally cut and paste into an email. And pretty much the same email went out every single week, why change it, it worked and it connected them to a SignUpGenius form. We actually would have one SignUpGenius form for every week, So that it just dropped off and we got rid of all those ones that were already done, and it worked really nicely and was clean. And the students obviously could do that, it wasn't a problem for them to jump on and to figure out, oh, I want this date and that time, we wanted that to give them the flexibility. I want to say in here that you need to be patient and professional and just ask them to sign up, and I think we all are but sometimes in this game of trying to get as many students in, we kind of try to push them and be demanding of you need to do this by this date, I don't like that, I'm not that person. I just had grace with them and understood that they were uncomfortable and that it wasn't this easy thing I was asking, and so if I didn't get them that week I just kept asking every single week, we just kept putting it out there and then enough of them started talking about it in class, that they felt like I could try that I could do that myself. Eventually nearly all of our students either signed up for the remote testing or the in-person testing, which I should mention the SignUpGenius didn't just have the remote testing spots, it had the in-person as well. So that it constantly was in their mind that, oh, I have a choice. I can go in now if I feel comfortable enough, or I can go ahead and do the online. And I mentioned using the SignUpGenius, it was just the easiest, most flexible way that we could think of to get students to sign up, and then we would use it to send a reminder later and we'll talk more about that on future slides. MARGARET TESKE: Yeah, I put a note in the chat that it's a great tool for practicing calendaring. And EL Civics does that as well as in some of the EL Civics they have calendaring. CRYSTAL KORBAS: I just wanted to show you what that look like, we are smaller so we don't have massive numbers of students that wanted to come in every week or sign up for these, so we were doing a couple of sessions a week. And at first of course two or three people, and we'll talk more in a minute. But I wanted to kind of give you an idea of what it look like and it would just go out to the students each week as a link saying this week is this link, this week is this link. And we do two weeks in advance, usually of dates that they could choose from and we tried to mix up afternoon, evening, morning, some in-person, some especially when we first were starting this in like October, November, we were doing three or four sessions a week of a mixture of in-person and remote. And it added, we just wanted to add that flexibility for the student to have choice. And like I said, we used it for the in-person testing, I think it just gave them the ability to maybe switch to in-person which we could handle 10 people in-person, so it kind of made it go especially in those early months when we weren't doing 10 at a time. It allowed us to be able to have a few more people in a session at the time. MARGARET TESKE: Crystal, Cathleen I think, asked, how do you schedule more than one student at a time at the same time period? CRYSTAL KORBAS: It allows up to 10 people on the SignUpGenius, is that what you're asking? CATHLEEN PETERSEN: I guess it would be, how do you know when the ten is up, when it's full? So will it stop after-- CRYSTAL KORBAS: It won't let them sign up after. CATHLEEN PETERSEN: --drop, and say not available or something? CRYSTAL KORBAS: Right. It just won't even allow them to sign up, and of course they don't have the link at this point. So they have to sign up for us to send them the link of how to get on the Zoom to do the sign up. CATHLEEN PETERSEN: So there's a setting that you can do for that? CRYSTAL KORBAS: Yes, it's part of the programming of available spots. See how it is, I have a Windows 10 and then it's just 10 in parentheses after it, that's how many spots are available. CATHLEEN PETERSEN: OK, thank you. CRYSTAL KORBAS: If it was 10. Yeah, and it'll go down and say nine or eight or whatever as you go. Yeah, thank you. Next, OK. So after there was this whole thing of how do you then know and I agree Cathleen, how do you know how many people, well it was a process we had to take off the SignUpGenius, we left them on there of course on the list, but we would take their name, put it on to another list because our proctors and we'll talk a little bit about our proctors in a moment. But because they were not teachers, they didn't have access and we didn't give them access full on to ASAP, so they didn't have all the student information. So we had to have some mechanism to give them the information they needed like email address, phone number, their language, their ID number, that kind of thing so that they could have that information available. And then the Google Sheet, let me see, they needed to have access to student information yes, and after the session, we also had that same sheet be useful to our people in the front office. They would then create an email and send out the test scores to the student and the teacher on a test score report. And so I had somebody else who would access that and do that work to send it out and communicate with everybody after the fact. And this is just an example of what that Google Sheet look like, we would include the Zoom link, who was in charge of the session and then I was always the second person, which I know is a lot but if you don't know that you're going to have more than five people, you need to have somebody who can put some extra support in there. But be flexible enough to walk away when you're not needed. And I didn't want to schedule somebody for 2 and 1/2 hours of testing when and not have them do it, I wanted-- I'm very sensitive to hourly employees since I did work in that environment for many years, so hourly teachers are close to my heart. So I don't like to schedule people unless I know that they're going to be able to get paid for that 2 and 1/2 hours or the two hours that I've scheduled them for, so I just made it so every session I would jump in for half an hour to 45 minutes, help out and then if I wasn't needed for the rest of the session I walked away. We also use the same document to put the station registration code for each of the sessions. It got a little bit confusing because we were doing multiple like ASC and ESL and pre-test and post-test because our pre's would gather all of our information, and so we had multiple tests that a student could be taking, and we needed to make sure that we had the right session station number for that. So we would kind of use that off to the side, we would just put it up there. And I think that's good enough for this one, OK. And then the day before the student actually came it was a great reminder that one of our staff members was sent out to the student, here's your testing session, your Zoom link, we all look forward to seeing you there. Here are the translated instructions in the language that you've designated is your first language, and it included a screenshot document. And we also would make sure that the primary proctor was also sending out that same document again and establishing contact in case there was problems along the way. I should also mention that the email would have our cell phone numbers because you had to have that quick contact with the student to be able to make sure that they needed to be able to get a hold of you if they-- something happened in their session and they needed extra help. The primary test proctor also emailed them that language, that translated screenshot and then after the session, the front office staff would send out the score report. I probably copied that one again, sorry about that. So a little bit more on or a little bit on selection and preparation for our proctors. So our teachers they were busy, they had a lot going on and normally they were somewhat involved in our courses testing in the ESL world, which was the majority of the teachers we're talking about. And so we really kind of identified early on that, that remote testing function needed to be done by others not the ESL teachers, they were at home teaching and they needed to be connecting with their students. And so what we did was we used our high set proctors to support our courses testing. And so in any case they had started from the beginning because they then HiSET testing, they didn't do CASAS testing. So when I came on I started getting them trained, I worked with them individually and as a group in remote in our sessions remotely. And they were really good with scaffolding instructions, which I felt was really important that they be able to just focus on what's the next thing we need to work on and support to get that student up and running online. And so I did some introduction to the whole testing process first by having them do in-person tests just so that they could see how do I set up a session, work out the kinks of how do I know if they are-- what session they're needing to do, how do I pick the computers, all that kind of stuff. So we worked on that first just to get them familiar, and Margaret could you move me on? And I'll throw in there again that I was the new director or assistant director and I had done in-person testing, actually the school had only done in-person testing up until this point, they hadn't even done one-on-one testing. So nobody was familiar at the school with the testing remotely. And then many students they still needed the pre-test, but many didn't want to do the in-person testing, they were really uncomfortable with it. So it kind of really pushed us towards this remote testing. And so we conducted one-on-one, I had conducted one-on-one remote testing at my previous school. I had a little bit of comfort but I'll tell you I was not like running towards this, I was like that, seems really hard. I've done one-on-one remote, and I think I'm a little uncomfortable with the idea of two, let alone five, I don't know how I'm going to get there. And so I then took on, I can't just throw people at this that haven't done this before. And so I jumped in and did the one-on-one again just to remind me how to do it, and then I started working my way up. Started slow, and then did 1 on 2, 1 on 3, and we started getting better and better at it. But it wasn't a jump into 10 or jump into five with one proctor, it was try it and work at perfecting it. And by the way, so go to the next slide. At the same time, I brought those proctors in and let them watch. So they could see, oh my gosh, what am I getting myself into? And they were so adaptable. I was so blessed to have people that were really just willing to jump in there, and they just started supporting pretty quickly. And again, it was that whole, a couple of my students worked and adults with disabilities programs, they understood the students, they understood scaffolding. I'm not trying to compare, I'm just trying to say if you understand scaffolding and I'm going piece by piece and describing and talking through it, but showing through it too using different techniques when it's not working, they really did a great job of doing that. And so I stress to them though be patient both with yourself and with your students that are on there, and just acknowledge everything that they do that gets you one step further towards this. Give them a clap if you can't pat them on the back, at least give them a clap and say great work. So far this is not easy, and I think that helped, I love your bravo. And so the second sessions I started transitioning to the second proctor and we started getting a few more students in so that my first proctor, the primary was now becoming my proctor that I wanted to run these sessions. But still not running we were still just dipping our toes, and I'll tell you, sometimes you were just clapping because you got it took you an hour and a half to get all four or five people up and running, and then other days were like wow that was like 20 minutes, how did I do that? So I thought that was pretty great when we were getting that much quicker, but every once in a while you'd go back, you take a step back because it would be a different group of people, different issues would come up with a technology, and then around the third session they were able to run the session. And I was able to take a big step back and be able to just support, and then I just continued to support the first 30 to 45 minutes, rarely does it go much longer than that. So recently I mentioned, we've started to allow up to 10 students. Actually I should say that we were prepared for up to 15 one Saturday because we were trying to intake a bunch of pre-apprenticeship or apprenticeship students adults that were needing ESL support from one of our partners in the area. And so we had set it up for 15 students, we only made it to 10 but we did have two proctors, three proctors at one point, but then went to two proctors and it worked, and we were happy about that. And I guess that's kind of that second bullet, we don't have that many but when we do, I stay on the whole time if we do. And I always schedule myself so that I can always step out if nobody's there, but stay if I need if I'm needed. We were really fortunate in that we had one of our teachers is-- one of our proctors is CTE teacher, he's very big into graphics and I hadn't thought that through enough. And he just grabbed it and ran, and I felt so fortunate to have him willing to just jump in and translate. And then we found our district has some supports for checking our translations and we have a student, we have a IA that supports us with translation for Chinese in our classroom. One of our beginning classrooms so she helped. But we really found that this was huge, this was a game changer for us when we developed these detailed documents with screenshots. It just step them through the process so much easier and in a comfortable space for them. MARGARET TESKE: So it's a lot easier when you do that? CRYSTAL KORBAS: It's a lot easier when you do that. MARGARET TESKE: Great. CRYSTAL KORBAS: Yes. MARGARET TESKE: Highly recommend it if you're not-- CRYSTAL KORBAS: Highly recommend it, yeah. And so getting students ready for testing, we had started back and I think the fall before I got here, they had been passing out the Chromebooks that we had in our Chromebook carts. So our students that needed computers were getting computers, and all of those were preloaded with CASAS eTest. So it was already in Kiosk mode, we already had all of that figured out so that was easy. The harder students of course were the ones that didn't have the Chromebooks, and were happy with their Windows 10 or their iPad at home. So we had to get used to using really all three, but we don't use the iPads very frequently, it's not a norm. Students borrowed a school Chromebook if they didn't already have one, we found a lot of our students would come borrow it and then return it because they had what they needed at home. But we'll explain, there are some issues that crop up that sometimes you need the student to just try using the school Chromebook instead that's already pre-loaded. And we provided them that translated document that really helped get our students ready to go usually the day before. So the testing procedures, we use the approach two and three. And we did both, one to multiple with Windows 10, Chromebooks, and even iPads but not very frequently. And I don't know what my time is, I may do a quick time check. Am I running too long? Go a little quicker? I can do it. So we created binders, that's a good testing procedure, I think is create the binders for the proctors to have right in front of them because you can't be looking in multiple Windows on other devices, you really need to have it sitting in front of you. I think it's too hard to be talking on the Zoom and be looking through all these different documents and guidance, it's better just to have something in front of you. And we use the quick reference sheets at the beginning, but they kind of tell you to go up and do this part if you haven't already, and it kind of it was a little bit difficult. And so we just took the key components and made a quick checklist for ourselves based on how we were running our sessions, and I would suggest that it kind of helps to have it in the order that you're going to do it just to make sure you hit all the things you need to do. You had mentioned earlier Margaret that I think it doesn't talk about moving them to the breakout room necessarily before you're checking IDs, but that is I'm going to do ID checks and what the room looks like when they're private, I don't want to do that. So the breakout room part was pretty important to us, and so we wanted to have that step through so it flowed. And that's good, so you can go to the next slide. So lessons learned. The Windows 10 computer, one of our big lessons is especially in a population that has a lot of translation tools that are often embedded at start-up, so when they start up, restart their computer. It just comes on in the background and oh by the way, it's their husband's computer or someone else in the family's computer. They don't even know what's starting up, and they aren't very well vast in technology necessarily. So now they're in a room by themselves and the CASAS test program's shutting down. So we found that was something that happened and yes, I totally agree going to the Help Desk is a very good idea. However, when you're in the middle of it you're kind of left with-- we have to figure something else out and so often that's something else out was do you have an iPad? Can you bring an iPad over? And I was the resident iPad person because really we rarely did it, but I knew to pull up the instructions and run through the steps and get it into the-- I can't remember if it's-- no it's not Kiosk mode it's the other mode but it's the guided access mode, and so I was-- MARGARET TESKE: Guided access. CRYSTAL KORBAS: --I was able to manipulate it. The first time was tricky, but after that it was like, OK, I know what I'm doing, I can do this thing, but it's tough when you got windows 10, Chromebook, and now iPad and you're trying to coordinate all of that. And oh, by the way, your other proctor is supposed to be going in and checking just to make sure nobody's wandered into the breakout room or in the background. And so I feel that that's an important job of our proctors to make sure that the testing environment is correct. So you're helping-- you're juggling all of this, you're trying to juggle so much. So anyway, just to kind of that was one of our aha's was sometimes we had to loan the school Chromebook out and push the student to come in and get it because it wasn't going to work on their Windows 10 or they'd come back the next session with somebody else for their different Windows 10 computer and they understood to have whoever shut down all those other systems beforehand. Sometimes too we would have, is your son home? Is your husband home? Is your wife home? Whoever, can they come in and help you with the Setup and that-- literally I had an eight-year-old child that was doing so awesome putting an iPad into guided access and spoke great English, and his dad was very grateful, and then of course he left the room and I watched him go. MARGARET TESKE: Kids have learned so much from this online learning too. CRYSTAL KORBAS: Yeah, and it's very empowering to the children for sure. OK, and so I'm getting close to the end here, suggestions. So start slow, I mean, that would be my biggest thing is don't go into this with I need to get to this point by next week. You need to be very methodical about it but you need and have procedures and have it documented and have a system, but let yourself have some grace in OK what did we learn? Definitely have some of that discussion afterwards, it's worth the time to get the system flowing smoothly to be able to make sure that the students feel good about the process because you want them to come back and post-test with you, that's pretty important. And so just be patient with everybody that's involved. And be prepared with the documentation that you need. You need to have a list in front of you of the students, you need to have the station IDs written down if you're doing it like we're doing it where you're giving them control of their own computer, and then watching them. I really didn't talk about that, you've got to be really careful about the camera situation. We really didn't discuss that in this but you need to know how are you going to monitor them and know what that device is. So if it's a Chromebook, I need to be able to monitor them on their own cell phone and watch what they're doing. If it's a Windows 10, does it have-- is it a desktop that can't be moved? Well then I need a camera that if it isn't movable, I need their iPhone so I can see around and check their room. So you've got to be a little aware of the limitations of the different devices. So you might, like Margaret suggested, want to only do Chromebooks one day and only do Windows 10 another day because it does get confusing. OK, what are you on? And what do you have that you're using as a camera? OK, show it to me, and I didn't-- I know I-- let me see-- MARGARET TESKE: Your SignUpGenius kind of takes care of that, right? CRYSTAL KORBAS: The SignUpGenius tells me that, but I have to make sure I put it on the spreadsheet that I have so that the proctor knows. Because he's not looking at the SignUpGenius. And I need to make sure that the proctor understands the implications in their training of what it means, that they're supposed to be able to see and I don't know that I hit it. But the other nice thing to remember is that that phone that they're using as a camera, it could be turned towards the screen when they're stuck, not when they're testing. But when they're trying to set up, use it as a tool to be able to see where are they because you get lost in your head. The other thing is if you have the ability to have them, screen share once they get in the breakout room, let them screen share and you can see exactly what they're doing on their computer. You know exactly where they are and what the process is that they need to do next to get where they need to go. MARGARET TESKE: Crystal, we're kind out of your time, but you have a couple good questions. So one of the participants asks what do you suggest for someone who does not have a remote testing team? She's like the only one trained to do remote testing. CRYSTAL KORBAS: Yeah, you're going to be stuck at five people max. Unless you want to try to get on the pilot or whatever if they still allow you to join with the 12, and as soon as they approve the 12, then you're going to try to get to that. But that's a tough one because I always felt uncomfortable as a one-on-five with how do I help that next person and still check the rooms to make sure the students don't have people in there with them. And kind of juggling and going back and forth between all these students and if you get stuck in a 15 minute getting them on boarded into the test, I would say you got to utilize that meeting with the student ahead of time idea. We don't do that but you could meet with the student ahead of time and get them all lined up to go. MARGARET TESKE: So there's a question like you need a second proctor usually, because of the main-- you've got a main room and a breakout room, but actually students in the main room can be told stay there while the proctor takes them into the breakout room and the proctor goes back and forth. CRYSTAL KORBAS: Well you could actually put everybody in-- MARGARET TESKE: Right Gilbert? I mean if you have something else to add. GILBERT LEOS: Well, that's what I do and I mentioned in my slides that we actually just send everybody to the breakout room, but we give them instruction to say, stay in your break room, we're going to come to you because that is the most secure way we can engage with the student. CRYSTAL KORBAS: I agree. MARGARET TESKE: And Beth is asking about your Chromebook lending procedure, can you type that in the chat while we get Gilbert started? CRYSTAL KORBAS: Sure, we're a small school so it's not a big procedure. MARGARET TESKE: Yeah, not a big procedure, good. OK, but a lot of us are small, so that's cool. All right, Gilbert. GILBERT LEOS: Well, thank you very much Margaret, my name is Gilbert Leos, I work at Pasadena City College's noncredit division Foothill Campus. I am the EL Civics specialist there, and just to kind of give you a little brief understanding of how we work in conjunction with Pasadena City College. We are separate from the college, we have our own campus. And we serve primarily adult learners and we also WIOA Title II funded. Next slide, please. Before COVID, we were serving approximately 2,500 students annually but once COVID came around, our numbers dropped dramatically. We had a reduction from 2,600 students to 2,400 students in the '19, '20 year. This year alone you're seeing at least 686 students, which is a quarter to a third of what we were doing prior to COVID. So COVID has definitely impacted us dramatically. And so we're doing our best to reach out to our students and to find ways to engage them and to encourage them to come back to school, especially now as we're moving out of this pandemic. Next slide, please. Of the 686 students, 75% of them were new students, which is very surprising, and 25% came back from the previous year. So a lot of our new students-- a lot of the students that we have are new, and we weren't expecting that, we were expecting mostly our old students to come back, and so we were very at least pleased to see a growth in that area. Of our 686 we have about 74% of the student population are female, and we also serviced about 26% male. Next slide, please. Our ethnicity breakdown. We primarily also service the Asian population, but we also service our Hispanic, White and Black, and African-American population as well, but the majority of it all of it all is our Asian population. We do have a few others that we service such as American, Indians, Filipinos, and Native American, Native Hawaiians, and Pacific Islanders. Next please. So this is what our testing facility looks like. When you come in before COVID, we didn't have the plexiglass. We now have added that so that when we do go back to in-person testing, our students will have the opportunity to sit socially distanced from each other so that they can actually engage in the tests at the lab. But in the meantime, we are using these computers here to give remote access to our students so that they can actually perform both eTests and EL Civics tests. Next slide, thank you. So our computers, we have 45 Dell OptiPlex desktop computers and they each hold eight gigs of RAM, and they use an Icore, an i5 Intel Core Processor. We have Windows 10 on each one of the computers, and right now we are using the Xcellon HD cameras. We just recently purchased those and they've been a benefit because they have built-in microphones with them. We also have our computers loaded with CASAS eTest, of course the three major browsers Google Chrome, Mozilla Firefox, and for us because our computers are a little bit older, Internet Explorer. Of course Zoom is loaded and other applications, such as Microsoft Office and Adobe Acrobat are available. Each of these stations requires that the staff log into them individually. So this isn't just where we can, we're not at that point but working towards it where we can load them up all at once, but at the moment we're required to log into each station individually. In terms of using Zoom and testing, the way we go about it is that we log all of our testing computers into Zoom at the same time using the web signing sheet. The first computer that we designate as the host computer is logged in and inside the actual Zoom application you'll see it as host. And then the subsequent additional computers that we add in become co-hosts, and we can therefore have them all log-in at the same time using one account, versus using multiple accounts. Next slide. With regards to the breakout rooms, students are placed into each breakout room individually when they're taking the test. We use the share screen feature to give the students access to the test on our lab computers, and they do remotely access our lab computers. So it's not that we're giving them a link. And they can go on, they actually get a chance to use our systems, and so we know that we have control over what they're working with and what they're seeing, and everything else with that. Next slide please. What we consider to be acceptable technology for testing. For us, we want students to have computers with built-in or external speakers microphones and webcams, very essential that they have these. We don't mind that they have desktops, laptops or tablets including iPads, one of the things we have kind of distance ourselves from and that is Chromebooks because we haven't had much success with that, and encountered a few issues with it. But we primarily accept macOS and Windows 10 operating systems. Next slide. So the issues that we've encountered specifically within Zoom have been share screen. We would initially share a test and then we would share something else. And in the process, Zoom would crash on us every single time on our end and sometimes on the end of the student. So in order to remedy that, what we found is that by unchecking the screen sharing option under use hardware acceleration for in the advanced section of share screen setting, we were able to utilize share screen in such a way that we can now share multiple windows whenever we needed to. Another issue we have of course, is with the iPads. They would not allow us to view our students while they were taking the test remotely and utilizing our computers. So one of our colleagues came up with this solution, where if you use the side-by-side mode inside of the share screen setting that it would broadcast the actual camera from the iPad while the student was taking the test. And because of that, we were able to keep them on camera and watch them as they performed the tests. Next slide. At our campus, when it comes to EL Civics testing, we test our ESL courses levels one through five. These courses roughly match the courses and interest functional levels. Our lowest level one being beginning low and level five being advanced. These courses are split up into two sections, A and B. And so our courses will range from English 1A to ESL 5B. Our class sizes are typically around 20 to 30 students, occasionally we have more or less but that's how our courses are set up in terms of ESL. Next slide. These classes are tested three times a year when it comes EL Civics. We have our ESL classes on an eight week session schedule, and so for the fall semester, we'll have a first session of eight weeks in the-- we'll have a second week session, and then the spring we'll also have a first and second eight week session as well. And during this eight week session, what I found best is to test our students within the fifth and sixth week, giving them sufficient time to acquire all the knowledge that they're going to learn from EL Civics at that time. Next slide please. And so during the 2020 year, we decided that we were only going to test levels four and higher just because in the initial part of our COVID issue back in '20, a lot of the students were struggling with technology, understanding technology especially our ESL students. They were not able to understand well, what is this function or they couldn't understand even the simplest of instructions, and therefore because of that we made that decision to just go with the students that we know who have had more success over the years and understand instruction. Therefore we choose them, and for the first fall 8 weeks we had 61 students actually participated in our assessment, the following eight weeks we increased by 76 and we're hoping that this spring semester will have even more. Next slide. When I prepare the materials and I'm pretty much the one who does it, I actually start with the courses rubric. And so what I'll do is depend upon which club we have selected for the year, and we select usually typically three. I will pull that course's rubric out and begin reviewing it, researching all materials, all the information needed to teach and create the tests so that the students have that information to not only just acquire and learn it, but they're ready to go. And so we start with the rubric first, next. Once I've done all the research and I've actually gone through a grade tests, I know what's going to be on there. I have all the materials and all the slides and all the nice little images you have to go looking for, I actually put all that into Google Slides, I found that that has been very effective in terms of distribution more than anything else. Prior to COVID I was printing out papers, and maps, and pamphlets, and booklets, and it was costly and time consuming. With the slides it's much simpler and easier, and it seems to be helpful with the instructors when they're trying to teach that material in their classes. Next slide. So one of the things that I did with my manuals or booklets, a protocol was make sure that there was practice exercises and I continue that even today by creating a Google Doc, that gives the students the opportunity to see what type of questions will be on the EL Civics exam and to get a chance to practice. And not only just practice, have the answers so that they know what I'm expecting to see when I actually grade their exams. And so I make those available via link as well. Next. Our instructors, what I do in terms of all of the materials that are created and everything that we have, I make sure that the instructors get this prior to the week, the week before class begins. We want to make sure that our instructors have everything that they need and understand what's going to be coming up for that year so they can incorporate it into their lesson plan. And so I make sure that the links are provided for the Google Slides and Docs, as well as the link to a student testing agreement. One of the things that we would like to have and continue to have is that our instructors engage them, engage their students in understanding what is going to be expected of them when they come and take the test. And not just from not just hear it from us but hear from the instructor, and not only that if they have any questions, they can also ask the instructor, what this means, what that means. Also provide them a PDF copy of the courses assessment rubric just to let the instructors know how the test will be graded so that they can prepare better, prepare their students and understand that it's not just me who wants to make up things that they actually get what they need. Also I provide additional information and instructions, such as what to emphasize in their lessons and how or when we're going to take the test. Next slide, please. With the proctors, I'm pretty much the only proctor. I do have-- we do have our courses coordinator and she does help me whenever we begin testing. And what I do with her is I walk her through the entire process, I make sure that she has the opportunity to have all the documents whether digital paper, so that she knows what it is that we're going to be working on or what information to me to acquire from these students. We also have rosters for each class that we deal with, to make sure that we can know who's accepted, who's agreed to the agreements, and who's there. And so she has all the information and after we've gone through the process, we'll then have a Q&A amongst each other to see if there's any questions she may have or I may have some questions of her, so we'll go through that nice little dialogue. Next slide. Again the instruction materials I create from Google Docs and Google Slides, all that material. Those links are given to our instructor and the instructor is responsible for sending out that information via email to their students, as well as posting on their main Canvas page. And so we want to make sure that the students they can go in either place to get that information and begin preparing for the exam. Now as far as the content being taught, we allow the instructors the freedom to teach it however they wish. Whether it's synchronous or asynchronously so that it works and conforms with their lesson plan. Next slide. Now the way we set the lab is that each computer is logged in to Zoom on the day of the test and then assign to its own proper breakout room. I also utilize the Firefox web browser and that's where I go to the cool form, where the test has been created and have it ready and prepared so that they can give it to the students. The spellcheck component of the browser is disabled, students love to use this feature with Firefox. I guarantee to disable that and make sure that they're not able to use it. Next slide, please. Next slide, OK thanks. Our web cams are turned on, and we make sure that they stay on until the student begins the test. Once the test begins we turn them off so that the student is not distracted by anything else and they're focused on the exam. Microphones are initially muted but when the proctor engages with them we turn them on, and they remain muted once the test begins. Next slide. We have our students when it comes time for test. We have students come during their scheduled hours to the Zoom room and once everybody's there at the scheduled time, we give them an additional five minutes for any latecomers that may come in and then we begin to give out our instruction. Next slide. And when we give out that instruction to our students, we review the functions of Zoom. Some of the most important functions that some of them do have trouble with even when we get to that stage and that is with chat. Share screening and breakout rooms. We've had students who when we try to engage them in chat they don't know where it's at, they don't know where the button is. So we make sure that we have a slide that explains to where there are, these functions are at, and how to access them. We also review the testing agreement and make sure that they understand what is expected of them and ask them if they have any questions. Next slide. We also let them know about the breakout rooms and about what is going to be expected of them once they reach there, such as they will only have photo ID. They will need to make sure that their test area is clear and they will also make sure they need to make sure that they are the only person in their room. We do ask and emphasize that they please stay in their breakout rooms because we've had students who have exited the breakout room and had difficulty returning back to it. Once that all that information has been disseminated, we then assign each student to the personal breakout room and set them off. Next slide. So once the proctor goes to the station, what they do with each individual student in their breakout is they asked to see a valid photo ID and then they asked to see the students room, and then they ask the student if they agree with the testing agreement. Afterwards once all that has been completed, the proctor will then inform the student that they can leave once the test has been completed and they're ready to go. Next slide. Once the student is ready to go, the proctor will share the screen, giving the student access to the lab computer and they will be able to remotely access it. And we can see as proctors what is going on when they're taking the tests, whenever they're having an issue with writing, we can see that if they're having an issue with the question, we can see all of that. And so we monitor that throughout the process. But once the student has access, we now move on to the next student as quickly as possible. And so that we can then monitor all of them all at once. The next slide. Now during the test again we monitor the students, we make sure they're following the guidelines, make sure there's nobody in the room and we're there if they have any questions. If a student goes teacher, teacher, were there to answer their questions in any shape, or form. Next slide, please. After the test, we regain control of the computers. By then the student has already left the room and we close out the web browser and afterwards we just exit Zoom. And once that is done, the EL Civics testing is complete. I believe that-- and that's it. Any questions? CATHLEEN PETERSEN: I have a question about-- I understand doing the remote control on the one-on-one, I understand about assigning students to different breakout rooms and monitoring them, but I don't understand how all the students can be remote controlled so you have-- explain that to me again. GILBERT LEOS: OK, so what it is that for every one student you have one lab computer designated for them, that is assigned to one specific breakout room-- CATHLEEN PETERSEN: OK. GILBERT LEOS: --and when you have that one-on-one relationship, that student you can then give access to that one computer to the student, and that student has access. So everything is one-to-one in terms of-- CATHLEEN PETERSEN: So it's just like on a one, just like having one-to-one only you're setting him up, OK, and breakout instead of that, OK. So then how do they-- you said you sent them one Zoom address and you make one host and the other co-host. GILBERT LEOS: OK, so what we do in terms of setting up the lab is that all of our computers are logged into one account via the web signing of Zoom. From there we send each computer to its own specific breakout room, the student will then be assigned to that breakout room where that computer exists, so that we can have that relate-- so that computer can be related to that student. And then we can share that screen with that student. CATHLEEN PETERSEN: OK. GILBERT LEOS: Does that make sense? CATHLEEN PETERSEN: OK so you're kind of creating a Zoom meeting with your-- lab computers, you're creating a Zoom meeting and the computers are the individual breakout rooms like it would be a person-- GILBERT LEOS: Yes. CATHLEEN PETERSEN: --Zoom meeting and now you're adding the component of having a student go into the breakout room and now gets remote control over the computer? GILBERT LEOS: That's correct. CATHLEEN PETERSEN: OK. MARGARET TESKE: Now Gilbert you're still having one proctor for five students? GILBERT LEOS: Yes, that is correct. But we do-- MARGARET TESKE: But you using the one to one remote control system that's-- GILBERT LEOS: That's correct. MARGARET TESKE: OK. Lori had a great question. I don't know if you want to go Lori or I-- LORI HOWARD: So Gilbert this is Lori, hi. I was just wondering about which skills the low level ESL students need to learn in order to be able to participate in your CoApp testing. If I understand correctly, you said the CoApp testing was only for the higher levels. GILBERT LEOS: That's correct. It seems that some of them had trouble understanding how to utilize Zoom, how to install Zoom, and also some of them were not familiar with computers that were much more familiar with their phones. And we were trying-- we're trying to keep away from the phones for EL Civics testing at the moment just because the screen size is just not big enough for the test. MARGARET TESKE: But there are EL Civics that are oral, oral testing. GILBERT LEOS: Yes, the EL Civics class that we selected was not oral, it was written. MARGARET TESKE: Oh, OK. LORI HOWARD: But I was also wondering, had those students been pre and post tested on a CASAS test previously so they would have had experience with the computer in the CASAS testing? GILBERT LEOS: That, I would assume that they were, but I have no idea as to at least for this year they would have. Prior to that, I'm not sure if they were tested before back in the fall of '19, or early spring '20 before the COVID hit. And so that was the reason why we made the decision was based upon that information at that time and not on the 2021 year. LORI HOWARD: OK, thank you. CATHLEEN PETERSEN: We're having success with beginning lit students working with in Zoom classes now, but it took time, we're actually getting beginning lit students remotely tested one-on-one. GILBERT LEOS: Wow. MARGARET TESKE: Great. CATHLEEN PETERSEN: Great. MARGARET TESKE: Yeah, there's a lot of things Gilbert I'd be happy to chat with you about EL Civics and what you could do to get reaching down to the lower levels, there's a lot of teachers that are really good at that. CATHLEEN PETERSEN: Start at the higher levels for everything. [LAUGHS] MARGARET TESKE: No, for EL Civics, CATHLEEN PETERSEN: Yeah. MARGARET TESKE: You know CoApps, there's a lot of CoApps that are really good for lower levels. And you know like Alisa in your area, Cathleen, and then-- CATHLEEN PETERSEN: Alisa, yeah Alisa does-- MARGARET TESKE: Alisa Takeuchi. CATHLEEN PETERSEN: She teaches beginning lit, but she has her beginning lit students go ahead and do the beginning low assessments. Awesome. MARGARET TESKE: Yeah, so it's possible. You really have to help them choose the right CoApps basically. Oh OK, other questions? Good question Lori, like that one. Other questions? Gilbert has a lot of different procedures that he uses, are a little complicated, keep that in mind. I mean, start slow like Crystal said, and build up, build up over time. It's the best way. CATHLEEN PETERSEN: I just want to chime in again, Crystal, and just say everything you were saying we tried, we did the short checkoff list, we had them looking over the shoulder, we have-- the thing is the only thing we haven't done is the SignUp. We've been getting the list from our resource room from the list of students who need to be tested giving them to the schedules, the proctors then they've been working with the teachers in their Zoom meeting, in their Zoom classes trying to get students signed up for their working days and hours. CRYSTAL KORBAS: I understand, that it's whatever works for you. You've got to be patient with yourself and your group, and just try your best. One at a time, 10 at a time, whatever you can do. MARGARET TESKE: And we have to think like the future too. I mean once it's over, we feel like we can get back into classes. What can we do for those online classes still because a lot of students still want to do some online classes? They like that format, it's a lot easier for them. GILBERT LEOS: I know I would love to keep EL Civics remote regardless or even if they just come into the lab and do it on the computer, it just seems to be a little bit easier and especially when you're disseminating the information. It's just much easier to send out the link and have everything prepared than it is to print it up. MARGARET TESKE: I forgot to put up the presentation slides link here, but it is in the chat, OK. DOMINICA: Hi, I have a question, this is Dominica. MARGARET TESKE: Yes. DOMINICA: For Gilbert, I saw that you were using Google Form for the test, how about for an application form? Are you changing it to like a Google Form using Google Form or what? GILBERT LEOS: At this moment we haven't actually done anything with applications. However, I would most likely be inclined to use the Google Form just because for an application is nothing more than a form and you already have it there and you can customize it to whatever needs that you need. And you can pull the data out in CSV file, and import it into either access or Excel depending on how you want to grade it. DOMINICA: OK, thank you. MARGARET TESKE: And Cathleen posted that they have a fillable application form that's online. Maybe Cathleen you can connect with Dominica and let her know. CATHLEEN PETERSEN: No I'm just saying we didn't use it. But when we were getting ready to do something, we had some-- we had we were looking at one of the employment ones and I saw that there were fillable ones. But we needed, I needed somebody's help to turn it into a PDF or whatever, so we didn't actually use it but I'm saying that there are real, so you could set up, when they say-- MARGARET TESKE: Authentic. CATHLEEN PETERSEN: --or something-- yeah. DOMINICA: Of course I understand a form is a form, and we want it to be authentic. But is it possible to just do a Google Form instead of a PDF, a fillable PDF? MARGARET TESKE: Yes, you could have an image with the numbers by the areas you want them to fill in and put that on the Google Form. DOMINICA: Oh, OK, that makes sense. MARGARET TESKE: And Google Forms have come a long way since I used them a lot. Keep that in mind. But check in with other agencies too, a lot actually use application forms. DOMINICA: Thank you. MARGARET TESKE: Good question Dominica. And Bethany mentions that we want to encourage you to do the EL evaluation. Let us know how we did, let OTAN know how we did. And Lori Howard's here, she said yes, you can use Google Forms. LORI HOWARD: Sorry I couldn't find my unmute, can I just say quickly that you can use it. The idea of authentic that you would use authentic questions if you're going to do it electronically, you could just put the authentic questions into a Google Form. DOMINICA: Because in class when we teach them we do share the PDF, but it's so much harder for low level students to do like the fillable document. LORI HOWARD: But you can always adapt for the low level students. DOMINICA: OK, thank you. MARGARET TESKE: Remember though you are getting them ready for real life-- DOMINICA: Yes. MARGARET TESKE: --if there's a push and pull there. Well thank you all for coming. If you have more questions, please feel-- [AUDIO OUT] --us, we'll have a chat and talk via email. And thank you for coming.