Earlier this year, PAR welcomed A. Jordan Wright, PhD, for a webinar concerning best practices in teleassessment. Dr. Wright is the Director of the Center for Counseling and Community Wellbeing at New York University's Steinhardt School of Culture, Education, and Human Development, where he also coordinates the psychological assessment curriculum in the Counseling Psychology program. He is the author of the upcoming Essentials of Psychological Tele-Assessment. As teleassessment has become an increasingly important part of many clinician’s lives, we are republishing selected questions posed by webinar attendees looking for ways to incorporate teleassessment into their practices. For a full list of the questions asked of Dr. Wright and his responses, click here.
Q: What are your thoughts about using personal protective equipment (PPE) during assessments? If we use PPE, is it okay to change the order in which subtests are administered?
A: Currently, we have absolutely no research into the potential impact of using PPE on the data that emerge during an assessment. Remember, the more you veer off from standardized administration, the greater the threat to validity. So, changing the order of subtests adds one large variable that changes standardized administration procedures. PPE adds another (and in a way that is likely to be quite significant).
Q: My school district is asking us to only report confidence intervals due to breaking standardization with PPE during in-person testing. What are your thoughts on only reporting confidence intervals?
A: Because we know there are not systematic effects of teleassessment, confidence intervals are helpful (they can remind us and readers that scores are imperfect). However, with PPE, we don’t have research studies to confirm where children's scores would likely fall, so even confidence intervals can be misleading.
Q: Is there a disclaimer about teleassessment that could be used in reports? Is there specific language that should be used to make it more legally defensible when doing teleassessment?
A: Mine is evolving. Here's the gist of the language I include: 1. It should be noted that the evaluation was conducted using teleassessment (remote) procedures. 2. It is known that administering tests in this way may have some effects on the validity of the data that emerge from the tests. 3. However, the teleassessment was conducted in alignment with the best and most current research evidence to elicit data that constitute a valid representation of the client's functioning.
Q: In your experience, how are teleassessment reports received by schools, testing boards like ETS, etc.?
A: Many school districts have developed their own rules. Check with your school district and the state psychological associations in your state. Advocacy is a role that we as psychologists need to take on so kids can get resources they need. If a school district or company has a blanket statement that they will not accept teleassessments, work toward educating them about the evidence base of conducting teleassessments.
Q: What information can we share with parents, families, and schools about equivalence and validity?
A: We have reviewed the current state of equivalence/validity research across all tests for the Essentials of Psychological Tele-Assessment book. It is of course fair and ethical to discuss the limitations of the evidence base with the interested parties. But you can also summarize the current state of support (for the most part, across IQ and achievement tests, research has shown very little, if any, impact of conducting testing remotely on scores that emerge).
Q: What’s your best advice when remote testing ELL students with chaotic settings at home (lots of siblings, distractions, limited ability from parent to support)?
A: This is really tough, and it's a social justice issue. Obviously, we cannot only provide services to those with “perfect” home environments. A remote, in-office setup is one way that we can balance the safety of tele-assessment with better controlling the environment. If you set up an office with a laptop, any manipulatives and response booklets, etc., and have students come into that office to do their remote assessment, this provides a much more controlled environment. This is also the solution when students/clients do not have access to the necessary technology (e.g., a stable internet connection).
Want help with remote and teleassessment? We can help here!
Want to view the entire webinar? Visit the PAR Training Portal!
This week’s blog was written by Lindsey O’Brennan, PhD, a licensed psychologist and owner of Morningstar Wellness.
In March 2020, the majority of Americans were faced with the stressful and uncomfortable task of transitioning work to be entirely remote. No more were the days of enduring the rush hour commute or booking flights for work conferences. Instead we spent our energy buying and learning new online platforms and software. The titles of mom and dad were suddenly synonymous with teacher, coach, and classmate. We carved out space for a home office and, if possible, a sense of privacy from family members (our new coworkers). The after work happy hours were replaced with Netflix binging (thank you “Tiger King” and “Ozark” for your life lessons!), learning how to make sourdough bread, or taking our dogs for yet another walk to get out of the house.
The initial phase of lockdown was difficult on even the best of days. Yet there was a sense of unity during those early months. I felt closer to my neighbors who now became the only other people I physically saw beside my immediate family. I relished our neighborhood walks and time spent in the backyard as a family. I frequently saw “We’re in this together” and “Kindness matters” signs in the windows of closed-up shops or spray painted along my neighborhood streets. There was a sense of hope that America was going to get through this. There was also an underlying optimism that we would be waving goodbye to COVID by summer.
Well hindsight is 2020 (not sure that saying holds up anymore). Despite our desires for a quick vaccine, COVID remained ever steady in our world through the summer and fall months. However, noticeable things were changing across the nation in terms of the reopening of businesses and school districts and the growing need for mental health services.
Related Article: ASSESS THE IMPACT OF THE PANDEMIC ON KIDS
As a psychologist who works both in private practice and with local school districts, I had to decide how and when I was going to return to work following quarantine. During the initial lockdown, I moved my entire business over to telehealth. Because of this, about 25% of my clients—particularly school-aged clients—decided to take a break from therapy until they could be in-person again. I frequently heard from parents that kids were “simply Zoom-ed out” and didn’t want to stare at a computer screen while yet another adult talked to them. I also noticed I was not bringing my best self into the telehealth therapy sessions. I would catch myself glancing down at the clock more frequently. I hated knowing that my inbox was one click away from the telehealth browser window, thus requiring me to mentally refocus more often.
Part of what I love so much about therapy is creating a sacred space for the client where they can unload their emotional baggage. But with telehealth, we did not share the same physical space, so the distractions of the real world felt ever present for me and my clients. It came to a point where for me, the benefits of telehealth (ease, safety, convenience) were not outweighing the risk of contracting COVID-19. My focus was then to develop a plan for how I could safely offer therapy to clients in person and via telehealth depending on their needs and comfort level.
Related Article: E-MANUALS: CONVENIENT DIGITAL TOOLS TO HELP YOU
I want to point out that my decision to return to my office full-time was a personal one. I’ve talked with a multitude of colleagues—some of whom returned to their office months before me and others who continue to solely provide telehealth services. No matter where you land on the spectrum of remote versus in-person work, here is some food for thought on how to navigate the path to a new normal:
Related article: Read Dr. O’Brennan’s blog on her initial shift to telehealth services.