Presentations

On Demand

2020 Graduate Student Research Award Presentations Welcome to the Graduate Student Research Award presentations. This is the third year in a row we have offered this program, and we are excited to announce we were able to select two recipients this year. The theme of the 2021 ATP Graduate Student Research Award ...
A Case Study for the "New Normal": Longitudinal Assessment with Spaced Repetition Are you wondering what all the Longitudinal Assessment buzz is about? Has the pandemic flipped your assessment plans upside-down? Join us, and learn how the American Board of Otolaryngology- Head and Neck Surgery (ABOHNS) partnered with the American Board of Medical Specialties (ABMS) and Internet ...
Access Beyond the Assessment: Building a Digital Assessment System for Accessibility from the Ground Up Accessibility has long been a challenge in the assessment industry, where accessibility components are often retrofitted into online assessment solutions. But when WCAG accessibility becomes an inherent requirement of a testing system, the benefits for usability and maintenance are clear. In this presentation, we'll discuss ...
Accessibility: From Accommodation to Equal Access A recent trend that is emerging in the assessment industry concerns a shift from "accommodations" to "accessibility." Whereas it was acceptable five years ago to offer "equal-but-separate" accommodations, (like separate rooms that required additional work for candidates to get scheduled into), the current expectation is ...
Achieving Diversity and Validity Using Modern Perspectives on Assessing Intelligence Intelligence is an individual difference that is arguably more important than ever for success in a world that is constantly growing in complexity. However, persistent group-score differences has limited its use. Despite its importance, the conceptualization and measurement of intelligence in personnel assessment has changed ...
Assessment Makes a Better World - Where Is the Evidence? The promise of assessment is that it levels the playing field and gives opportunity to all. Using assessments, we can open up the world and allow everyone to demonstrate their potential. The most disadvantaged person can demonstrate their capability in a fair assessment and obtain ...
Avoiding Misuse of Translated Psychological Assessment Scales Psychological assessment scales, such as the WISC-IV and Bayley-III, are very powerful comprehensive tools for assessing children's development delays. Some issues, however, arise when using translated psychological assessment scales across different cultures. For example, a study in China conducted using the Bayley Scale of Infant ...
Business as Unusual: Satisfying Customer Needs During the Pandemic The pandemic continues to have a significant impact on medical schools, students and secure test delivery. Traditional oral and clinical assessments prove particularly difficult to administer. Acknowledging that change was inevitable, an innovative online solution was created to fill this gap. In this session, industry ...
Ch-Ch-Ch-Ch-Changes - Turn and Face the Strange: Addressing Test Security Through a Global Pandemic, and Beyond The year 2020 brought with it many changes, including a rush to remote testing. Making the move from in-person to remote testing is becoming more common — and sometimes required — for certification and licensure programs around the world. However, moving to remote testing has many challenges, especially ...
Changes in Incidents Observed During Remote Proctoring and Record-and-Review During the Pandemic Academic dishonesty is reportedly high in the disciplines of engineering, business and nursing (Dyer et al., 2020). Yet, institutions expect to produce ethical and safe students. Studies also suggest that students will respond positively to efforts to communicate the importance of academic honesty. Therefore, if an ...
Charming Your SMEs: Tips for Educating and Engaging Question Authors If only it was as simple as giving an item writer a topic area and sending her on her way to produce a great question. Testing professionals know it takes a great deal of effort to train SMEs to produce high-quality questions. Additionally, it takes ...
Converting 4-Option to 3-Option Multiple Choice Questions Without Pretesting! Case Study Results This session will explore the benefits of using 3-option multiple-choice (MC) items and explain how to convert an item bank with 4-option MC (MC4) items to 3-option MC (MC3) items without re-pretesting all of the items in the bank. The goals of this session are: 1. ...
Creating a Certification Program for the Credentialing Professional In this session, three presenters will share with attendees the process of developing a credential for professionals who work in the credentialing industry. It is both an opportunity and a challenge to develop a program that meets the expectations of those who themselves work in ...
Develop Better Polytomous Items - A Psychometric Aspect The presentation shows how the Rasch Partial Credit Model is used to provide diagnostic information on the performance of polytomous items and sheds light on some common mistakes when constructing polytomous items. Additionally, the audience will learn how the process is implemented to improve polytomous ...
Dispelling the 5 Myths of Modern Performance-Based Certification Expensive. Complicated. Time-consuming. These are some common misconceptions held by those considering performance-based certification. What has motivated companies like VMWare, Amazon AWS, Google and many others to make the switch to performance-based certification in recent years, despite these misconceptions? Instead of presenting candidates with only ...
Diving into a Pool-Based Test Design: Considerations for Adopting CAT or LOFT Many testing programs use a linear, fixed-form test design, but this design can be vulnerable to test-security threats and is, therefore, best suited for exams that are administered in a short testing event at a secure test center. However, to ensure reasonable examinee accessibility to ...
Don't Get Left Behind - The Time for Micro-Credentials is NOW! There's been a lot of buzz about micro-credentials — for good reason. They're well suited to the task of upskilling and reskilling the workforce. They're flexible — they can be used for multiple purposes, and they enable the customization that both employers and professionals desire. They also ...
From Design to Detection: Implementing Chameleon Clones to Enhance Exam Security COVID-19 caused many changes to the current landscape of assessment, including a major reduction in seating capacity for in-person testing centers. To accommodate the test-administration needs of examinees, a national licensure testing organization decided to lengthen administration windows, but were concerned about the implications for ...
Going Remote: Setting Standards in the Virtual Age Standard setting has remained uniquely difficult to convert to a virtual model due to the complexity of the exercise, the level of engagement required of participants, and potential security concerns. Armed with lessons learned after a year-long project to adapt and innovate a virtual, modified-Angoff, ...
Gotta Catch Them All: Attracting Every SME You Can! Subject Matter Experts (SMEs) are the foundation of any good certification exam and yet, they are often hard to attract, identify and keep. This session explores various practices used in order to attract, identify and maintain experts for a variety of program types.
How LSAC Continued to Meet High-Stakes Security Standards Through a Pandemic In the 73 years since the first LSAT was administered, the test has never gone through so many changes in such a short period of time as it did when the COVID-19 pandemic began its spread across the world in early 2020. Join this session to hear ...
Innovations in Data Forensics for Detecting Collusion and Preknowledge In the past 15 years, data forensics analyses have become essential security elements of many assessment programs. These analyses have focused on using response similarity statistics to detect collusion (e.g., content sharing and answer copying) and using aberrance and response-time statistics to detect preknowledge (i....
Managing "Everyday" Crises Through Incident-Management Teams What do you do when a snowstorm prohibits safe travel and cuts power for thousands? Or an earthquake destroys buildings and endangers all those residing in the impacted area? Or an explosive is detonated, causing death and destruction in its wake? These are all real, "...
Performance-Based Testing: You're in! What's Next? In this interactive session, the presenters will use a series of scenarios and questions in a game show format to present attendees with considerations for what happens after your performance-testing program goes live. Attendees will join "the game," using remote polling software. So much hard ...
Performance-Based Validation: Best Practice for Leveraging Labs for Testing Skills Performance-Based Testing (PBT) is a methodology for assessing individual, practical skills. By focusing on a person's ability to perform a task, it's an improvement on traditional testing. In this session, the presenter — leveraging experience from implementing the world's largest PBT program — will discuss the elements ...
Preparing Your Test-takers for Success with Online Proctoring While online proctoring quickly grew, it was not without its challenges, one of which is preparing test takers for a new kind of test-taking experience. One professional credentialing organization did this particularly well. FP Canada will share the plan they executed to prepare test takers ...
Privacy Concerns With Virtual Proctoring Candidates are expressing concerns that virtual proctoring invades their privacy. • First, having to do a room scan to show the testing environment can be an issue. For example, a candidate living in poverty may be embarrassed by their living conditions. • Next, virtual proctoring typically requires ...
Select Your Own Certification Path: A Case Study of Program Design This case study in program design examines how one highly regarded IT certification program redesigned their program from the ground up. The redesign intentionally emphasized flexibility for candidates' lifelong learning and certification journeys by allowing certifications to be focused on both job roles and technology ...
Simulating the Security and Psychometric Properties of One-and-Done Items The testing industry has responded quickly to the COVID-19 pandemic. There has been a great migration to online testing. Although testing continues, can it continue securely? We believe the time is right for the industry to embrace one-and-done items. We can leverage the technology of ...
SPONSOR SESSION (Alpine Testing Solutions) - Exam Security and COVID-19: Practical Concerns and Strategies to Address Them How do organizations take on the arduous task of managing exam security in light of adjustments made during the COVID-19 pandemic? This session will explore options to help programs tackle all three phases of exam security — Prevention, Detection, and Enforcement — throughout the exam lifecycle. The ...
SPONSOR SESSION (ATA Online) - Lessons Learnt From a Year of Remote Testing in China It has been an unusual year of life experience and social constrains for all test takers and awarding bodies. Being one of the largest testing markets that normally facilitates tens of millions of tests across all age and professions every year, ATA has experienced an ...
SPONSOR SESSION (British Council) - Remote Proctoring in Challenging Environments: Ensuring Assessment Opportunities in a Pandemic With traditional testing centres shut down around the world due to the Covid-19 pandemic, students worldwide were unable to undertake many school, professional and university examinations. ACCA, one of the British Council's oldest and largest clients, was facing significant disruption to exam delivery worldwide and ...
SPONSOR SESSION (CMS) - What Really Matters When Choosing to Transition to Online Testing? This session discusses and describes two programs and their decisions to move to online proctored testing. One program transitioned from paper/pencil to online testing and the other program shifted from brick-n-mortar to online.
SPONSOR SESSION (Examity) - Initiate, Update, and Communicate: How to Successfully Shift the Candidate Experience Online As many programs move from on-ground to online delivery, clear communication to test-takers has become more important than ever. Online proctoring may be a new experience for test-takers, which is why it is imperative to make the process as simple as possible. When making the ...
SPONSOR SESSION (Internet Testing Systems) - The Evolution of Online Assessment with New Delivery Options Test takers are asking for more choices due to the current environment. Our testing partners are looking for innovative solutions to grow their programs, and to continue deliver in a remote world. ITS is proud to share next generation testing solutions that solves both needs. ...
SPONSOR SESSION (Kryterion) - Rapid Test Publishing with Multi-Modal Exam Delivery Having the freedom to rapidly publish or edit your exams whenever you want is a great advantage. It gets even better when you can easily publish them to multiple delivery channels. This sponsor session will focus on the benefits of taking full control of your ...
SPONSOR SESSION (Learn on Demand Systems) - Validate by Doing! Why you Should Implement Performance-based Testing to Better Assess your Learners Want to truly assess the skills your learners gained during IT-focused training? Go beyond testing them! Moving from traditional questions to performance tasks in fully functional IT environments will not only increase the value and effectiveness of your validations but produce a more accurate representation ...
SPONSOR SESSION (Meazure Learning/ProctorU/Yardstick) - How We Maintain Quality and How Quality is Related to Security At Meazure Learning/ProctorU/Yardstick, we have a dedicated quality and process security team within the compliance department. This team is charged with monitoring quality and security irsks and executing process changes/programs to increase the effectiveness of our proctoring operations. In this presentation, we ...
SPONSOR SESSION (Pearson VUE) - Changes, Challenges, and Chances: How COVID Will Impact the Future of Testing Times they have a-changed, and they'll continue to change as we emerge from the pandemic. Join Pearson VUE for a lively "Top Ten" discussion on the ways COVID has changed and challenged us, while also providing us with unexpected chances for growth and new ways ...
SPONSOR SESSION (Prometric) - Gaining Greater Insights and Program Growth Through Data Analytics In order to drive transformative program growth and achieve corporate strategic objectives, licensing and credentialing organizations need to gain greater data-driven insights into the performance of their assessment programs. The software tools and analytical processes developed to support today's business requirements may be insufficient to ...
SPONSOR SESSION (PSI Services) - The Current State of Multi-Modal Testing: Trends, Research, and Considerations Many organizations adopted multi-modal testing in response to COVID-19, giving us an unprecedented ability to examine meta trends across in-person testing and remote proctoring within multiple programs. In this session, we review trends, research, and lessons learned in the past year with the pandemic-driven transition ...
SPONSOR SESSION (Questionmark) - Thinking about Using Questionmark for Certification? Join us for a Quick Demo In a world where SaaS is driving changes to exam development, assessing current knowledge and skills is more important and easier than ever. Certification programs need a way to verify that candidates around the world are keeping their knowledge and skills up-to-date. For each program, ...
SPONSOR SESSION (Six Red Marbles) - Technology-Enabled Solutions: Answering Questions at Scale Six Red Marbles was presented with a challenge: to answer over a million questions in a year. Through the development of the Marbles Answering Platform (MAP) and its workflow, which ensures high-quality responses, we were able to meet this challenge and keep the costs low ...
SPONSOR SESSION (Zoomorphix Systems) - Practice Exams - Ensuring A Positive Candidate Experience What experience do you want for your candidates when they purchase and access practice exams? There are endless options for presenting your practice or demo exams in ways that simulate the testing environment while allowing candidates to access content in ways most useful for their ...
Student Perceptions of Remote Proctor VS Onsite Proctor Test Administrations In addition to the other challenges facing institutions and students during the 2020 pandemic, how to continue to assess student preparedness to enter, progress or complete a nursing program became a challenge for NLN as a test publisher. To meet the need, NLN partnered with Questionmark ...
The Need for Speed: Reducing the Time Between Job Analysis and Launch We live in an age where we have become accustomed to clicking a button and having things arrive the next day, if not within hours. To meet the demands of professionals looking to quickly demonstrate their skills through certification, the current, test-development cycle model needs ...
The World Has Changed: Is Your Learning Strategy Still Relevant? Association of American Medical Colleges (AAMC) administers the Medical College Admission Test® (MCAT®) exam and is dedicated to advancing medical education to meet society's evolving needs. In 2015, the AAMC introduced a new MCAT exam, switching from a 3.5-hour to a 7-hour exam, with four sections, ...
Two Leaps in a Single Bound: From Paper-Based to Remote Assessment In the spring of 2020, medical boards like much of the world at the time found themselves in a pandemic-inspired predicament. Many medical boards rely on in-person, interview-style Oral Certifying Exams as the last step in the Board Certification process. But with in-person exams cancelled due ...
Utilizing Technology for the Ultimate Candidate Experience With the events of 2020 having a significant impact on all aspects of education and training, it's no surprise that the test-taker experience has also seen a significant shift. And, as with any change, having a seamless candidate experience is key. In this presentation, you will ...
When Beta Forms AND Beta Samples Differ: Hitting the Unlucky Lottery? Pretesting items is a necessity in developing valid, reliable and fair assessments. This case study examines a scenario of two 76-item/point beta forms being randomly administered to two unintentionally different samples. The difference in form means was over 8 points, with SEMs of 2.25 and 2.23. By ...