Panel Discussions

On Demand

Accommodations with Remote Proctoring: Challenges & Opportunities Delivering test accommodations in a remotely - proctored format can present many challenges to candidates with disabilities, test sponsors and test-delivery providers. Some traditional accommodations, like extra time, may be easy to implement in a remote-proctored setting. But what about extra breaks? What about testing ...
Ask the DPOs Ask EU DPOs for 2 association member organizations about their roles, how companies can utilize their services more effectively, what they see as potential stumbling blocks with ever-evolving privacy and data security concerns, repercussions of the invalidation of Privacy Shield, SCCs, and more.....
Assessment Industry and Edtech: Leading or Following? The edtech industry is a thriving economic sector. According to a recent report by Grand View Research, the global edtech market is projected to reach 285.2 billion USD by 2027. The COVID-19 pandemic has highlighted the need for education technology and broadly accessible assessment opportunities. Rapid changes ...
Automated Item Generation: State of the Art, Issues, Future Research Automated item generation (AIG) is an innovative practice that is gaining increasing attention as a viable method to create virtually unlimited test content using algorithms in lieu of humans. The benefits are apparent: cost efficiency and security chief among them, making test items disposable and ...
AWARD WINNERS SESSION: Perspectives on Testing: Where We Have Been, Where We are Now, and Where We are Headed If ever there was a time to hear from the best and the brightest in our industry, it is now! Join us for this special panel session as ATP's 2020 and 2021 ATP Award Winners weigh in with their perspectives on testing: where we have been, where ...
Beyond Assessments: Why you don't want to be a test provider in a solutions marketplace The challenges that the testing industry is facing in terms of the backlash against testing, can be effectively addressed, not be defending testing for the sake of the tests, but because the tests themselves are the entryway to solutions. Whether it be in Education, offender ...
Bias In, Bias Out: How Can We Responsibly Use Artificial Intelligence and Machine Learning Algorithms Artificial intelligence and machine learning (AI/ML) models are powerful tools for assessment professionals to have in their toolkit. AI/ML can efficiently help us improve our ability to predict important outcomes and, as a result, help us and our clients make better decisions. But ...
Business Continuity During the Pandemic: How to Pivot to a Remote Grading Process The COVID-19 pandemic brought about a sudden, dramatic and global shift for testing delivery. We were forced to make a decision: cancel exams or find a computer-based delivery method. With a plan to expand to computer-based delivery in 2.5 years, we made the decision to be ...
Developing a New High-Stakes Assessment: From Start to Finish The development of a high-stakes exam is a challenging process that involves multiple stakeholders. One higher-education, health-profession association took on the task of developing a knowledge-based assessment as one component of a student's medical knowledge in the last four months of their education. There were ...
Evolving Content Practices in an Online World Since the massive rise in online, proctored-test delivery, bad actors have found new and interesting ways to cheat. There are a number of content and exam-design practices that programs can use as offensive and defensive security practices. Managing item exposure through limited testing windows, multiple ...
Facing the Courts Security and privacy incidents often include both legal and public relations implications, and potentially even more so as testing programs have rapidly shifted to remote testing in response to the global pandemic. The reality is that any incident may be judged not only in the ...
Fair and Equitable Assessments for All Measurement professionals always strive to create assessment products and services that are equitable and fair for all people. However, there has been an increasing level of criticism recently to suggest that there may be a need for additional commitment and a unified front in eliminating ...
Global Credentials: How Did They Get There? International or global expansion of a certification or credential is complex and requires a feasibility assessment of multiple variables before proceeding. Presenters will discuss the paths taken by their certification/credentialing programs to address global needs for standards of practice in their respective professions. Each ...
Have a Psychometric Question? Ask a Panel of Dueling Psychometricians! Psychometricians representing different operational perspectives from a variety of testing programs offering certificates, certifications and licenses will field a range of test-development and psychometric questions from audience members. Questions may range from the first steps of designing a program to item development to standard setting ...
How Can the Educational Testing Industry Help Close the Achievement Gap Widened by Covid-19? A continuing concern in K-12 education in the United States has been the pernicious achievement gap between under-served children children of color, children with special education needs, and children in low SES schools and more privileged children. During the 2019-2020 school year, many things happened ...
How the COVID 19 Pandemic Has Escalated Digital Transformation For Testing Companies Two months into the COVID Pandemic, Satya Nadella, CEO of Microsoft, was quoted as saying that orgamnizations had experienced 2 years of digital transformation in two months. By the end of the summer of 2020, the Rotman INstitute in Toronto reported that the rate of change had ...
IRL v URL: A Roundtable on the Impact of Talking to Test Takers Remotely Testing organizations can gather informative feedback from current and prospective test takers, using approaches including objective/empirical, self-reported qualitative data and structured qualitative interactions, including cognitive labs and focus groups, which can be tailored to focus on specific aspects of validity-evidence gathering. As in-person meetings ...
Launching a Brand-New, High-Stakes Certification Program During COVID-19 The global pandemic has had an impact on assessment programs the world over, making test owners think quickly on their feet and explore new ways of testing their candidates. Join us for an interactive discussion exploring the challenges and successes of launching a new, high-stakes ...
Leading Through the Pandemic: Leadership Lessons and Insights from Industry CEO's 2020 and the COVID 19 pandemic tested every one of us professional and personally. For CEO's the additional challenge of steering their organizatioms through the financial uncertainty, the digital shirfe, the mass adoption of work from home and the planning of return to office as well as ...
Making the Jump: Questions and Considerations When Weighing the Benefits of Linear-on-the-Fly (LOFT Testing) This session will outline considerations that credentialing programs should make when contemplating the transition to Linear-on-the-Fly (LOFT) tesing. The characteristics and benefits of LOFT will be discussed, along with the evaluations programs should make while making this determination. Evaluation can be accomplished by assessing the ...
Online Proctoring and Test Center Equivalence & Considerations: A Comprehensive Look Online assessment is demonstrating tremendous potential as a tool to expand access and streamline the experience for test-takers but there is confusion about security & appropriate applications of online proctoring. During this session, a panel of assessment experts from a variety of backgrounds will present ...
Online, Remote-Proctored Testing: Issues and Research in High-Stakes Settings In this session, the editors of ATP's Journal of Applied Testing Technology will serve as a panel to discuss a collection of articles in a special edition devoted to empirical research and theory-driven discussions examining key issues in the use of online, remote, proctored assessment ...
Post-Pandemic Asia EdTech: Growth and Deepening in Learning Assessment EdTech based learning created new learning environment where teachers and students can create content using lecture capture solutions (LCS), MOOCs and LMS. The technology-based learning enabled opportunities for developing 21st century skills of collaborative, and online independent learning that could be engaging, moving away from ...
Quality Management: Pros, Cons, and Tips for Building and Maintaining a QMS Third-party accreditation and best practice for credentialing programs require a proactive system for quality assurance and improvement. Through a series of questions, panelists will discuss the pros and cons of a quality-management system, offer solutions to common challenges, and share tips and tools for maintaining ...
Remotely Proctored Exams: The Human Side The delivery of remotely proctored exams has been discussed, dissected and debated by assessment professionals extensively. There are white papers on best practices, research papers on effectiveness, and guidelines for securing these environments. However, how much dialog have we shared about the test-taker's perspective in ...
So Your Test Content Has Been Compromised. Now What? In this panel discussion, we will discuss the potential impact compromised test items may have on program policies, test-development activities, test administration, and forensic analysis. We will speak with leaders representing certification programs who have encountered and responded to incidents of compromised test content, a ...
Test Fraud Prevention-Inoculating Your Test Program Against Item Leaks, Harvesting, and Pre-Knowledge Test fraud erodes the reputations and intellectual property of every high-stakes test program. For decades, our industry has focused on detecting, not preventing, the spread of test fraud. As Ben Franklin stated, An ounce of prevention is worth a pound of cure. What if you ...
Testing Accommodations - Legal Challenges and Practical Solutions in 2021 and Beyond COVID-19 has changed our world in many ways. The legal precepts that apply to disability accommodations in testing are no exception. This session will provide a refresher on those principles under the ADA. It then will focus on how they are evolving to meet the ...
The Promise and Perils of Using Artificial Intelligence in Testing This panel brings together experts in artificial intelligence and assessment to consider the likely benefits of using AI within assessment to make decisions about people and also the possible pitfalls. Although artificial intelligence promises advancements in precision, efficiency, cost reduction and unbiased data-driven decision-making, AI ...
The Roles of Humans and Machines in Test Scoring Systems The growth of interest in the use of Artificial Intelligence in the area of assessment has seen the introduction of auto-scoring systems across the industry. While these systems have been shown to increase efficiency and scalability in the assessment of both written and spoken responses, ...
Transitioning from In-Person to Virtual OSCEs: How Three Licensing/Credentialing Organizations in Canada Are Leveraging Technology to Deliver Performance-Based Assessments in the Face of COVID-19 Challenges It's been a year since we abruptly embarked on our work-from-home virtual journeys. In that time, we may have upgraded our home offices, but many of us are still there. WFH is no longer new, and it may, in fact, be here for a while. ...
Treating Your Pandemic Hangover - a Workforce Perspective In response to the global pandemic, our world has experienced radical shifts in a short period of time. The need to social distance has caused educators and employers to think differently about distance learning, working from home, and the use of technology to train and ...
Using AI and Biometrics: The Good, The Bad, and The Cost Artificial intelligence and biometrics are being used by employers for security, hiring and promotion decisions, and by testing programs for securing test content, protecting the integrity of the testing process, and identifying examinees. At the same time, incorporating these tools potentially increases hard and soft ...
Virtual Item Development: Ensuring rigor, integrity and security in a shifting world Previously, many organizations conducted item-development activities in-person, with panelists traveling to a single location to work together. In 2020, this was no longer a possibility, and many had to adapt item development (like so many aspects of daily life). Organizations need to shift to virtual item ...
Virtual Test Development: Silver Linings and Lessons Learned To develop valid exams, we must effectively interact with SMEs to obtain the right information at the right time during the development process a practice that is more art than science. This has only become more difficult in the wake of COVID-19 and increased reliance ...
Weathering The Storm: Preparing for and responding to assessment data incidents and breaches Testing organizations administer thousands of assessments around the world every day. As testing programs innovate to leverage new technologies, in many cases, greater volumes and new types of personal data are collected and stored. Data is valuable, but there are risks associated with its use ...