The security and integrity of testing is of key concern to everyone involved, test publishers and test takers alike, but the technology available to disrupt the efficacy of testing processes continues to develop. Test takers know that subverting academic integrity can be a financially sensible decision. It can help people gain qualifications that they do not deserve. Companies also know that there is substantial money to be made in providing services to help students and test takers to cheat.
In this keynote address, Dr Thomas Lancaster will review the ever-evolving landscape of products and services available to help learners relax in their bath robe and gain undeserved qualifications with very little effort required. Assessments answers are readily available to students and other test takers. Technologies intended to be mostly harmless can be used in ways not originally intended. As artificial intelligence-based systems become central to both education and employment, the question has to be asked as to how far resisting change is the right approach and how approaches to assessment led by the community of test publishers need to evolve. Join this keynote presentation to be both amazed at the innovation happening in this space but to also be alert to the opportunities to innovate and stay ahead of the curve.
Speaker(s): Dr. Thomas Lancaster, Senior Teaching Fellow in Computing, Imperial College London
ATP and the International Test Commission recently collaborated on the development of new Guidelines for Technology-Based Assessment. The Guidelines outline a wide range of important considerations and best practices for ensuring valid, reliable and fair assessment in a digital environment. During this session, key contributors to the Guidelines will provide an overview of the chapter on Test Security. In an interactive and engaging session, we will review common test security threats, risks and mitigation strategies. We will also share the test security guidelines suggested for technology-based assessments and discuss considerations for implementing these security best practices.
Speaker(s): Rachel Schoenig, CEO, Cornerstone Strategies & Chief Science Officer, Examity ; John Weiner, Chief Science Officer, PSI Services LLC
The rapid adoption of remotely proctored online exams has presented bad actors with new technology avenues for perpetrating test fraud. To protect the validity of test scores, it is crucial for test program leaders and exam security specialists to understand how these test security threats are quickly evolving in order to effectively detect and respond to them. This session exposes the nature and extent of the two most frequent and most elusive exam threat vectors – proxy-test taking and systematic item bank harvesting. Panelists will share their experiences with “new wave” test fraud techniques in the context of typical exam-taking scenarios so that attendees get a sense of where the likely weak points are in their remotely proctored exam delivery process and what to look for in detecting specific instances of technology-enabled fraud. Discussion will also address the challenges of preventing, deterring, detecting, and responding to these sophisticated exam security threats.
Speaker(s): Rose Hastings Keith, Senior Operations Manager, Duolingo; Harry Samit, Director, Special Investigations, Pearson VUE; Ardeshir Geranpayeh, Freelance Computational Psychometrics Consultant
Moderator: Pamela Becker, General Manger & Group Executive Board Member, Hogrefe Ltd
As threats to test score integrity and exam security evolve, so must the manner by which assessment organisations and providers protect themselves against test fraud. As an industry, although we’ve made great strides in the areas of deterrence, prevention and detection in response to the novel threats, the rapidly shifting threat landscape demands unceasing deployment of new and effective counter measures. Informed assessment professionals will want to adopt multi-faceted protection strategies to deter, prevent, and detect and respond to novel manifestations of remote-access proxies and item theft. Expert panelists will overview innovative approaches in this session that can help to continue the fight against and mitigate test fraud.
Speaker(s): Marc Weinstein, Chief Privacy Officer, Caveon LLC; Donna McPartland, McPartland Privacy Advising LLC; Paul Muir, Head of Technology Enabled Assessment, British Council
Moderator: Basim Baig, Senior Engineering Manager, Duolingo