University of Auckland logo

Stay informed

Receive updates on teaching and learning initiatives and events.

  1. Home
  2.  — 
  3. Learning technologies to support teaching
  4.  — 
  5. Inspera assessment platform
  6.  — Inspera question randomisation

Inspera question randomisation

Guide to randomising questions and answers in Inspera Online Assessments as permitted by the Assessment Services.
Types of randomisation Explanation Permitted by the Assessment Services Possible in Inspera Notes
Randomising answers The question is the same on all versions, but the response options (A, B, C, D) are shuffled. Yes Yes
  • MCQ answer options are always randomised by Inspera and this setting is not changeable.
  • Real-time corrections during the exam are possible.
Randomising variables The question and its response options are the same on all versions, but the variables within a response option differ.

E.g., In the same calculation, one version of the text gives students a price of $1.12 to work with but another version gives students a price of $2.43 to work with.

Yes, but with caution and only if you have an approved exemption to use Canvas Yes, by using the question selection functionality outlined below
  • The Assessment Services advises caution on the use of this type of randomisation, even though the technology allows for it to be created, because of the complexity and potential for errors to creep in when setting and/or marking the exam.
  • Real-time corrections during the exam are possible.
Randomising question selection The question presented to the student is pulled from a bank of x similar questions and is randomly allocated. All questions within the section have to be of equal marks and level of difficulty.

E.g., Section 1 = Question 1
Students would be randomly assigned one of the following four questions – each would be set up as a separate question in Inspera.

  • Describe the attributes of Audrey Hepburn
  • Describe the attributes of Humphrey Bogart
  • Describe the attributes of Katherine Hepburn
  • Describe the attributes of James Dean
Yes Yes, noting the ‘pull question’ functionality used in Inspera can also be used in a way that would result in random question order which is not allowed
  • This should be used with caution, as one question could be harder/easier to answer than the other and could cause inequities between students.
  • This can be used with any question type only if each question has the same maximum marks and should only be used where the questions are similar in nature and difficulty.
  • To achieve this, use the Inspera Assessment functionality of Sections in question sets and “pull questions in a section”.
  • Although Inspera functionality does enable ‘pulling’ multiple questions into a section, this is not permitted as it would create a randomising of the order of questions.  It is recommended only one question should be pulled from a few options into a section. This will enable students to easily locate any corrections.
  • It is also important to note that enabling ‘pull’ in sections means markers will not be able to quickly navigate through candidates focusing on one question option at a time; a marker will be presented the question option presented to the student for that section.
Randomising question order The questions are the same, but the students see them in a different order.

The sequence in which question 99, say, appears would be different for each student.

No Yes
  • Current limitations with the functionality for updating and advising corrections do not enable this to be a viable option.
  • Altering the order of questions can lead to omission of questions and anomalies in the answer sheets.
  • Randomisation of question order makes it problematic to issue correction notices during an exam. It creates uncertainty and increased anxiety for students who raise queries during the exam about a potential error that we are unable to resolve. When an error isn’t resolved quickly during an exam, we receive increasing numbers of student queries, and then complaints following the exam, with claims that the unresolved error caused students to become distracted throughout the rest of their exam, impacting their performance. We do not have robust processes for identifying those exams with randomisation nor functionality to easily communicate issues or make and communicate corrections.  We will be exploring opportunities to improve functionality and processes to determine if this could be an option going forward.
Randomising question selection and order Different questions appear on different versions of the examination.

Each student receives a random set of y questions from a test bank of z questions.

No Yes
  • Current limitations with the functionality for updating and advising corrections do not enable this to be a viable option.
  • This functionality would certainly reduce the possibility/ability for students to cheat. However, the strong concerns around it are around equity/fairness to all students. It is simply not possible to say that all questions within a test bank would have a similar level of difficulty and so some students might randomly be being given a “harder” section of questions than others (even if, say, they are grouped into easier, medium, and harder questions and each student received three questions from each category).
  • Since students would randomly be receiving completely different questions, real-time corrections would not be possible.

 

Resources

View the Inspera guide to the randomisation of MCQ options.

For additional support, self-help guides are published on the .

For access to Inspera and any other queries, please see the contact details for the  on the Staff Intranet.

See also

Inspera online assessment platform

An overview of Inspera including links to self-help resources, setting up an Inspera test in Canvas, and pedagogical advice.

Inspera exam process for teachers

The steps required to schedule your exam and a pre-exam checklist.

Page updated 28/11/2023 (added see also section)

Send us your feedback

What do you think about this page? Is there something missing? For enquiries unrelated to this content, please visit the Staff Service Centre

This form is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.