QM Perception (ONLINE TESTS)

QuestionMark Perception is the new tool that you can use to create questions and administer tests through the Cecil Web Interface (CWI).  It has been integrated with CWI to allow you to create and manage your questions and test set ups through the web in QM and administer them through CWI.

 

For Staff who have already have tests created in Cecil Explorer, the Staff Service Centre can provide a one off import of these questions or if you have access to use the Win32 version you can do this yourself following the instructions below.

 

If you would like a full list of the available features in QuestionMark Perception please click here.

 

 

 


 

Known compatibility issues:

 

  • In Internet Explorer 9, if you receive any errors you will need to turn Compatibility mode off.

  • In Firefox 4 or 5 you will not be able to Try Out questions at this stage. You would need to use Internet Explorer instead.

  • QM Perception is incompatible with Chrome

  • Questions originally created in QM Win32 are not editable in QM Perception

 

Accessing QuestionMark Perception:

 

QuestionMark is automatically activated for all courses provisioned in CECIL.

 

NB: Demo courses that have been provisioned will require QM activation if you require it - you must contact the Staff Service Centre (staffservice@auckland.ac.nz) to process this request.

NB: If you do not see your course's folder in QuestionMark Perception, you must use the QuestionMark link of that course through either Course Admin and Reports | Tests or through Activities and Marks section in CWI. This will create that given course's QM folder. Only staff members of a given course can create content for and have access to it's respective QM folder.

 

  1. Go to https://www.qmperception.auckland.ac.nz/portal/cecil/

  2. Click login

  3. Type in your university username and your questionmark password.

  4. You will be directed to the Perception Enterprise Manager window.  This is where you will create your questions and tests. Click on the Authoring option in the top menu to continue. [Figure 2]

 

Figure 2

top

 

 

Creating Questions

 

  1. Go to https://www.qmperception.auckland.ac.nz/portal/cecil/

  2. Click login

  3. Type in your university username and your questionmark password.

  4. It will take you to the perception manager. Click on Authoring and Question Manager.  

  Figure 3

 

 

  1. click on New Subtopic.  Enter a name (do not use apostrophes in the name of the topic) you want to call it and click on the Create button. [Figure 4]

  2. Note: When you are creating subtopics, please be aware that the complexity of the assessments relies on the folder structure. E.g. if you wish to have 4 sections in your test that grab 5 random questions from each topic, with each topic having a question bank of 20 questions each, best practise would be to create the first subtopic for that particular assessment overall, then an additional 4 subtopics underneath - each representing the 4 topics for that assessment.


Figure 4
 

  1. You may add a New Subtopic if you wish to.
     

  2. Double click on  the newly created topic to open it.  If the topic was already created.  The questions already existent in the topic will be displayed on the right-hand pane.  Click on New Question [Figure 5] and select the type of question you want to create and click the Create button.


Figure 5

 

  1. Enter in the question wording in the window and type in a name or label for it. Please make sure this is something short that would help you easily identify the question without going into it. Click Next.

  2. Note: Do not copy and paste the question wording directly from a Word document to QM editor. Word has its own format that might cause your question to have issues previewing for the students. If you would like to copy and paste from your question bank in Word, please copy and paste them into Notepad first (as this will convert all the text into plain text) then copy from Notepad and paste them into QM Editor. To ensure it previews correctly select the Question and click Try Out (located on the top left hand side of the page under New Question). If the screen is blank then you will need to re-write your question. It is always good practice to test the test live as a dummy student before releasing the test to the students.
     

  3. Enter the answer options and click on the Add button
     

  4. Put in a weighting for each one.  This will be 1 for the correct answer and 0 for incorrect answers.
     

  5. If required, add in Feedback for each option and click on Set
    Note:
    This is optional - depending how you set up your assessment, feedback can be toggled on or off. If you are simply entering feedback like 'incorrect' or 'correct', this is unnecessary as the system will alert the student if they have gotten the question correct or not.
     

  6. Click on the Finish button.  The question will now display in the list on the right hand pane.
     

Note:  Please do not use apostrophes in the name of the topic as you will have problems when adding questions into assessments later.

 

 

top

 

 

Character Restrictions

 

Due to the way Questionmark stores its data, there are certain restrictions that apply when it comes to the use of special characters in names and text throughout the software. The special characters in question are as follows:

  • ‘ (Single quote/apostrophe)

  • “ (Double quote)

  • & (Ampersand)

  • / (Forward slash)

  • \ (Back slash)

  • , (Comma)

  • £ (British pound)

  • ¦ (Pipe)

  • < (Less-than sign)

  • > (Greater-than sign)

  • : (Colon)

  • ; (Semi-colon)

  • # (Hash)

 

 

* While input is allowed, use of these special characters will display a warning message, or they will not display correctly when you attempt to use/edit them. These characters could cause issues if they are used in the process of delivering and reporting.

^ Translating special characters needs to be done carefully. Questionmark will export the marked special characters as HTML code. However, the special characters that are not part of the question text will also be changed but placed in a special XLIFF tag that identifies that it should not be translated. For example, the following:

<p>This <phrase> & music<p>

...will become:

<bpt id='a1'>&lt;P&gt;</bpt>This &lt;phrase&gt; & music<ept id='a2'>&lt;/P&gt;</ept>

So, if you are designing an application to use the XLIFF produced by Questionmark, it will need to be programmed to cope with this and not change the HTML text but only the question text. Also, the application you use for translating any of the XLIFF files should not double-encode the text. However, Questionmark has been designed to cope with the most common character that is double-encoded, the & (ampersand).

 

The following warning messages may appear if an invalid special character in Questionmark Enterprise Manager (QM Web) is used:

 

 

top

 

 

Once you have created all the needed questions in the topic you can create an assessment to include these questions.

 

Create Assessment

 

  1. Go to https://www.qmperception.auckland.ac.nz/portal/cecil/

  2. Click login

  3. Type in your university username and your questionmark password.

  4. You will be directed to the Perception Enterprise Manager window.  This is where you will create your questions and tests. Click on the Authoring option in the top menu to continue.
     

  5. Select the Assessment Manager from the dropdown list
     

  6. Click on the course folder.  This will by default be created for you.  If not available please contact the Cecil Service desk on 85100 option 2 to request it to be enabled.
     

  7. Click on the  New Assessment option.
     

  8. Type in a name for the assessment in the Assessment Name field and select the type of assessment (Test) from the drop down list.
     

  9. If this assessment is password protected (which means that Students and Staff will need to enter a password to access it) please type in the Password and Confirm it in the fields provided, click on Next>>

    Note:
    Currently if you click on the TryOut option on the left hand side when the assessment has a password it will throw an error and will not available to associate with an activity in CWI.  The work-around for this is to create the assessment from scratch and WITHOUT clicking on TryOut go into CWI and associate it with the activity session.

  10. Make sure Open Access to Assessments is either greyed out or unticked
     

  11. Choose a template i.e. how you want the questions presented to the students from the Template File for the assessment dropdown list located at the bottom of the window. Please use either the cecil (students click on arrows to go back and forth for each question) or cecilflat (questions appear on one scroll page)
     
    Note:
    If you wish your students to be able to view feedback at the end of the assessment, please the 'Display Feedback at end of assessment' box is ticked and have feedback set to your questions. Feedback will only appear once a student has submitted their test. They will also only be able to view feedback for the questions which they answered incorrectly.
     

  12. Click on the Add Questions button and choose to upload all the questions from a topic or just selected ones.  You can choose multiple topics to upload questions from.  
     

  13. You can choose to use just one or many questions from each of the selected topics by clicking on the radio buttons next to the available options All, Randomly or Selected, then click on the Close button.  
     

  14. Click on the Next>> button, then on the Finish button.  
     

  15. Note: It is best practice not to use the Pass/Fail option, unless you want a student to get 0 marks for a test if they fail to meet a minimum correct %
     

  16. You will be able to provide a Message given at the end of assessment (Fail message) along with a URL and/or Message given if passed as well as a URL if assessment passed.  
     

  17. Click Finish or go <<Back to make changes.  Your test will now be listed under the Assessments option.
     

  18. If you wish to see what it looks like i.e. what students will see when they log on to Cecil, select the assessment and click on the   button on the left hand menu.
     

  19. You will be able to make changes to this assessment by selecting the assessment and then clicking on the  Edit button on the left.  

top

 

Create an assessment with Feedback:

 

To set feedback as visible in Question mark is fairly straightforward. Make sure when you create questions they have feedback for each possible choice. NB: Feedback will only show for questions answered incorrectly

 

  1. Click Browser Based Authoring

  2. Select Assessment Manager

  3. Select the class you wish to make the assessment for.

  4. On the left hand side click New Assessment

  5. Give your assessment a name and choose if you want to have a message at the start of the assessment. Also choose if you want to give your assessment a password.

  6. Set the Assessment Type to Test

  7. Click Next

  8. Make sure you have checked Display feedback at the end of the assessment and set your Template file for assessment (either cecil or cecilflat)

  9. Click Next

  10. Continue making your Cecil Test as normal.

 

top

 

Associating assessment to Cecil

 

  1. Log  in to Cecil: http://cecil.auckland.ac.nz  and select the course from your Current Teaching folder in the navigation pane.
     

  2. Go to the Activities & Marks function for the course
     

  3. Click on the activity session i.e. Test 01 you want to associate with the test
     

  4. If the activity session has not been created please do this first.  Click here for instructions on how to create an assessed activity session.
     

  5. Once this has been done, select the session and click on the button on the menu on the right hand side
     

  6. In the window that comes up make sure that the Is Assessed box is ticked and then tick Use Questionmark perception for Test Delivery. Select the assessment you want to associate with this activity from the Associated Test dropdown list.


                                             
     

  7. Select how you would like to have this marked by choosing one of the options from the Marking Options dropdown list.
     

  8. Key in the number attempts you want students to be able to complete this test, in the Test Attempts field.  Then click on the Save button in the top menu. Note: The default number of attempts is 9999. This will be the number of attempts given if you do not adjust the number of attempts.

  9. Make sure the Mark Visible Date is set to the current date and time so that students can see their mark as soon as they complete the test.
     

The test is now all set to go. Students will be able to log in and complete this test at the date and time specified when you created the activity.

 

Note: Staff can no longer associate a QuestionMark test template to multiple activity sessions in CWI without first un-associating that test template from the previous activity.

 

top

 

 

Increasing an individual students attempt for a test
 

  • Before the due date on CECIL

    1. Go to https://www.qmperception.auckland.ac.nz/portal/cecil/

    2. Click login

    3. Type in your university username and your questionmark password.

    4. It will take you to the perception manager.

    5. In this window click on Administration and then on Schedule.  This will bring up a list of all the assessments along with the students AUIDs.  Select the student and click on Edit.  Increase the attempts and click on the Save button.

 

  • After the due date on CECIL

    1. Change the due date on CECIL to the current time.

    2. Log in into Cecil web: http://cecil.auckland.ac.nz. Select the course you want to have the test in from the Current - Teaching folder.

    3. Click on the Course Admin & Reports function.  Click on the ‘QuestionMark Perception’ this will take you into the Perception Enterprise Manager window

    4. In this window click on Administration and then on Schedule.  This will bring up a list of all the assessments along with the students AUIDs.  Select the student and click on Edit.  Increase the attempts and click on the Save button.

    5. Get the student to click the 'Start/Resume' button right after you do this.

    6. Immediately change the due date on the CECIL activity back to the original due date and time.

NB: If you are unable to be in touch with the student, i.e. on the phone with them telling them to start the test, or, get them into your office to sit the test, please contact the Staff Service Centre to arrange an alternative.

 

top

 

More Information

 

  • Authoring Guide: https://www.questionmark.com/perception/help/v5/product_guides/authoring/Default_CSH.htm#Welcome.htm

  • Enterprise Manager User Guide (QM Web): https://www.questionmark.com/perception/help/v5/product_guides/em/default.htm

  • Authoring Manager Help: https://www.questionmark.com/perception/help/v5/help/am/index.html

  • Enterprise Reporter (QM Web): https://www.questionmark.com/perception/help/v5/product_guides/er/index..html

  • QuestionMark Knowledge Base (login using @auckland.ac.nz email is required): https://www.questionmark.com/perception/help/v5/Pages/kb_role_od..aspx

  • QuestionMark Product and Best Practice Guides (login using @auckland.ac.nz is required): https://www.questionmark.com/perception/help/v5/Pages/product_guides_op.aspx

 

top

 

 

 

How do I...

 

Create an assessed activity

 

Get Started with QuestionMark Perception

 

What can't I do in this version of Question Mark?

 

How to access and use the content converter?

 

How do I access the Win32 version of Questionmark?

 

How do I use the Win32 version of Questionmark?