QMS STANDARDS
CONTROLLED DOCUMENT: WI-QMI-51003
BUSINESS UNIT:
QMerit Inc. 111 Pacifica, Suite 200, Irvine, CA 92618
STANDARD TYPE:
Work Instruction
PROCEDURE TITLE: Configuration; QTAS
AREA: Products and Services TYPE OF PROCEDURE:
Learning; Formal
DOCUMENT NUMBER: WI-QMI-51003 REVISION: 1.0
PROCEDURE STATUS
IMPLEMENTED
RELEASED
02/09/16
mm/dd/yy
UNLOCK DOCUMENT TO EDIT BEYOND THIS POINT
1.0 PURPOSE/SCOPE You will find details and challenging questions to assist you in creating the perfect assessments which assist you in your ambitions of connecting resources to work activities. It is recommended that this work instruction be referenced AFTER you have read and have your head around WI-QMI-11000 | Master business process; QTAS. Details provided include readiness; planning; authoring; assembling; pilot and review; and my favorite: gotime. Don’t forget to check out Section 5.0 as there are MANY references to other quality documents which will fill in the gaps. 2.0 RESPONSIBILITIES 2.1 TASK RESPONSIBILITIES QMerit Inc. maintains certain policies to encourage appropriate levels of feedback for workers. It is the responsibility of QMERIT Inc. and its’ clients to implement and operate this procedure in their areas of operation and to:
Ensure that the SOP and all associated documents, knowledge databases and tools are understood and adopted. Supplement the SOP with Work Instruction as required in order to meet local market needs, Business Unit needs, regulatory requirements, customer preferences and/or proven operating and/or delivery methods.
2.2 APPROVAL / ESCALATION RESPONSIBILITIES It is the responsibility of QMERIT Inc. and its’ clients to implement this SOP The QMerit Inc. CLO is the point of escalation for all matters inquired upon or contested with regards to this policy. Procedure Title: – Configuration; QTAS
Page 1 of 9
QMS STANDARDS
CONTROLLED DOCUMENT: WI-QMI-51003
3.0 PROCEDURE (WI STEPS) 3.1 READINESS STEP WHAT 1. Graphic showing questions, topics, assessments, and assessment folders
2. Assess templates and potential personalization
WHEN Keep handy while going through the steps below to keep you grounded on the overall process
COMPETENCY (WHO) QTAS owner and subject matter experts (client)
Prior to any configuration steps
QMerit and client core discovery and project personnel
HOW (TOOLS) Refer to section 5.0 PRINT: SKETCH | R1-WI-QMI-11000 | Overview of QTAS (high level) Refer to section 6.0 QuestionMark manual
3.2 Planning STEP WHAT 1. OPTION: job task analysis survey
2. Item bank
WHEN Once you have scoped the initial questions and topics you will need to align learning content. Often this may be overwhelming, using a job task analysis can help focus your efforts on what the community requires. After topics have been established
COMPETENCY (WHO) QTAS owner and subject matter experts (client)
HOW (TOOLS) Refer to section 5.0 WI-QMI-51007 | configuration; JTA SOP-QMI-1005 | content management
QTAS owner and subject matter experts (client)
WI-QMI-51006 3.2.13.2.3
Refer to section 7.0 Access authoring environment ----Refer to section 5.0 WI-QMI-51005 | configuration; assessments
3. Meta-tag questions
Procedure Title: – Configuration; QTAS
Questions can be configured and easily associated with meta-
QTAS owner and subject matter experts (client)
WI-QMI-51006 | configuration; topics Refer to section 7.0
Page 2 of 9
QMS STANDARDS
CONTROLLED DOCUMENT: WI-QMI-51003
STEP
WHAT
4. Establish access rights
5. OPTION: localization
WHEN tags containing task knowledge, skills or data references
Questions, topics, assessments, assessment folders, can all be individually secured to control access for authors and participants
COMPETENCY (WHO)
QTAS owner and subject matter experts (client)
Interacting with learning content in one’s native language will increase knowledge transfer
QTAS owner and subject matter experts (client)
WHEN Once your preliminary planning is completed
COMPETENCY (WHO) QTAS owner and subject matter experts (client)
HOW (TOOLS) Access authoring environment ----Refer to section 5.0: WI-QMI-51004 | configuration; questions Refer to section 7.0 Access authoring environment ----Refer to section 5.0: WI-QMI-11000 | master business process; QTAS Refer to section 6.0 QuestionMark manual
3.3 Authoring STEP WHAT 1. Author questions, topics, assessments
HOW (TOOLS) Refer to section 7.0 Access authoring environment ----Refer to section 5.0
2. Add relevant stimulus
Procedure Title: – Configuration; QTAS
Questions have more meaning by making them come to life with video, audio and even mathematical equations
QTAS owner and subject matter experts (client)
Configuration work instructions 51004 through 51006 Refer to section 7.0 Access authoring environment ----Refer to section 5.0 Page 3 of 9
QMS STANDARDS
CONTROLLED DOCUMENT: WI-QMI-51003
STEP
WHAT
3. OPTION: O observational P items T I O n
4. Question iterations
5. Question management
WHEN
COMPETENCY (WHO)
Sometimes it is hard to determine if you are on the right track, especially with questions and assessments. Consider using observational assessments during the process to gauge the relevance of your direction
QTAS owner and subject matter experts (client)
The review cycle questions, topics, and assessments is important and in some cases can provide valuable and defensible legal data Once the initial questions have been created a maintenance schedule should be established.
QTAS owner and subject matter experts (client)
QTAS owner and subject matter experts (client)
HOW (TOOLS) WI-QMI-51004 | configuration; questions Refer to section 7.0 Access authoring environment ----Refer to section 5.0 WI-QMI-51005 | configuration; assessments Refer to section 7.0 Access authoring environment
Relevance is key, make sure that you identify those questions requiring updates and potential retirement Refer to section 7.0 Access authoring environment ----Refer to section 5.0 WI-QMI-51004 | configuration; questions
3.4 Assembling STEP WHAT 1. Selection of questions
Procedure Title: – Configuration; QTAS
WHEN How will questions be delivered? Rules based or random selection?
COMPETENCY (WHO) QTAS owner and subject matter experts (client)
HOW (TOOLS) Refer to section 7.0 Access authoring Page 4 of 9
QMS STANDARDS
CONTROLLED DOCUMENT: WI-QMI-51003
STEP
WHAT
2. Topic details
WHEN Random selection is always good as it prevents the passing of answers to other participants; however, requires additional questions in the item bank Passing scores of the topic pre-requisites (if applicable)
COMPETENCY (WHO)
QTAS owner and subject matter experts (client)
WI-QMI-51004 | configuration; questions Refer to section 7.0 Access authoring environment ----Refer to section 5.0
Overall topic scoring and feedback. Multiple topics can be blended into a single assessment whose outcomes can balance the priority of one topic over another
3. OPTION: time limit
HOW (TOOLS) environment ----Refer to section 5.0
WI-QMI-51006 | configuration; topics
Very helpful with certification testing; however, may be overkill with other forms of assessments. You are seeking knowledge transfer and encouraging participants to “want to learn”, time limits can create stress
QTAS owner and subject matter experts (client)
WHEN Target communities and specific questions to solicit: comments, suggested modifications, restructuring from subject matter experts (expand past your community or SME contributors)
COMPETENCY (WHO) QTAS owner and subject matter experts (client)
SOP-QMI-1000 | feedback; QTAS Refer to section 7.0 Access authoring environment ----Refer to section 5.0 WI-QMI-51005 | configuration; assessments
3.5 Pilot and review STEP WHAT 1. Question iterations
Procedure Title: – Configuration; QTAS
HOW (TOOLS) Refer to section 7.0 Access authoring environment ----Refer to section 5.0 WI-QMI-51004 | configuration; questions
Page 5 of 9
QMS STANDARDS
CONTROLLED DOCUMENT: WI-QMI-51003
STEP WHAT 2. Assessment trials
3. OPTION: Experimental questions
WHEN Consider sending the assessment to a group of pilot users. Questions with high levels of relevance will create credibility
COMPETENCY (WHO) QTAS owner and subject matter experts (client)
HOW (TOOLS) Refer to section 7.0 Access authoring environment ----Refer to section 5.0 WI-QMI-51005 | configuration; assessments WI-QMI-51004 | configuration; questions
It is possible to test questions within assessments without impacting scores. Consider with unsure or complex topics
QTAS owner and subject matter experts (client)
WHEN After the assessment has been assembled consideration should be made to ensure its integrity once delivered:
COMPETENCY (WHO) QTAS owner and subject matter experts (client)
HOW (TOOLS) Refer to section 5.0
QTAS owner and subject matter experts (client)
Refer to section 5.0
3.6 Go-time STEP WHAT 1. Assessment integrity
WI-QMI-51005 | configuration; assessments
Configure the “save-asyou-go” frequency to avoid data loss during assessment for participant If a re-take occurs, will you present the same or different questions?
2. Assessment delivery
Procedure Title: – Configuration; QTAS
Do you need to ensure the person taking the assessment is the person assigned? Consider secure browsers or participant identification measures Considerations and configuration options BEFORE scheduling assessments:
WI-QMI-51005 | configuration;
Page 6 of 9
QMS STANDARDS
CONTROLLED DOCUMENT: WI-QMI-51003
STEP
WHAT
WHEN How will participants interact? Browser stationary computer, Browser mobile device, print, scanning (fill in the bubbles)
COMPETENCY (WHO)
HOW (TOOLS) assessments
Are disabilities accounted for? Will results need to be launched / tracked from other transactional systems of record? If a re-take occurs, will a time limit be implemented before retake happens?
4.0 SPECIAL DEFINITIONS THE FOLLOWING TERMS ARE REFERRED TO IN THIS STANDARD; TO VIEW THE DEFINITION OF EACH TERM PLEASE CLICK ON THE LEXICON LIBRARY LINK: LEXICON LIBRARY TERM Assessment CLO Feedback Outcome-based education QTAS Scheduling Subject matter expert (SME) Standard Operating Procedure (SOP) Topic Work instruction (WI)
5.0 ASSOCIATED REFERENCE DOCUMENTS THE FOLLOWING DOCUMENTS PROVIDE ADDITIONAL INFORMATION: DOCUMENT NAME SKETCH | R1-WI-QMI-11000 | Overview of QTAS (high level) WI-QMI-11000 | master business process; QTAS
Procedure Title: – Configuration; QTAS
LOCATION http://bit.ly/R1_WI_11000_SketchQtasOverview http://bit.ly/WIQMI11000
Page 7 of 9
QMS STANDARDS
CONTROLLED DOCUMENT: WI-QMI-51003
DOCUMENT NAME WI-QMI-1000 | configuration; JTA SOP-QMI-1005 | content management WI-QMI-51005 | configuration; assessments WI-QMI-51004 | configuration; questions WI-QMI-51006 | configuration; topics WI-QMI-51000 | cycle; questions SOP-QMI-1000 | feedback; QTAS
LOCATION http://bit.ly/WIQMI1000 http://bit.ly/SOPQMI1005 http://bit.ly/WIQMI51005 http://bit.ly/WIQMI51004 http://bit.ly/WIQMI51006 http://bit.ly/WIQMI51000 http://bit.ly/SOPQMI1000
6.0 ASSOCIATED KNOWLEDGE DATABASE THE FOLLOWING KNOWLEDGE DATABASES PROVIDE ADDITIONAL INFORMATION: KNOWLEDGE DATABASE QuestionMark V5 QMerit marked up manual
LOCATION http://bit.ly/R_WI_11000_QuestionMarkV5Marked UpManual http://ondemand.questionmark.com/home/402385
QuestionMark authoring environment
7.0 ASSOCIATED TOOLS THE FOLLOWING TOOLS MAY BE REQUIRED FOR COMPLIANCE TO THIS STANDARD: ASSOCIATED TOOLS QMerit Lexicon Library
LOCATION http://bit.ly/QMeritLexiconLibrary
8.0 REVISION HISTORY REVISION (X.X) DATE OF LAST REVISION
1.0 02/16/16
LAST APPROVAL DATE
02/09/16
(MM/DD/YY) (MM/DD/YY)
DOCUMENT AUTHOR: Greg Lush
DOCUMENT MANAGER: Greg Lush
REASON FOR CHANGE:
SECTION / PARAGRAPH CHANGED
Revision
1.0
All
Procedure Title: – Configuration; QTAS
CHANGE MADE
Initial entry of document
DATE OF REVISION MM/DD/YY
02/09/16
Page 8 of 9
QMS STANDARDS
CONTROLLED DOCUMENT: WI-QMI-51003
9.0 ELECTRONIC NOTIFICATION LIST: ELECTRONIC NOTIFICATIONS VP Technical Services VP Sales VP Engineering 10.0
APPROVALS
PLEASE GO TO THE LINK BELOW FOR THE ELECTRONIC RECORD OF THE REVIEW AND APPROVAL OF THIS POLICY. LOGIN TO VIEW FIRST APPROVER NAME: GREG LUSH BUSINESS UNIT: QMERIT INC. TITLE: CLO SIGNATURE: ELECTRONIC APPROVAL
SECOND APPROVER NAME: TRACY PRICE BUSINESS UNIT: QMERIT INC. TITLE: CEO AND CHAIRMAN SIGNATURE: ELECTRONIC APPROVAL
THIRD APPROVER NAME: BUSINESS UNIT: QMERIT INC. TITLE: SIGNATURE:
DOCUMENT HISTORY SECTION: Document Created on 02/09/16 by Greg Lush Edits and URLs on 02/16/16 by Greg Lush
Procedure Title: – Configuration; QTAS
Page 9 of 9