QMS STANDARDS
CONTROLLED DOCUMENT: WI-QMI-51004
BUSINESS UNIT:
QMerit Inc. 111 Pacifica, Suite 200, Irvine, CA 92618
STANDARD TYPE:
Work Instruction
PROCEDURE TITLE: Configuration; questions
AREA: Products and Services TYPE OF PROCEDURE:
Learning; Formal
DOCUMENT NUMBER: WI-QMI-51004 REVISION: 1.01
PROCEDURE STATUS
IMPLEMENTED
RELEASED
02/09/16
mm/dd/yy
UNLOCK DOCUMENT TO EDIT BEYOND THIS POINT
1.0 PURPOSE/SCOPE The closer the stimulus in the learning situation matches stimulus in the performance situation, the better the ability of the learner to remember, what they learned. Questions can act as such stimuli. The more a question can “simulate” a learner's performance situation the more it will facilitate knowledge transfer. 2.0 RESPONSIBILITIES 2.1 TASK RESPONSIBILITIES QMerit Inc. maintains certain policies to encourage appropriate levels of feedback for workers. It is the responsibility of QMERIT Inc. and its’ clients to implement and operate this procedure in their areas of operation and to:
Ensure that the SOP and all associated documents, knowledge databases and tools are understood and adopted. Supplement the SOP with Work Instruction as required in order to meet local market needs, Business Unit needs, regulatory requirements, customer preferences and/or proven operating and/or delivery methods.
2.2 APPROVAL / ESCALATION RESPONSIBILITIES It is the responsibility of QMERIT Inc. and its’ clients to implement this SOP The QMerit Inc. CLO is the point of escalation for all matters inquired upon or contested with regards to this policy.
Procedure Title: – Configuration; questions
Page 1 of 7
QMS STANDARDS
CONTROLLED DOCUMENT: WI-QMI-51004
3.0 PROCEDURE (WI STEPS) 3.1 CONSIDERATIONS STEP 1. Topics
WHAT
WHEN Before any questions are created
COMPETENCY (WHO) QTAS owner and subject matter expert (client)
HOW (TOOLS) Initial creation of topic names (categories to group questions) can be tough. If someone asked you “what will I learn?”, your response may possibly be the names of your topics. You may consider sub-topics as well to break things up. Refer to section 5.0
2. Job task analysis (JTA)
Optional: used to prioritize requirements
QTAS owner and subject matter expert (client)
WI-QMI-51006 | configuration; topics Questions need to be connected to learning content. If your content list needs to be prioritized, consider running a JTA process Refer to section 5.0
3. Feedback
Feedback is displayed during the assessment process AFTER the question block (configuration).
QTAS owner and subject matter expert (client)
WI-QMI-51007 | configuration; jta Refer to section 5.0 WI-QMI-51005 | configuration; assessments SOP-QMI-1000 | feedback; QTAS
Procedure Title: – Configuration; questions
Page 2 of 7
QMS STANDARDS
CONTROLLED DOCUMENT: WI-QMI-51004
3.2 Creation STEP WHAT 1. Questions
WHEN After WI-QMI-3000 “the” Match
COMPETENCY (WHO) QTAS owner and subject matter expert (client)
HOW (TOOLS) Writing questions is a real art, here is what I try to remember (importance ordered) while authoring questions: Objective of a question is to help the participant succeed Question feedback is equally as important Verify knowledge transfer
2. Try out
3. Review and iterate
Preferably after each question is written
In sequence after 3.2.1 and 3.2.2
QTAS owner and subject matter expert (client)
QTAS owner and subject matter expert (client)
Refer to section 7.0. Access authoring environment Many engines have the ability to test questions, this is an important step. Funny how things look different between creating and consuming Refer to section 7.0. Access authoring environment Depending upon the authoring tool you may have the ability to solicit feedback and control versions of questions. Cast a wider net and involve
Procedure Title: – Configuration; questions
Page 3 of 7
QMS STANDARDS
CONTROLLED DOCUMENT: WI-QMI-51004
STEP
WHAT
WHEN
COMPETENCY (WHO)
HOW (TOOLS) testers of questions outside of your SME community. This may require additional levels of access on questions and/or topics. Refer to section 7.0. Access authoring environment Refer to section 5.0: WI-QMI-51000 | review cycles; questions
4. Metatags or metadata
Post question writing while reviewing within a topic.
QTAS owner and subject matter expert (client)
WI-QMI-51006 | configuration; topics As metatags are referenced by questions you will likely need to add them in a metatag container first, then come back and assign to questions. Refer to section 7.0. Access authoring environment Refer to the following (section 5.0) WI-QMI-51001 | QTAS; metadata
Procedure Title: – Configuration; questions
Page 4 of 7
CONTROLLED DOCUMENT: WI-QMI-51004
QMS STANDARDS
3.3 Consumption STEP WHAT 1. Question blocks
WHEN When creating assessments
COMPETENCY (WHO) QTAS owner and subject matter expert (client)
HOW (TOOLS) Blocks are containers of questions (similar to topics); however, at the assessment level. Questions blocks, packaged within assessments, can contain single questions, topics, or questions. See 3.1.3 for feedback functionality. Suggested naming logic: role_purpose_skill group_organizatio n Refer to section 7.0. Access authoring environment Refer to the following (section 5.0) WI-QMI-51005 | configuration; assessments
4.0 SPECIAL DEFINITIONS THE FOLLOWING TERMS ARE REFERRED TO IN THIS STANDARD; TO VIEW THE DEFINITION OF EACH TERM PLEASE CLICK ON THE LEXICON LIBRARY LINK: LEXICON LIBRARY TERM Assessment Feedback Outcome-based education QTAS Subject matter expert (SME)
Procedure Title: – Configuration; questions
Page 5 of 7
QMS STANDARDS
CONTROLLED DOCUMENT: WI-QMI-51004
TERM Standard Operating Procedure (SOP) Topic Work instruction (WI)
5.0 ASSOCIATED REFERENCE DOCUMENTS THE FOLLOWING DOCUMENTS PROVIDE ADDITIONAL INFORMATION: DOCUMENT NAME R-WI-QMI-51004 | CLO Insights R1-WI-11000 | SKETCH | Overview of QTAS (high level) WI-QMI-3000 | “the” Match WI-QMI-51001 | QTAS; metadata WI-QMI-51006 | configuration; topics WI-QMI-1000 | configuration; jta SOP-QMI-1005 | content management WI-QMI-51005 | configuration; assessments SOP-QMI-1000 | feedback; QTAS
LOCATION http://bit.ly/R_WI_QMI_51004_CLOInsights http://bit.ly/R1_WI_11000_SketchQtasOverview http://bit.ly/WIQMI3000 http://bit.ly/WIQMI51001 http://bit.ly/WIQMI51006 http://bit.ly/WIQMI1000 http://bit.ly/SOPQMI1005 http://bit.ly/WIQMI51005 http://bit.ly/SOPQMI1000
6.0 ASSOCIATED KNOWLEDGE DATABASE THE FOLLOWING KNOWLEDGE DATABASES PROVIDE ADDITIONAL INFORMATION: KNOWLEDGE DATABASE QuestionMark V5 QMerit marked up manual Use of question blocks (QuestionMark)
LOCATION http://bit.ly/R_WI_11000_QuestionMarkV5Marked UpManual https://questionmark.com/content/assessmentblocks
7.0 ASSOCIATED TOOLS THE FOLLOWING TOOLS MAY BE REQUIRED FOR COMPLIANCE TO THIS STANDARD: ASSOCIATED TOOLS QMerit Lexicon Library QuestionMark authoring environment
LOCATION http://bit.ly/QMeritLexiconLibrary http://ondemand.questionmark.com/home/402385
8.0 REVISION HISTORY REVISION (X.X) DATE OF LAST REVISION (MM/DD/YY)
Procedure Title: – Configuration; questions
1.0 02/16/16
Page 6 of 7
QMS STANDARDS
CONTROLLED DOCUMENT: WI-QMI-51004
LAST APPROVAL DATE (MM/DD/YY)
02/09/16
DOCUMENT AUTHOR: Greg Lush
DOCUMENT MANAGER: Greg Lush
REASON FOR CHANGE:
SECTION / PARAGRAPH CHANGED
Revision
1.0 1.01
All 3.3.1
CHANGE MADE
Initial entry of document Added naming logic
DATE OF REVISION MM/DD/YY
02/09/16 02/09/16
9.0 ELECTRONIC NOTIFICATION LIST: ELECTRONIC NOTIFICATIONS VP Technical Services VP Sales VP Engineering 10.0
APPROVALS
PLEASE GO TO THE LINK BELOW FOR THE ELECTRONIC RECORD OF THE REVIEW AND APPROVAL OF THIS POLICY. LOGIN TO VIEW FIRST APPROVER NAME: GREG LUSH BUSINESS UNIT: QMERIT INC. TITLE: CLO SIGNATURE: ELECTRONIC APPROVAL
SECOND APPROVER NAME: TRACY PRICE BUSINESS UNIT: QMERIT INC. TITLE: CEO AND CHAIRMAN SIGNATURE: ELECTRONIC APPROVAL
THIRD APPROVER NAME: BUSINESS UNIT: QMERIT INC. TITLE: SIGNATURE:
DOCUMENT HISTORY SECTION: Document Created on 02/09/16 by Greg Lush Edits and URLs on 02/16/16 by Greg Lush
Procedure Title: – Configuration; questions
Page 7 of 7