QMS STANDARDS
CONTROLLED DOCUMENT: WI-QMI-51005
BUSINESS UNIT:
QMerit Inc. 111 Pacifica, Suite 200, Irvine, CA 92618
STANDARD TYPE:
Work Instruction
PROCEDURE TITLE: Configuration; assessments
AREA: Products and Services TYPE OF PROCEDURE:
Learning; Formal
DOCUMENT NUMBER: WI-QMI-51005 REVISION: 1.01
PROCEDURE STATUS
IMPLEMENTED
RELEASED
02/09/16
mm/dd/yy
UNLOCK DOCUMENT TO EDIT BEYOND THIS POINT
1.0 PURPOSE/SCOPE It’s critical, to understand how people learn, what they have in fact learned, and whether this knowledge is useful for their particular job. That’s why the cornerstone of developing successful educational, training, and certification materials is the effective use of assessments. Organizations can use assessments to guide people to powerful learning experiences; reduce learning curves; extend the forgetting curve; confirm skills, knowledge and aptitudes; and motivate people by giving them a real sense of achievement. 2.0 RESPONSIBILITIES 2.1 TASK RESPONSIBILITIES QMerit Inc. maintains certain policies to encourage appropriate levels of feedback for workers. It is the responsibility of QMERIT Inc. and its’ clients to implement and operate this procedure in their areas of operation and to:
Ensure that the SOP and all associated documents, knowledge databases and tools are understood and adopted. Supplement the SOP with Work Instruction as required in order to meet local market needs, Business Unit needs, regulatory requirements, customer preferences and/or proven operating and/or delivery methods.
2.2 APPROVAL / ESCALATION RESPONSIBILITIES It is the responsibility of QMERIT Inc. and its’ clients to implement this SOP The QMerit Inc. CLO is the point of escalation for all matters inquired upon or contested with regards to this policy.
Procedure Title: – Configuration; assessments
Page 1 of 7
QMS STANDARDS
CONTROLLED DOCUMENT: WI-QMI-51005
3.0 PROCEDURE (WI STEPS) 3.1 READINESS STEP WHAT 1. Whiteboard: Prerequisites
2. Assessment folders
3. Naming logic
WHEN Your whiteboard should show question blocks, their names, and the expected pass fail percentages for each specific assessment. Using the aforementioned sketch, it will be easy to map out which question blocks will serve as prerequisites. Please note that prerequisites are other assessments Questions are organized into topics and assessments are organized into assessment folders. Just like topics work towards the smallest number of folders possible. Prior to the first assessment being created. Consider the following taxonomy:
COMPETENCY (WHO) QTAS owner and subject matter expert (client)
HOW (TOOLS) Whiteboard or workflow tool
QTAS owner and subject matter expert (client)
Access authoring environment (section 7.0) Refer to section 5.0
QTAS owner and subject matter expert (client)
WI-QMI-51006 | configuration; topics Refer to section 7.0 Access authoring environment
role.industry.skillgroup. organization 3.2 Creation STEP WHAT 1. Assessment types
WHEN Depending upon the assessment or learning management system you will have different options. Most will include exams, tests, surveys and quizzes
COMPETENCY (WHO) QTAS owner and subject matter expert (client)
HOW (TOOLS) Refer to section 5.0 R-WI-QMI-51005 | assessment stakes and types
These are all considerably different, please refer to the
Procedure Title: – Configuration; assessments
Page 2 of 7
QMS STANDARDS
CONTROLLED DOCUMENT: WI-QMI-51005
STEP
WHAT
2. Whiteboard: all steps 1. list question blocks 2. prioritize question blocks 3. score question blocks 4. assigned prerequisites 5. create assessment folder 6. confirm topic folders 7. map questions by block 8. map responses 9. create response templates for email and immediate feedback 10. identify all URLs 11. bit.ly all URLs 12. associate all bit.ly URLs to responses 3. Configure assessment (s)
4. Try out
WHEN stakes and types for clarity Taking the time to flowchart all of the interrelationships between questions, topics, question blocks, prerequisites, feedback and outcomes before starting any assessment configuration is advised
Preferably after the white boarding session mentioned in 3.2.2
Many engines have the ability to try out assessments prior to publishing; however, it has been my experience that this does not always produce the best trial run. You should
Procedure Title: – Configuration; assessments
COMPETENCY (WHO)
HOW (TOOLS)
QTAS owner and subject matter expert (client)
Whiteboard or workflow tool
QTAS owner and subject matter expert (client)
Refer to section 7.0
QTAS owner and subject matter expert (client)
Access authoring environment Refer to section 7.0 Access authoring environment Refer to section 5.0
Page 3 of 7
QMS STANDARDS
CONTROLLED DOCUMENT: WI-QMI-51005
STEP
WHAT
WHEN consider testing the assessment after publishing.
COMPETENCY (WHO)
HOW (TOOLS) WI-QMI-51005 | configuration; assessment
QTAS owner and subject matter expert (client)
Refer to section 7.0
Please note that participants will not see the assessment until you make it available in scheduling process 5. Feedback / outcomes
As with questions and topics feedback is available at the assessment level.
Access authoring environment
Outcomes will take into consideration outcome values from question blocks contained within the assessment. This gives the assessment writer an opportunity to weight the importance of question blocks as they pertain to a specific assessment.
Refer to section 5.0 SOP-QMI-1000 | feedback; QTAS SOP-QMI-1001 | outcomes; QTAS
3.3 Consumption STEP WHAT 1. Branching
WHEN A more sophisticated way of providing feedback is allowed at the conclusion of an assessment based on the outcome.
COMPETENCY (WHO) QTAS owner and subject matter expert (client)
HOW (TOOLS) Refer to section 7.0 Access authoring environment
Assessments may have outcomes.
2. Publishing
You may branch to either a URL (to explore some additional content solicit social feedback) or to another assessment After your assessment is complete this is the intermediate step between creation and exposing the
Procedure Title: – Configuration; assessments
QTAS owner and subject matter expert (client)
Refer to section 7.0 Access authoring environment
Page 4 of 7
QMS STANDARDS
CONTROLLED DOCUMENT: WI-QMI-51005
STEP
WHAT
3. Scheduling
WHEN assessment to your community. In some cases to get a full test of an assessment you need to publish, as mentioned in 3.2.4 Once the assessment is published it can be scheduled for consumption. Myriad variables exist regarding who will see the assessment and how they will receive notification.
COMPETENCY (WHO)
QTAS owner and subject matter expert (client)
HOW (TOOLS)
Refer to section 7.0 Access authoring environment Refer to section 6.0 QuestionMark V5 QMerit marked up manual
4.0 SPECIAL DEFINITIONS THE FOLLOWING TERMS ARE REFERRED TO IN THIS STANDARD; TO VIEW THE DEFINITION OF EACH TERM PLEASE CLICK ON THE LEXICON LIBRARY LINK: LEXICON LIBRARY TERM Assessment Feedback Outcome-based education QTAS Scheduling Standard Operating Procedure (SOP) Topic Work instruction (WI)
5.0 ASSOCIATED REFERENCE DOCUMENTS THE FOLLOWING DOCUMENTS PROVIDE ADDITIONAL INFORMATION:
Procedure Title: – Configuration; assessments
Page 5 of 7
QMS STANDARDS
CONTROLLED DOCUMENT: WI-QMI-51005
DOCUMENT NAME R-WI-QMI-51005 | assessment stakes and types WI-QMI-51006 | configuration; topics WI-QMI-51005 | configuration; assessment SOP-QMI-1000 | feedback; QTAS SOP-QMI-1001 | outcomes; QTAS R-WI-QMI-51005 | (screenshot) assessment lifecycle WI-QMI-51001 | Metadata; QTAS
LOCATION http://bit.ly/R_WI_QMI_51005_AssessmentStak esAndTypes http://bit.ly/WIQMI51006 http://bit.ly/WIQMI51005 http://bit.ly/SOPQMI1000 http://bit.ly/SOPQMI1001 http://bit.ly/R_WI_QMI_51005_AssessmentLifec ycle http://bit.ly/WIQMI51001
6.0 ASSOCIATED KNOWLEDGE DATABASE THE FOLLOWING KNOWLEDGE DATABASES PROVIDE ADDITIONAL INFORMATION: KNOWLEDGE DATABASE QuestionMark V5 QMerit marked up manual
LOCATION http://bit.ly/R_WI_11000_QuestionMarkV5Marked UpManual https://questionmark.com/content/assessmentblocks
Use of question blocks (QuestionMark)
7.0 ASSOCIATED TOOLS THE FOLLOWING TOOLS MAY BE REQUIRED FOR COMPLIANCE TO THIS STANDARD: ASSOCIATED TOOLS QMerit Lexicon Library QuestionMark authoring environment
LOCATION http://bit.ly/QMeritLexiconLibrary http://ondemand.questionmark.com/home/402385
8.0 REVISION HISTORY REVISION (X.X) DATE OF LAST REVISION
1.01 02/16/16
LAST APPROVAL DATE
02/11/16
(MM/DD/YY) (MM/DD/YY)
DOCUMENT AUTHOR: Greg Lush
DOCUMENT MANAGER: Greg Lush
REASON FOR CHANGE:
Revision
SECTION / PARAGRAPH CHANGED
Procedure Title: – Configuration; assessments
CHANGE MADE
DATE OF REVISION MM/DD/YY
Page 6 of 7
QMS STANDARDS
CONTROLLED DOCUMENT: WI-QMI-51005
1.0 1.01
All 5.0
Initial entry of document Added additional reference
02/09/16 2/11/2016
9.0 ELECTRONIC NOTIFICATION LIST: ELECTRONIC NOTIFICATIONS VP Technical Services VP Sales VP Engineering 10.0
APPROVALS
PLEASE GO TO THE LINK BELOW FOR THE ELECTRONIC RECORD OF THE REVIEW AND APPROVAL OF THIS POLICY. LOGIN TO VIEW FIRST APPROVER NAME: GREG LUSH BUSINESS UNIT: QMERIT INC. TITLE: CLO SIGNATURE: ELECTRONIC APPROVAL
SECOND APPROVER NAME: TRACY PRICE BUSINESS UNIT: QMERIT INC. TITLE: CEO AND CHAIRMAN SIGNATURE: ELECTRONIC APPROVAL
THIRD APPROVER NAME: BUSINESS UNIT: QMERIT INC. TITLE: SIGNATURE:
DOCUMENT HISTORY SECTION: Document Created on 02/09/16 by Greg Lush Document edited on 02/11/16 by Greg Lush Edits and URLs on 02/16/16 by Greg Lush
Procedure Title: – Configuration; assessments
Page 7 of 7