QMS STANDARDS
CONTROLLED DOCUMENT: SOP-QMI-1001
BUSINESS UNIT:
QMerit Inc. 111 Pacifica, Suite 200, Irvine, CA 92618
STANDARD TYPE:
Standard Operating Procedure
PROCEDURE TITLE: Outcomes; QTAS
AREA: Management Systems TYPE OF PROCEDURE:
HR and Learning
DOCUMENT NUMBER: SOP-QMI-1001 REVISION: 1.0
PROCEDURE STATUS
IMPLEMENTED
RELEASED
02/08/16
mm/dd/yy
UNLOCK DOCUMENT TO EDIT BEYOND THIS POINT
1.0 PURPOSE/SCOPE People need to know where they stand; we deliver that in a learning system via the careful and deliberate configuration of outcomes. Question outcomes are determined by the participants’ choice, and specify what the consequences of this choice will be. For example, if the stimulus is “what is the capital city of Peru?”, and the participant selected “Buenos Aires” as the choice, then the outcome might be a feedback message displayed saying “incorrect – the capital city of Peru is Lima”, and the participant receives a score of zero for that question. QMerit focuses on a learning style often referred to as outcome-based education. As you might imagine outcomes are very important to make sure that the participant is receiving the information you intended so that the learning goal may be met. 2.0 RESPONSIBILITIES 2.1 TASK RESPONSIBILITIES QMerit Inc. maintains certain policies to encourage appropriate levels of feedback for workers. It is the responsibility of QMERIT Inc. and its’ clients to implement and operate this procedure in their areas of operation and to:
Ensure that the SOP and all associated documents, knowledge databases and tools are understood and adopted. Supplement the SOP with Work Instruction as required in order to meet local market needs, Business Unit needs, regulatory requirements, customer preferences and/or proven operating and/or delivery methods.
2.2 APPROVAL / ESCALATION RESPONSIBILITIES It is the responsibility of QMERIT Inc. and its’ clients to implement this SOP
Procedure Title: – Outcomes; QTAS
Page 1 of 4
CONTROLLED DOCUMENT: SOP-QMI-1001
QMS STANDARDS
The QMerit Inc. CLO is the point of escalation for all matters inquired upon or contested with regards to this policy. 3.0 PROCEDURE (SOP) 3.1 outcomes overview 3.1.1 contained within many assessment and learning management engines functionality exists to create outcomes at the question level, the topic level, or the assessment level. In most cases topic outcomes and assessment outcomes function in the same way as the question outcomes, except at the topic and assessment (rather than individual question) level. 3.1.2 question results are identified by which outcomes are associated with the answer. Outcomes are used extensively in reporting to analyze and list answers to questions. These reports become much more meaningful if the outcomes are organized and named well. Therefore, authors should create question outcomes for each different scenario that reporting dictates. 3.2 question outcomes may consist of: 3.2.1 condition: this evaluates the participant’s answers, and links the choices they make to their score and the feedback that is given to them. 3.2.2 score: this includes the score granted to participants who make the choice related to this outcome. The question will generally contain several outcomes, and a specific choice may be linked to more than one outcome. 3.2.3 feedback: this is the text of the feedback given for the outcome. It may be an HTML or mathML format, and may also include links to URLs, resources and content. For more information on feedback alternatives please reference SOP-QMI–1000 (feedback; QTAS) 3.3 outcome conditions 3.3.1 when tying outcomes directly to individual questions you should be aware that some question types may not apply depending upon the system you are using. For instance: 3.3.1.1 explanation questions do not need any outcomes 3.3.1.2 essay questions usually have only basic outcomes such as scored and underscored outcome because they are not scored at the time the participant takes them 3.3.2 with more sophisticated assessment engines the simple outcome conditions above may be combined with logical operators such as AND, OR, and NOT to make a more complex condition. 3.4 assessment offsets leveraging topic and question block outcomes 3.4.1 questions are organized into topics and these topics as they are consumed by an assessment, can create unique scoring outcomes. These scoring outcomes will allow the assessment author to essentially balance the significance of topics within a single assessment. While this takes planning the effort is well worth the flexibility at the assessment level. 4.0 SPECIAL DEFINITIONS THE FOLLOWING TERMS ARE REFERRED TO IN THIS STANDARD; TO VIEW THE DEFINITION OF EACH TERM PLEASE CLICK ON THE LEXICON LIBRARY LINK: LEXICON LIBRARY TERM Assessment CLO Procedure Title: – Outcomes; QTAS
Page 2 of 4
QMS STANDARDS
CONTROLLED DOCUMENT: SOP-QMI-1001
TERM Feedback Outcome-based education QTAS Scheduling Standard Operating Procedure (SOP) Topic Work instruction (WI)
5.0 ASSOCIATED REFERENCE DOCUMENTS THE FOLLOWING DOCUMENTS PROVIDE ADDITIONAL INFORMATION: DOCUMENT NAME SOP-QMI-1000 feedback; QTAS WI-QMI-51004 configuration; questions WI-QMI-51005 configuration; assessments WI-QMI-51006 configuration; topics WI-QMI-11000 master business process; QTAS
LOCATION http://bit.ly/SOPQMI1000 http://bit.ly/WIQMI51004 http://bit.ly/WIQMI51005 http://bit.ly/WIQMI51006 http://bit.ly/WIQMI11000
6.0 ASSOCIATED KNOWLEDGE DATABASE THE FOLLOWING KNOWLEDGE DATABASES PROVIDE ADDITIONAL INFORMATION: KNOWLEDGE DATABASE
LOCATION
7.0 ASSOCIATED TOOLS THE FOLLOWING TOOLS MAY BE REQUIRED FOR COMPLIANCE TO THIS STANDARD: ASSOCIATED TOOLS QMerit Lexicon Library
LOCATION http://bit.ly/QMeritLexiconLibrary
8.0 REVISION HISTORY REVISION (X.X) DATE OF LAST REVISION
1.0 02/16/16
LAST APPROVAL DATE
02/08/16
(MM/DD/YY) (MM/DD/YY)
DOCUMENT AUTHOR: Greg Lush
Procedure Title: – Outcomes; QTAS
DOCUMENT MANAGER: Greg Lush
Page 3 of 4
QMS STANDARDS
CONTROLLED DOCUMENT: SOP-QMI-1001
REASON FOR CHANGE:
SECTION / PARAGRAPH CHANGED
Revision
1.0
All
CHANGE MADE
Initial entry of document
DATE OF REVISION MM/DD/YY
02/08/16
9.0 ELECTRONIC NOTIFICATION LIST: ELECTRONIC NOTIFICATIONS VP Technical Services VP Sales VP Engineering 10.0
APPROVALS
PLEASE GO TO THE LINK BELOW FOR THE ELECTRONIC RECORD OF THE REVIEW AND APPROVAL OF THIS POLICY. LOGIN TO VIEW FIRST APPROVER NAME: GREG LUSH BUSINESS UNIT: QMERIT INC. TITLE: CLO SIGNATURE: ELECTRONIC APPROVAL
SECOND APPROVER NAME: TRACY PRICE BUSINESS UNIT: QMERIT INC. TITLE: CEO AND CHAIRMAN SIGNATURE: ELECTRONIC APPROVAL
THIRD APPROVER NAME: BUSINESS UNIT: QMERIT INC. TITLE: SIGNATURE:
DOCUMENT HISTORY SECTION: Document Created on 02/08/16 by Greg Lush Edits and URLs on 02/16/16 by Greg Lush
Procedure Title: – Outcomes; QTAS
Page 4 of 4