How To Calibrate Humans: Attribute Agreement Analysis
Jd Marhevko, VP QLMS/EHS, Accuride Corp, Salne, MI, USA
Keywords: Calibration, Risk Management, Attribute Agreement Analysis
Why: Customers rarely differentiate the causals of a PPM defect at the contract table. A ppm is a ppm . Whether the feature is for a safety or critical nature vs a visual attribute nature, either can keep a company from securing the order. While product and process evaluations by humans are done daily for reasons of efficiency and cost, the effectiveness of this evaluation process can be but is rarely assessed. This leaves the organization wide open for risk of returns, ill-will, rework, and ultimately loss of business. Learn how to identify and manage this risk in a hands-on and engaging manner.
Humans CAN BE calibrated. Control plans call out for MSA analysis on key processes. Inevitably, these mainly focus on features measured by variables gaging systems. However, MSA analysis should also be applied to processes are attribute-based and are inspected visually and/or via methods where gaging/tools aren t used (largely due to the need for cost savings or efficiency). Some examples are the interpretation of color, grey scale analysis, glossiness, chips/dings, surface imperfections like scratches or pinholes and voids, paint coverage, etc. Many businesses rely upon the skills of their personnel to interpret these go/no go attribute features. When personnel do not repeatedly and accurately disposition the product they evaluate, several different types of business losses can be incurred including loss of time via arguments, over and/or under rejecting of product with associated losses, unplanned premium freight, etc.
This interactive session enables participants to learn how to develop, create, execute and interpret an Attribute Agreement Analysis (AAA) so that an accurate and repeatable disposition can be made and rework and returns can be effectively reduced. An AAA is an MSA for attributes. Auditing professionals need to understand the effectiveness of these methods when used by their clientele and/or in their own organization. Attendees will see how they can apply this tool while learning how to mitigate business cost exposure.
Session Description: Humans CAN BE calibrated. Control plans call out for MSA analysis on key processes. These mainly focus on features measured by variables gaging systems. However, MSA analysis also applies to attribute-based processes that are inspected visually. Some examples are the interpretation of color or surface imperfections like scratches. Many businesses rely upon the skills of their personnel to interpret these go/no go attribute features. When personnel do not repeatedly and accurately disposition the product they evaluate, business loss and risk can be incurred. This VERY interactive session enables participants to learn how to develop, create, execute and interpret an Attribute Agreement Analysis (AAA) so that an accurate and repeatable disposition can be made and rework and returns can be effectively reduced. Attendees will see how they can apply this tool while learning how to mitigate business cost exposure.
General concepts covered in the session
Defining Attribute Agreement Analysis (AAA): A review of basic AAA analysis. Will cover the 3 basic types of agreements: Agreement with oneself, Agreement to a peer, Agreement to the standard. Both the Statistical AAA and the Kappa value will be reviewed. Confidence levels for the result bands will also be reviewed. Incorporation of AAA into the Control Plan and frequency of calibration will be reviewed.
How It Works: While reviewing the concepts, the audience will be undergoing multiple live simulations via an in-session exercises so that they can experience the 3 basic types of agreements. This is a very engaging exercise where they will visually evaluate whether or not test products pass or fail the various attribute tests including, shininess , surface damage and roundness.
Benefits of the Calibrated Human: There are multiple benefits when calibrating the human operator. Via an interactive Pros/Cons discussion, the general benefits of reductions in arguments (what is good or not) internal/ external rework, returns, premium freight, etc. will be discussed.
Key Objectives: 1.To help people understand how AAA can be effectively utilized for mitigating business loss. 2. Increased understanding of how to actually perform the analysis. 3. Build confidence in the ability to calibrate a human operator
“ISO 9001 is used by millions of people and organisations around the world and the upcoming 2015 revision will have a big impact on those who work with the standard.
The impact of this revision will be similar to, if not greater than the 2000 edition, which was a major change for accreditation bodies, certification bodies, training organisations, implementing organisations, procurement organisations, consultants and customers.”
An excerpt from IRCA Resources on “ISO 9001: IRCA Supporting the 2015 Revision”, October 2013