51.363—Quality assurance.
An ongoing quality assurance program shall be implemented to discover, correct and prevent fraud, waste, and abuse and to determine whether procedures are being followed, are adequate, whether equipment is measuring accurately, and whether other problems might exist which would impede program performance. The quality assurance and quality control procedures shall be periodically evaluated to assess their effectiveness and relevance in achieving program goals.
(a) Performance audits.
Performance audits shall be conducted on a regular basis to determine whether inspectors are correctly performing all tests and other required functions. Performance audits shall be of two types: overt and covert, and shall include:
(1)
Performance audits based upon written procedures and results shall be reported using either electronic or written forms to be retained in the inspector and station history files, with sufficient detail to support either an administrative or civil hearing;
(2)
Performance audits in addition to regularly programmed audits for stations employing inspectors suspected of violating regulations as a result of audits, data analysis, or consumer complaints;
(3)
Overt performance audits shall be performed at least twice per year for each lane or test bay and shall include:
(iv)
Observation and written evaluation of each inspector's ability to properly perform an inspection;
(i)
Remote visual observation of inspector performance, which may include the use of aids such as binoculars or video cameras, at least once per year per inspector in high-volume stations (i.e., those performing more than 4000 tests per year);
(ii)
Site visits at least once per year per number of inspectors using covert vehicles set to fail (this requirement sets a minimum level of activity, not a requirement that each inspector be involved in a covert audit);
(iii)
For stations that conduct both testing and repairs, at least one covert vehicle visit per station per year including the purchase of repairs and subsequent retesting if the vehicle is initially failed for tailpipe emissions (this activity may be accomplished in conjunction with paragraph (a)(4)(ii) of this section but must involve each station at least once per year);
(iv)
Documentation of the audit, including vehicle condition and preparation, sufficient for building a legal case and establishing a performance record;
(v)
Covert vehicles covering the range of vehicle technology groups (e.g., carbureted and fuel-injected vehicles) included in the program, including a full range of introduced malfunctions covering the emission test, the evaporative system tests, and emission control component checks (as applicable);
(vi)
Sufficient numbers of covert vehicles and auditors to allow for frequent rotation of both to prevent detection by station personnel; and
(vii)
Where applicable, access to on-line inspection databases by State personnel to permit the creation and maintenance of covert vehicle records.
(b) Record audits.
Station and inspector records shall be reviewed or screened at least monthly to assess station performance and identify problems that may indicate potential fraud or incompetence. Such review shall include:
(1)
Automated record analysis to identify statistical inconsistencies, unusual patterns, and other discrepancies;
(2)
Visits to inspection stations to review records not already covered in the electronic analysis (if any); and
(3)
Comprehensive accounting for all official forms that can be used to demonstrate compliance with the program.
(c) Equipment audits.
During overt site visits, auditors shall conduct quality control evaluations of the required test equipment, including (where applicable):
(1)
A gas audit using gases of known concentrations at least as accurate as those required for regular equipment quality control and comparing these concentrations to actual readings;
(2)
A check for tampering, worn instrumentation, blocked filters, and other conditions that would impede accurate sampling;
(7)
A check to determine that station gas bottles used for calibration purposes are properly labelled and within the relevant tolerances;
(8)
Functional dynamometer checks addressing coast-down, roll speed and roll distance, inertia weight selection, and power absorption;
(10)
A check of the pressure monitoring devices used to perform the evaporative canister pressure test(s); and
(3)
The training and knowledge requirements in paragraph (d)(1) of this section may be waived for temporary auditors engaged solely for the purpose of conducting covert vehicle runs.
(e) SIP requirements.
The SIP shall include a description of the quality assurance program, and written procedures manuals covering both overt and covert performance audits, record audits, and equipment audits. This requirement does not include materials or discussion of details of enforcement strategies that would ultimately hamper the enforcement process.