69 / 73
Ref. No. [UMCES] CBL 2016-010
ACT VS16-01
69
The audits were conducted in accordance with the procedures described in EPA's
Guidance on
Technical Audits and Related Assessments for Environmental Data Operations (EPA QA/G-7)
. The
audits included a review of staff, test procedures (sample collection, sample analysis, data processing,
etc.), facilities, and documentation.
The TSA’s’ findings for the two field tests were positive and indicated that these components
of the DO sensor verification were being implemented in a manner consistent with the Test Protocols
and SOPs. Minor deviations, such as schedule changes, were documented in laboratory records. None
of the deviations in the Test Protocols had any effect on data quality for the verification and no
corrective action was required. All phases of the implementation of the test reviewed during the TSA
were acceptable and performed in a manner consistent with ACT data quality goals. The overall
quality assurance objectives of the test were met.
ACT personnel are well-qualified to implement the verification, and demonstrated expertise in
pertinent procedures. Communication and coordination among all personnel was frequent and
effective. ACT’s internal record keeping and document control is well organized. The ACT staff
understands the need for QC, as shown in the conscientious development and implementation of a
variety of QC procedures.
All samples and instrument measurements were collected, analyzed and cataloged as described
in the Test Protocols and SOPs. Examination of maintenance and calibration logs provided evidence of
recent and suitable calibration of sampling and analytical equipment.
Data Assessments
Data review is conducted to ensure that only sound data that are of known and documented
quality and meet ACT technology verification quality objectives are used in making decisions about
technology performance. ACT’s data review processes are based in part on two EPA guidance
documents:
Guidance on Environmental Data Verification and Data Validation
(QA/G-8) [EPA,
2002] and
Guidance on Technical Audits and Related Assessments for Environmental Data Operations
(QA/G-7) [EPA, 2000].
At the outset of the assessment phase, the data were verified and validated to evaluate whether
the data have been generated according to the Test Protocols, satisfy acceptance criteria, and are
appropriate and consistent with their intended use of evaluating the performance of the test sensors.
Data verification evaluates the completeness, correctness, and consistency of the data sets against the
requirements specified in the Test Protocols, measurement quality objectives (MQOs) in the ACT
Quality Assurance Project Plan (QAPP), and any other analytical process requirements contained in
SOPs. The ACT QA Manager reviewed the reference sample data sets from all field sites and verified
that the sampling and analysis protocols specified in the Test Protocols were followed, and that the
ACT measurement and analytical systems performed in accordance with approved methods, based on:
•
The raw data records were complete, understandable, well-labeled, and traceable;
•
All data identified in the Test Protocols were collected;
•
QC criteria were achieved; and
•
Data calculations were accurate.
Data validation uses the outputs from data verification and included inspection of the verified
field and laboratory data to determine the analytical quality of the data set. A representative set of
approximately 10% of the data on core parameters was traced in detail from raw data from field and