Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Audit”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Photovoltaic system criteria documents. Volume 6: Criteria for auditing photovoltaic system applications and experiments. Revision A

The criteria is defined for auditing photovoltaic system applications and experiments. The purpose of the audit is twofold: to see if the application is meeting its stated objectives and to measure the application's progress in terms of the National Photovoltaic Program's goals of performance, cost, reliability, safety, and socio-environmental acceptance. The information obtained from an audit will be used to assess the status of an application and to provide the Department of Energy with recommendations on the future conduct of the application. Those aspects are covered of a site audit necessary to produce a systematic method for the gathering of qualitative and quantitative data to measure the success of an application. A sequence of audit events and guidelines for obtaining the required information is presented.

Koenig, John C.↗

John F. Kennedy Space Center, Safety, Reliability, Maintainability and Quality Assurance, Survey and Audit Program

This document is the product of the KSC Survey and Audit Working Group composed of civil service and contractor Safety, Reliability, and Quality Assurance (SR&QA) personnel. The program described herein provides standardized terminology, uniformity of survey and audit operations, and emphasizes process assessments rather than a program based solely on compliance. The program establishes minimum training requirements, adopts an auditor certification methodology, and includes survey and audit metrics for the audited organizations as well as the auditing organization.

Source record↗

The Functional Resonance Analysis Method for a systemic risk based environmental auditing in a sinter plant: A semi-quantitative approach

Environmental auditing is a main issue for any production plant and assessing environmental performance is crucial to identify risks factors. The complexity of current plants arises from interactions among technological, human and organizational system components, which are often transient and not easily detectable. The auditing thus requires a systemic perspective, rather than focusing on individual behaviors, as emerged in recent research in the safety domain for socio-technical systems. We explore the significance of modeling the interactions of system components in everyday work, by the application of a recent systemic method, i.e. the Functional Resonance Analysis Method (FRAM), in order to define dynamically the system structure. We present also an innovative evolution of traditional FRAM following a semi-quantitative approach based on Monte Carlo simulation. This paper represents the first contribution related to the application of FRAM in the environmental context, moreover considering a consistent evolution based on Monte Carlo simulation. The case study of an environmental risk auditing in a sinter plant validates the research, showing the benefits in terms of identifying potential critical activities, related mitigating actions and comprehensive environmental monitoring indicators. - Highlights: • We discuss the relevance of a systemic risk based environmental audit. • We present FRAM to represent functional interactions of the system. • We develop a semi-quantitative FRAM framework to assess environmental risks. • We apply the semi-quantitative FRAM framework to build a model for a sinter plant.

54 ENVIRONMENTAL SCIENCES↗

SU-F-T-485: Independent Remote Audits for TG51 NonCompliant Photon Beams Performed by the IROC Houston QA Center

Purpose: IROC-H conducts external audits for output check verification of photon and electron beams. Many of these beams can meet the geometric requirements of the TG 51 calibration protocol. For those photon beams that are non TG 51 compliant like Elekta GammaKnife, Accuray CyberKnife and TomoTherapy, IROC-H has specific audit tools to monitor the reference calibration. Methods: IROC-H used its TLD and OSLD remote monitoring systems to verify the output of machines with TG 51 non compliant beams. Acrylic OSLD miniphantoms are used for the CyberKnife. Special TLD phantoms are used for TomoTherapy and GammaKnife machines to accommodate the specific geometry of each machine. These remote audit tools are sent to institutions to be irradiated and returned to IROC-H for analysis. Results: The average IROC-H/institution ratios for 480 GammaKnife, 660 CyberKnife and 907 rotational TomoTherapy beams are 1.000±0.021, 1.008±0.019, 0.974±0.023, respectively. In the particular case of TomoTherapy, the overall ratio is 0.977±0.022 for HD units. The standard deviations of all results are consistent with values determined for TG 51 compliant photon beams. These ratios have shown some changes compared to values presented in 2008. The GammaKnife results were corrected by an experimentally determined scatter factor of 1.025 in 2013. The TomoTherapy helical beam results are now from a rotational beam whereas in 2008 the results were from a static beam. The decision to change modality was based on recommendations from the users. Conclusion: External audits of beam outputs is a valuable tool to confirm the calibrations of photon beams regardless of whether the machine is TG 51 or TG 51 non compliant. The difference found for TomoTherapy units is under investigation. This investigation was supported by IROC grant CA180803 awarded by the NCI.

60 APPLIED LIFE SCIENCES↗

Pascua Yaqui Tribe Energy Audit (Final Report)

The Pascua Yaqui Tribe has the goal of reducing energy use and costs in its government facilities and housing. In a proactive effort to meet the Tribe's needs an energy audit was performed to accomplish the following goals: Develop an energy efficiency implementation strategy. Prepare an energy audit to identify cost-effective energy efficiency opportunities. Plan and conduct a level II energy audit in tribal government buildings and tribal housing. The audit encompassed four tribal government buildings and a group of residential structures. The purpose of this project was to assess the various facilities energy use in order to inform a means to lower annual consumption. An evaluation of each facility's historical energy and major energy-consuming equipment was performed, and energy conservation measures (ECM's) were identified. An average of 4 ECM's where recommended for each facility. If each facility's recommended ECM's are implemented, the average calculated yearly benefits to the government and residential buildings would result in a 48.3% reduction in electrical energy/costs savings and a 14.4% reduction in natural gas energy/costs savings. Recommended projects for implementation include: Interior Lighting Upgrade, Exterior Lighting Upgrade, Solar Pool Covers, Retro-Commissioning, Low Volt Fixtures, Plug Load Management System, Occupancy Sensor Control, and Solar PV for government/casino buildings and appliance, window, HVAC, Weather Stripping, and water heaters replacement in residences.

03 NATURAL GAS↗

FEMP Facility Evaluation (Audit) Decision Tree

This document is a resource to be used in concert with FEMP Audit Definitions, FEMP Consolidated Facility Management Guidance, and agency best practices and expert judgment—for agencies to use to determine the best approaches to evaluate their facilities. It features a decision tree that provides a framework for agencies to interpret gathered facility data to understand the existing conditions; benchmark the facility against others in the portfolio to determine whether an on-site or remote audit is appropriate for a facility; determine the best remote or on-site audit level of detail to meet agency facility auditing goals, such as meeting Energy Independence and Security Act of 2007 requirements and developing projects; and improve their energy and water management programs.

auditing↗

SU-E-T-282: Dose Measurements with An End-To-End Audit Phantom for Stereotactic Radiotherapy

Purpose: Report on dose measurements as part of an end-to-end test for stereotactic radiotherapy, using a new audit tool, which allows audits to be performed efficiently either by an onsite team or as a postal audit. Methods: Film measurements have been performed with a new Stereotactic Cube Phantom. The phantom has been designed to perform Winston Lutz type position verification measurements and dose measurements in one setup. It comprises a plastic cube with a high density ball in its centre (used for MV imaging with film or EPID) and low density markers in the periphery (used for Cone Beam Computed Tomography, CBCT imaging). It also features strategically placed gold markers near the posterior and right surfaces, which can be used to calculate phantom rotations on MV images. Slit-like openings allow insertion of film or other detectors.The phantom was scanned and small field treatment plans were created. The fields do not traverse any inhomogeneities of the phantom on their paths to the measurement location. The phantom was setup at the delivery system using CBCT imaging. The calculated treatment fields were delivered, each with a piece of radiochromic film (EBT3) placed in the anterior film holder of the phantom. MU had been selected in planning to achieve similar exposures on all films. Calibration films were exposed in solid water for dose levels around the expected doses. Films were scanned and analysed following established procedures. Results: Setup of the cube showed excellent suitability for CBCT 3D alignment. MV imaging with EPID allowed for clear identification of all markers. Film based dose measurements showed good agreement for MLC created fields down to 0.5 mm × 0.5 mm. Conclusion: An end-to-end audit phantom for stereotactic radiotherapy has been developed and tested.

60 APPLIED LIFE SCIENCES↗

Towards Streamlining Auditing for Compliance With Requirements in Open-Source Software at NASA

Context: NASA requires all software to meet several requirements (NPR 7150.2) depending on software criticality. The instantiation of these requirements may vary per project; however, once decided upon, projects must undergo audits to evaluate compliance with these requirements. Aim: We propose that audit effort can be reduced when requirements are realized by leveraging commonly used open-source infrastructure for version control, issue tracking and continuous integration, and the generated records are analyzed using a repository mining software tool to quantify process compliance. Method: We perform a case study in the NASA-funded Copilot project, utilizing Kaiaulu, a repository mining software tool. We define four software compliance metrics based on the Copilot’s requirements, and analyze their impact on source code quality. Results: Our work demonstrates how it is possible to leverage existing open source tools and platforms to facilitate software certification and qualification, and to streamline the auditing process required even when stringent requirements must be enforced. Conclusion: Together, both project and tool can be utilized to visualize project compliance, and metrics can be defined to more easily identify process irregularities to minimize auditing efforts. Project Repository: github.com/Copilot-Language/copilot Tool Repository: github.com/sailuh/kaiaulu

code-quality↗

Scaling Building Energy Audits through Machine Learning Methods on Novel Drone Image Data

Building energy audits are time-consuming and labor-intensive. This paper describes a new method using machine learning (ML) techniques on novel data sources (drone images) to improve the identification of building characteristics and retrofit opportunities, and thereby reduce the effort for audits. The new ML method includes: (1) Building footprint extraction using line extraction, polygonization, and polygon-merging, (2) Building envelope extraction using PIX4d modeling software to reconstruct a building 3D model, (3) Visualization tool for viewing images from the 3D model, (4) Window-to-wall ratio (WWR) using state-of-art deep neural network semantic segmentation, (5) Envelope thermal anomaly detection using an unsupervised machine learning clustering algorithm, and (6) Rooftop energy equipment detection based on an object detection algorithm. The testing of this method involved a comparison of additional ML-generated information overlaid on current ‘state-of-practice’ audit and remote assessment baselines using evaluation metrics: labor time and associated cost, marginal benefits of using ML-generated information in workflows for audits and remote assessments, integration potential with existing processes and tools, and replicability/scalability of the method. In two test buildings in California that had comprehensive drawings and meter data available, the ML method effectively generated a building footprint, envelope, rooftop equipment, WWR, and locations of envelope thermal anomalies. Projected target segments of the ML method are sites with minimal drawings and energy data, and underserved sectors such as multistoried housing, disadvantaged communities, and schools for which the ML method can enable identification of building asset characteristics and prioritization of envelope retrofits and decentralized energy equipment retrofits.

Singh, Reshma↗

Impact of Using Audit Data to Improve the Evidence-Based Use of Single-Fraction Radiation Therapy for Bone Metastases in British Columbia

Purpose: To assess the impact of a population-based intervention to increase the consistency and use of single-fraction radiation therapy (SFRT) for bone metastases. Methods and Materials: In 2012, an audit of radiation therapy prescriptions for bone metastases in British Columbia identified significant interphysician and -center (26%-73%) variation in the use of SFRT. Anonymous physician-level and identifiable regional cancer center SFRT use data were presented to all radiation oncologists, together with published guidelines, meta-analyses, and recommendations from practice leaders. The use of SFRT for bone metastases from 2007 through 2011 was compared with use of SFRT in 2013, to assess the impact of the audit and educational intervention. Multilevel logistic regression was used to assess the relationship between the usage of SFRT and the timing of the radiation while controlling for potentially confounding variables. Physician and center were included as group effects to account for the clustered structure of the data. Results: A total of 16,898 courses of RT were delivered from 2007 through 2011, and 3200 courses were delivered in 2013. The rates of SFRT use in 2007, 2008, 2009, 2010, 2011, and 2013 were 50.5%, 50.9%, 48.3%, 48.5%, 48.0%, and 59.7%, respectively (P<.001). Use of SFRT increased in each of 5 regional centers: A: 26% to 32%; B: 36% to 56%; C: 39% to 57%; D: 49% to 56%; and E: 73% to 85.0%. Use of SFRT was more consistent; 3 of 5 centers used SFRT for 56% to 57% of bone metastases RT courses. The regression analysis showed strong evidence that the usage of SFRT increased after the 2012 intervention (odds ratio 2.27, 95% confidence interval 2.06-2.50, P<.0001). Conclusion: Assessed on a population basis, an audit-based intervention increased utilization of SFRT for bone metastases. The intervention reversed a trend to decreasing SFRT use, reduced costs, and improved patient convenience. This suggests that dissemination of programmatic quality indicators in oncology can lead to increased utilization of evidence-based practice.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Clinical Chart Audits as a Potential Process Improvement Strategy Within the Radiation Therapy Department of a Community-Based Cancer Center

Within the health care profession, many organizations rely on routine clinical chart audits to detect areas for enhancement and potential triggers for error. Effective clinician documentation within the electronic treatment record is mandatory should high-quality care be maintained. This study aimed to determine what type of information might be obtained from radiation therapy treatment chart audits. This information would help to inform areas for improvement within the department and to determine whether introducing clinical chart audits as routine would be of benefit.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Multifamily Tool for Energy Audits (MulTEA) Engineering Manual (Version 1)

The Multifamily Tool for Energy Audits (MulTEA) is an energy audit tool designed to provide auditors with an improved energy simulation tool for multifamily buildings and an improved tool for identifying cost-effective energy-efficiency retrofit measures for multifamily buildings. MulTEA is designed specifically to help states and local weatherization agencies implement the Department of Energy (DOE) Weatherization Assistance Program. MulTEA was developed jointly by the Oak Ridge National Laboratory (ORNL) and the Lawrence Berkeley National Laboratory (LBNL). MulTEA is part of ORNL’s web-based Weatherization Assistant suite of audit tools (https://weatherization.ornl.gov/softwaredescription/). The energy calculation engine including the DOE- 2 simulation model and supplementary calculation modules is shared by MulTEA and LBNL’s Home Energy Saver pro (HESpro) (http://hespro.lbl.gov/pro/). On the ORNL side, the energy calculation engine is coupled with a user interface and output reporting capabilities based on Weatherization Assistance Program regulations and guidelines pertinent to MulTEA. On the LBNL side, the same engine will be used in HESpro to expand it to handle multifamily buildings. MulTEA is designed to address small and large multifamily buildings with decentralized and centralized heating, ventilation, and air-conditioning (HVAC) and domestic hot water (DHW) systems. Version 1 of MulTEA addresses small multifamily buildings with decentralized HVAC systems, and decentralized or centralized DHW systems. The capability to model large buildings and centralized HVAC systems will be incorporated in Version 2.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

CY20 AIHA Internal Audit of ALAB and NIF-HPL and CY20 Management Review of ALAB

An internal audit was performed in ALAB to ISO 17025:2017; EPA LQST and AIHA requirements using the current AIHA Checklist. The scope of the internal audit was the annual review of AIHA-accredited industrial hygiene methods performer in both ALAB and NIF HPL. The Internal audit resulted in 3 deficiencies and 3 comments.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Document Traceability Internal Audit of the Analytical Laboratory Report on 08-26-2021

An internal audit was performed in ALAB 8/25/21 to the NELAC 2016 Standard requirements using the NELAC 2016 checklist (TNI 2016 CSDP-Volume1Checklist-Master-2-15-18-v9). The scope of the internal audit was a document traceability of the environmental testing in LRF-00118, LRF00095, and LRF 00133 performed in ALAB. The internal audit resulted in five deficiencies and two comments. The deficiencies were addressed using the ALAB non-conformance reporting system, see ALAB NCRs 10002742-10002746. FRM-5100 Management Observation and NCRs are attached.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

The RIACS Intelligent Auditing and Categorizing System

The organization of the RIACS auditing package is described along with how to installation instructions and how to interpret the output. How to set up both local and remote file system auditing is given. Logging is done on a time driven basis, and auditing in a passive mode.

Bishop, Matt↗

Alternative Auditing Approaches

This presentation for the 2017 Energy Exchange in Tampa, Florida, offers information about advanced auditing technologies and techniques including alternative auditing approaches and considerations and caveats.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Analyzing the Multiscale Impacts of Implementing Energy-Efficient HVAC Improvements Through Energy Audits and Economic Input–Output Analysis

Abstract Heating, ventilation, and air-conditioning (HVAC) systems are usually an industry’s highest consumer of energy, most of which goes toward space cooling in buildings. Industrial energy-efficiency audits not only benefit manufacturers but also generate significant economic and environmental benefits to localities, states, and the nation. This article analyzes the micro- and macro scale impacts of implementing energy-efficient HVAC systems by integrating the industrial building energy data with the macroeconomic regional economic flow model. Micro-scale data include 10 years of historical energy, cost, and carbon dioxide savings achieved from energy-efficient HVAC implementation offered to manufacturers through industrial energy audits. The data were integrated into the macroeconomic modeling framework to illuminate the cascading regional economic impacts of implementing energy-efficient HVAC recommendations in manufacturing facilities. Results show that if recommendations had been implemented throughout all manufacturers in the region, $656 M energy costs would have been directly saved, 7.8 million metric tons of carbon dioxide emissions would have been avoided, and 4387 jobs could have been created, resulting in a total annual economic impact of $899 M stemming from direct, indirect, and induced impacts. The results offer insight into how industrial energy systems can be designed and provide models for how communities can accomplish a net-zero society.

Energy & Fuels↗

SU-E-J-208: Feasibility Study On Using Small Plastic Phantoms for Auditing Radiation Output of MR-Linac Systems

Purpose: To study feasibility of using small plastic phantoms designed for conventional linac output auditing to measure the output of MR-Linac systems. Methods: For simulations, the CT scan of an IROC(formerly RPC) acrylic block phantom designed for 8 MV beams was imported in a research version of the treatment planning system (Monaco). Dose delivered to three TLDs in the block was calculated with a Monte Carlo algorithm and a beam model based on an MR-linac prototype with and without a magnetic field (B=1.5T). In a large mathematical water phantom, the same beam was used to calculate dose in full scatter conditions. The block factor (F) was calculated as the ratio of the average dose to the block TLDs to the dose at the reference point in the mathematical phantom. For experimental measurement, four IROC blocks were irradiated with the MR-linac prototype, and data were analyzed by IROC. Results: The F factor without a B field was 1.053. When a B field was applied, it changed the dose distribution in the block, especially on the edges. With a B field parallel to the long axes of the TLD, F was 1.038. However, with a perpendicular B field, F factor increased slightly to 1.075. In the IROC report, the output determined with two blocks parallel to the B field was 2.3% higher than the output by the two blocks perpendicular to the B field. The average of all four blocks was within 2% of machine output measured with an ion chamber. Conclusion: It may be feasible to expand the utility of the acrylic block phantoms for radiation output auditing from conventional linacs to MR-linacs. However, the scatter correction factor can change due to the B field and its orientation to the block. More symmetric phantom designs may be less prone to mistakes. We acknowledge research support from Elekta.

60 APPLIED LIFE SCIENCES↗