Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Audit Report”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Field Validation of Air-Source Heat Pumps for Cold Climates

Heating energy is the largest end-use for U.S. residential buildings accounting for approximately one-third of residential building energy consumption (EIA 2021). Historically, air-source heat pumps have been limited to temperate climates because of subpar performance at extremely cold outdoor air temperatures. However, recent advances to cold-climate air-source heat pump technology, which typically rely on inverter-driven, variable-speed compressors and variable-speed fans, have significantly improved low-temperature heat pump performance enabling the technology to save energy for many homes in cold climates. The primary objective of this project was to measure in-field performance of centrally ducted, variable-capacity air-source heat pumps in cold climates to validate performance and develop field-based performance maps. The project focused on quantifying heat pump performance at cold temperatures. The sites identified for the study were primarily located in the Northwest United States since homes in the region tend to have all-electric space heating systems and high-efficiency heat pumps have been incentivized in the region for several years. NREL partnered with Ecotope, Inc., a small energy consulting firm located in Seattle, WA, for site recruitment, monitoring equipment installation, data quality management. All the sites included in the study had previously installed a high-efficiency, central heat pump system. One site was in a Denver, CO suburb, which was the only dual fuel heat pump in the study. We used airside and power measurements, collected at 5-second intervals, to quantify heat pump capacity, coefficient of performance (COP), and auxiliary heater energy consumption. We developed algorithms to automatically determine the heat pump operating mode including defrost and auxiliary heating operation. A whole-house thermal and duct audit was completed during the initial site visit to estimate winter heating loads and assess heat pump sizing. Whole-home heating design loads were calculated at ASHRAE 99% design temperatures and compared to manufacturer-reported maximum capacities to assess the heat pump sizing at each site.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Hospice Landscape Report

In July 2018, CMS requested assistance from Oak Ridge National Laboratory (ORNL) to provide expert data science support aimed at developing algorithms for data mining of medical data for operational and payment purposes. The project is intended to be exploratory: work is aimed at alleviating challenges associated with improper payments, specifically audit methodologies and targeting and changes to risk scores. Project goals include developing new, sophisticated methods for audit targeting and improved profile– payment error correlations, specifically focused on Medicare Part C, the program under which MAOs provide health care services to beneficiaries. ORNL conducted RADV analyses against RAPS and EDS data as well as a hospice landscape analysis per a January 2015 dataset that included Medicare beneficiaries who were in hospice in 2017 and 2018. Ongoing work under this project also involves development of predictive models for RADV investigations and hospice landscape.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Data Driven Commercial Building Energy Code Compliance and Technology Inventory for New York City

Building Performance Standards (BPS) are gaining national traction. A BPS will require new processes in the design, construction, and operation of buildings that take the occupants into account and enable predictive analysis to ensure compliance with current and future GHG emissions caps. In New York City, most buildings over 25,000 square feet will be regulated by a BPS starting in 2024, regardless of whether it is new construction permitted under current energy codes or an existing building. This research is one of the first to begin the evaluation of a long-term series of building policies in the context of an open data ecosystem, in cooperation with city agencies. Existing building policies enacted in NYC have ranged from building energy benchmarking and labeling to energy audits to the regulation of GHG emission in buildings. Through the development of a dataset related to building technologies and energy consumption, this project can help to evaluate if meaningful conclusions can be drawn for the data that has been largely self-reported in compliance with city regulations. This project will also provide lessons learned from a deep dive into these types of datasets to provide best practices for municipalities or states seeking to embark on policies like those enacted in NYC. In addition, a Building Automation System (BAS) Stretch Standard of Care (SSOC) for owners, designers, and building operators will enable the measurement and predictive analysis of energy consumption and GHG emissions at the plant, system, or component level, in anticipation of regulated GHG limits on buildings based on energy use. The SSOC is expected to be suitable for use on a national level. The primary feature of an SSOC is a standardized format for a set of BAS points that can be used to control and to gather data from individual plants, systems, or components that are related to building energy consumption. This project examined how measurements compare to prescriptive or simulation-based energy code targets, finding little correlation between predictive 8760-hour energy modeling and actual energy consumption for a small sample (n=27) of buildings constructed after 2015. Other analysis found that, while large multifamily housing (MFH) buildings showed a general trend similar to predicted reductions in energy use from the implementation of model commercial energy codes, this trend was not evident in the office, K-12 school, and hotel use groups in NYC. No upward or downward trends in energy consumption were found when buildings were grouped by size. Energy audit data were analyzed and it appears that there is bias by audit company on measures recommended to clients. Further research should be performed to cross-analyze this with other attributes, such as building size, vintage, and number of stories. Analysis found that for 281 buildings that were permitted and completed after 2015 and had submitted benchmarking data in 2022, between 81% and 96% (by use group) were found to be in compliance with the 2024 to 2029 NYC BPS emission caps, and between 55% and 89% were in compliance with the 2030-2034 caps. This work is beneficial to the public in helping policymakers and building stakeholders better understand the wide-ranging implications of a BPS.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
NASA NTRS2022

Assessing Several Non-Traditional Data Sources for Value in Aviation Safety

The NASA System-Wide Safety (SWS) project and its predecessor projects have been developing Machine Learning (ML) algorithms for commercial aviation safety for many years. These algorithms have been applied to Flight Operations Quality Assurance (FOQA); radar track data (e.g., Threaded Track); and safety reports, including Aviation Safety Reporting System (ASRS) and Aviation Safety Action Plan (ASAP). SWS is working with partners to get access to other data that air carriers provide, such as maintenance data, and has been assisting carriers in working with other data, such as Line Operations Safety Audit (LOSA) data, using manual methods. However, the project has discussed whether there are other data that are not traditionally used in aviation safety analysis that may be useful. This paper discusses four sets of data and models that are not traditionally used in aviation safety but that have shown promise for such use. In the future, we plan to incorporate such data into ML algorithms to use with data that we have used before and determine the additional benefit that is actually achieved under different contexts from the inclusion of these non-traditional data sources.

Nikunj C. Oza↗
DOE OSTI2020

Opportunities for Using the Industrial Assessment Center Database for Industrial Water Use Analysis

The manufacturing sector accounted for approximately 5–6% of total U.S. water use in 2015. Of that amount, 75–80% is self supplied withdrawal from surface-water and groundwater sources and the remainder is from public water supplies. Although manufacturing facilities commonly locate in water-scarce areas, water scarcity still poses a great risk to the manufacturing sector. Reliable water is necessary for any facility that relies on it for process and comfort cooling, cleaning, employee use, and steam generation. One of these barriers to water efficiency is the lack of reliable data on overall U.S. industrial water use—how it is used and the quantities required for each sector. If a facility cannot be easily compared with a facility of similar size and sector, knowing if it is effectively using water conservation best practices is difficult. One potential source of industrial water use data is the U.S. Department of Energy (DOE)–sponsored Industrial Assessment Centers (IACs). IACs are university-based organizations that provide free audits to small- and medium-sized manufacturing facilities to identify productivity improvement and waste and energy reduction opportunities. The IACs also maintain a database of all the audits conducted, which currently holds more than 19,267 assessments and 145,000 recommendations (as of July 24, 2020). This database also contains energy utility (electricity, natural gas, and other fuels) and water utility data, making it a potential data source for industrial water use. This report attempts to create regression models to predict a small- or medium-sized industrial facility’s annual water use or cost based on its industrial subsector and several possible relevant variables. Using data collected by IAC assessments, models for several industrial subsectors were generated via stepwise regression techniques to determine which variables (annual sales, number of employees, facility/plant area, annual production hours, and a water stress metric) are relevant.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
NASA NTRS2012

Security Data Warehouse Application

The Security Data Warehouse (SDW) is used to aggregate and correlate all JSC IT security data. This includes IT asset inventory such as operating systems and patch levels, users, user logins, remote access dial-in and VPN, and vulnerability tracking and reporting. The correlation of this data allows for an integrated understanding of current security issues and systems by providing this data in a format that associates it to an individual host. The cornerstone of the SDW is its unique host-mapping algorithm that has undergone extensive field tests, and provides a high degree of accuracy. The algorithm comprises two parts. The first part employs fuzzy logic to derive a best-guess host assignment using incomplete sensor data. The second part is logic to identify and correct errors in the database, based on subsequent, more complete data. Host records are automatically split or merged, as appropriate. The process had to be refined and thoroughly tested before the SDW deployment was feasible. Complexity was increased by adding the dimension of time. The SDW correlates all data with its relationship to time. This lends support to forensic investigations, audits, and overall situational awareness. Another important feature of the SDW architecture is that all of the underlying complexities of the data model and host-mapping algorithm are encapsulated in an easy-to-use and understandable Perl language Application Programming Interface (API). This allows the SDW to be quickly augmented with additional sensors using minimal coding and testing. It also supports rapid generation of ad hoc reports and integration with other information systems.

Vernon, Lynn R.↗
DOE OSTI2023

Open Source Evaluation Framework for Solar Forecasting

The Solar Forecast Arbiter is an open-source evaluation framework for solar forecasting. The framework enables evaluations of solar irradiance, solar power, and net-load forecasts that are impartial, repeatable and auditable. The Solar Forecast Arbiter addresses stakeholder-informed use cases including evaluation of forecast skill, comparisons to reference data sets, private forecast trials, and evaluation of probabilistic forecast skill. The framework includes a data validation toolkit, reference data sources, data privacy protocols, and benchmark forecast capabilities for intra-hour and day ahead forecast horizons. Reports and metrics communicate the relative merits of the test and benchmark forecasts. The reports are created from standardized templates and include graphics for qualitatively evaluating deterministic and probabilistic forecasts and standard metrics for quantitatively evaluating forecasts. The Solar Forecast Arbiter is designed to support all solar forecasting stakeholders, including Solar Forecasting 2 Topic Area 2 and Topic Area 3 teams.

14 SOLAR ENERGY↗
DOE OSTI2026

Knowledge Graph for End-to-End Traceability of an Integrated Human-Earth System Model

Integrated human-Earth system models inform energy-water-land system dynamics and policies, yet their results are difficult to trace through input-data, model structure, scenario configurations, and solved outputs. Because this information is siloed across disconnected artifacts, process-based IAMs have historically lacked a unified, queryable representation. Such lack of traceability prevents researchers from systematically isolating the multi-sector drivers of complex outcomes (such as tracing water-scarcity results back to distant energy-system dynamics) or conducting holistic uncertainty attribution across hundreds of interacting parameters. To address this concern, our work documents the software engineering process of a knowledge graph that unifies these four layers for the Global Change Analysis Model (GCAM-USA_Reference scenario, GCAM v9.1). The graph was built as a relational property graph in DuckDB from the run’s own artifacts: the input-preparation dependency map (gcamdata chunk map), the model’s XML input files, the run configuration, and the results database (BaseX), successfully mapping the model’s declared structure. The resulting graph comprises 204,321 nodes and 1,687,814 edges across 16 node types and 15 edge types, with approximately 16.3 million time-series values stored separately to maintain structural efficiency. To ensure representation fidelity, every edge carries an epistemic-status annotation recording the warrant for the relationship (structural, provenance, dependency, or model-derived), and a machine-readable provenance ledger classifying the origin of every schema element. Evaluation against a fixed five-benchmark suite with locked baselines reports zero structural orphans, zero dangling edge endpoints, and 100% of output-producing technologies traceable to raw input files. Two interactive interfaces present the graph, including a serverless browser application built on DuckDB-Wasm. By establishing the first end-to-end provenance framework for an IAM, this work enables researchers and scientists to systematically audit complex policy scenarios, debug model structures, and trace policy-relevant outputs to their data origins in real time.

Artifical Intelligence↗
NASA NTRS2003

Performance and Accountability Report

The NASA Fiscal Year 2002 Performance and Accountability Report is presented. Over the past year, significant changes have been implemented to greatly improve NASA's management while continuing to break new ground in science and technology. Excellent progress has been made in implementing the President's Management Agenda. NASA is leading the government in its implementation of the five government-wide initiatives. NASA received an unqualified audit opinion on FY 2002 financial statements. The vast majority of performance goals have been achieved, furthering each area of NASA's mission. The contents include: 1) NASA Vision and Mission; 2) Management's Discussion and Analysis; 3) Performance; and 4) Financial.

Source record↗
DOE OSTI2021

Reducing Energy Use and Making Energy More Efficient in the Native Village of Kiana (Final Technical Report)

The goal of the Remote Alaska Community Energy Efficiency (RACEE) Competition was to advance the implementation of affordable, resilient, and clean energy-efficient solutions for remote Alaska communities. RACEE assisted Kiana with its unique challenges, mostly the remote nature of their location paired with the harsh temperatures and isolated electrical grid resulting in high energy costs. In addition to the assistance from DOE, the Alaska Energy Authority (AEA) provided direct technical assistance to RACEE recipients throughout their projects. Before Kiana started work, AEA conducted energy audits in public buildings and facilities to identify which energy measures would be most effective for the community’s energy goals.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
NASA NTRS1981

Report by the Aerospace Safety Advisory Panel

The process of preparation for the first two shuttle flights was observed and information from both flights was gathered in order to confirm the concept and performance of the major elements of the space transportation system. To achieve truly operational operating safety, regularity, and minimum practical cost, the organization of efforts between the R&D community and any transportation service organization should be clearly separated with the latter organization assuming responsibilities for marketing its services; planning and acquiring prime hardware and spares; maintainance; certification of procedures; training; and creation of requirements for future development. A technical audit of the application of redundancy concepts to shuttle systems is suggested. The state of the art of space transportation hardware suggests that a number of concept changes may improve reliability, costs, and operational safety. For the remaining R&D flights, it is suggested that a redline audit be made of limits that should not be exceeded for ready to launch.

Source record↗
NASA NTRS2007

Electrostatic Evaluation of the SRB Velostat(Trademark) Pads

During RSRM Grain inspection, pads constructed of Velostat are grounded and installed in the RSRM bore enabling inspectors to move throughout the bore during the inspection. Velostat pads are installed by grounding the first pad installed and subsequent pads are installed overlapping the previously installed pad maintaining a conductive path to facility ground. Pads are removed upon completion of the inspection in a reverse fashion. As the pads are removed scanning of propellant surfaces is performed per OMRS. During PPICI Audit of B5308.006 (Forward Segment Grain Inspection) in October 07 one audit finding noted that electrostatic scanning of propellant surfaces was being performed during removal of conductive pads following grain inspection. ATK does not perform electrostatic scanning of propellant surfaces during pad removal following final inspection at the plant. The integrated team consisting of NASA SE, USA SE, USA QE, ATK LSS, ATK Systems Safety and ATK DE concurred that electrostatic scanning of propellant surfaces was unnecessary as the conductive pads are grounded. Additional time spent in bore performing scanning presents itself as additional risk. Technicians reported that they have never seen any voltage readings while scanning propellant surfaces during pad removal. USA Systems engineering has written KB 17530 in response to the finding which will delete the requirement (item 2 B47GEN.ll0) to scan propellant surfaces during pad removal. As a result of an E3 panel discussion on December 13, 2007, it was decided that verification of the electrical grounding of the Velostat pads be verified.

Buhler, Charles R.↗
NASA NTRS2004

ISS Asset Tracking Using SAW RFID Technology

A team at the NASA Johnson Space Center (JSC) is undergoing final preparations to test Surface Acoustic Wave (SAW) Radio Frequency Identification (RFID) technology to track assets aboard the International Space Station (ISS). Currently, almost 10,000 U.S. items onboard the ISS are tracked within a database maintained by both the JSC ground teams and crew onboard the ISS. This barcode-based inventory management system has successfully tracked the location of 97% of the items onboard, but its accuracy is dependant on the crew to report hardware movements, taking valuable time away from science and other activities. With the addition of future modules, the volume of inventory to be tracked is expected to increase significantly. The first test of RFID technology on ISS, which will be conducted by the Expedition 16 crew later this year, will evaluate the ability of RFID technology to track consumable items. These consumables, which include office supplies and clothing, are regularly supplied to ISS and can be tagged on the ground. Automation will eliminate line-of-sight auditing requirements, directly saving crew time. This first step in automating an inventory tracking system will pave the way for future uses of RFID for inventory tracking in space. Not only are there immediate benefits for ISS applications, it is a crucial step to ensure efficient logistics support for future vehicles and exploration missions where resupplies are not readily available. Following a successful initial test, the team plans to execute additional tests for new technology, expanded operations concepts, and increased automation.

Schellhase, Amy↗
DOE OSTI2022

Industrial Assessment Center for Energy Efficiency, Smart Manufacturing and Cyber Security of Illinois and Northwestern Indiana Small and Medium Sized Manufacturing Companies and Water Facilities (Final Technical Report)

The University of Illinois Chicago (UIC) established and implemented a U.S. Department of Energy (DOE) sponsored Industrial Assessment Center (IAC) from September 1, 2016 through December 31, 2021. The established UIC IAC focused on providing 1) technical assistance to small and medium-sized enterprises (SMEs) and water and wastewater facilities in Illinois and northwestern Indiana and 2) education and training university students developing the future energy workforce. The technical assessments incorporated energy efficiency, increasing productivity via smart manufacturing, energy management systems, enhancing on-site cyber security practices, and the promotion of DOE best practices and tools. The educational training enabled UIC faculty and staff to provide classroom education, exposure to industry research, multiple targeted training sessions, real world experience with industry professionals, and live training to implement professional grade audits and recommendations.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2026

Feature Engineering and Ensemble Methods for Imbalanced ICS Intrusion Detection: Pipeline Audit and Constrained Evaluation

Industries are becoming increasingly connected and are more vulnerable to cyberattacks due to the widened attack surface. Industrial Control Systems (ICS) are among the most critical sectors that malicious actors can target, as such attacks can cause significant operational disruption and physical damage. It is imperative to detect such attacks as early as possible. This paper evaluates constraint-conditioned optimistic performance estimates for traditional ML models in ICS intrusion detection (i.e., estimates obtained under contiguous, non-shuffled temporal evaluation without test-set alteration, but with pre-split feature engineering that may introduce temporal leakage, due to dataset constraints). Our findings are threefold. First, we quantify how iterative feature engineering affects tree-based ensemble performance and examine how pipeline decisions (split strategy, sampling scope, and cleaning policy) can inflate or reduce reported IDS results under constraint-bound evaluation. Second, we compare intrinsic class-imbalance handling across ensemble models. Third, under our current pipeline constraints (including pre-split feature engineering), CatBoost achieves the best performance on Water Storage Tank (accuracy: 0.9831, class-1 F1: 0.9682), while Light- GBM achieves the best performance on Gas Pipeline (accuracy: 0.9618, class-1 F1: 0.9086).

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Thermal performance and energy consumption validation of an occupied local government office building outfitted with ceiling tile phase change materials

Buildings present an opportunity for energy conservation and the modulation of peak energy demand through controlled Heating, Ventilation, and Air Conditioning (HVAC) energy use. The administrative and office building stock in the United States holds potential to achieve energy and demand savings through retrofits such as insulation, weatherization, and thermal energy storage. Specifically, there is a need to validate passive phase change material (PCM) applications in full scale in aging administrative buildings in the US to evaluate the energy benefits. Aim of this study was to conduct a whole building level thermal and energy validation of an operational building and explore an alternative method for evaluating energy efficiency. To accomplish this, the study employed PCMs in the drop ceiling and carry out an energy audit and on-site measurement of HVAC systems' energy demand and consumption. A full-scale EnergyPlus energy model, modeled by the authors, served as a baseline for evaluation. The results show that calibrated model's envelope temperature measures fall within the accepted errors. HVAC energy simulation results also fall within the accepted errors for monthly and hourly pre- and post- PCM retrofit electricity and natural gas data. The novelty of this study is that it employees energy scales per Heating Degree Hour and Cooling Degree Hour, in contrast to the commonly used Heating Degree Days and Cooling Degree Days as reported in the literature to analyze energy savings. These findings underscore the pivotal role of a calibrated model in assessing the efficacy of a singular energy measure, like a PCM-retrofitted ceiling, in an occupied office building.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2026

NeuDiff Agent: a governed AI workflow for single-crystal neutron crystallography

Large-scale facilities increasingly face analysis and reporting latency as a limiting step in scientific throughput, particularly for structural studies that require iterative reduction, integration, refinement and validation. To improve the time to result and analysis efficiency, NeuDiff Agent is introduced as a governed, tool-using AI workflow for TOPAZ at the Spallation Neutron Source. NeuDiff Agent takes instrument data through reduction, integration, refinement and validation to a validated crystal structure and a publication-ready CIF. NeuDiff Agent coordinates established crystallographic tools under explicit governance by restricting actions to allowlisted tools, enforcing fail-closed verification gates at key workflow boundaries, and capturing complete provenance for inspection, auditing and controlled replay. The present benchmark is limited to structural crystallography for periodic structures; magnetic structure analysis and incommensurate or superspace refinement are outside the scope of the current workflow. Performance is assessed using a fixed prompt protocol and repeated end-to-end runs with two large language model backends, with user and machine time partitioned and intervention burden and recovery behaviors quantified under gating. In a reference-case benchmark, NeuDiff Agent reduces wall time from 435 min (manual) to 86.5 ± 4.7 to 94.4 ± 3.5 min (4.6–5.0× faster) while producing a validated CIF with no checkCIF level A or B alerts. These results establish a practical route to deploy agentic AI in facility crystallography while preserving traceability and publication-facing validation requirements.

Xiao, Zhongcan [ORNL] (ORCID:0000000220761961)↗