Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “independent evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Scale-Dependent Value of QPF for Real-Time Streamflow Forecasting

Incorporating rainfall forecasts into a real-time streamflow forecasting system extends the forecast lead time. Since quantitative precipitation forecasts (QPFs) are subject to substantial uncertainties, questions arise on the trade-off between the time horizon of the QPF and the accuracy of the streamflow forecasts. This study explores the problem systematically, exploring the uncertainties associated with QPFs and their hydrologic predictability. The focus is on scale dependence of the trade-off between the QPF time horizon, basin-scale, space-time scale of the QPF, and streamflow forecasting accuracy. To address this question, the study first performs a comprehensive independent evaluation of the QPFs at 140 U.S. Geological Survey (USGS) monitored basins with a wide range of spatial scales (~10 – 40,000 km 2 ) over the state of Iowa in the Midwestern United States. The study uses High-Resolution Rapid Refresh (HRRR) and Global Forecasting System (GFS) QPFs for short and medium-range forecasts, respectively. Using Multi-Radar Multi-Sensor (MRMS) quantitative precipitation estimate (QPE) as a reference, the results show that the rainfall-to-rainfall QPF errors are scale-dependent. The results from the hydrologic forecasting experiment show that both QPFs illustrate clear value for real-time streamflow forecasting at longer lead times in the short- to medium-range relative to the no-rain streamflow forecast. The value of QPFs for streamflow forecasting is particularly apparent for basin sizes below 1,000 km 2 . The space-time scale, or reference time t r ) (ratio of forecast lead time to basin travel time) ~ 1 depicts the largest streamflow forecasting skill with a systematic decrease in forecasting accuracy for t r > 1.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Application and Certification of Comparative Vacuum Monitoring Sensors for Structural Health Monitoring of 737 Wing Box Fittings

Multi-site fatigue damage, hidden cracks in hard-to-reach locations, disbonded joints, erosion, impact, and corrosion are among the major flaws encountered in today's extensive fleet of aging aircraft and space vehicles. The use of in-situ sensors for real-time health monitoring of aircraft structures are a viable option to overcome inspection impediments stemming from accessibility limitations, complex geometries, and the location and depth of hidden damage. Reliable, structural health monitoring systems can automatically process data, assess structural condition, and signal the need for human intervention. Prevention of unexpected flaw growth and structural failure can be improved if on-board health monitoring systems are used to continuously assess structural integrity. Such systems are able to detect incipient damage before catastrophic failures occurs. Condition-based maintenance practices could be substituted for the current time-based maintenance approach. Other advantages of on-board distributed sensor systems are that they can eliminate costly, and potentially damaging, disassembly, improve sensitivity by producing optimum placement of sensors and decrease maintenance costs by eliminating more time- consuming manual inspections. This report presents a Sandia Labs-aviation industry effort to move SHM into routine use for aircraft maintenance. This program addressed formal SHM technology validation and certification issues so that the full spectrum of concerns, including design, deployment, performance and certification were appropriately considered. The Airworthiness Assurance NDI Validation Center (AANC) at Sandia Labs, in conjunction with Boeing, Delta Air Lines, Structural Monitoring Systems Ltd., Anodyne Electronics Manufacturing Corp. and the Federal Aviation Administration (FAA) carried out a certification program to formally introduce Comparative Vacuum Monitoring (CVM) as a structural health monitoring solution to a specific aircraft wing box application. Validation tasks were designed to address the SHM equipment, the health monitoring task, the resolution required, the sensor interrogation procedures, the conditions under which the monitoring will occur, the potential inspector population, adoption of CVM into an airline maintenance program and the document revisions necessary to allow for routine use of CVM as an alternate means of performing periodic structural inspects. To carry out the validation process, knowledge of aircraft maintenance practices was coupled with an unbiased, independent evaluation. Sandia Labs designed, implemented, and analyzed the results from a focused and statistically-relevant experimental effort to quantify the reliability of the CVM system applied to the Boeing 737 Wing Box fitting application. All factors that affect SHM sensitivity were included in this program: flaw size, shape, orientation and location relative to the sensors, as well as operational and environmental variables. Statistical methods were applied to performance data to derive Probability of Detection (POD) values for CVM sensors in a manner that agrees with current nondestructive inspection (NDI) validation requirements and also is acceptable to both the aviation industry and regulatory bodies. This report presents the use of several different statistical methods, some of them adapted from NDI performance assessments and some proposed to address the unique nature of damage detection via SHM systems, and discusses how they can converge to produce a confident quantification of SHM performance An important element in developing SHM validation processes is a clear understanding of the regulatory measures needed to adopt SHM solutions along with the knowledge of the structural and maintenance characteristics that may impact the operational performance of an SHM system. This report describes the major elements of an SHM validation approach and differentiates the SHM elements from those found in NDI validation. The activities conducted in this program demonstrated the feasibility of routine SHM usage in general and CVM in particular for the application selected. They also helped establish an optimum OEM-airline-regulator process and determined how to safely adopt SHM solutions. This formal SHM validation will allow aircraft manufacturers and airlines to confidently make informed decisions about the proper utilization of CVM technology. It will also streamline the regulatory actions and formal certification measures needed to assure the safe application of SHM solutions.

42 ENGINEERING↗
DOE OSTI2020

Materials and Fuels Complex Operations Management Improvement Strategy

The Materials and Fuels Complex (MFC) has experienced substantial growth in terms of staff, research, and production in recent years. MFC operational performance has effectively kept pace with this growth. However, to capture the continuous improvement actions needed to improve effectiveness and increase the efficiency of our management systems, a broad operations management strategy is necessary. The MFC Operations Management Improvement (OMI) Strategy is complementary to the MFC Five-Year Mission and Investment Strategies and the MFC Management Plan. The OMI strategy is structured to address the management systems outlined in the Nuclear Facility Management Standard Operations Model. Each management system is evaluated independently in a chapter that describes the prior 5 years of performance improvement, a description of improvement actions for the MFC staff that directly perform within or contribute to the management system, process improvements, and any needed equipment improvements. Additional chapters are added to address subject areas not formally described in the standard operations model. The OMI strategy actions are structured to have cross cutting impacts for improvements pertaining to the entire directorate or a single division. All division improvement agendas are aligned to the OMI strategy.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2021

Independent Gamma Spectroscopy Analysis of a Plutonium Oxide Sample

Independent gamma spectroscopy data analysis of a plutonium oxide sample was requested on July 23, 2021. The primary request was to assess the Pu-239 activity/mass of the sample using previously collected gamma spectral data. Using the provided gamma spectral analysis report and spectral files, an independent evaluation of the data was conducted without any prior knowledge of the isotopic activity/mass of the sample.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2022

Materials and Fuels Complex Operations Management Improvement Strategy for FY2022

The Materials and Fuels Complex (MFC) has experienced substantial growth in terms of staff, research, and production in recent years. MFC operational performance has effectively kept pace with this growth. However, to capture the continuous improvement actions needed to improve effectiveness and increase the efficiency of our management systems, a broad operations management strategy is necessary. The MFC Operations Management Improvement (OMI) Strategy is complementary to the MFC Five-Year Mission and Investment Strategies and the MFC Management Plan. The OMI strategy is structured to address the management systems outlined in the Nuclear Facility Management Standard Operations Model. Selected management systems are evaluated independently in chapters that describe the prior 5 years of performance improvement, a description of improvement actions for the MFC staff that directly perform within or contribute to the management system, process improvements, and any needed equipment improvements. Chapter selection is based on a management system’s need for improvement. In some cases, management systems may be combined in a single chapter. Additional chapters are added to address subject areas not formally described in the standard operations model.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

Materials and Fuels Complex Operations Management Improvement Strategy for Fiscal Year 2023

The Materials and Fuels Complex (MFC) has experienced substantial growth in terms of staff, research, and production in recent years. MFC operational performance has effectively kept pace with this growth. However, to capture the continuous improvement actions needed to improve effectiveness and increase the efficiency of our management systems, a broad operations management strategy is necessary. The MFC Operations Management Improvement (OMI) Strategy is complementary to the MFC Five-Year Mission and Investment Strategies and the MFC Management Plan. The OMI strategy is structured to address the management systems outlined in the Nuclear Facility Management Standard Operations Model. Selected management systems are evaluated independently in chapters that describe the prior 5 years of performance improvement, a description of improvement actions for the MFC staff that directly perform within or contribute to the management system, process improvements, and any needed equipment improvements. Chapter selection is based on a management system’s need for improvement. In some cases, management systems may be combined in a single chapter. Additional chapters are added to address subject areas not formally described in the standard operations model.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2021

Extending a land-surface model with <i>Sphagnum</i> moss to simulate responses of a northern temperate bog to whole ecosystem warming and elevated CO<sub>2</sub>

Abstract. Mosses need to be incorporated into Earth system models to better simulate peatland functional dynamics under the changing environment. Sphagnum mosses are strong determinants of nutrient, carbon, and water cycling in peatland ecosystems. However, most land-surface models do not include Sphagnum or other mosses as represented plant functional types (PFTs), thereby limiting predictive assessment of peatland responses to environmental change. In this study, we introduce a moss PFT into the land model component (ELM) of the Energy Exascale Earth System Model (E3SM) by developing water content dynamics and nonvascular photosynthetic processes for moss. The model was parameterized and independently evaluated against observations from an ombrotrophic forested bog as part of the Spruce and Peatland Responses Under Changing Environments (SPRUCE) project. The inclusion of a Sphagnum PFT with some Sphagnum-specific processes in ELM allows it to capture the observed seasonal dynamics of Sphagnum gross primary production (GPP) albeit with an underestimate of peak GPP. The model simulated a reasonable annual net primary production (NPP) for moss but with less interannual variation than observed, and it reproduced aboveground biomass for tree PFTs and stem biomass for shrubs. Different species showed highly variable warming responses under both ambient and elevated atmospheric CO2 concentrations, and elevated CO2 altered the warming response direction for the peatland ecosystem. Microtopography is critical: Sphagnum mosses on hummocks and hollows were simulated to show opposite warming responses (NPP decreasing with warming on hummocks but increasing in hollows), and hummock Sphagnum was modeled to have a strong dependence on water table height. The inclusion of this new moss PFT in global ELM simulations may provide a useful foundation for the investigation of northern peatland carbon exchange, enhancing the predictive capacity of carbon dynamics across the regional and global scales.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Validating Protection System Behavior with Machine Learning in a Master State Overseer

As power system protection devices continue the widespread transition from analog to digital, they become increasingly intricate. The internal functions and communication between critical grid components must now be significantly more complex to keep up with the demands of the modern smart grid. This brings increased difficulty in maintenance and monitoring, making it harder to identify potential misoperation, power anomalies, and cyber threats. Such issues are often only pinpointed after an exhaustive and costly post-mortem analysis, when a major outage or damage has already occurred. A solution is needed for validating protection systems as they operate, independently evaluating grid state and confirming whether the protection system is behaving accordingly. As opposed to incident response, this acts as a constant verification mechanism that raises a flag when subtler issues are noticed, catching them earlier and preventing larger incidents. This work presents the implementation of such a system, expanding on the prototype developed by the authors in a previous paper. This is accomplished with a machine learning (ML) system capable of validating the performance of protection systems by classifying anomalous events and characterizing protection system responses based solely on available current and voltage measurements. Additionally, this system is contextualized within a larger, modular Master State awareness Overseer (MSO) framework, responsible for monitoring, analyzing, and managing an electric grid.

24 - POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Fission Product Yield Modeling and Evaluation

Although independent and cumulative fission product yields have been a part of evaluated libraries for decades, there have been few updates over the years. The fission product yield sub-library in the ENDF/B-VIII.0 library is still largely based on the evaluation of England and Rider from the mid-90’s, with only more recent updates to the energy dependence of 239 Pu below 2 MeV and fixes to isomeric states and missing fission products. Over the past several years, there have been a wealth of new measurements of independent and cumulative fission product yields, particularly those with short half-lives, and there have been significant improvements in the modeling of prompt and delayed fission observables. Here, we describe recent progress in the improvement of fission product yield calculations, using the BeoH code and the underlying Hauser Fesh-bach Fission Fragment Decay (HF 3 D) model, developed at Los Alamos National Laboratory. We will describe our recent calculations for consistent prompt and delayed fission observables for major and minor actinides, including new work investigating isomeric ratios. We will detail the ongoing evaluation process for energy-dependent fission product yields from thermal up to 20 MeV incident neutron energy and some validation work that has been performed for these new fission product yield calculations. Additionally, we will discuss future perspectives of this work, highlighting the need for additional data.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
DOE OSTI2021

Stochastically estimated covariance matrices for independent and cumulative fission yields in the ENDF/B-VIII.0 and JEFF-3.3 evaluations

A Monte-Carlo method for the generation of correlation and covariance matrices for independent and cumulative fission yields has been developed. The method uses a constrained Monte-Carlo resampling structure in order to vary evaluated fission yield libraries in a way that meets basic conservation principles. This results in the generation of correlation/covariance matrices with limited model bias and uncertainty; the matrices are primarily reflective of the evaluated fission yield uncertainties and correlations that arise from the evaluation process. This method has been applied to generate correlation and covariance matrices for all of the fissioning systems of the ENDF/B-VIII.0 and JEFF-3.3 evaluations, marking the first time such matrices have been generated for all of these systems. These covariance matrices have been published online for immediate public use. These correlation and covariance matrices can be used to improve uncertainty estimation in calculations of reactor antineutrino emission rates, decay heat problems, and nuclear forensics.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Energy dependence of prompt fissions neutron multiplicity in the 239 Pu(n, ƒ) reaction

Accurate multiplicities of prompt fission neutrons emitted in neutron-induced fission on a large energy range are essential for fundamental and applied nuclear physics. Measuring them to high precision for radioactive fissioning nuclides remains, however, an experimental challenge. In this work, the average prompt-neutron multiplicity emitted in the 239 Pu(n, ƒ) reaction was extracted as a function of the incident-neutron energy, over the range 1-700 MeV, with a novel technique, which allowed to minimize and correct for the main sources of bias and thus achieve unprecedented precision. At low energies, our data validate for the first time the ENDF/B-VIII.0 nuclear data evaluation with an independent measurement and reduce the evaluated uncertainty by up to 60%. This work opens up the possibility of precisely measuring prompt fission neutron multiplicities on highly radioactive nuclei relevant for an essential component of energy production world-wide.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

Total-Ionizing-Dose Effects on Long-term Data Retention Characteristics of Commercial 3-D NAND Memories

This article evaluates the data retention characteristics of irradiated multi-level cell (MLC) 3-D NAND flash memories. We irradiate the memory chips by a Co-60 gamma-ray source for up to 50 krad(Si) and then write a random data pattern on the irradiated chip to find its retention characteristics. The experimental results show that the data retention property of the irradiated chips is significantly degraded compared to the un-irradiated ones. We evaluate two independent strategies to improve the data retention characteristics of the irradiated chips. Furthermore, the first method involves high-temperature annealing of the irradiated chip while the second method suggests pre-programming the memory modules before deploying them in radiation-prone environments.

3-D NAND flash↗
DOE OSTI2023

Shading contributes to Sphagnum decline in response to warming

Experimental warming of an ombrotrophic bog in northern Minnesota has caused a rapid decline in the productivity and areal cover of Sphagnum mosses, affecting whole-ecosystem carbon balance and biogeochemistry. Direct effects of elevated temperature and the attendant drying are most likely the primary cause of the effects on Sphagnum, but there may also be responses to the increased shading from shrubs, which increased with increasing temperature. To evaluate the independent effects of reduction in light availability and deposition of shrub litter on Sphagnum productivity, small plots with shrubs removed were laid out adjacent to the warming experiment on hummocks and hollows in three blocks and with five levels of shading. Four plots were covered with neutral density shade cloth to simulate shading from shrubs of 30%–90% reduction in light; one plot was left open. Growth of Sphagnum angustifolium/fallax and S. divinum declined linearly with increasing shade in hollows, but there was no response to shade on hummocks, where higher irradiance in the open plots may have been inhibitory. Shading caused etiolation of Sphagnum—they were thin and spindly under the deepest shade. A dense mat of shrub litter, corresponding to the amount of shrub litter produced in response to warming, did not inhibit Sphagnum growth or cause increases in potentially toxic base cations. CO 2 exchange and chlorophyll-a fluorescence of S. angustifolium/fallax from the 30% and 90% shade cloth plots were measured in the laboratory. Light response curves indicate that maximal light saturated photosynthesis was 42% greater for S. angustifolium/fallax grown under 30% shade cloth relative to plants grown under 90% shade cloth. The response of Sphagnum growth in response to increasing shade is consistent with the hypothesis that increased shade resulting from shrub expansion in response to experimental warming contributed to reduced Sphagnum growth.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Electroslag additive manufacturing: A pathway for high throughput near net shape production

Electroslag Additive Manufacturing (ESAM), a new high-throughput additive manufacturing (AM) method that combines Electroslag Strip Cladding (ESC) and wire arc AM (WAAM) is introduced. This combination enables the high deposition rate of ESC (more than 20 kg/h with a 60 mm strip electrode) to benefit from the precise geometric control of WAAM. As a precursor to ESAM, the ESC process is investigated in an AM context independently by evaluating both direct and staggered bead-stacking strategies and analyzing the microstructural and mechanical properties of each. This is followed by an ESAM demonstration producing an annular geometry by pairing ESC with gas tungsten arc welding (GTAW), wherein GTAW is utilized to construct annular walls that are subsequently infilled via ESC. The microstructure and mechanical properties of ESC-only AM are compared with that of the ESAM method and it is shown that printed integral retaining walls do not impact the resulting mechanical properties of ESAM. Furthermore, results indicate that ESAM-produced Alloy 625 parts exhibit tensile properties on par with cast counterparts, supporting the method’s scalability to components exceeding one metric ton, and possibly making ESAM a viable future manufacturing approach for competitive production of large-scale components currently manufactured by casting and forging.

Additive manufacturing↗
DOE OSTI2025

Nernst power factor and figure of merit in the compensated semimetal ScSb

Recently, topological semimetals have emerged as strong candidates for solid-state thermomagnetic refrigerators due to their enhanced Nernst effect. This enhancement arises from the combined contributions of the Berry-curvature-induced anomalous Nernst coefficient associated with topological bands and the normal Nernst effect resulting from synergistic electron-hole compensation. Generally, these two effects are intertwined in topological semimetals, making it challenging to evaluate them independently. Here, we report the observation of a high Nernst effect in the electron-hole compensated semimetal ScSb with topologically trivial electronic band structures. Remarkably, we find a high maximum Nernst power factor of 𝑃⁢𝐹 𝑁 ∼ 35 × 10 −4 W m −1 K −2 in ScSb. The Nernst thermopower (𝑆 𝑥⁢𝑦 ) exhibits a peak of ∼ 47 µ⁢V/K at 12 K and 14 T, yielding a Nernst figure of merit (𝑧 𝑁 ) of ∼ 28 × 10 −4 K −1 . Notably, despite its trivial electronic band structure, both the 𝑃⁢𝐹 𝑁 and 𝑧 𝑁 values of ScSb are comparable to those observed in topological semimetals with Dirac band dispersions. In conclusion, the origin of the large Nernst signal in ScSb is explained by compensated electron and hole carriers, through Hall resistivity measurements, angle-resolved photoemission spectroscopy, and density functional theory calculations.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2020

A Mathematical Framework for Representing Cyber-Physical System Interdependencies and Resilience

U.S. critical infrastructure is increasingly composed of integrated cyber-physical systems (CPS) whose components are operationally interdependent. These interdependencies can create additional vulnerabilities beyond those that are typically evaluated through independent physical and cyber risk assessments. These additional vulnerabilities, previously undetected at the sub-system and/or component level, could cause cascading effects across both the physical and cyber domains that could lead to infrastructure disruption or failure. This paper will review an initial mathematical framework developed to help understand the dynamics of these interfacing physical and cyber components at a holistic system level. The resulting framework also provides a method for modeling and assessing the resilience of CPS in complex and adaptive systems. It frames the system in terms of mission performance and the potential effects to performance caused by attacks that are cyber, physical, or blended in nature. The framework utilizes a systems-based, state-space modeling approach to reason about risk, resilience, and interdependencies in CPS. Probabilities are applied to each CPS component regarding a threat (both man-made and natural) and the likelihood of that particular component being impacted, along with indirect impact to other interdependent components. These component-level impacts from threats then translate into mission-level impact and systemic state change.

Brigantic, Robert T.↗
DOE OSTI2026

Quantifying Operational Drivers of Multimodal Biometric Verification in Aerial Surveillance

Multimodal biometric verification is increasingly applied across operational contexts ranging from close-range security cameras and building-mounted surveillance to long-range ground sensors and unmanned aerial system (UAS) imagery. Variations in acquisition conditions—such as image resolution, viewing geometry, and motion artifacts—pose significant challenges for cross-domain algorithmic generalization. This study evaluates two independent multimodal biometric verification systems developed under the Intelligence Advanced Research Projects Activity (IARPA) Biometric Recognition and Identification at Altitude and Range (BRIAR) program, comparing performance on close-range and aerial datasets. Close-range video served as a baseline to quantify the decline in verification performance on aerial footage. The dataset included six UAS platforms, spanning small quadcopters at 10m altitude to medium-sized fixed-wing aircraft at 360m. Mixed-effects logistic regression identified image resolution (head and body pixel counts), head height, sensor characteristics, and algorithm selection as primary determinants of verification success, whereas demographic attributes and mission gait were not significant predictors. Activity type and collection site influenced performance in close-range data but had negligible impact on UAS imagery. These results clarify modality-specific strengths and limitations and highlight opportunities to enhance cross-domain biometric verification.

Peluso, Alina [ORNL] (ORCID:0000000328950406)↗