Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “SCORE”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28

Machine Learning-Based Identification of the Interface Regions for Coupling Local and Nonlocal Models

Local-nonlocal coupling approaches provide a means to combine the computational efficiency of local models and the accuracy of nonlocal models. However, the coupling process can be challenging, requiring expertise to identify the interface between local and nonlocal regions. Here, this study introduces a machine learning-based approach to automatically detect the regions in which the local and nonlocal models should be used. The method uses loading functions evaluated at grid points to decide the model selection at those points. Training of the networks is based on datasets provided by classes of loading functions for which reference coupling configurations are computed using accurate coupled solutions, where accuracy is measured in terms of the relative error between the solution to the coupling approach and the solution to the nonlocal model. We study two approaches that vary in data structure. The first, the full-domain input data approach, uses the entire load vector and outputs a complete label vector, performing a global classification. The second, a window-based approach, processes loads into windows and addresses the problem as a node-wise classification where each window's central point is classified individually. The classification problems are solved via deep learning algorithms based on convolutional neural networks. The performance of these approaches is studied on one-dimensional numerical examples using F1-scores and accuracy metrics. Notably, the windowing approach achieves an accuracy of 0.96 and an F1-score of 0.97, highlighting its potential to automate coupling processes effectively and enhance computational efficiency in material science applications.

97 MATHEMATICS AND COMPUTING↗

Making Phase-Picking Neural Networks More Consistent and Interpretable

Improving the interpretability of phase-picking neural networks remains an important task to facilitate their deployment to routine, real-time seismic monitoring. The popular phase-picking neural networks published in the literature lack interpretability because their output prediction scores do not necessarily correspond with the reliability of phase picks and can even be highly inconsistent depending on how we window the waveform data. Here, we show that systematically shifting the waveforms during training and using an antialiasing filter within the neural network architecture can substantially improve the consistency of the output prediction scores and can even make them scale with the signal-to-noise ratios of the waveforms. We demonstrate the improvements by applying these approaches to a commonly used phase-picking neural network architecture and using waveform data from the 2019 Ridgecrest earthquake sequence.

58 GEOSCIENCES↗

PRIMO - The P&A Project Optimizer

In support of the Methane Emissions Reduction Program (MERP) and under the National Methane Emissions Reduction Initiative (NEMRI), the National Energy Technology Laboratory (NETL) and NETL site support contractors are developing and releasing an open-source decision-support tool (“PRIMO”) to help organizations determine which marginal conventional wells (MCWs) or other low-producing wells make the best candidates for plugging utilizing MERP funds, while also optimizing subsequent plugging and abandonment (P&A) campaigns for both program impact and efficiency. The framework—which is fully customizable—provides three main capabilities: 1. Ranking candidate wells (based on user preferences) 2. Identifying high-impact, high-efficiency P&A project candidates (with transparently computed scores for relevant metrics) 3. Comparing competing P&A projects quantitatively (through transparently computed project impact and efficiency scores) As such, PRIMO is a versatile, fully customizable tool that is meant to support organizations in making data-based, transparent, and defensible well selection and P&A project design decisions. For questions, comments or feedback, please contact primo@netl.doe.gov.

MERP↗

Deep Set Auto Encoders for Anomaly Detection in Particle Physics

There is an increased interest in model agnostic search strategies for physics beyond the standard model at the Large Hadron Collider. We introduce a Deep Set Variational Autoencoder and present results on the Dark Machines Anomaly Score Challenge. We find that the method attains the best anomaly detection ability when there is no decoding step for the network, and the anomaly score is based solely on the representation within the encoded latent space. This method was one of the top-performing models in the Dark Machines Challenge, both for the open data sets as well as the blinded data sets.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Powering the Blue Economy - Ocean Observing Use Cases Report

The "Powering the Blue Economy" (PBE) Report identified ocean observing and autonomous underwater vehicle (AUV) recharge as near-term markets with significant potential for marine energy integration when specified qualitative and quantitative assessment criteria were used. The ocean observing market (including AUVs) scored high relative to other markets analyzed in the PBE Report with respect to market size, marine renewable energy (MRE) compatibility with functional requirements, competitive positioning (i.e., MRE versus other power sources), path to market, and alignment to the Department of Energy Water Power Technologies Office (WPTO) and other agencies' objectives. Based on this scoring, Pacific Northwest National Laboratory (PNNL) and the National Renewable Energy Laboratory (NREL) pursued the development of five use cases that represent a spectrum of ocean observation platforms, fixed and mobile, to explore the present and future power needs that might be satisfied by marine energy. The use cases were described and analyzed for this potential by examining current missions and future needs, evaluating the mix of renewable energy sources that might satisfy those needs at sea, and understanding the overall cost drivers that might enable this application.

14 SOLAR ENERGY↗

Random Forest Optimization for Radionuclide Identification

Radionuclide identification through gamma-ray spectroscopy is an indispensable tool in combatting the illicit smuggling of nuclear material. The radionuclide identification devices used in the field need to provide ready-made answers to non-experts, and therefore require sophisticated algorithms that can interpret the underlying data. We investigated the Random Forest classifier as a tool for identifying the radionuclide that is consistent with the data. We were provided with training and validations data sets and used them to optimize the two hyperparameters of the classifiers: maximum features required, and minimum samples used to split each node. The F1 score, a harmonic mean of precision and recall, was used to evaluate the performance of each built classifier. We found the optimal performance with minimum samples of 5 and maximum features of 50, with the F1 score of 0.95.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Optimizing Classifiers for Radionuclide Identification

Identifying threat nuclear materials is a critical for the prevention of acts of nuclear terrorism on the homeland. For this purpose, many radionuclide identification devices are deployed in the field. However, these will not necessarily be in the hands of non-experts, therefore these devices need to provide ready-made answers for the personnel in the field. This is where advanced algorithms are employed to both interpret the data and provide the identification of the nuclear material being interrogated. We took a machine learning approach to identification, by using training and validation data sets to create and optimize classifiers which determine which radionuclide is consistent with the data. The classifiers investigated were the Random Forest, Decision Tree, Support Vector Machine, and XG Boost and their performance was judged using the F1 Score for both hyperparameter tuning and comparison. In the end, we found out that the Random Forest Classifier worked the best based off the F1 Score they got which was 0.98.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Internet Access Index: Measuring the availability and household adoption of high-speed internet

Access to broadband or high-speed internet has taken on increased importance during the COVID-19 pandemic as many workplaces and schools shifted to a virtual environment. The Internet Access Index (IAI) was developed to better understand the challenges many households face in connecting to high-speed internet, whether due to lack of broadband availability from internet service providers or difficulties in subscribing to a broadband service. The IAI is calculated as the product of 3 factors. The first two factors gauge the quality and availability of high-speed internet and the third factor represents the public’s ability to subscribe to high-speed internet services. The IAI scores United States’ census tracts on a [0,1] scale, where values near 0 represent areas with less internet access and values approaching 1 represent more internet access. The maximum score (1.0) implies that all census blocks within a census tract have high speed internet available at the highest national speed (currently 1000 mbps), and that all households within the tract have a fixed broadband subscription of some type.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Feedstock-Conversion Interface Consortium: Failure Mode and Effects Analysis Summary Report (FY2022)

This report provides an overview of the development of failure modes and effects analysis (FMEA) and its implementation as a systematic criticality and risk assessment tool supporting a quality by design (QbD) approach for FCIC research. This report also provides a high-level overview of the results for the FMEA evaluation of two feedstock preprocessing system configurations: (1) generation of pine residue materials for high-temperature pyrolysis conversion and (2) generation of corn stover materials for low-temperature conversion using deacetylation and disc mechanical refining pretreatment for fermentation to hydrocarbons. For the results presented in this report, our FMEA interviews included two approaches. The first approach was to perform FMEA interviews for the entire system of unit operations giving a wholistic system level view. The second approach consisted of detailed interviews for each individual unit operation within the system allowing for a “deep dive” into the specific failures for the individual components within the configuration. These two approaches provide different resolutions of information. The FMEA results of this report were focused on failures associated with meeting critical quality attributes (CQAs) identified for the target conversion processes for each processed feedstock type. The information gathered through the FMEA interviews include estimations of risk scores for meeting each given CQA specification, identification of the impacts for not meeting a CQA specification, capturing causes associated with material attributes and process parameters for each failure, identification of current detection methods, and speculation of potential mitigation strategies for decreasing a failure’s risk score. The complete results of all FMEA interviews are provided in the Appendices of this report.

09 BIOMASS FUELS↗

Downselection and Basic Properties of Additively Manufactured ODS Alloys

In the AMMT program the work package for development of new materials aimed to explore the advanced manufacturing techniques that are feasible for the manufacturing of advanced materials components. A merit-based feasibility study was attempted to identify an accelerated development path for dispersion strengthened (ODS) alloys by creatively combining additive manufacturing (AM) technologies with the recent advances in ODS materials and traditional manufacturing technologies. For the fiscal year, the primary tasks were focused to develop additive manufacturing (AM) and post-build processing route for oxide dispersion strengthened (ODS) ferritic (Fe-Cr alloy or 14YWT) and austenitic (Fe-Cr-Ni alloys or 316L and 316H) alloys and to perform basic microstructural and mechanical characterizations to provide feedbacks to the alloy and processing design. Further, the multi-laboratory effort created collaboratively a decision criteria matrix to evaluate and downselect the new materials processed by advanced manufacturing methods. This report is to describe the ODS alloy processing routes combining AM processes and post-build thermomechanical treatments, mechanical and microstructural characteristics of the newly developed materials, and the application results of the decision criteria matrix for the AM ODS alloys including a downselected material and feasible processing route. Key mechanical test results including tensile strength, tensile ductility, and fracture toughness data and are reported and explained. Higher strength was measured from the ferritic ODS alloys, while higher ductility and fracture toughness were measured from the austenitic ODS alloys. Many of the decision criteria were scored the same for the AM ferritic and austenitic ODS alloys, however, the generally known fact that the austenitic alloys have higher corrosion resistance and significantly better ductility. Although these scores are not significantly different to make them highly discernable, the austenitic ODS alloys were downselected to be the primary materials group in the future research on ODS materials in AMMT program.

36 MATERIALS SCIENCE↗

Robotics Plan in Support of DOME Testbed Operations

Various robotic tooling options have been evaluated for the NRIC DOME concept of operations (ConOps). Framatome was contracted to develop a wide-ranging list of commercial off the shelf (COTS) and custom robotic systems to be considered for performing the DOME ConOps functions. Subsequent project tasks from Framatome narrowed down the list and scored the most viable options. The abbreviated list, and associated scoring, has been reviewed and assessed to provide formal recommendations for the robotic ConOps functions of DOME. The overhead telescoping mast & Kraft arm assembly is recommended as the primary system for reactor demobilization and removal. The estimated cost is $\$700$K with a timeline to develop and deliver of about 2.5 years. The mast & Kraft arm would still require an overhead lift system for mobilization and installation. Either the refurbished polar crane or a new gantry crane delivery platform could both serve as the overhead lift and delivery system. The estimated costs for the refurbishment polar crane and new gantry crane systems are, respectively, $\$4.4$M and $\$3$M with about 2.5 years to develop and deliver. A Brokk + Kraft crawler & arm is recommended as a secondary robotic system to support the overhead mast & Kraft arm system. The Brokk + Kraft crawler & arm would cost an estimated $\$726$k and would take about 1.5 years to develop and deliver. The Boston Dynamics SPOT robot is also recommended for the in-service monitoring during experimentation operations. The estimated cost is $\$220$K with a timeline to deliver of 8-14 months. The Elios 3 aerial drone is recommended to perform large area radiation dose rate mapping and visual inspections. The estimated cost is a $\$100$K and will also need about 8-14 months to develop and deliver. A mockup rig is also recommended to be procured an employed to test & verify the robotic capabilities as well as provide needed training for operations personnel. It is estimated that a mockup rig would cost about $\$500$k and would take up to a year to develop and build.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

2022 Climate Change Vulnerability Assessment and Resilience Plan Summary

Los Alamos National Laboratory (LANL, or the Laboratory) produced a Vulnerability Assessment and Resilience Plan (VARP) following Department of Energy (DOE) Guidance to assess and manage climate change related risks to the Laboratory’s assets and operations. This is a condensed summary of the Laboratory’s 2022 VARP – the full version of the document is not publicly available at this time. The VARP was led by the Pollution Prevention (P2) Program in the Environmental Protection and Compliance Division (EPC-DO) and covers the entirety of the 36-square-mile LANL site in Los Alamos, New Mexico. A Steering Committee, composed of representatives from the three main Laboratory Directorates and the Los Alamos Field Office, identified real property Critical Assets based on their Mission Dependency Index (MDI) scores. LANL used MDI scores of 70 and above, which are considered Mission-Critical, to generate a list of 141 Critical Asset facilities.

54 ENVIRONMENTAL SCIENCES↗

Applications of fuzzy logic and best-worst method for tritium sensor selection

Accurate assessment of tritium as a fuel source is critical in fusion reactions, necessitating effective sensor evaluation methods. This study investigates a multi-criteria decision-making framework for selecting tritium sensors, integrating fuzzy logic to enhance decision quality. Initial attempts at applying fuzzy logic were found to be too elementary and failed to capture the complexity of multi-criteria selection; this prompted a refined approach that incorporated expert insights and advanced ranking techniques for sensor evaluation. The research used a two-stage methodology. In the first stage, important criteria and sub-criteria for sensor performance were identified and defined. These criteria were then weighted and scored using a fuzzy best-worst method, drawing upon expert opinions to ensure relevance and validity. The second stage involved interpreting information about varying sensors to rank them based on their overall criteria scores, encouraging the selection of the most suitable options. The result of the study is a proposed method for effective sensor selection in fusion reactors, which in turn will significantly improve the reliability of tritium monitoring in fusion applications.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Augmented Human Analysis (AHA)

Radio frequency (RF) signal monitoring generally emphasizes intentionally generated signals, such as WiFi, Bluetooth, or cellular transmissions. However, electronic devices also produce unintended radiated emissions (UREs), which could also be useful in RF spectrum analysis. In either case, deriving intelligence from RF signals is typically a human-intensive process requiring significant domain knowledge. In the Augmented Human Analysis (AHA) project, we investigate the utility of dimensionally aligned signal projection (DASP) and machine learning (ML) algorithms for accelerating RF analysis workflows. We find that while DASP algorithms can indeed highlight signal characteristics relevant for classification tasks, the choice of algorithmic hyperparameters greatly affects performance. To address this challenge, we evaluate the quality of DASP outputs using the silhouette score, which measures how well data points cluster; high silhouette scores indicate good clustering, and thus good hyperparameter values. This approach is critical for machine learning pipelines as the DASP parameters cannot be directly optimized during model training. By identifying good DASP parameters, and thus good DASP outputs, as a preprocessing step, we can decrease the amount of effort required for downstream ML model training. We demonstrate our workflow using a dataset of UREs from common household devices, showing that even without the aid of ML, proper selection of DASP parameters enables clustering by device type.

42 ENGINEERING↗

Evaluating large scale aqueous organic redox flow battery performance with a hybrid numerical and machine learning framework

Aqueous organic redox flow battery (AORFB) is a promising cost-competitive technology for large-scale energy storage. Among existing work, the dihydroxyphenazine (DHP)-based AORFB has demonstrated high energy density and low-capacity degradation in 10 cm$^2$ cells during lab tests. However, its commercial-scale performance in more complex environments remains unknown, posing a barrier to commercialization. To address this gap, this work presents a comprehensive performance evaluation of a 780 cm$^2$ DHP-based AORFB by combining a physics-based numerical model, machine learning (ML)-based surrogate models, and ML-derived sensitivity quantification. Specifically, we first select 12 key battery parameters that include 10 physicochemical and 2 operation quantities, then select 6 performance metrics that include energy efficiency (EE), discharging capacity, charging energy, and power losses due to concentration, activation, and ohmic over-potentials. With such selection, 12800 combinations of the 12 parameters are subsequently generated using the Latin Hypercube Sampling method. Such combinations, together with 38 pre-defined State of Charge, are then integrated to a validated AORFB model developed in COMSOL to compute the performance metrics. With both input parameters and performance metrics, 60 deep neural network (DNN) surrogate models are then trained to approximate the relationship between the 10 physicochemical quantities and 6 performance metrics at each flow rate and current density. Sensitivity scores are then calculated based on the DNN models. Two additional sensitivity analysis tools, i.e., MARS, and SHAP, are also used to cross-validate the sensitivity scores from the DNN. The results demonstrate that 1) the standard potential ranks first in controlling EE and charging energy, 2) the membrane conductivity is most critical for power loss and EE, and 3) specific area and reaction rate control activation power loss.

25 ENERGY STORAGE↗

Materials Scorecards, Phase 1: Advanced Materials and Manufacturing Technology

This report presents preliminary material score cards (Phase 1) based on a survey of industry experts and the limited literature available on the state of advanced manufacturing of materials for nuclear applications. Seven reactor types were considered, and the data is presented in tabular form. The caveat is that the scores are based on limited data and expert judgement. Considerable work remains to be done to prioritize materials for advanced manufacturing to support existing and advanced reactors. A central database of processing conditions, resulting microstructure, post processing, properties, and performance of these materials is needed to support the accelerated adoption of advanced manufacturing by the industry.

36 MATERIALS SCIENCE↗

Economic Evaluation of Modernization Expenditures for Electric Utility Distribution Systems: A Guide for Utility Regulators

Cost-effectiveness evaluation of potential grid modernization solutions is integral to integrated distribution system planning (IDSP). This report synthesizes and updates prior cost-effectiveness approaches identified by the U.S. Department of Energy for grid modernization investments, incorporating multi-objective decision-making. The structure of the report follows the IDSP process, from identifying objectives and priorities to prioritizing grid solutions. The report details two methods for conducting initial cost-effectiveness screening of individual and interdependent grid components: (1) Lowest Reasonable Cost and (2) Benefit-Cost Analysis. Drawing on solutions that passed the initial cost-effectiveness screen, the utility prioritizes grid solutions based on policy objectives and priorities, regulatory compliance, operational efficiencies, and other factors to develop a portfolio of distribution solutions. The utility uses multi-objective decision-making to assess each proposed expenditure against each objective and respective metric. The utility applies a weighting factor, reflecting the priority ranking of the objective, to the total numerical “score” based on the contribution of the proposed solution to addressing each objective. Ultimately, the utility ranks each expenditure from highest to lowest priority using the final score for each solution as well as its cost. The report includes examples of emerging best practices for states and utilities and a cost-effectiveness process checklist.

24 POWER TRANSMISSION AND DISTRIBUTION↗

wa-hls4ml and lui-gnn: A benchmark and GNN-based surrogate model for hls4ml resource and latency estimation

As machine learning (ML) increasingly serves as a tool for addressing real-time challenges in scientific applications, the development of advanced tooling has significantly reduced the time required to iterate on various designs. These advancements have solved major obstacles, but also exposed new challenges. For example, processes that were not previously considered bottlenecks, such as model synthesis, are now becoming limiting factors in the rapid iteration of designs. To reduce these emerging constraints, multiple efforts are being launched toward designing an ML-based surrogate model that estimates resource usage of synthesized accelerator architectures. This model would reduce the design iteration time, especially when designing within a set of given hardware constraints. This approach shows considerable potential, but as it stands, the effort is early and would benefit from coordination and standardization to assist future work as it emerges. We introduce wa-hls4ml, a benchmark for ML accelerator resource and latency estimation, and its corresponding initial dataset of more than 100,000 fully connected neural networks, all synthesized using hls4ml and targeting Xilinx FPGAs. In addition to the resource utilization and latency data provided, the dataset includes generated artifacts and log files for many of the synthesized neural networks, in order to support future research in ML-based code generation. The benchmark evaluates the performance of resource and latency predictors against several common ML model architectures, primarily originating from scientific domains, as exemplar models, as well as the average performance across a subset of the dataset. We measure the performance of a given predictor model through multiple metrics, including $R^2$ score and SMAPE on regression tasks, as well as inference time to further characterize the estimator under test. Additionally, we introduce the latency/utilization inference graph neural network (lui-gnn), a surrogate model that uses a graph neural network to represent input architectures in the form of a directed graph. This graph representation allows for a diverse set of model architectures to all be effectively handled by a surrogate model. We present the architecture and performance of the model, as evaluated by the new proposed benchmark, including SMAPE, $R^2$ score, and inference times, and find that lui-gnn generally predicts latency and utilization for the 75\% quantile within several percent of the synthesized resources on the synthetic test dataset, indicating that this approach of estimating resource and latency via a surrogate models has promise and warrants further research.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗