Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “machine learning tools”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Golden Eagle Behavioral Modeling Enabled by High-Fidelity Atmospheric Models

The DOE-funded Golden Eagle Behavioral Modeling project combines knowledge of eagle behavior, eagle telemetry data, high-fidelity atmospheric and wind power plant flow models, and machine learning to develop tools that predict behavior and risk around wind power plants. This presentation provides background on the project and modeling approaches, as well as recent modeling and validation results from the region around the Top of the World wind plant in Wyoming.

49 EE - Wind and Water Power Program - Wind (EE-4W↗

Methods for evaluation and treatment of data shift

This is a code repository for a set of tools for detecting and mitigating data shifts in machine learning. The goal of the tools is to provide capabilities for determining when new data sets differ from training data sets and for adapting existing models to new data or correcting data shifts (via domain adaptation). The components will be written in Python, a high-level programming language that takes advantage of the Python ecosystem of high-quality open-source packages for machine learning and signal processing.

Parikh, Nidhi↗

Grand challenges in the design, manufacture, and operation of future wind turbine systems

Abstract. Wind energy is foundational for achieving 100 % renewable electricity production, and significant innovation is required as the grid expands and accommodates hybrid plant systems, energy-intensive products such as fuels, and a transitioning transportation sector. The sizable investments required for wind power plant development and integration make the financial and operational risks of change very high in all applications but especially offshore. Dependence on a high level of modeling and simulation accuracy to mitigate risk and ensure operational performance is essential. Therefore, the modeling chain from the large-scale inflow down to the material microstructure, and all the steps in between, needs to predict how the wind turbine system will respond and perform to allow innovative solutions to enter commercial application. Critical unknowns in the design, manufacturing, and operability of future turbine and plant systems are articulated, and recommendations for research action are laid out. This article focuses on the many unknowns that affect the ability to push the frontiers in the design of turbine and plant systems. Modern turbine rotors operate through the entire atmospheric boundary layer, outside the bounds of historic design assumptions, which requires reassessing design processes and approaches. Traditional aerodynamics and aeroelastic modeling approaches are pressing against the limits of applicability for the size and flexibility of future architectures and flow physics fundamentals. Offshore wind turbines have additional motion and hydrodynamic load drivers that are formidable modeling challenges. Uncertainty in turbine wakes complicates structural loading and energy production estimates, both around a single plant and for downstream plants, which requires innovation in plant operations and flow control to achieve full energy capture and load alleviation potential. Opportunities in co-design can bring controls upstream into design optimization if captured in design-level models of the physical phenomena. It is a research challenge to integrate improved materials into the manufacture of ever-larger components while maintaining quality and reducing cost. High-performance computing used in high-fidelity, physics-resolving simulations offer opportunities to improve design tools through artificial intelligence and machine learning, but even the high-fidelity tools are yet to be fully validated. Finally, key actions needed to continue the progress of wind energy technology toward even lower cost and greater functionality are recommended.

17 WIND ENERGY↗

J-PLUS: Support vector regression to measure stellar parameters

Stellar parameters are among the most important characteristics in studies of stars which, in traditional methods, are based on atmosphere models. However, time, cost, and brightness limits restrain the efficiency of spectral observations. The Javalambre Photometric Local Universe Survey (J-PLUS) is an observational campaign that aims to obtain photometry in 12 bands. Owing to its characteristics, J-PLUS data have become a valuable resource for studies of stars. Machine learning provides powerful tools for efficiently analyzing large data sets, such as the one from J-PLUS, and enables us to expand the research domain to stellar parameters. The main goal of this study is to construct a support vector regression (SVR) algorithm to estimate stellar parameters of the stars in the first data release of the J-PLUS observational campaign. The training data for the parameter's regressions are featured with 12-waveband photometry from J-PLUS and are crossidentified with spectrum-based catalogs. These catalogs are from the Large Sky Area Multi-Object Fiber Spectroscopic Telescope, the Apache Point Observatory Galactic Evolution Experiment, and the Sloan Extension for Galactic Understanding and Exploration. We then label them with the stellar effective temperature, the surface gravity, and the metallicity. Ten percent of the sample is held out to apply a blind test. We develop a new method, a multi-model approach, in order to fully take into account, the uncertainties of both the magnitudes and the stellar parameters. The method utilizes more than 200 models to apply the uncertainty analysis. We present a catalog of 2 493 424 stars with the root mean square error of 160 K in the effective temperature regression, 0.35 in the surface gravity regression, and 0.25 in the metallicity regression. We also discuss the advantages of this multi-model approach and compare it to other machine-learning methods.

79 ASTRONOMY AND ASTROPHYSICS↗

Velocity Extraction Using Complete Time-Domain Waveform Data and Audio Machine Learning

We developed a new machine learning-based tool for extracting information from interferometry measurements: MIDWAZE (Modular Interferometry Direct Waveform AnalyZEr). This paper showcases MIDWAZE’s ability to extract an object’s velocity information from Photonic Doppler Velocimetry (PDV) data at near-human accuracy with little to no human intervention. MIDWAZE can extract velocities roughly 350 times as fast as a human analyst "rushing" to complete their extractions, with similar extraction accuracy. MIDWAZE’s most outstanding feature is that it operates directly in waveform/temporal space, freeing analysis from certain limitations imposed by traditional spectrogram-based approaches and opening the way to "phase aware" PDV analysis. MIDWAZE also has limited ability to discriminate between different solid objects, which we develop as a first step towards automated discrimination of different kinds of objects such as ejecta clouds.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Evaluating Deception Detection Model Robustness To Linguistic Variation

With the increasing use of automated, machine learning-driven tools and the downstream impact that algorithmic judgements can have, it is critical to develop models that are robust to evolving or manipulated inputs. Evaluating the reliability of multimodal models across linguistic variations to understand model susceptibility to intentional linguistic adversarial attacks as well as natural linguistic variations is essential in this pursuit. We present extensive analysis of model robustness and susceptibility to linguistic variations in the setting of deceptive news detection, a difficult classification task that is an increasingly important problem to solve with the impact of misinformation spread online. We evaluate the effectiveness of incorporating adversarial defense strategies and measure model susceptibility to state-of-the-art adversarial attacks using two types of linguistic attacks — character and word perturbations. We consider two multiclass prediction tasks — a 3-way classification of tweets as trustworthy, propaganda, or disinformation; and a 4-way classification as clickbait, hoax, satire, or conspiracy — and compare the performance of three embeddings that have been state-of-the-art for several NLP tasks — GloVe, ELMo, and BERT — to highlight consistent trends in susceptibility, high confidence misclassifications, and high impact failures. We find that character or mixed ensemble models are the most effective defense mechanisms and that character perturbations are a more effective attack than word perturbations for deception classification.

adversarial evaluation↗

Using Machine Learning to Improve Thermostability of MHETase

Protein engineering is a field which utilizes proteins as tools, which has many useful applications in medicine, industry, biofuels and more.1 One such protein is MHETase, which is a protein that plays an important function in the degradation of polyethylene terephthalate (PET) plastics, which are commonly used in water and soda bottles.2 However, these proteins are adapted to work in specific conditions, and may not satisfy the desired properties that a new application would desire, or could be improved. For instance, a more thermostable MHETase would be more effective in the plastic degradation conditions.3 To make these desired changes, the primary structure of the protein is mutated, but there are many possible mutations and positions to mutate to make with the 20 canonical amino acids. Therefore, to narrow down the possibilities and to make the process of finding a thermostable MHETase variant, we used sequence design tools that are grounded in machine learning to find mutations that would improve thermostability of MHETase.4 In particular, we used the tools Protein MPNN and Fireprot to design a more thermostable MHETase enzyme. We then compiled these mutations into a library and grew these proteins using bacteria colonies, and measured their effectiveness using a fluorescent protein marker. Thermostable proteins and their marker would fold correctly and fluorescence would be seen, but if neither folded correctly then there would be no marker detected. We grew these proteins in bacteria and then intend to use these methods to evaluate their thermostability.

59 BASIC BIOLOGICAL SCIENCES↗

Using Machine Learning to Improve Thermostability of MHETase

Protein engineering is a field which utilizes proteins as tools, which has many useful applications in medicine, industry, biofuels and more. One such protein is MHETase, which is a protein that plays an important function in the degradation of polyethylene terephthalate (PET) plastics, which are commonly used in water and soda bottles.2 However, these proteins are adapted to work in specific conditions, and may not satisfy the desired properties that a new application would desire, or could be improved. For instance, a more thermostable MHETase would be more effective in the plastic degradation conditions.3 To make these desired changes, the primary structure of the protein is mutated, but there are many possible mutations and positions to mutate to make with the 20 canonical amino acids. Therefore, to narrow down the possibilities and to make the process of finding a thermostable MHETase variant, we used sequence design tools that are grounded in machine learning to find mutations that would improve thermostability of MHETase.4 In particular, we used the tools Protein MPNN and FireProt to design a more thermostable MHETase enzyme. We then compiled these mutations into a library and grew these proteins using bacteria colonies, and measured their effectiveness using a fluorescent protein marker. Thermostable proteins and their marker would fold correctly and fluorescence would be seen, but if neither folded correctly then there would be no marker detected. We grew these proteins in bacteria and then intend to use these methods to evaluate their thermostability.

59 BASIC BIOLOGICAL SCIENCES↗

Machine Learning for Predictive Performance Analysis in Charged Particle Beam Tools

Imaging methods driven by probes, electrons, and ions have played a dominant role in modern science and engineering. Opportunities for machine vision and AI that focus on consumer problems like driving and feature recognition, are now presenting themselves for automating aspects of the scientific processes. This proposal aims to enable and drive discovery in ultra-low energy implantation by taking advantage of faster processing, flexible control and detection methods, and architecture-agnostic workflows that will result in higher efficiency and shorter scientific development cycles. Custom microscope control, collection and analysis hardware will provide a framework for conducting novel in situ experiments revealing unprecedented insight into surface dynamics at the nanoscale. Ion implantation is a key capability for the semiconductor industry. As devices shrink, novel materials enter the manufacturing line, and quantum technologies transition to being more mainstream. Traditional implantation methods fall short in terms of energy, ion species, and positional precision. Here we demonstrate 1 keV focused ion beam Au implantation into Si and validate the results via atom probe tomography. We show the Au implant depth at 1 keV is 0.8 nm and that identical results for low energy ion implants can be achieved by either lowering the column voltage, or decelerating ions using bias – while maintaining a sub-micron beam focus. We compare our experimental results to static calculations using SRIM and dynamic calculations using binary collision approximation codes TRIDYN and IMSIL. A large discrepancy between the static and dynamic simulation is found that is due to lattice enrichment with high stopping power Au and surface sputtering. Additionally, we demonstrate how model details are particularly important to the simulation of these low-energy heavy-ion implantations. Finally, we discuss how our results pave a way to much lower implantation energies, while maintaining high spatial resolution.

47 OTHER INSTRUMENTATION↗

Critical review of lithium recovery from geothermal brines with implications for Smackover Formation, USA

The rapidly growing demand for lithium, a critical element for energy storage and national security technologies, has intensified concerns over the long-term availability and environmental impact of conventional lithium sources, such as hard-rock mining. To meet future demand, it is vital to explore unconventional resources that can provide sustainable domestic supplies. Geothermal brines, produced as a byproduct of geothermal energy generation, offer a promising alternative for lithium recovery by leveraging existing infrastructure and renewable energy production. In particular, the Smackover Formation, an extensive reservoir of high-salinity brines spanning Arkansas, Texas, Louisiana, Mississippi, and Alabama in the U.S. Gulf Coast, holds significant untapped lithium reserves. Co-producing geothermal energy and lithium from these brines aligns with sustainable extraction objectives while addressing resource scarcity. This review synthesizes current knowledge of lithium occurrence in the Smackover Formation and geothermal resources in the region, while also exploring how emerging tools such as machine learning can enhance resource targeting and co-production efficiency. Finally, we discuss key technical challenges and outline future research directions needed to advance lithium extraction from geothermal brines and secure a resilient domestic supply chain.

15 GEOTHERMAL ENERGY↗

Bragg glass signatures in Pd x ErTe 3 with X-ray diffraction temperature clustering

The Bragg glass phase is a nearly perfect crystal with glassy features predicted to occur in vortex lattices and charge-density-wave systems in the presence of disorder. Detecting it has been challenging, despite its sharp theoretical definition in terms of diverging correlation lengths. Here we present bulk probe evidence supporting a Bragg glass phase in the systematically disordered charge-density-wave material of Pd x ErTe 3 . We do this by using comprehensive X-ray data and a machine-learning-based analysis tool called X-ray diffraction temperature clustering (X-TEC). We establish a diverging correlation length in samples with moderate intercalation over a wide temperature range. To enable this analysis, we introduced a high-throughput measure of inverse correlation length that we call peak spread. The detection of Bragg glass order and the resulting phase diagram advance our understanding of the complex interplay between disorder and fluctuations. Moreover, the use of our analysis technique to target fluctuations through a high-throughput measure of peak spread can revolutionize the study of fluctuations in scattering experiments.

36 MATERIALS SCIENCE↗

Highly transferable atomistic machine-learning potentials from curated and compact datasets across the periodic table

Machine learning atomistic potentials trained using density functional theory (DFT) datasets allow for the modeling of complex material properties with near-DFT accuracy while imposing a fraction of its computational cost. The curation of the DFT datasets can be extensive in size and time-consuming to train and refine. In this study, we focus on addressing these barriers by developing minimalistic and flexible datasets for many elements in the periodic table regardless of their mass, electronic configuration, and ground state lattice. These DFT datasets have on average, ~4000 different structures and 27 atoms per structure, which we found sufficient to maintain the predictive accuracy of DFT properties and notably with high transferability. We envision these highly curated training sets as starting points for the community to expand, modify, or use with other machine learning atomistic potential models, whatever may suit individual needs, further accelerating the utilization of machine learning as a tool for material design and discovery.

42 ENGINEERING↗

Solving differential‐algebraic equations in power system dynamic analysis with quantum computing

Abstract Power system dynamics are generally modeled by high dimensional non‐linear differential‐algebraic equations (DAEs) given a large number of components forming the network. These DAEs' complexity can grow exponentially due to the increasing penetration of distributed energy resources, whereas their computation time becomes sensitive due to the increasing interconnection of the power grid with other energy systems. This paper demonstrates the use of quantum computing algorithms to solve DAEs for power system dynamic analysis. We leverage a symbolic programming framework to equivalently convert the power system's DAEs into ordinary differential equations (ODEs) using index reduction methods and then encode their data into qubits using amplitude encoding. The system non‐linearity is captured by Hamiltonian simulation with truncated Taylor expansion so that state variables can be updated by a quantum linear equation solver. Our results show that quantum computing can solve the power system's DAEs accurately with a computational complexity polynomial in the logarithm of the system dimension. We also illustrate the use of recent advanced tools in scientific machine learning for implementing complex computing concepts, that is, Taylor expansion, DAEs/ODEs transformation, and quantum computing solver with abstract representation for power engineering applications.

computational complexity↗

tesuract v.1.0

SAND2021-14370 O Tesuract (tensor surrogate approximation and computation) provides Python tools to build machine learning regressors that include polynomial chaos expansions. The software also offers methods for creation regressors for tensor outputs such as spatially varying fields and using a reduced order modeling methodology. The library is built on and compatible with the scikit-learn API, which allows integration with one of the most ubiquitous machine learning Python libraries out there. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Chowdhary, Kamaljit↗

DER Cybersecurity Detection and Response Suite

SAND2024-08475O The Distributed Energy Resource (DER) Cybersecurity Detection and Response Suite is a solution for distributed energy resource (DER) systems. The DER Security Orchestration, Automation, and Response (SOAR) solution that uses alerts from signature- and behavior-based Intrusion Detection Systems are intended to be deployed as bump-in-the-wire (BITW) devices in front of DER equipment. The fielded application would use multiple intrusion detection systems that report data to SOAR to respond to cyberattacks. The suite consists of two software components: • The proactive intrusion detection and mitigation system (PIDMS) secures grid-edge photovoltaic smart inverters and other equipment in distributed energy resource systems. It is a distributed BITW solution; cyber and physical data are automatically processed using network inspection tools and custom machine learning algorithms to detect abnormal events and correlate cyber-physical events. • The Security Orchestration, Automation, and Response for Distributed Energy Resources (SOAR4DER) application ingests data from several intrusion detection systems to quickly block attacks and revert DER systems to good states. Using a collection of intrusion detection system technologies on a BITW device, it incorporates physical and cyber data to detect abnormal and potential malicious behaviors. Multiple SOAR playbooks then use the intrusion detection system data streams to automatically defend the system. SOAR4DER system testing showed detection and response times under 30 seconds for all adversary reconnaissance, denial-of-service attacks, malicious Modbus commands, brute-force logins, and machine-in-the-middle attacks. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Johnson, Jay↗

Feature Pathway Graphs using Random Forest Regressors

SAND2025-04671O Feature Pathway Graphs using Random Forest Regressors is a software tool that uses machine learning to determine pathways of influence between features in data sets. It can be used as a surrogate method for casual discovery. The output creates pathway graphs between features of interest. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Peterson, Matthew↗

Multiscale X-ray phase contrast imaging of human cartilage for investigating osteoarthritis formation

The evolution of cartilage degeneration is still not fully understood, partly due to its thinness, low radio-opacity and therefore lack of adequately resolving imaging techniques. X-ray phase-contrast imaging (X-PCI) offers increased sensitivity with respect to standard radiography and CT allowing an enhanced visibility of adjoining, low density structures with an almost histological image resolution. This study examined the feasibility of X-PCI for high-resolution (sub-) micrometer analysis of different stages in tissue degeneration of human cartilage samples and compare it to histology and transmission electron microscopy. Ten 10%-formalin preserved healthy and moderately degenerated osteochondral samples, post-mortem extracted from human knee joints, were examined using four different X-PCI tomographic set-ups using synchrotron radiation the European Synchrotron Radiation Facility (France) and the Swiss Light Source (Switzerland). Volumetric datasets were acquired with voxel sizes between 0.7 × 0.7 × 0.7 and 0.1 × 0.1 × 0.1 µm 3 . Data were reconstructed by a filtered back-projection algorithm, post-processed by ImageJ, the WEKA machine learning pixel classification tool and VGStudio max. For correlation, osteochondral samples were processed for histology and transmission electron microscopy. X-PCI provides a three-dimensional visualization of healthy and moderately degenerated cartilage samples down to a (sub-)cellular level with good correlation to histologic and transmission electron microscopy images. X-PCI is able to resolve the three layers and the architectural organization of cartilage including changes in chondrocyte cell morphology, chondrocyte subgroup distribution and (re-)organization as well as its subtle matrix structures. X-PCI captures comprehensive cartilage tissue transformation in its environment and might serve as a tissue-preserving, staining-free and volumetric virtual histology tool for examining and chronicling cartilage behavior in basic research/laboratory experiments of cartilage disease evolution.

3D analysis↗

Improvement and generalization of ABCD method with Bayesian inference

To find New Physics or to refine our knowledge of the Standard Model at the LHC is an enterprise that involves many factors, such as the capabilities and the performance of the accelerator and detectors, the use and exploitation of the available information, the design of search strategies and observables, as well as the proposal of new models. We focus on the use of the information and pour our effort in re-thinking the usual data-driven ABCD method to improve it and to generalize it using Bayesian Machine Learning techniques and tools. We propose that a dataset consisting of a signal and many backgrounds is well described through a mixture model. Signal, backgrounds and their relative fractions in the sample can be well extracted by exploiting the prior knowledge and the dependence between the different observables at the event-by-event level with Bayesian tools. We show how, in contrast to the ABCD method, one can take advantage of understanding some properties of the different backgrounds and of having more than two independent observables to measure in each event. In addition, instead of regions defined through hard cuts, the Bayesian framework uses the information of continuous distribution to obtain soft-assignments of the events which are statistically more robust. To compare both methods we use a toy problem inspired by pp\to hh\to b\bar b b \bar b p p → h h → b b ‾ b b ‾ , selecting a reduced and simplified number of processes and analysing the flavor of the four jets and the invariant mass of the jet-pairs, modeled with simplified distributions. Taking advantage of all this information, and starting from a combination of biased and agnostic priors, leads us to a very good posterior once we use the Bayesian framework to exploit the data and the mutual information of the observables at the event-by-event level. We show how, in this simplified model, the Bayesian framework outperforms the ABCD method sensitivity in obtaining the signal fraction in scenarios with 1% and 0.5% true signal fractions in the dataset. We also show that the method is robust against the absence of signal. We discuss potential prospects for taking this Bayesian data-driven paradigm into more realistic scenarios.

Alvarez, Ezequiel↗