Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model discovery”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 919 records · Page 51

Energy Services Interface: Architecture, Requirements, and Agreements

This report continues and extends the development of the Energy Services Interface (ESI) that recently has been led by the U.S. Department of Energy’s Grid Modernization Laboratory Consortium. The ESI is intended to facilitate the coordination of multiple, flexible energy resources that work in tandem to satisfy grid objectives by using performance attributes encoded within an ESI Service Template. The ESI relies on a pair of interfaces, representing the service requestor (the consumer of a service) and a service provider (who manages its resources per the agreed performance attributes) to achieve what is commonly known as a “grid service”. Due to its performance-driven approach, the ESI is hypothesized to be able to satisfy all common grid needs via only six common ESI service types. This report first reviews the status of ESI development, including its fundamental tenets. The report makes three important contributions to ESI development: First, it recognizes the similarity between service level agreements and the contract-like agreements that would be needed between energy service requestors and providers and recommends that ESI service agreements be modeled after the web services agreement specification. Second, whereas prior development efforts had focused on a flat, five-stage lifecycle, this report asserts that the ESI should have three behavioral layers in its architecture—the discovery, agreement, and service layers. Finally, this report offers concrete requirements that should be useful toward the development of the service requestors’ and service providers’ respective communications interfaces.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Wino and Real Minimal Dark Matter Excluded by Fermi Gamma-Ray Observations

We show that minimal, fermionic dark matter (DM) models in the $n$-dimensional representation of the weak force with zero hypercharge that make up 100% of the DM under the standard cosmological history are strongly excluded for $n < 9$. This includes the thermal wino, which we show is ruled out even allowing for DM core sizes up to $\sim$6.7 kpc with the preferred local DM density or $\sim$3.7 kpc in addition to the local DM density being half the preferred value, at less than $0.2$ GeV/cm$^3$. We reach these conclusions through dedicated searches with 14 years of Fermi gamma-ray data in the inner Galaxy between 30 GeV and 2 TeV for the continuum gamma-rays produced in the decays of unstable particles produced in DM annihilation and bound-state formation processes. We consider a variety of Milky Way DM profiles in our analyses, including those motivated by modern hydrodynamic cosmological simulations, and show that all the $n < 9$ minimal DM models are disfavored even under the most conservative assumptions for these density profiles. While wino, quintuplet ($n=5$), and $n = 7$ DM models are strongly disfavored by our analyses under the standard cosmology, we discuss how non-standard cosmological histories or DM sub-fractions could still allow for these particles to be realized in nature, with discovery opportunities at next-generation particle colliders and gamma-ray telescopes.

Cosmology and Nongalactic Astrophysics (astro-ph.C↗

Enabling discovery data science through cross-facility workflows

Experimental and observational instruments for scientific research (such as light sources, genome sequencers, accelerators, telescopes and electron microscopes) increasingly require High Performance Computing (HPC) scale capabilities for data analysis and workflow processing. Next-generation instruments are being deployed with higher resolutions and faster data capture rates, creating a big data crunch that cannot be handled by modest institutional computing resources. Often these big data analysis pipelines also require near real-time computing and have higher resilience requirements than the simulation and modeling workloads more traditionally seen at HPC centers. While some facilities have enabled workflows to run at a single HPC facility, there is a growing need to integrate capabilities across HPC facilities to enable cross-facility workflows, either to provide resilience to an experiment, increase analysis throughput capabilities, or to better match a workflow to a particular architecture. In this paper we describe the barriers to executing complex data analysis workflows across HPC facilities and propose an architectural design pattern for enabling scientific discovery using cross-facility workflows that includes orchestration services, application programming interfaces (APIs), data access and co-scheduling.

Antypas, Katerina B.↗

Double Chooz {theta}13 measurement via total neutron capture detection

Neutrinos were assumed to be massless particles until the discovery of the neutrino oscillation process. This phenomenon indicates that the neutrinos have non-zero masses and the mass eigenstates (nu(1), nu(2), nu(3)) are mixtures of their flavour eigenstates (nu(e), nu(mu), nu(tau)). The oscillations between different flavour eigenstates are described by three mixing angles (theta(12), theta(23), theta(13)), two differences of the squared neutrino masses of the nu(2)/nu(1) and nu(3)/nu(1) pairs and a charge conjugation parity symmetry violating phase delta(CP). The Double Chooz experiment, located near the Chooz Electricite de France reactors, measures the oscillation parameter theta(13) using reactor neutrinos. Here, the Double Chooz collaboration reports the measurement of the mixing angle theta(13) with the new total neutron capture detection technique from the full data set, yielding sin(2)(2 theta(13)) = 0.105 +/- 0.014. This measurement exploits the multidetector configuration, the isoflux baseline and data recorded when the reactors were switched off. In addition to the neutrino mixing angle measurement, Double Chooz provides a precise measurement of the reactor neutrino flux, given by the mean cross-section per fission <sigma(f)& rang; = (5.71 +/- 0.06) x 10(-43) cm(2) per fission, and reports an empirical model of the distortion in the reactor neutrino spectrum. The Double Chooz collaboration reports the neutrino oscillation parameter theta(13) from a measurement of the disappearance of reactor anti-electron neutrinos with the total neutron capture technique.

Djurcic, Z.↗

Discovery of multi-functional polyimides through high-throughput screening using explainable machine learning

Polyimides have been widely used in modern industries because of their excellent mechanical and thermal properties, e.g., high-temperature fuel cells, displays, and aerospace composites. However, it usually takes decades of experimental efforts to develop a successful product. Aiming to expedite the discovery of high-performance polyimides, we utilize computational methods of machine learning (ML) and molecular dynamics (MD) simulations. Our study provides compelling evidence for the effectiveness of a data-driven approach in discovering novel polyimides. We first build a comprehensive library of more than 8 million hypothetical polyimides based on the polycondensation of existing dianhydride and diamine/diisocyanate molecules. Then we establish multiple ML models for the thermal and mechanical properties of polyimides based on their experimentally reported values, including glass transition temperature, Young’s modulus, and tensile yield strength. The obtained ML models demonstrate excellent predictive performance in identifying the key chemical substructures influencing the thermal and mechanical properties of polyimides. The use of explainable machine learning describes the effect of chemical substructures on individual properties, from which human experts can understand the cause of the ML model decision. Applying the well-trained ML models, we obtain property predictions of the 8 million hypothetical polyimides. Then, we screen the whole hypothetical dataset and identify three (3) best-performing novel polyimides that have better-combined properties than existing ones through Pareto frontier analysis. For an easy query of the discovered high-performing polyimides, we also create an online platform https://polyimide-explorer.herokuapp.com/ that embeds the developed ML model with interactive visualization. Furthermore, we validate the ML predictions through all-atom MD simulations and examine their synthesizability. The MD simulations are in good agreement with the ML predictions and the three novel polyimides are predicted to be easy to synthesize via Schuffenhauer’s synthetic accessibility score. Following the proposed ML guidance, we successfully synthesized a novel polyimide and the experimentally obtained high glass transition/thermal decomposition temperature demonstrated its excellent thermal stability. Here our study demonstrates an efficient way to expedite the discovery of novel polymers using ML prediction and MD validation. The high-throughput screening of a large computational dataset can serve as a general approach for new material discovery in other polymeric material exploration problems, such as organic photovoltaics, polymer membranes, and dielectrics.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Adaptive Discovery and Mixed-Variable Optimization of Next Generation Synthesizable Microelectronic Materials

Design of new microelectronic materials is characterized by several challenges such as high-dimensionality of the atomic structure-composition variable space, formidable cost of directly using high-fidelity simulations for design optimization, dispersity in literature-reported similar materials and synthesis methods, complex physical mechanisms, and mixed qualitative and quantitative design variables that lead to a disjointed design space. Even though machine learning (ML) techniques have been employed to expedite materials innovation, existing methods treat ML and design optimization as two separate processes, failing to resolve the fundamental challenges associated with high dimensionality and mixed-variable complexity. We have developed a ML enhanced mixed-variable material design optimization framework to efficiently extract useful information from existing data in literature and physics-based simulations to guide the autonomous search for optimal materials. Our proposed framework is composed of four computational modules: (1) a natural language processing (NLP) based virtual screening module, (2) classification based concept exploration module, (3) a density functional theory (DFT)-based high-fidelity evaluation model, and (4) a novel latent-variable Gaussian process (LVGP) ML model for mixed-variable problems with uncertainty quantification, which seamlessly integrates with Bayesian Optimization (BO) and achieves superb efficiency through embedded physics-based dimension reduction. Our approach is demonstrated and validated using the testbed of functional materials exhibiting metal-insulation transitions (MITs), with the targeted reversible resistivity changes (∼10^5) near room temperature. At the end of the 30-month project, we have developed a series of new ML techniques using NLP, conditional variational autoencoders, active learning, latent-variable Gaussian processes, integrated with Bayesian optimization. Our project has resulted in new predicted MITs compounds and improved understanding of MITs microscopic mechanisms, which in turn will revolutionize microelectronics science to provide energy-saving solutions. Our research has improved both creativity and efficiency in transforming rare-event discoveries of new functional materials to persistent innovations. In addition to open-sourcing the online MIT database and the classification model, the LVGP open source code has been downloaded more than 15,000 times within two years. More than 40 MIT compounds have been identified and many have been pursued experimentally via collaborators. The research results are published in close to 20 collaborative papers in high-impact journals, such as Chem. Mater., Appl. Phys. Rev., Sci. Rep., among others of design space.

36 MATERIALS SCIENCE↗

Bayesian experimental design and parameter estimation for ultrafast spin dynamics

Abstract Advanced experimental measurements are crucial for driving theoretical developments and unveiling novel phenomena in condensed matter and materials physics, which often suffer from the scarcity of large-scale facility resources, such as x-ray or neutron scattering centers. To address these limitations, we introduce a methodology that leverages the Bayesian optimal experimental design paradigm to efficiently uncover key quantum spin fluctuation parameters from x-ray photon fluctuation spectroscopy (XPFS) data. Our method is compatible with existing theoretical simulation pipelines and can also be used in combination with fast machine learning surrogate models in the event that real-time simulations are unfeasible. Our numerical benchmarks demonstrate the superior performance in predicting model parameters and in delivering more informative measurements within limited experimental time. Our method can be adapted to many different types of experiments beyond XPFS and spin fluctuation studies, facilitating more efficient data collection and accelerating scientific discoveries.

97 MATHEMATICS AND COMPUTING↗

Cyber Attack Sequences Generation for Electric Power Grid

Security assessment of cyber-physical energy systems (CPESs) such as the electric power grid is a critical operation to maintain availability, reliability, and quality of service in the presence of persistent threats from malicious cyber actors. Existing security assessment approaches such as penetration testing and red teaming rely on subject matter expert experience and forensic cyber analysis of historical events to perform realistic, threat-informed assessments of CPES defense. CPESs have a large attack surface because of the heterogeneity and complexity of underlying topology, devices, measurements, and vulnerabilities. The aforementioned approaches lead to partial coverage of the attack surface with a large set of unknown but possible exploits. There is a need to automate the CPES attack surface discovery and contextualize it for relevant, highly probable, real-world attack scenarios. We propose a methodology and framework to facilitate the discovery of the CPES attack surface. We present a multilayer attack graph with ranked attack sequences to describe CPES failure scenarios. We present a work-in-progress framework that lists key components to automate the attack modeling and sequence generation. We demonstrate the published National Electric Sector Cybersecurity Organization Resource CPES failure scenario to highlight the trustworthiness of generated attack sequences.

Dutta, Ashutosh↗

Kinematic Evidence for Bipolar Ejecta Flows in the Galactic Supernova Remnant W49B

W49B is a unique Galactic supernova remnant with centrally peaked, “bar”-like ejecta distribution, which was once considered evidence for a hypernova origin that resulted in a bipolar ejection of the stellar core. However, chemical abundance measurements contradict this interpretation. Closely connected to the morphology of the ejecta is its velocity distribution, which provides critical details for understanding the explosion mechanism. We report the first ever observational constraint on the kinematics of the ejecta in W49B using the Resolve microcalorimeter spectrometer on the X-ray Imaging and Spectroscopy Mission (XRISM). Using XRISM/Resolve, we measured the line-of-sight velocity traced by the Fe Heα emission, which is the brightest feature in the Resolve spectrum, to vary by ±300 km s −1 with a smooth east-to-west gradient of a few tens of kilometers per second per parsec along the major axis. Similar trends in the line-of-sight velocity structure were found for other Fe-group elements Cr and Mn, traced by the Heα emission, and also for intermediate-mass elements Si, S, Ar, and Ca, traced by the Lyα emission. The discovery of the east–west gradient in the line-of-sight velocity, together with the absence of a twin-peaked line profile or enhanced broadening in the central region, clearly rejects the equatorially expanding disk model. In contrast, the observed velocity structure suggests bipolar flows reminiscent of a bipolar explosion scenario. An alternative scenario would be a collimation of the ejecta by an elongated cavity sculpted by bipolar stellar winds.

High resolution spectroscopy↗

Data driven discovery and quantification of hyperspectral leaf reflectance phenotypes across a maize diversity panel

Abstract Estimates of plant traits derived from hyperspectral reflectance data have the potential to efficiently substitute for traits, which are time or labor intensive to manually score. Typical workflows for estimating plant traits from hyperspectral reflectance data employ supervised classification models that can require substantial ground truth datasets for training. We explore the potential of an unsupervised approach, autoencoders, to extract meaningful traits from plant hyperspectral reflectance data using measurements of the reflectance of 2151 individual wavelengths of light from the leaves of maize ( Zea mays ) plants harvested from 1658 field plots in a replicated field trial. A subset of autoencoder‐derived variables exhibited significant repeatability, indicating that a substantial proportion of the total variance in these variables was explained by difference between maize genotypes, while other autoencoder variables appear to capture variation resulting from changes in leaf reflectance between different batches of data collection. Several of the repeatable latent variables were significantly correlated with other traits scored from the same maize field experiment, including one autoencoder‐derived latent variable (LV8) that predicted plant chlorophyll content modestly better than a supervised model trained on the same data. In at least one case, genome‐wide association study hits for variation in autoencoder‐derived variables were proximal to genes with known or plausible links to leaf phenotypes expected to alter hyperspectral reflectance. In aggregate, these results suggest that an unsupervised, autoencoder‐based approach can identify meaningful and genetically controlled variation in high‐dimensional, high‐throughput phenotyping data and link identified variables back to known plant traits of interest.

Tross, Michael C.↗

FAIRification, Quality Assessment, and Missingness Pattern Discovery for Spatiotemporal Photovoltaic Data

The ongoing growth of the photovoltaic market has pushed the demand for power forecasting and performance evaluation for a huge population of PV power plants. Through access to a large number of time series data sets from different power plants, we have found common issues that impede the modeling process. Namely, the time series data are hard to transfer between groups due to differences in variable nomenclature, and the quality of the data sets can vary. We address the issue of variable nomenclature by FAIRifying spatiotemporal PV time series data. Through the creation of a solar power plant ontology, we propose standards for the naming and structure of metadata used to describe the data from these power plants. Using the structure from this ontology, we have developed both R and Python packages for the automation of the FAIRification process. We have also developed an R package that automates the analysis of the quality of a data set through the designation of letter grades. With access to large time series data sets across many power plants, we can utilize spatiotemporal coherence between the sites in order to improve the quality of our data. To solve the issue of data missingness, we propose the use of Spatiotemporal-GNN autoencoders to detect and impute missing values from a data set by utilizing data from power plants nearby.

14 SOLAR ENERGY↗

Predicting Small Molecule Transfer Free Energies by Combining Molecular Dynamics Simulations and Deep Learning

Accurately predicting small molecule partitioning and hydrophobicity is critical in the drug discovery process. There are many heterogeneous chemical environments within a cell and entire human body. For example, drugs must be able to cross the hydrophobic cellular membrane to reach their intracellular targets, and hydrophobicity is an important driving force for drug–protein binding. Atomistic molecular dynamics (MD) simulations are routinely used to calculate free energies of small molecules binding to proteins, crossing lipid membranes, and solvation but are computationally expensive. Machine learning (ML) and empirical methods are also used throughout drug discovery but rely on experimental data, limiting the domain of applicability. We present atomistic MD simulations calculating 15,000 small molecule free energies of transfer from water to cyclohexane. This large data set is used to train ML models that predict the free energies of transfer. We show that a spatial graph neural network model achieves the highest accuracy, followed closely by a 3D-convolutional neural network, and shallow learning based on the chemical fingerprint is significantly less accurate. A mean absolute error of ~4 kJ/mol compared to the MD calculations was achieved for our best ML model. We also show that including data from the MD simulation improves the predictions, tests the transferability of each model to a diverse set of molecules, and show multitask learning improves the predictions. This work provides insight into the hydrophobicity of small molecules and ML cheminformatics modeling, and our data set will be useful for designing and testing future ML cheminformatics methods.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Predicting the Activity and Selectivity of Bimetallic Metal Catalysts for Ethanol Reforming using Machine Learning

Machine learning is ideally suited for the pattern detection in large uniform datasets, but consistent experimental datasets on catalyst studies are often small. Here we demonstrate how a combination of machine learning and first-principles calculations can be used to extract knowledge from a relatively small set of experimental data. The approach is based on combining a complex machine-learning model trained on an extensive computational library of transition-state energies with simple linear regression models of experimental catalytic activities and selectivities from the literature. Using the combined model, we identify the key C–C bond scission reactions involved in ethanol reforming and perform a computational screening for ethanol reforming on monolayer bimetallic catalysts with architectures TM-Pt-Pt(111) and Pt-TM-Pt(111) (TM = 3d transition metals). The model also predicts four promising catalyst compositions for future experimental studies. In conclusion, the approach is not limited to ethanol reforming but is of general use for the interpretation of experimental observations as well as for the computational discovery of novel catalytic materials.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A curated benchmark for cofolding models on kinase conformational states

Abstract Protein kinases are critical drug targets, requiring therapeutics that can modulate their active and inactive conformational states. While cofolding models can generate global folds directly from kinase sequences and ligand SMILES strings, these models have not yet been tested on their ability to recover ligand-induced-fit conformational states of the kinase proteins. Here, we introduce KinConfBench, a curated benchmark of 2225 high-quality human kinase chains to evaluate the ability of four state-of-the-art cofolding models—Boltz-2, Chai-1, Protenix, and RoseTTAFold-All-Atom—to recover both canonical and rare conformational states. We show that geometric success metrics of a ligand pose in the active site do not correlate strongly with the correct kinase conformational state, motivating a new set of dynamical benchmarks for assessing cofolding models. While all four cofolding models achieve ~60–80% prediction accuracy for kinase conformational classification, they exhibit severe mode collapse when performing multiple inferences, show negligible structural diversity in sampling induced-fit motions, and display a prevalent “apo-drift” in which most cofolding models predominantly predict the kinase to be in its ligand-free state. Our results highlight that capturing ligand-induced protein conformational diversity, not just geometric fit, is critical for next-generation structure-based drug discovery.

Sun, Kunyang↗

Synthesis and magnetic properties of the Shastry-Sutherland family R 2 Be 2 SiO 7 ( R = Nd , Sm , Gd-Yb )

Compounds forming the quasi-two-dimensional Shastry-Sutherland lattice (SSL) have attracted significant experimental and theoretical attention in the field of frustrated magnetism. This is primarily due to their realization of an exactly soluble J 1 –J 2 orthogonal dimer model capable of hosting magnetic order, dimer singlet, and plaquette singlet phases in zero applied field and their complex magnetic phase diagrams with fractional magnetization plateaus and possible superfluid and supersolid phases found between the plateau states. The discovery and characterization of SSL compounds based on rare-earth magnetic ions provide a direct route to study the stability and properties of these exotic magnetic phases in systems with a variety of different magnetic anisotropies. In this paper, we discuss the synthesis and magnetic characterization of polycrystalline samples of the R 2 ⁢Be 2 ⁢SiO 7 family, where R=Nd, Sm, and Gd-Yb. All family members crystallize in the space group $P\bar{⁢4}⁢2_1⁢m$ (113) and show no signs of long-range magnetic order above 2 K, except for R=Tb which orders antiferromagnetically at 2.6 K.

36 MATERIALS SCIENCE↗

Micro-Mechanically Guided High-Throughput Alloy Design Exploration Towards Metastability-Induced H Embrittlement Resistance

We develop a high-throughput approach for studying H embrittlement (HE)-resistance in alloys, which is based on combinatorial compositional screening of metastability effects by in situ scanning electron microscopy H-analyses. The project objective included: (i) technique development of high-throughput screening (HTS) for HE-resistance, (ii) discovery of new metallic materials with superior HE-resistance, (iii) Multiscale verification of HE-resistance of the new alloys and H-barrier layers, from atomic scale to an engineering scale. The investigation focused on a model system that enables exploration of different metastable states in Fe-based complex-concentrated alloys. Composition spread islands with hundreds of varying compositions are fabricated on a single substrate using a combinatorial co-sputtering technique. To screen these alloys, we developed and employed a home-built SEM-based integrated analysis system capable of characterizing H-permeability, H-trapping, H-influence on mechanical properties, and other material properties, as well as atomistic to continuum simulations to study the underlying physics.

08 HYDROGEN↗

Reliable and Efficient Machine Learning (Final Technical Report)

Modern scientific experiments generate massive amounts of data at a pace much faster than humans can manually analyze. While machine learning has revolutionized commercial data analysis (such as recommending movies or recognizing faces), applying these tools to complex scientific discovery is challenging because scientific answers must be precise, interpretable, and adhere to physical laws. The research under this project aims to develop new mathematical tools and computer algorithms specifically designed for scientific applications. Major progress has been made in automatically cleaning and deconstructing messy experimental data, analyzing the visual information of physical phenomena, determining the underlying physical variables, and providing rig orous mathematical analysis of interesting algorithms and concepts widely used in machine learning. This project addressed the critical gap between our ability to generate massive scientific data and our ability to extract interpretable information from it. We established mathematical foundations for Scientific Machine Learning (SciML) aimed at effective data analytics and automated discovery. Our work focused on three core objectives: (1) developing reliable feature extraction methods for dynamic high-dimensional data, (2) establishing mathematical foundations for discovering dynamics via neural networks, and (3) creating rigorous optimization techniques for these models. Key outcomes come from two fronts. On the practical side, they include the development of algorithms that significantly enhance the extraction of signals from field data, as well as the capability to handle situations that exhibit smooth variations or physical stretching due to temperature changes. They also include the creation of an automated framework for discovering fundamental state variables from raw experimental data, demonstrating the ability to identify intrinsic physical dimensions without prior knowledge of the governing laws. On the theoretical front, the research results in theoretical advances in Optimal Transport, a widely used notion in SciML, specifically regarding functions with fixed-size nodal sets, provide sharp bounds relevant to uncertainty quantification. Meanwhile, the outcomes also include the establishment of convergence theories for nonlocal gradient descent methods, enabling robust optimization with noisy data in high-dimensional settings commonly encountered in scientific modeling. The project also helps creating opportunities to train the next generation of researchers, equipping them with the necessary technical skills for today’s workplace and preparing them for future advances.

97 MATHEMATICS AND COMPUTING↗

Surrogate Neural Architecture Codesign Package (SNAC-Pack)

Neural Architecture Search is a powerful approach for automating model design, but existing methods struggle to accurately optimize for real hardware performance, often relying on proxy metrics such as bit operations. We present Surrogate Neural Architecture Codesign Package (SNAC-Pack), an integrated framework that automates the discovery and optimization of neural networks focusing on FPGA deployment.

Weitz, Jason [UC, San Diego]↗