Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “machine reasoning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Predicting the von Neumann entanglement entropy using a graph neural network

Calculating the von Neumann entanglement entropy from experimental data is challenging due to its dependence on the complete wavefunction, forcing reliance on approximations such as classical mutual information (MI). We propose a machine learning approach using a graph neural network to predict the von Neumann entropy directly from experimentally accessible bitstrings. We test this approach on a Rydberg ladder system and achieve a mean absolute error of $3.6\,\times 10^{-3}$ when evaluating within the training range on a dataset with entropy values ranging from 0 to 1.9. The model achieves a mean absolute percentage error of 1.44% and outperforms MI-based bounds. When tested beyond the training range, the model maintains reasonable accuracy. Furthermore, we demonstrate that fine-tuning the model with small datasets significantly improves performance on data outside the original training range.

graph neural networks↗
DOE OSTI2021

NENCI-2021. I. A large benchmark database of non-equilibrium non-covalent interactions emphasizing close intermolecular contacts

In this work, we present NENCI-2021, a benchmark database of ~8000 Non-Equilibirum Non-Covalent Interaction energies for a large and diverse selection of intermolecular complexes of biological and chemical relevance. To meet the growing demand for large and high-quality quantum mechanical data in the chemical sciences, NENCI-2021 starts with the 101 molecular dimers in the widely used S66 and S101 databases and extends the scope of these works by (i) including 40 cation–π and anion–π complexes, a fundamentally important class of non-covalent interactions that are found throughout nature and pose a substantial challenge to theory, and (ii) systematically sampling all 141 intermolecular potential energy surfaces (PESs) by simultaneously varying the intermolecular distance and intermolecular angle in each dimer. Designed with an emphasis on close contacts, the complexes in NENCI-2021 were generated by sampling seven intermolecular distances along each PES (ranging from 0.7× to 1.1× the equilibrium separation) and nine intermolecular angles per distance (five for each ion–π complex), yielding an extensive database of 7763 benchmark intermolecular interaction energies (E int ) obtained at the coupled-cluster with singles, doubles, and perturbative triples/complete basis set [CCSD(T)/CBS] level of theory. The E int values in NENCI-2021 span a total of 225.3 kcal/mol, ranging from -38.5 to +186.8 kcal/mol, with a mean (median) E int value of -1.06 kcal/mol (-2.39 kcal/mol). In addition, a wide range of intermolecular atom-pair distances are also present in NENCI-2021, where close intermolecular contacts involving atoms that are located within the so-called van der Waals envelope are prevalent—these interactions, in particular, pose an enormous challenge for molecular modeling and are observed in many important chemical and biological systems. A detailed symmetry-adapted perturbation theory (SAPT)- based energy decomposition analysis also confirms the diverse and comprehensive nature of the intermolecular binding motifs present in NENCI-2021, which now includes a significant number of primarily induction-bound dimers (e.g., cation–π complexes). NENCI-2021 thus spans all regions of the SAPT ternary diagram, thereby warranting a new four-category classification scheme that includes complexes primarily bound by electrostatics (3499), induction (700), dispersion (1372), or mixtures thereof (2192). A critical error analysis performed on a representative set of intermolecular complexes in NENCI-2021 demonstrates that the E int values provided herein have an average error of ±0.1 kcal/mol, even for complexes with strongly repulsive E int values, and maximum errors of ±0.2–0.3 kcal/mol (i.e., ~±1.0 kJ/mol) for the most challenging cases. For these reasons, we expect that NENCI-2021 will play an important role in the testing, training, and development of next-generation classical and polarizable force fields, density functional theory approximations, wavefunction theory methods, and machine learning based intra- and inter-molecular potentials.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Learning Quantum States and Unitaries of Bounded Gate Complexity

While quantum state tomography is notoriously hard, most states hold little interest to practically minded tomographers. Given that states and unitaries appearing in nature are of bounded gate complexity, it is natural to ask if efficient learning becomes possible. In this work, we prove that to learn a state generated by a quantum circuit with G two-qubit gates to a small trace distance, a sample complexity scaling linearly in G is necessary and sufficient. We also prove that the optimal query complexity to learn a unitary generated by G gates to a small average-case error scales linearly in G . While sample-efficient learning can be achieved, we show that under reasonable cryptographic conjectures, the computational complexity for learning states and unitaries of gate complexity G must scale exponentially in G . We illustrate how these results establish fundamental limitations on the expressivity of quantum machine-learning models and provide new perspectives on no-free-lunch theorems in unitary learning. Together, our results answer how the complexity of learning quantum states and unitaries relate to the complexity of creating these states and unitaries. Published by the American Physical Society 2024

Zhao, Haimeng (ORCID:0000000166751489)↗
DOE OSTI2020

Model Driven Deception for Defense of Operational Technology Environments

Due to the strong integration of real-world physics, OT deception platforms must operate differently than traditional IT deceptions. For instance, turning off a valve will be detected downstream by other sensors because the flow will reduce and stop. Additionally, controllers and applications leverage data from sensors to send control commands to each other. A believable deception must be integrated with the system to project the effects of events. An attack will likely attempt to control the physical process in a negative manner. To make the attacker believe they are achieving their objective, it must predict the effects of these actions, to a reasonable degree. Our approach to simulating a model to generate realistic decoy behavior is explored including description of two approaches: a physics model-based approach and a data driven approach. The performance of two machine learning techniques are investigated in their ability to learn a good enough model of the physics of the system.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Application of Convolutional and Feedforward Neural Networks for Fault Detection in Particle Accelerator Power Systems

High voltage converter modulators (HVCM) provide power to the accelerating cavities of the spallation neutron source (SNS) facility. HVCM experience catastrophic failures, which increase the downtime of the SNS and reduce beam time. The faults may occur due to different reasons including failures of the resonant capacitor, core saturation due to the magnetic flux, insulated-gate bipolar transistor (IGBT) failures, and others. We recently have setup a HVCM test stand to develop and test machine learning models for anomaly detection and fault prognostics. In this work, we propose binary classifiers and autoencoder architectures based on convolutional (CNN) and feedforward neural networks (FNN) to facilitate distinguishing normal from faulty waveforms coming from the HVCM during operation. The results indicate that the CNN binary classifier is the best model among the four showing very stable performance in the training and testing sets with impressive metrics of precision and recall reaching up to 99\% with a very small uncertainty. The FNN classifier shows the least performance with a large uncertainty in its metrics. The performances of the two autoencoders based on CNN and FNN were in between, showing very good performance nonetheless.

Radaideh, Majdi↗
DOE OSTI2023

Characterizing the flux effect on the irradiation embrittlement of reactor pressure vessel steels using machine learning

In-service exposure to high-energy neutrons embrittles reactor pressure vessel (RPV) steels. An increase in the yield stress (Δσ y ) results in a corresponding increase in the brittle to ductile transition temperature (ΔT c ). Most existing models underpredict ΔT c at higher fluence following accelerated irradiations in test reactors. High fluence, up to 10 20 n/cm 2 in some cases, will be reached over extended RPV vessel operation of 80 years, or more, at low service flux. Embrittlement has been extensively studied in accelerated, higher flux test reaction irradiations. However, the use of test reactor data naturally raises the question of flux effects. Here, this study used a machine learning approach trained on a set of hardening data, covering a wide range of flux, fluence, and steel compositions to determine the interactive effects of both irradiation and material variables on Δσ y . The analysis included machine learning-based cross-plots of the variable dependence of Δσ y for six core steels (i.e., CM6, LC, LD, LG, LH, and LI), with controlled differences in their Cu and Ni contents. A primary objective is to evaluate an effective to actual fluence (Φt e /Φt) ratio, as a function of flux, fluence, and steel composition. This is information critical to properly use intermediate flux-high fluence data in calibrating a low flux-high fluence embrittlement model. The predicted Φt e /Φt is reasonably consistent with estimates previously derived from a physics-based solute recombination trap model.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Quantum-Chemically Informed Machine Learning: Prediction of Energies of Organic Molecules with 10 to 14 Non-hydrogen Atoms

High-fidelity quantum-chemical calculations can provide accurate predictions of molecular energies, but their high computational costs limit their utility, especially for larger molecules. We have shown in previous work that machine learning models trained on high-level quantum-chemical calculations (G4MP2) for organic molecules with one to nine non-hydrogen atoms can provide accurate predictions for other molecules of comparable size at much lower costs. Here we demonstrate that such models can also be used to effectively predict energies of molecules larger than those in the training set. To implement this strategy, we first established a set of 191 molecules with 10–14 non-hydrogen atoms having reliable experimental enthalpies of formation. We then assessed the accuracy of computed G4MP2 enthalpies of formation for these 191 molecules. The error in the G4MP2 results was somewhat larger than that for smaller molecules, and the reason for this increase is discussed. Two density functional methods, B3LYP and ωB97X-D, were also used on this set of molecules, with ωB97X-D found to perform better than B3LYP at predicting energies. The G4MP2 energies for the 191 molecules were then predicted using these two functionals with two machine learning methods, the FCHL-Δ and SchNet-Δ models, with the learning done on calculated energies of the one to nine non-hydrogen atom molecules. The better-performing model, FCHL-Δ, gave atomization energies of the 191 organic molecules with 10–14 non-hydrogen atoms within 0.4 kcal/mol of their G4MP2 energies. Thus, this work demonstrates that quantum-chemically informed machine learning can be used to successfully predict the energies of large organic molecules whose size is beyond that in the training set.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS1980

A silicon sheet casting experiment

The casting of silicon blanks for solar cells directly without slicing is an exciting concept. An experiment was performed to investigate the feasibility of developing a machine that casts wafers directly. A Czochralski furnace was modified to accept a graphite ingot-simulating fixture. Silicon was melted in the middle of the ingot simulator in a boron nitride mold. Sample castings showed reasonable crystal size. Solar cells were made from the cast blanks. The performance is reported.

Bickler, D. B.↗
DOE OSTI2024

Optimizing High-Throughput Inference on Graph Neural Networks at Shared Computing Facilities with the NVIDIA Triton Inference Server

Abstract With machine learning applications now spanning a variety of computational tasks, multi-user shared computing facilities are devoting a rapidly increasing proportion of their resources to such algorithms. Graph neural networks (GNNs), for example, have provided astounding improvements in extracting complex signatures from data and are now widely used in a variety of applications, such as particle jet classification in high energy physics (HEP). However, GNNs also come with an enormous computational penalty that requires the use of GPUs to maintain reasonable throughput. At shared computing facilities, such as those used by physicists at Fermi National Accelerator Laboratory (Fermilab), methodical resource allocation and high throughput at the many-user scale are key to ensuring that resources are being used as efficiently as possible. These facilities, however, primarily provide CPU-only nodes, which proves detrimental to time-to-insight and computational throughput for workflows that include machine learning inference. In this work, we describe how a shared computing facility can use the NVIDIA Triton Inference Server to optimize its resource allocation and computing structure, recovering high throughput while scaling out to multiple users by massively parallelizing their machine learning inference. To demonstrate the effectiveness of this system in a realistic multi-user environment, we use the Fermilab Elastic Analysis Facility augmented with the Triton Inference Server to provide scalable and high-throughput access to a HEP-specific GNN and report on the outcome.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Application of machine learning to evaluating and remediating models for energy and environmental engineering

Machine learning (ML) algorithms have been increasingly successful in their applications to solve energy and environmental engineering problems. ML algorithms have the advantage of being able to solve highly nonlinear issues effectively. Furthermore, considering the limited sample size of data collected in energy and environmental engineering, obtaining a ML model with reasonable accuracy is simple. Unfortunately, the vast majority of the current applications of ML algorithms lack effective screening of dominant factors and comprehensive model validation, which weakens the predictive ability of the models. The present study takes the minimum miscible pressure (MMP) of CO 2 - oil systems as an example. It establishes a systematic and robust predictive model to address this issue. Based on 147 sets of slim tube tests, the predictive models of the MMPs are investigated by application of eight ML algorithms. The paper concludes that most of the published ML models in the field of energy and environmental engineering prediction are not reliable. Furthermore, it addresses the main reasons for the poor performance of some predictive models built by ML and provides guidelines on how to make such models robust. Further, to the best of our knowledge, this is the first study to point out the defects of current ML modeling methods and propose countermeasures for their application in energy and environmental engineering problems.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
NASA NTRS1987

Raising the AIQ of the Space Station

Expert systems and robotics technologies are to be significantly advanced during the Space Station program. Artificial intelligence systems (AI) on the Station will include 'scars', which will permit upgrading the AI capabilities as the Station evolves to autonomy. NASA-Ames is managing the development of the AI systems through a series of demonstrations, the first, controlling a single subsystem, to be performed in 1988. The capabilities being integrated into the first demonstration are described; however, machine learning and goal-driven natural language understanding will not reach a prototype stage until the mid-1990s. Steps which will be taken to endow the computer systems with the ability to move from heuristic reasoning to factual knowledge, i.e., learning from experience, are explored. It is noted that the development of Space Station expert systems depends on the development of experts in Station operations, which will not happen until the Station has been used extensively by crew members.

Lum, Henry↗
NASA NTRS2011

Meta-RaPS Algorithm for the Aerial Refueling Scheduling Problem

The Aerial Refueling Scheduling Problem (ARSP) can be defined as determining the refueling completion times for each fighter aircraft (job) on multiple tankers (machines). ARSP assumes that jobs have different release times and due dates, The total weighted tardiness is used to evaluate schedule's quality. Therefore, ARSP can be modeled as a parallel machine scheduling with release limes and due dates to minimize the total weighted tardiness. Since ARSP is NP-hard, it will be more appropriate to develop a ppro~imate or heuristic algorithm to obtain solutions in reasonable computation limes. In this paper, Meta-Raps-ATC algorithm is implemented to create high quality solutions. Meta-RaPS (Meta-heuristic for Randomized Priority Search) is a recent and promising meta heuristic that is applied by introducing randomness to a construction heuristic. The Apparent Tardiness Rule (ATC), which is a good rule for scheduling problems with tardiness objective, is used to construct initial solutions which are improved by an exchanging operation. Results are presented for generated instances.

Kaplan, Sezgin↗
NASA NTRS2020

A Machine Learning Examination of Hydroxyl Radical Differences Among Model Simulations for CCMI-1

Hydroxyl radical (OH) plays critical roles within the troposphere, such as determining the lifetime of methane (CH4), yet is challenging to model due to its fast cycling and dependence on a multitude of sources and sinks. As a result, the reasons for variations in OH and the resulting CH4 lifetime (TCH4), both between models and in time, are difficult to diagnose. We apply a neural network (NN) approach to address this issue within a group of models that participated in the Chemistry-Climate Model Initiative (CCMI). Analysis of the historical specified dynamics simulations performed for CCMI indicates that the primary drivers of TCH4 differences among ten models are the flux of UV light to the troposphere (indicated by the photolysis frequency JO1D) due mostly to clouds, mixing ratio of tropospheric ozone (O3), the abundance of nitrogen oxides (NOx≡NO+NO2), and details of the various chemical mechanisms that drive OH. Water vapor, carbon monoxide (CO), the ratio of NO:NOx, and formaldehyde (HCHO) explain moderate differences in TCH4, while isoprene, CH4, the photolysis frequency of NO2 by visible light (JNO2), overhead O3 column, and temperature account for little-to-no model variation in CH4. We also apply the NNs to analysis of temporal trends in OH from 1980 to 2015. All models that participated in the specified dynamics historical simulation for CCMI demonstrate a decline in CH4 during the analysed timeframe. The significant contributors to this trend, in order of importance, are tropospheric O3, JO1D, NOx, and H2O, with CO also causing substantial interannual variability in OH burden. Finally, the identified trends in TCH4 are compared to calculated trends in the tropospheric mean OH concentration from previous work, based on analysis of observations. The comparison reveals a robust result for the effect of rising water vapor on OH and CH4, imparting an increasing and decreasing trend of about 0.5% decade(exp -1), respectively. The responses due to NOx, O3 column, and temperature are also in reasonably good agreement between the two studies, though a discrepancy in the CH4 response highlights a need for further examination of the CH4 feedback on the abundance of OH.

Julie M Nicely↗
DOE OSTI2021

Predictive Models of Genetic Redundancy in Arabidopsis thaliana

Abstract Genetic redundancy refers to a situation where an individual with a loss-of-function mutation in one gene (single mutant) does not show an apparent phenotype until one or more paralogs are also knocked out (double/higher-order mutant). Previous studies have identified some characteristics common among redundant gene pairs, but a predictive model of genetic redundancy incorporating a wide variety of features derived from accumulating omics and mutant phenotype data is yet to be established. In addition, the relative importance of these features for genetic redundancy remains largely unclear. Here, we establish machine learning models for predicting whether a gene pair is likely redundant or not in the model plant Arabidopsis thaliana based on six feature categories: functional annotations, evolutionary conservation including duplication patterns and mechanisms, epigenetic marks, protein properties including posttranslational modifications, gene expression, and gene network properties. The definition of redundancy, data transformations, feature subsets, and machine learning algorithms used significantly affected model performance based on holdout, testing phenotype data. Among the most important features in predicting gene pairs as redundant were having a paralog(s) from recent duplication events, annotation as a transcription factor, downregulation during stress conditions, and having similar expression patterns under stress conditions. We also explored the potential reasons underlying mispredictions and limitations of our studies. This genetic redundancy model sheds light on characteristics that may contribute to long-term maintenance of paralogs, and will ultimately allow for more targeted generation of functionally informative double mutants, advancing functional genomic studies.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Final Scientific/Technical Report-FREE-piston Zero Emissions Refrigerator (FREEZER)

The FREE-piston Zero Emissions Refrigerator (FREEZER™) is a natural refrigerant Stirling-cycle cooler developed by AMSC in partnership with Heatcraft, targeted as a replacement refrigeration system for walk-in coolers or freezers found commonly in restaurants, convenience stores, supermarkets, etc. The FREEZER™, combined with a closed-loop CO2 heat-transfer system, had the goal to provides an efficient (Target COP = 1.4), zero ODP (Ozone Depletion Potential) and near zero GWP (Global Warming Potential) refrigeration solution with no synthetic, flammable, or toxic refrigerants. Other near zero GWP refrigeration systems do not exist at the scale and performance level of FREEZER. ARPA-E Continuation Funding enabled the design and fabrication of one Advanced Development Unit (ADU) cooler and two Field Test Unit (FTU) coolers, and a new revised Field Test Unit (new FTU). Heatcraft was to extensively test the various coolers at their facilities, which closely simulate real-world conditions. The original plan was to install and operate FREEZER FTUs alongside a traditional cooling solution at one or more customer locations to obtain data on direct performance comparisons with existing commercial refrigeration systems. Success in this FREEZER refinement and field-test project will establish the basis for a new class of environmentally friendly refrigeration systems that will revolutionize the industry. The hardware developed under the program is shown below in Figure 1. Five Stirling-cycle machines were built within the program, with a sixth cooler still under construction. The original DU and the ADU coolers met the performance target with a coefficient of performance (COP) of 1.2. The FTU was underperforming during the initial tuning of the free-piston Stirling cycle dynamics when there was a catastrophic failure of the fasteners on pressure boundary. This caused a pause to the program while the failure mechanism was investigated. The root cause was an inadequate flange design that allowed an excessive cyclic loading on the fasteners, leading to a fatigue failure. It was determined that existing FTU design could not be reasonably salvaged in a safe manner, and that fact, combined with the lower-than-expected performance of the new experimental heat exchanger modules lead to the design of the “new FTU” with a more conventional shell-and-tube heat exchanger design which should get close to the design target COP of 1.4, but have a higher overall machine cost. The program ran out of time before the fabrication of the new FTU was completed, but AMSC is still working on the cooler, with the majority of the parts fabricated, and hopes to have the unit under test sometime in early 2022, after which it will be shipped to Heatcraft for additional testing.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Anomaly Detection in Materials Digital Twins with Multiscale ICME for Additive Manufacturing

Detecting anomaly in fatigue and fracture experimental materials science is an interesting yet challenging topic. The reasons are threefold. First, the anomalous microstructure feature that gives rise to structural failure is small, sometimes in the order of 10 -7 of the interrogated volume. This, in turn, results in a highly imbalanced classification problem in machine learning (ML). Second, the consequence is high, in the sense that the test specimen is destructed in such case. Third, the convolution between microstructure stochasticity and the small probability of void nucleation, growth, and coalescence makes failure and fracture a hard-to-predict and challenging problem in materials science due to its irreproducibility, even experimentally. In this paper, we developed a materials digital twin and applied anomaly detection methods to detect voids and anomaly in additive manufacturing (AM). The materials digital twin is driven by two integrated computational materials engineering (ICME) models, which are kinetic Monte Carlo (kMC) and crystal plasticity finite element method (CPFEM). In conclusion, we demonstrated that by using anomaly detection, it is possible to detect voids and other defects in materials digital twin, which paves way for future research in integrating materials digital twin with its physical counterpart.

ICME↗
NASA NTRS1989

Detection of edges using local geometry

Researchers described a new representation, the local geometry, for early visual processing which is motivated by results from biological vision. This representation is richer than is often used in image processing. It extracts more of the local structure available at each pixel in the image by using receptive fields that can be continuously rotated and that go to third order spatial variation. Early visual processing algorithms such as edge detectors and ridge detectors can be written in terms of various local geometries and are computationally tractable. For example, Canny's edge detector has been implemented in terms of a local geometry of order two, and a ridge detector in terms of a local geometry of order three. The edge detector in local geometry was applied to synthetic and real images and it was shown using simple interpolation schemes that sufficient information is available to locate edges with sub-pixel accuracy (to a resolution increase of at least a factor of five). This is reasonable even for noisy images because the local geometry fits a smooth surface - the Taylor series - to the discrete image data. Only local processing was used in the implementation so it can readily be implemented on parallel mesh machines such as the MPP. Researchers expect that other early visual algorithms, such as region growing, inflection point detection, and segmentation can also be implemented in terms of the local geometry and will provide sufficiently rich and robust representations for subsequent visual processing.

Gualtieri, J. A.↗
NASA NTRS1939

The Enlarged N.A.C.A. Tank, and Some of Its Work

The most conspicuous of the features of the enlarged N.A.C.A. tank are derived directly from those of the original tank and owe their present form not only to the reasons for their first use but also to the experience obtained with them. As in the original tank, there are: 1) A basin of great length (new 2,880 feet); 2) Rails made of structural H beams, without machining; 3) A towing carriage of very high speed (now 80 mph maximum); 4) Rubber tires on all the wheels, pneumatic on the running wheels and solid on the guide wheels.

Truscott, Starr↗