Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model discovery”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

AtomSets as a hierarchical transfer learning framework for small and large materials datasets

Abstract Predicting properties from a material’s composition or structure is of great interest for materials design. Deep learning has recently garnered considerable interest in materials predictive tasks with low model errors when dealing with large materials data. However, deep learning models suffer in the small data regime that is common in materials science. Here we develop the AtomSets framework, which utilizes universal compositional and structural descriptors extracted from pre-trained graph network deep learning models with standard multi-layer perceptrons to achieve consistently high model accuracy for both small compositional data (<400) and large structural data (>130,000). The AtomSets models show lower errors than the graph network models at small data limits and other non-deep-learning models at large data limits. They also transfer better in a simulated materials discovery process where the targeted materials have property values out of the training data limits. The models require minimal domain knowledge inputs and are free from feature engineering. The presented AtomSets model framework can potentially accelerate machine learning-assisted materials design and discovery with less data restriction.

Chen, Chi (ORCID:0000000180087043)↗
DOE OSTI2024

DECOVALEX-2023: Task E Final Report

This is the Task E final report for DECOVALEX-2023. Task E is focused on understanding thermal, two-phase hydrological, and mechanical (TH2M) processes, especially related to predicting brine migration in the excavation damaged zone around a heated excavation in salt. Salt is attractive as a disposal medium for radioactive waste because it is self-healing and is essentially impermeable and essentially non-porous in the far field (away from excavations). Investigation of the short-term (days to years) near-field (centimeters to tens of meters) behavior of salt is important for radioactive waste disposal because this early period strongly controls the amount of brine in a salt repository. Brine leads to corrosion of waste forms and waste packages, and possible dissolution of radionuclides with brine transport being a potential transport vector to the accessible environment. The main test case used in Task E is the ongoing Brine Availability Test in Salt (BATS) heater test located underground at the Waste Isolation Pilot Plant (WIPP) near Carlsbad, New Mexico, USA. The Task was divided into a series of Steps. Step 0 was an introduction to processes in salt, that included matching historical unheated brine inflow data from boreholes at WIPP and matching temperature observations during BATS heater test 1a. Step 1 included validation of models against a thermo-poroelastic analytical solution relevant to heated boreholes in salt, and two-phase flow around an excavation in salt. Step 2 required all the individual components covered in steps 0 and 1 to come together to match observed brine inflow behavior during the BATS 1a heater test. There were a range of approaches from the teams, from mechanistic to prescriptive. Given the uncertainties in the problem, some teams used one- or two-dimensional models of the processes, while other teams included more geometrical complexity in three-dimensional models. The key learning points from Task E have been: • Heat conduction through salt typically requires non-linear thermal conductivity (as a function of temperature), but most models do a good job matching observations, given appropriate adjustments to the applied power and some thermocouple locations. • Thermal pressurization requires coupled thermal-hydrological-mechanical (THM) responses that consider the thermal expansion of the fluid and solid phases. • Initialization of two-phase flow models around a borehole or excavation in salt are more realistically represented as “wetting up”, rather than “drying down” (i.e., the initial state after excavation is mostly dry, rather than mostly wet). • The BATS 1a heater test includes a significant release of brine after the end of heating, which requires a large increase in permeability to recreate. Task E has been a great learning experience for all the teams involved, and feedback from the modeling teams has led to changes in the design of follow-on BATS experiments, which are now ongoing underground at WIPP. There was a balance throughout the task between freedom to model phenomena how each team saw fit, and prescriptiveness in problem design to bring the modeling teams closer together to allow attribution of smaller differences between models to different modeling choices. The modeling approaches seem to go through two phases: an early phase of discovery or testing, and a later phase of refinement and improvement. In future modeling efforts, different field data could be used (e.g., BATS 2) and more time should be included in the processes for teams to make multiple model refinement or even significant changes to their conceptual model or setup, based on lessons learned from the modeling exercise.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
NASA NTRS1995

Fast Spatio-Temporal Data Mining from Large Geophysical Datasets

Use of the UCLA CONQUEST (CONtent-based Querying in Space and Time) is reviewed for performance of automatic cyclone extraction and detection of spatio-temporal blocking conditions on MPP. CONQUEST is a data analysis environment for knowledge and data mining to aid in high-resolution modeling of climate modeling.

knowledge discovery data mining climate modeling c↗
DOE OSTI2025

Machine-Learning Analysis of Radiative Decays to Dark Matter at the LHC

The search for weakly interacting matter particles (WIMPs) is one of the main objectives of the High Luminosity Large Hadron Collider (HL-LHC). In this work we use Machine-Learning (ML) techniques to explore WIMP radiative decays into a Dark Matter (DM) candidate in a supersymmetric framework. The minimal supersymmetric WIMP sector includes the lightest neutralino that can provide the observed DM relic density through its co-annihilation with the second lightest neutralino and lightest chargino. Moreover, the direct DM detection cross section rates fulfill current experimental bounds and provide discovery targets for the same region of model parameters in which the radiative decay of the second lightest neutralino into a photon and the lightest neutralino is enhanced. This strongly motivates the search for radiatively decaying neutralinos which, however, suffers from strong backgrounds. We investigate the LHC reach in the search for these radiatively decaying particles by means of cut-based and ML methods and estimate its discovery potential in this well-motivated, new physics scenario. We demonstrate that using ML techniques would enable access to most of the parameter space unexplored by other searches.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Data-Driven Discovery of Active Nematic Hydrodynamics

Active nematics can be modeled using phenomenological continuum theories that account for the dynamics of the nematic director and fluid velocity through partial differential equations (PDEs). While these models provide a statistical description of the experiments, the relevant terms in the PDEs and their parameters are usually identified indirectly. We adapt a recently developed method to automatically identify optimal continuum models for active nematics directly from spatio-temporal data, via sparse regression of the coarse-grained fields onto generic low order PDEs. After extensive benchmarking, we apply the method to experiments with microtubule-based active nematics, finding a surprisingly minimal description of the system. Furthermore, our approach can be generalized to gain insights into active gels, microswimmers, and diverse other experimental active matter systems.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
NASA NTRS2006

Application of State Analysis and Goal-Based Operations to a MER Mission Scenario

State Analysis is a model-based systems engineering methodology employing a rigorous discovery process which articulates operations concepts and operability needs as an integrated part of system design. The process produces requirements on system and software design in the form of explicit models which describe the behavior of states and the relationships among them. By applying State Analysis to an actual MER flight mission scenario, this study addresses the specific real world challenges of complex space operations and explores technologies that can be brought to bear on future missions. The paper describes the tools currently used on a daily basis for MER operations planning and provides an in-depth description of the planning process, in the context of a Martian day's worth of rover engineering activities, resource modeling, flight rules, science observations, and more. It then describes how State Analysis allows for the specification of a corresponding goal-based sequence that accomplishes the same objectives, with several important additional benefits.

mission planning↗
DOE OSTI2021

IMPECCABLE: Integrated Modeling Pipeline for COVID Cure by Assessing Better Leads

ABSTRACT The drug discovery process currently employed in the pharmaceutical industry typically requires about 10 years and $2-3 billion to deliver one new drug. This is both too expensive and too slow, especially in emergencies like the COVID-19 pandemic. In silico methodologies need to be improved both to select better lead compounds, so as to improve the efficiency of later stages in the drug discovery protocol, and to identify those lead compounds more quickly. No known methodological approach can deliver this combination of higher quality and speed. Here, we describe an Integrated Modeling PipEline for COVID Cure by Assessing Better LEads (IMPECCABLE) that employs multiple methodological innovations to overcome this fundamental limitation. We also describe the computational framework that we have developed to support these innovations at scale, and characterize the performance of this framework in terms of throughput, peak performance, and scientific results. We show that individual workflow components deliver 100× to 1000× improvement over traditional methods, and that the integration of methods, supported by scalable infrastructure, speeds up drug discovery by orders of magnitudes. IMPECCABLE has screened ~10 11 ligands and has been used to discover a promising drug candidate. These capabilities have been used by the US DOE National Virtual Biotechnology Laboratory and the EU Centre of Excellence in Computational Biomedicine.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Accurate and uncertainty-aware multi-task prediction of HEA properties using prior-guided deep Gaussian processes

Surrogate modeling techniques have become indispensable in accelerating the discovery and optimization of high-entropy alloys (HEAs), especially when integrating computational predictions with sparse experimental observations. This study systematically evaluates the training and testing performance of four prominent surrogate models—conventional Gaussian processes (cGP), Deep Gaussian processes (DGP), encoder-decoder neural networks for multi-output regression and eXtreme Gradient Boosting (XGBoost)—applied to a hybrid dataset of experimental and computational properties of the 8-component HEA system Al-Co-Cr-Cu-Fe-Mn-Ni-V. We specifically assess their capabilities in predicting correlated material properties, including yield strength, hardness, modulus, ultimate tensile strength, elongation, and average hardness under dynamic/quasi-static conditions, alongside auxiliary computational properties. The comparison highlights the strengths of hierarchical deep modeling approaches in handling heteroscedastic, heterotopic, and incomplete data commonly encountered in materials science. Our findings illustrate that combined surrogate models such as DGPs infused with machine-learned priors outperform other surrogates by effectively capturing inter-property correlations and by assimilating prior knowledge. This enhanced predictive accuracy positions the combined surrogate models as powerful tools for robust and data-efficient materials design.

36 MATERIALS SCIENCE↗
DOE OSTI2023

A GPT‐4 Reticular Chemist for Guiding MOF Discovery**

Abstract We present a new framework integrating the AI model GPT‐4 into the iterative process of reticular chemistry experimentation, leveraging a cooperative workflow of interaction between AI and a human researcher. This GPT‐4 Reticular Chemist is an integrated system composed of three phases. Each of these utilizes GPT‐4 in various capacities, wherein GPT‐4 provides detailed instructions for chemical experimentation and the human provides feedback on the experimental outcomes, including both success and failures, for the in‐context learning of AI in the next iteration. This iterative human‐AI interaction enabled GPT‐4 to learn from the outcomes, much like an experienced chemist, by a prompt‐learning strategy. Importantly, the system is based on natural language for both development and operation, eliminating the need for coding skills, and thus, make it accessible to all chemists. Our collaboration with GPT‐4 Reticular Chemist guided the discovery of an isoreticular series of MOFs, with each synthesis fine‐tuned through iterative feedback and expert suggestions. This workflow presents a potential for broader applications in scientific research by harnessing the capability of large language models like GPT‐4 to enhance the feasibility and efficiency of research activities.

Chemistry↗
DOE OSTI2022

Structure-based discovery of potent WD repeat domain 5 inhibitors that demonstrate efficacy and safety in preclinical animal models

WD repeat domain 5 (WDR5) is a core scaffolding component of many multiprotein complexes that perform a variety of critical chromatin-centric processes in the nucleus. WDR5 is a component of the mixed lineage leukemia MLL/SET complex and localizes MYC to chromatin at tumor-critical target genes. As a part of these complexes, WDR5 plays a role in sustaining oncogenesis in a variety of human cancers that are often associated with poor prognoses. Thus, WDR5 has been recognized as an attractive therapeutic target for treating both solid and hematological tumors. Previously, small-molecule inhibitors of the WDR5-interaction (WIN) site and WDR5 degraders have demonstrated robust in vitro cellular efficacy in cancer cell lines and established the therapeutic potential of WDR5. However, these agents have not demonstrated significant in vivo efficacy at pharmacologically relevant doses by oral administration in animal disease models. We have discovered WDR5 WIN-site inhibitors that feature bicyclic heteroaryl P 7 units through structure-based design and address the limitations of our previous series of small-molecule inhibitors. Importantly, our lead compounds exhibit enhanced on-target potency, excellent oral pharmacokinetic (PK) profiles, and potent dose-dependent in vivo efficacy in a mouse MV4:11 subcutaneous xenograft model by oral dosing. Furthermore, these in vivo probes show excellent tolerability under a repeated high-dose regimen in rodents to demonstrate the safety of the WDR5 WIN-site inhibition mechanism. Collectively, our results provide strong support for WDR5 WIN-site inhibitors to be utilized as potential anticancer therapeutics.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

Scaling Laws of Graph Neural Networks for Atomistic Materials Modeling

Atomistic materials modeling is a critical task with wide-ranging applications, from drug discovery to materials science, where accurate predictions of the target material property can lead to significant advancements in scientific discovery. Graph Neural Networks (GNNs) represent the state-of-the-art approach for modeling atomistic material data thanks to their capacity to capture complex relational structures. While machine learning performance has historically improved with larger models and datasets, GNNs for atomistic materials modeling remain relatively small compared to large language models (LLMs), which leverage billions of parameters and terabyte-scale datasets to achieve remarkable performance in their respective domains. To address this gap, we explore the scaling limits of GNNs for atomistic materials modeling by developing a foundational model with billions of parameters, trained on extensive datasets in terabytescale. Our approach incorporates techniques from LLM libraries to efficiently manage large-scale data and models, enabling both effective training and deployment of these large-scale GNN models. This work addresses three fundamental questions in scaling GNNs: the potential for scaling GNN model architectures, the effect of dataset size on model accuracy, and the applicability of LLM-inspired techniques to GNN architectures. Specifically, the outcomes of this study include (1) insights into the scaling laws for GNNs, highlighting the relationship between model size, dataset volume, and accuracy, (2) a foundational GNN model optimized for atomistic materials modeling, and (3) a GNN codebase enhanced with advanced LLM-based training techniques. Our findings lay the groundwork for large-scale GNNs with billions of parameters and terabyte-scale datasets, establishing a scalable pathway for future advancements in atomistic materials modeling.

Li, Chaojian [ORNL] (ORCID:0000000340309777)↗
NASA NTRS2000

Development and Application of Computational/In Vitro Toxicological Methods for Chemical Hazard Risk Reduction of New Materials for Advanced Weapon Systems

The development of quantitative structure-activity relationship (QSAR) is essential for reducing the chemical hazards of new weapon systems. The current collaboration between HEST (toxicology research and testing), MLPJ (computational chemistry) and PRS (computational chemistry, new propellant synthesis) is focusing R&D efforts on basic research goals that will rapidly transition to useful products for propellant development. Computational methods are being investigated that will assist in forecasting cellular toxicological end-points. Models developed from these chemical structure-toxicity relationships are useful for the prediction of the toxicological endpoints of new related compounds. Research is focusing on the evaluation tools to be used for the discovery of such relationships and the development of models of the mechanisms of action. Combinations of computational chemistry techniques, in vitro toxicity methods, and statistical correlations, will be employed to develop and explore potential predictive relationships; results for series of molecular systems that demonstrate the viability of this approach are reported. A number of hydrazine salts have been synthesized for evaluation. Computational chemistry methods are being used to elucidate the mechanism of action of these salts. Toxicity endpoints such as viability (LDH) and changes in enzyme activity (glutahoione peroxidase and catalase) are being experimentally measured as indicators of cellular damage. Extrapolation from computational/in vitro studies to human toxicity, is the ultimate goal. The product of this program will be a predictive tool to assist in the development of new, less toxic propellants.

Frazier, John M.↗
DOE OSTI2025

Distributed Cross-Channel Hierarchical Aggregation for Foundation Models

Vision-based scientific foundation models hold significant promise for advancing scientific discovery and innovation. This potential stems from their ability to aggregate images from diverse sources—such as varying physical groundings or data acquisition systems—and to learn spatio-temporal correlations using transformer architectures. However, tokenizing and aggregating images can be compute-intensive, a challenge not fully addressed by current distributed methods. In this work, we introduce the Distributed Cross-Channel Hierarchical Aggregation (D-CHAG) approach designed for datasets with a large number of channels across image modalities. Our method is compatible with any model-parallel strategy and any type of vision transformer architecture, significantly improving computational efficiency. We evaluated D-CHAG on hyperspectral imaging and weather forecasting tasks. When integrated with tensor parallelism and model sharding, our approach achieved up to a 75% reduction in memory usage and more than doubled sustained throughput on up to 1,024 AMD GPUs on the Frontier Supercomputer.

Tsaris, Aristeidis (aris) [ORNL] (ORCID:0000000277↗
NASA NTRS1980

Discovery of intrinsic linear polarization in SS433

Observations of variable linear polarization in the optical range in the unique radio and X-ray source SS 433, which is characterized by moving emission lines in its visible and near-IR spectra, are reported. The observations were made with an unfiltered GaAs photocathode covering the spectral region 3000-9000 A, with a passband characteristic wavelength near 7000 A. Measurements reveal the presence of both a long-term and a very short time-scale variation in linear polarization in the continuum and in H-alpha, which indicate that a substantial fraction of the polarization is intrinsic to SS 433 and not produced in the interstellar medium. It is suggested that the most likely source of polarization in the optical continuum is electron scattering, and constraints on models of SS 433 implied by the discovery of intrinsic polarization are considered.

Mclean, I. S.↗
DOE OSTI2023

Toward the discovery of matter creation with neutrinoless β β decay

The discovery of neutrinoless ββ decay could soon be within reach. This hypothetical ultrarare nuclear decay offers a privileged portal to physics beyond the standard model of particle physics. Its observation would constitute the discovery of a matter-creating process, corroborating leading theories of why the Universe contains more matter than antimatter, and how forces unify at high energy scales. It would also prove that neutrinos and antineutrinos are not two distinct particles but can transform into each other, with their mass described by a unique mechanism conceived by Majorana. The recognition that neutrinos are not massless necessitates an explanation and has boosted interest in neutrinoless ββ decay. The field stands now at a turning point. Further, a new round of experiments is currently being prepared for the next decade to cover an important region of parameter space. In parallel, advances in nuclear theory are laying the groundwork to connect the nuclear decay with the underlying new physics. Meanwhile, the particle theory landscape continues to find new motivations for neutrinos to be their own antiparticle. This review brings together the experimental, nuclear theory, and particle theory aspects connected to neutrinoless ββ decay to explore the path toward, and beyond, its discovery.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
NASA NTRS2021

New Candidate Extreme T Subdwarfs from the Backyard Worlds: Planet 9 Citizen Science Project

Schneider et al. presented the discovery of WISEA J041451.67−585456.7 and WISEA J181006.18−101000.5, which appear to be the first examples of extreme T-type subdwarfs (esdTs; metallicity ≤−1 dex, T(eff) ≲ 1400 K). Here, we present new discoveries and follow-up of three T-type subdwarf candidates, with an eye toward expanding the sample of such objects with very low metallicity and extraordinarily high kinematics, properties that suggest membership in the Galactic halo. Keck/NIRES near-infrared spectroscopy of WISEA J155349.96+693355.2, a fast-moving object discovered by the Backyard Worlds: Planet 9 citizen science project, confirms that it is a mid-T subdwarf. With H(W2) = 22.3 mag, WISEA J155349.96+693355.2 has the largest W2 reduced proper motion among all spectroscopically confirmed L and T subdwarfs, suggesting that it may be kinematically extreme. Nevertheless, our modeling of the WISEA J155349.96+693355.2 near-infrared spectrum indicates that its metallicity is only mildly subsolar. In analyzing the J155349.96+693355.2 spectrum, we present a new grid of low-temperature, low-metallicity model atmosphere spectra. We also present the discoveries of two new esdT candidates, CWISE J073844.52−664334.6 and CWISE J221706.28−145437.6, based on their large motions and colors similar to those of the two known esdT objects. Finding more esdT examples is a critical step toward mapping out the spectral sequence and observational properties of this newly identified population.

Aaron M. Meisner↗
DOE OSTI2022

Watershed Workflow: A toolset for parameterizing data-intensive, integrated hydrologic models

Integrated, distributed hydrologic models leverage advances in computational power and data accessibility to improve predictive understanding of the water cycle. While impressive advances in this area of environmental modeling have been accomplished, such models are still rarely used, partially because of difficulty integrating model and data. This research describes the release of Watershed Workflow version 1.2, a new library aiming to automate and enable complex workflows defining inputs to high resolution, integrated, distributed hydrologic models. Watershed Workflow provides tools enabling the discovery, acquisition, mapping, and coordination of watershed geometry, land cover, soil properties, and meteorological data. It enables the construction of unstructured meshes that incorporate this data, and provides tools for automating a “first” simulation on any watershed in the United States. We present the design of the workflow tool, and describe best practices for its usage, culminating in a final example from watershed specification to simulation at the Coweeta Hydrologic Laboratory.

Integrated hydrologic modeling↗
NASA NTRS1995

LDEF contributions to cosmic ray and radiation environments research

LDEF-1 carried three experiments which are producing significant advances in our knowledge of ultra heavy and anomalous cosmic rays, solar flare particles, and heavy nuclei in the trapped belts. Nine other experiments made measurements on the radiation environments or performed dosmetric monitoring. Data from those experiments, and from measurements of induced radioactivity in LDEF components have significantly improved our knowledge of LEO radiation environment. Measurements at various locations shielding depths of radiation absorbed dose, linear energy transfer spectra, proton, neutron and heavy ion fluences, and induced radioactivity have been made, and many of these results have been compared to models. This has allowed the assessment of accuracy, and the potential for improvement, of the models. Serendipitous results from the radiation measurements include the discovery of atmospheric Be-7 plated on the front surface of LDEF, which has motivated a series of new investigations. A sample of measurements and modeling results will be presented, as well as the status of archiving the measurements and models.

Parnell, Thomas A.↗