Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “ML T&E”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

ClimSim: A large multi-scale dataset for hybrid physics-ML climate emulation

Modern climate projections lack adequate spatial and temporal resolution due to computational constraints. A consequence is inaccurate and imprecise predictions of critical processes such as storms. Hybrid methods that combine physics with machine learning (ML) have introduced a new generation of higher fidelity climate simulators that can sidestep Moore’s Law by outsourcing compute-hungry, short, high-resolution simulations to ML emulators. However, this hybrid ML-physics simulation approach requires domain-specific treatment and has been inaccessible to MLexperts because of lack of training data and relevant, easy-to-use workflows. Wepresent ClimSim, the largest-ever dataset designed for hybrid ML-physics research. It comprises multi-scale climate simulations, developed by a consortium of climate scientists and ML researchers. It consists of 5.7 billion pairs of multivariate input and output vectors that isolate the influence of locally-nested, high-resolution, high-fidelity physics on a host climate simulator’s macro-scale physical state. The dataset is global in coverage, spans multiple years at high sampling frequency, and is designed such that resulting emulators are compatible with downstream coupling into operational climate simulators. We implement a range of deterministic and stochastic regression baselines to highlight the ML challenges and their scoring. The data (https://huggingface.co/datasets/LEAP/ClimSim_high-res2) and code(https://leap-stc.github.io/ClimSim)arereleasedopenlytosupport the development of hybrid ML-physics and high-fidelity climate simulations for the benefit of science and society.

artificial intelligence, machine learning↗

Machine Learning in Infectious Disease for Risk Factor Identification and Hypothesis Generation: Proof of Concept Using Invasive Candidiasis

Machine learning (ML) models can handle large data sets without assuming underlying relationships and can be useful for evaluating disease characteristics, yet they are more commonly used for predicting individual disease risk than for identifying factors at the population level. We offer a proof of concept applying random forest (RF) algorithms to Candida-positive hospital encounters in an electronic health record database of patients in the United States. Candida-positive encounters were extracted from the Cerner HealthFacts database; invasive infections were laboratory-positive sterile site Candida infections. Features included demographics, admission source, care setting, physician specialty, diagnostic and procedure codes, and medications received before the first positive Candida culture. We used RF to assess risk factors for 3 outcomes: any invasive candidiasis (IC) vs non-IC, within-species IC vs non-IC (eg, invasive C. glabrata vs noninvasive C. glabrata), and between-species IC (eg, invasive C. glabrata vs all other IC). Fourteen of 169 (8%) variables were consistently identified as important features in the ML models. When evaluating within-species IC, for example, invasive C. glabrata vs non-invasive C. glabrata, we identified known features like central venous catheters, intensive care unit stay, and gastrointestinal operations. In contrast, important variables for invasive C. glabrata vs all other IC included renal disease and medications like diabetes therapeutics, cholesterol medications, and antiarrhythmics. Known and novel risk factors for IC were identified using ML, demonstrating the hypothesis-generating utility of this approach for infectious disease conditions about which less is known, specifically at the species level or for rarer diseases.

60 APPLIED LIFE SCIENCES↗

Machine Learning in the Context of Laser-Induced Breakdown Spectroscopy

The integration of machine learning (ML) with Laser-Induced Breakdown Spectroscopy (LIBS) has revolutionized the analytical capabilities of LIBS. The combi-nation of both methods enables more accurate and efficient data analysis. While LIBS itself is a powerful technique for elemental analysis, the vast amount of spectral data it generates can be hard to interpret. Machine learning addresses these challenges by leveraging algorithms that can learn from data, identify patterns, and make predictions without explicit programming for the interpretation of each specific task. In LIBS application, ML techniques are used to enhance various analytical processes. For example, ML algorithms can classify materials based on their spectral fingerprints, predict the concentration of elements in a sample, and identify underlying patterns within complex datasets. Here, this application improves the precision of LIBS analyses while significantly reducing the time required for data processing and interpretation. In this chapter, the fundamental concepts of ML will be discussed first. Following this, the process of data splitting and the importance of feature selection will be examined. Several machine learning methods will then be closely examined, exploring how each can benefit LIBS analysis and highlighting their respective advantages and shortcomings. This structured approach will provide a comprehensive understanding of the integration of ML in the context of LIBS analysis.

47 OTHER INSTRUMENTATION↗

Final Report in Response to ARPA-E Contract Award Number DE-AR0001157

Autonomous operations and maintenance (O&M) by robots has been identified as a key technology to facilitate both the safe operation, and reduced operational costs associated with future nuclear reactors. Radiation and thermal environments, particularly associated with molten salt reactor designs, excludes the use of human proximity and so there is a need to train robots for tasks that have not yet been fully identified, or for accidents that may occur in the future. This program sought to develop a generic methodology that could be applied to train ‘any’ robot, to perform ‘any’ task, through the use of machine learning (ML) training performed in a virtual reality (VR) environment that simulates the physically perceived task(s). The VR environment allows us to construct ‘any’ future task and the ML approach, which included reinforcement learning (RL), allowed us to generate extensive data sets that can be used to establish control algorithms to thereby control the physical robot in the physical environment.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Manipulating Excitonic Quantum Droplets in Two-Dimensional CdSe Nanoplatelets via Thickness and Core/Shell Morphology

Recently, photoexcitation of high-density 4 or 5 monolayer (ML) thick CdSe nanoplatelet films at temperatures below ~200K was observed to produce pump-intensitydependent, superlinear, progressively red-shifted light output due to amplified spontaneous emission (ASE) from polyexcitonic species, distinct from biexcitonic ASE. These polyexcitonic species comprise Coulombically bound multiexciton states, termed “quantum droplets”, that form when multiexciton binding energy exceeds thermal energy fluctuations. In this work, we investigate thinner samples as well as core/shell nanoplatelet films and find that the 3 ML sample supports quantum droplet ASE up to higher temperatures than the 4 or 5 ML whereas core/shell structures suppress this form of ASE even at very low sample temperatures despite observable biexcitonic ASE, suggesting that the reduced or repulsive Coulomb binding energy of multiple excitons suppresses quantum droplets. These findings help to add understanding of routes to harness quantum droplet optical nonlinearities.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Perspectives on Systematic Cloud Microphysics Scheme Development With Machine Learning

Cloud microphysics—the collection of processes that govern the small‐scale formation, evolution, and interactions of liquid droplets and ice crystals in clouds and precipitation—remains a major source of uncertainty in weather and climate models. Although too small in scale to be explicitly resolved in any large‐eddy simulation, weather, or climate model, the representation of cloud microphysical processes has significant impact at the climate scale. Current microphysical schemes are limited by both parametric uncertainty, linked to uncertainty in physical parameter values, and structural uncertainty, arising from incomplete physical understanding of the processes at play or approximations made for computational efficiency. Recent advances in the application of machine learning (ML) to the physical sciences show significant potential for minimizing these limitations by leveraging high‐fidelity simulations and observations. Here we outline the challenges that must be addressed to apply ML toward cloud microphysics scheme development. This perspectives paper synthesizes recent progress in using data‐driven methods, including ML, to improve cloud microphysics parameterizations and highlights opportunities to address key uncertainties. We discuss the roles of aleatoric (irreducible, or statistical) and epistemic (reducible, or systematic) errors in contributing to microphysics parameterization uncertainty. ML can leverage observations to improve microphysical schemes via bottom‐up and top‐down constraints. Methods such as differentiable programming and ML‐enhanced sampling strategies and the creation of large scale benchmark data sets promise to bridge the gap between observations and models and to improve the consistency of cloud microphysical representation across temporal and spatial scales.

Lamb, Kara D. [Columbia Univ., New York, NY (Unite↗

Sandtank-ML: An Educational Tool at the Interface of Hydrology and Machine Learning

Hydrologists and water managers increasingly face challenges associated with extreme climatic events. At the same time, historic datasets for modeling contemporary and future hydrologic conditions are increasingly inadequate. Machine learning is one promising technological tool for navigating the challenges of understanding and managing contemporary hydrological systems. However, in addition to the technical challenges associated with effectively leveraging ML for understanding subsurface hydrological processes, practitioner skepticism and hesitancy surrounding ML presents a significant barrier to adoption of ML technologies among practitioners. In this paper, we discuss an educational application we have developed—Sandtank-ML—to be used as a training and educational tool aimed at building user confidence and supporting adoption of ML technologies among water managers. We argue that supporting the adoption of ML methods and technologies for subsurface hydrological investigations and management requires not only the development of robust technologic tools and approaches, but educational strategies and tools capable of building confidence among diverse users.

54 ENVIRONMENTAL SCIENCES↗

Fine-Root Ecology Database (FRED): A Global Collection of Root Trait Data with Coincident Site, Vegetation, Edaphic, and Climatic Data, Version 3.

To address the need for a centralized root trait database, we compiled the Fine-Root Ecology Database (FRED) from published and unpublished data sources. We have continued to add to the FRED database since the release of FRED 2.0 in 2018, and a new version of FRED is now available. FRED 3.0 has more than 150,000 observations of more than 330 root traits, with data collected from more than 1400 data sources. FRED 3.0 has 45% more root trait observations than FRED 2.0, particularly in the categories of root anatomy, morphology, and microbial associations; ancillary data on associated site, vegetation, edaphic, and climatic conditions from across the globe have also increased concurrently. FRED is focused on fine roots (traditionally defined as roots less than 2 mm in diameter), as coarse roots are studied using different methodology, often at very different scales, and have different traits and trait interpretations. However, FRED accepts data collected from roots of all sizes, and already contains several observations of coarse roots. Data collection will continue for the foreseeable future.

54 ENVIRONMENTAL SCIENCES↗

Controlling Bacterial Contamination During Fuel Ethanol Fermentation Using Thermochemically Depolymerized Lignin Bio-Oils

Lactic acid bacteria (LAB) contamination during fuel ethanol fermentation can lead to significant economic loses. To circumvent this, fuel ethanol plants add antibiotics prophylactically, but their overuse has resulted in the emergence of antibiotic-resistant LAB strains. Lignin is a sustainable biopolymer that can be found as a waste product from lignocellulosic biorefineries. Technical lignins and their smaller phenolic subunits have been shown to exhibit broad-spectrum antimicrobial properties, but there is a lack of demonstrations of lignin derivatives with highly selective properties in the literature. Here, corn stover lignin from a biorefinery was oxidatively depolymerized using an environmentally benign organic oxidant, peracetic acid, into a bio-oil that has selective antimicrobial properties against LAB and not yeasts. The resulting bio-oil demonstrated up to 90% inhibition of commercially sampled LAB (including antibiotic-resistant strains) at 4 mg ml-1 with no inhibition against an industrial yeast strain. These antimicrobial properties of the bio-oil are attributed to larger unidentified lignin oligomers, compared to monolignols, that have a membrane damaging mode of action. Using the bio-oil (4 mg ml-1) during simultaneous saccharification and fermentation (SSF) of raw corn starch showed no inhibition of enzymatic activity, and in LAB contaminated fermentations the bio-oil treatments showed an 8% increase in ethanol yields at higher bacterial contamination ratios (l : 100 yeast to LAB, CFU per ml). This study illustrates the efficacy of using lignin bio-oil as an antibiotic replacement during fuel ethanol fermentation and demonstrates the highly selective antimicrobial properties of lignin oligomers, which creates a viable lignin valorization strategy for biorefineries.

bio-oil↗

Efficient and Selective Chemical Transformations in Highly Charged and Confined Nanodroplets

The acceleration of chemical reaction rates and the increased product selectivity in microdroplets compared to that in bulk solutions has become a topic of increasing interest that has been extensively characterized by electrospray ionization mass spectrometry (ESI-MS). However, the sources of this acceleration and the detailed relationships between droplet properties and resulting reaction rate acceleration are still under debate. Moreover, droplet properties are governed by multiple interrelated experimental parameters, i.e., electrospray voltage, solution flow rate, etc., which makes it difficult and time-consuming to explore this diverse parameter space using traditional manual experimental or computational approaches. In this work, we developed an automated experimental platform integrating reactions in controlled charged microdroplet environments with ESI-MS characterization and sequential hybrid Bayesian modeling, as well as an optimal experimental design framework, to achieve multidimensional parameter optimization for higher reaction turnover rates, based on a model reaction of tetraethylenepentamine (TEPA) with carbon dioxide. With the current platform, we have achieved automated scans with a range of electrospray voltages and solution flow rates, and determined and optimized parameter settings to achieve increased reaction turnovers. We have also linked this platform to the underlying properties of droplets via a hybrid model incorporating physics, high-level theoretical calculations, and machine learning (ML) approaches. The autonomous platform is broadly applicable to a range of chemical reactions relevant to DOE’s mission in chemical separations, catalysis, and materials synthesis.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Connectivity‐based parcellation of normal and anatomically distorted human cerebral cortex

Abstract For over a century, neuroscientists have been working toward parcellating the human cortex into distinct neurobiological regions. Modern technologies offer many parcellation methods for healthy cortices acquired through magnetic resonance imaging. However, these methods are suboptimal for personalized neurosurgical application given that pathology and resection distort the cerebrum. We sought to overcome this problem by developing a novel connectivity‐based parcellation approach that can be applied at the single‐subject level. Utilizing normative diffusion data, we first developed a machine‐learning (ML) classifier to learn the typical structural connectivity patterns of healthy subjects. Specifically, the Glasser HCP atlas was utilized as a prior to calculate the streamline connectivity between each voxel and each parcel of the atlas. Using the resultant feature vector, we determined the parcel identity of each voxel in neurosurgical patients ( n = 40) and thereby iteratively adjusted the prior. This approach enabled us to create patient‐specific maps independent of brain shape and pathological distortion. The supervised ML classifier re‐parcellated an average of 2.65% of cortical voxels across a healthy dataset ( n = 178) and an average of 5.5% in neurosurgical patients. Our patient dataset consisted of subjects with supratentorial infiltrating gliomas operated on by the senior author who then assessed the validity and practical utility of the re‐parcellated diffusion data. We demonstrate a rapid and effective ML parcellation approach to parcellation of the human cortex during anatomical distortion. Our approach overcomes limitations of indiscriminately applying atlas‐based registration from healthy subjects by employing a voxel‐wise connectivity approach based on individual data.

59 BASIC BIOLOGICAL SCIENCES↗

E-PINNs: Epistemic Physics-Informed Neural Networks

Physics-informed neural networks (PINNs) have demonstrated promise as a framework for solving forward and inverse problems involving partial differential equations. Despite recent progress in the field, it remains challenging to quantify uncertainty in these networks. While techniques such as Bayesian PINNs (B-PINNs) provide a principled approach to capturing epistemic uncertainty through Bayesian inference, they can be computationally expensive for large-scale applications. In this work, we propose Epistemic Physics-Informed Neural Networks (E-PINNs), a framework that uses a small network, the epinet, to efficiently quantify epistemic uncertainty in PINNs. The proposed approach works as an add-on to existing, pre-trained PINNs with a small computational overhead. We demonstrate the applicability of the proposed framework in various test cases and compare the results with B-PINNs using Hamiltonian Monte Carlo (HMC) posterior estimation and dropout-equipped PINNs (Dropout-PINNs). In our experiments, E-PINNs achieve calibrated coverage with competitive sharpness at substantially lower cost. We demonstrate that when B-PINNs produce narrower bands, they under-cover in our tests. E-PINNs also show better calibration than Dropout-PINNs in these examples, indicating a favorable accuracy-efficiency trade-off.

AI for Science↗

Advances in machine-learning-based sampling motivated by lattice quantum chromodynamics

Sampling from known probability distributions is a ubiquitous task in computational science, underlying calculations in domains from linguistics to biology and physics. Generative machine-learning (ML) models have emerged as a promising tool in this space, building on the success of this approach in applications such as image, text, and audio generation. Often, however, generative tasks in scientific domains have unique structures and features—such as complex symmetries and the requirement of exactness guarantees—that present both challenges and opportunities for ML. This Perspective outlines the advances in ML-based sampling motivated by lattice quantum field theory, in particular for the theory of quantum chromodynamics. Enabling calculations of the structure and interactions of matter from our most fundamental understanding of particle physics, lattice quantum chromodynamics is one of the main consumers of open-science supercomputing worldwide. Here, the design of ML algorithms for this application faces profound challenges, including the necessity of scaling custom ML architectures to the largest supercomputers, but also promises immense benefits, and is spurring a wave of development in ML-based sampling more broadly. In lattice field theory, if this approach can realize its early promise it will be a transformative step towards first-principles physics calculations in particle, nuclear and condensed matter physics that are intractable with traditional approaches.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Demonstration of machine-learning-enhanced Bayesian quantum state estimation

Machine learning (ML) has found broad applicability in quantum information science in topics as diverse as experimental design, state classification, and even studies on quantum foundations. Here, we experimentally realize an approach for defining custom prior distributions that are automatically tuned using ML for Bayesian quantum state estimation methods that generally better conform to the physical properties of the underlying system than standard fixed prior distributions. Previously, researchers have looked to Bayesian quantum state tomography for advantages like uncertainty quantification, the return of reliable estimates under any measurement condition, and minimal mean-squared error. However, practical challenges related to long computation times and conceptual issues concerning how to incorporate prior knowledge most suitably can overshadow these benefits. Using both simulated and experimental measurement results, we demonstrate that ML-defined prior distributions reduce net convergence times and provide a natural way to incorporate both implicit and explicit information directly into the prior distribution. These results constitute a promising path toward practical implementations of Bayesian quantum state tomography.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Small signaling peptides, phylogenetic analysis

ML Phylogenetic analysis of small signaling peptides in Arabidopsis, Sorghum bicolor, Rice, Wheat, Maize, and Brachypodium. Sorghum only phylogenetic trees were used to name genes. All trees but RALF tree are rooted at midpoint.

Kurtz, Evan [Department of Biochemistry and Biophy↗

Generalist multimodal AI: A review of architectures, challenges and opportunities

Multimodal models are expected to be a critical component to future advances in artificial intelligence. Here, this field is starting to grow rapidly with a surge of new design elements motivated by the success of foundation models in natural language processing (NLP) and vision. It is widely hoped that further extending the foundation models to multiple modalities (e.g., text, image, video, sensor, time series, graph, etc.) will ultimately lead to generalist multimodal models, i.e. one model across different data modalities and tasks. However, there is little research that systematically analyzes recent multimodal models (particularly the ones that work beyond text and vision) with respect to the underling architecture proposed. Therefore, this work provides a fresh perspective on generalist multimodal models (GMMs) via a novel architecture and training configuration specific taxonomy. This includes factors such as Unifiability, Modularity, and Adaptability that are pertinent and essential to the wide adoption and application of GMMs. The review further highlights key challenges and prospects for the field and guide the researchers into the new advancements.

Artificial intelligence (AI)↗

A Vision for Coupling Operation of US Fusion Facilities with HPC Systems and the Implications for Workflows and Data Management

The operation of large US Department of Energy (DOE) research facilities, like the DIII-D National Fusion Facility, results in the collection of complex multi-dimensional scientific datasets, both experimental and model-generated. In the future, it is envisioned that integrated data analysis coupled with large-scale high performance computing (HPC) simulations will be used to improve experimental planning and operation. Practically, massive data sets from these simulations provide the physics basis for generation of both reduced semi-analytic and machine-learning-based models. Storage of both HPC simulation datasets (generated from US DOE leadership computing facilities) and experimental datasets presents significant challenges. In this paper, we present a vision for a DOE-wide data management workflow that integrates US DOE fusion facilities with leadership computing facilities. Data persistence and long-term availability beyond the length of allocated projects is essential, particularly for verification and recalibration of artificial intelligence and machine learning (AI/ML) models. Because these data sets are often generated and shared among hundreds of users across multiple leadership computing facility centers, they would benefit from cross-platform accessibility, persistent identifiers (e.g. DOI, or digital object identifier), and provenance tracking. Here, the ability to handle different data access patterns suggests that a combination of low cost, high latency (e.g. for storing ML training sets) and high cost, low latency systems (e.g. for real-time, integrated machine control feedback) may be needed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

The Simons Observatory: HoloSim-ML: machine learning applied to the efficient analysis of radio holography measurements of complex optical systems

Near-field radio holography is a common method for measuring and aligning mirror surfaces for millimeter and sub-millimeter telescopes. In instruments with more than a single mirror, degeneracies arise in the holography measurement, requiring multiple measurements and new fitting methods. We present HoloSim-ML, a Python code for beam simulation and analysis of radio holography data from complex optical systems. This code uses machine learning to efficiently determine the position of hundreds of mirror adjusters on multiple mirrors with few micron accuracy. We apply this approach to the example of the Simons Observatory 6m telescope.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗