Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Scientific method”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

A survey of numerical linear algebra methods utilizing mixed-precision arithmetic

The efficient utilization of mixed-precision numerical linear algebra algorithms can offer attractive acceleration to scientific computing applications. Especially with the hardware integration of low-precision special-function units designed for machine learning applications, the traditional numerical algorithms community urgently needs to reconsider the floating point formats used in the distinct operations to efficiently leverage the available compute power. In this study, we provide a comprehensive survey of mixed-precision numerical linear algebra routines, including the underlying concepts, theoretical background, and experimental results for both dense and sparse linear algebra problems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Code for BALDR Study 07.05 v.1.0.0

SAND2024-01293O The Code for BALDR Study 07.05 software reproduces results from the BALDR study concerning "A Semi-Supervised Learning Method to Produce Explainable Radioisotope Proportion Estimates for NaI-based Synthetic and Measured Gamma Spectra." The code for BALDR Study 07.05 can reproduce a scientific study following the step numbers within the file names. Using synthetic and measured data to find the best model for the radioisotope proportion estimation task of interest, the study generated results for inclusion in a paper. The high-level methods involved are neural networks, semi-supervised learning, and out-of-distribution detection. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Morrow, Tyler↗
DOE OSTI2023

The LSST AGN Data Challenge: Selection Methods

Abstract Development of the Rubin Observatory Legacy Survey of Space and Time (LSST) includes a series of Data Challenges (DCs) arranged by various LSST Scientific Collaborations that are taking place during the project's preoperational phase. The AGN Science Collaboration Data Challenge (AGNSC-DC) is a partial prototype of the expected LSST data on active galactic nuclei (AGNs), aimed at validating machine learning approaches for AGN selection and characterization in large surveys like LSST. The AGNSC-DC took place in 2021, focusing on accuracy, robustness, and scalability. The training and the blinded data sets were constructed to mimic the future LSST release catalogs using the data from the Sloan Digital Sky Survey Stripe 82 region and the XMM-Newton Large Scale Structure Survey region. Data features were divided into astrometry, photometry, color, morphology, redshift, and class label with the addition of variability features and images. We present the results of four submitted solutions to DCs using both classical and machine learning methods. We systematically test the performance of supervised models (support vector machine, random forest, extreme gradient boosting, artificial neural network, convolutional neural network) and unsupervised ones (deep embedding clustering) when applied to the problem of classifying/clustering sources as stars, galaxies, or AGNs. We obtained classification accuracy of 97.5% for supervised models and clustering accuracy of 96.0% for unsupervised ones and 95.0% with a classic approach for a blinded data set. We find that variability features significantly improve the accuracy of the trained models, and correlation analysis among different bands enables a fast and inexpensive first-order selection of quasar candidates.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2021

Efficient Data Compression for 3D Sparse TPC via Bicephalous Convolutional Autoencoder

Real-time data collection and analysis in large experimental facilities present a great challenge across multiple domains, including high energy physics, nuclear physics, and cosmology. To address this, machine learning (ML)-based methods for real-time data compression have drawn significant attention. However, unlike natural image data, such as CIFAR and ImageNet that are relatively small-sized and continuous, scientific data often come in as three-dimensional 3D data volumes at high rates with high sparsity (many zeros) and non-Gaussian value distribution. This makes direct application of popular ML compression methods, as well as conventional data compression methods, suboptimal. To address these obstacles, this work introduces a dual-head autoencoder to resolve sparsity and regression simultaneously, called Bicephalous Convolutional AutoEncoder (BCAE). This method shows advantages both in compression fidelity and ratio compared to traditional data compression methods, such as MGARD, SZ, and ZFP. To achieve similar fidelity, the best performer among the traditional methods can reach only half the compression ratio of BCAE. Moreover, a thorough ablation study of the BCAE method shows that a dedicated segmentation decoder improves the reconstruction.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Position Papers for Inverse Methods for Complex Systems under Uncertainty Workshop

The ability to solve inverse problems – inferring unknown parameters, structures, or states of a system from observed data – is essential for advancing scientific discovery and innovation capabilities for the DOE mission. Basic research needs and challenges are particularly acute in emerging areas such as the interactive, data-driven, modeling and simulation of digital twins; decision support for experiments at DOE scientific user facilities; and for other complex systems and workflows. Inverse problems are at the heart of understanding and controlling complex systems due to factors such as observational data with varying modalities and fidelities, inherent uncertainties in physical measurements and numerical models, and the computational demands of rapid and high-fidelity simulations. The convergence of recent scientific computing trends – scientific machine learning, artificial intelligence, and computing advances such as exascale computing – is creating unprecedented opportunities. These advancements offer the potential to revolutionize how we approach inverse problems to extract actionable insights with the required level of accuracy and computational efficiency. This workshop and the Call for Position Papers are vital steps in bringing together experts to collectively explore and identify the new computational and mathematical directions needed in inverse methods for complex systems under uncertainty.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Optimizing Error-Bounded Lossy Compression for Scientific Data With Diverse Constraints

Vast volumes of data are produced by today's scientific simulations and advanced instruments. These data cannot be stored and transferred efficiently because of limited I/O bandwidth, network speed, and storage capacity. Error-bounded lossy compression can be an effective method for addressing these issues: not only can it significantly reduce data size, but it can also control the data distortion based on user-defined error bounds. In practice, many scientific applications have specific requirements or constraints for lossy compression, in order to guarantee that the reconstructed data are valid for post hoc analysis. For example, some datasets contain irrelevant data that should be isolated in particular and users often have intuition regarding value ranges, geospatial regions, and other data subsets that are crucial for subsequent analysis. Existing state-of-the-art error-bounded lossy compressors, however, do not consider these constraints during compression, resulting in inferior compression ratios with respect to user's post hoc analysis, due to the fact that the data itself provides little or no value for post hoc analysis. In this work we address this issue by proposing an optimized framework that can preserve diverse constraints during the error-bounded lossy compression, e.g., cleaning the irrelevant data, efficiently preserving different precision for multiple value intervals, and allowing users to set diverse precision over both regular and irregular regions. We perform our evaluation on a supercomputer with up to 2,100 cores. Experiments with six real-world applications show that our proposed diverse constraints based error-bounded lossy compressor can obtain a higher visual quality or data fidelity on reconstructed data with the same or even higher compression ratios compared with the traditional state-of-the-art compressor SZ. Furthermore, our experiments also demonstrate very good scalability in compression performance compared with the I/O throughput of the parallel file system.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Advancing Fusion with Machine Learning Research Needs Workshop Report

Abstract Machine learning and artificial intelligence (ML/AI) methods have been used successfully in recent years to solve problems in many areas, including image recognition, unsupervised and supervised classification, game-playing, system identification and prediction, and autonomous vehicle control. Data-driven machine learning methods have also been applied to fusion energy research for over 2 decades, including significant advances in the areas of disruption prediction, surrogate model generation, and experimental planning. The advent of powerful and dedicated computers specialized for large-scale parallel computation, as well as advances in statistical inference algorithms, have greatly enhanced the capabilities of these computational approaches to extract scientific knowledge and bridge gaps between theoretical models and practical implementations. Large-scale commercial success of various ML/AI applications in recent years, including robotics, industrial processes, online image recognition, financial system prediction, and autonomous vehicles, have further demonstrated the potential for data-driven methods to produce dramatic transformations in many fields. These advances, along with the urgency of need to bridge key gaps in knowledge for design and operation of reactors such as ITER, have driven planned expansion of efforts in ML/AI within the US government and around the world. The Department of Energy (DOE) Office of Science programs in Fusion Energy Sciences (FES) and Advanced Scientific Computing Research (ASCR) have organized several activities to identify best strategies and approaches for applying ML/AI methods to fusion energy research. This paper describes the results of a joint FES/ASCR DOE-sponsored Research Needs Workshop on Advancing Fusion with Machine Learning, held April 30–May 2, 2019, in Gaithersburg, MD (full report available at https://science.osti.gov/-/media/fes/pdf/workshop-reports/FES_ASCR_Machine_Learning_Report.pdf ). The workshop drew on broad representation from both FES and ASCR scientific communities, and identified seven Priority Research Opportunities (PRO’s) with high potential for advancing fusion energy. In addition to the PRO topics themselves, the workshop identified research guidelines to maximize the effectiveness of ML/AI methods in fusion energy science, which include focusing on uncertainty quantification, methods for quantifying regions of validity of models and algorithms, and applying highly integrated teams of ML/AI mathematicians, computer scientists, and fusion energy scientists with domain expertise in the relevant areas.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

Solving inverse problems in stochastic models using deep neural networks and adversarial training

Inverse problems associated with stochastic models constitute a significant portion of scientific and engineering applications. In such cases the unknown quantities are distributions. The applicability of traditional methods is limited because of their demanding assumptions or prohibitive computational consumption; for example, maximum likelihood methods require closed-form density functions, and Markov Chain Monte Carlo needs a large number of simulations. We propose a new method that estimates the unknown distribution by matching the statistical properties between observed and simulated random processes. We leverage the expressive power of neural networks to approximate the unknown distribution and use a discriminative neural network for computing the statistical discrepancies between the observed and simulated random processes. Here we demonstrated numerically that the proposed methods can estimate both the model parameters and learn complicated unknown distributions.

42 ENGINEERING↗
DOE OSTI2026

Flame Chemistry Workshop: a perspective on challenges and strategic actions in combustion experiments and chemical kinetics modeling

Continued progress in the development of predictive models for combustion chemistry—including ignition and flame behavior, species evolution, and combustion system performance—relies on overcoming enduring and emerging challenges in experimental measurements, theoretical formulations, and chemical kinetics mechanism construction. As combustion science continues to coincide with advances in sustainable fuels development, plasma technologies, and automated modeling capabilities, the need for coordinated, community-driven strategies is essential. The Flame Chemistry Workshop (FCWS), held biennially before the International Symposium on Combustion, serves as a dedicated platform to identify, consolidate, and address these challenges in a structured and collaborative manner. This perspective arises from discussions at the 7th FCWS in Milan, Italy (2024), and presents a collective view of the critical barriers currently limiting progress. Across the five technical domains discussed during the 7th FCWS – sustainable fuels combustion, advanced diagnostics for combustion measurements, experiments and modeling in plasma combustion, artificial intelligence and automated methods for theory and mechanisms generation, and chemical kinetic models—a series of persistent and emerging scientific challenges were identified, highlighting the need for deeper integration between three areas: theory, experiments, and modeling. In conclusion, the present article concisely describes present challenges that were identified in each of the technical domains in an effort to streamline and coordinate solutions to accelerate progress in combustion science.

Chemical kinetics↗
DOE OSTI2024

A model to separate conduction and radiation in high temperature laser flash measurements for semi-transparent materials

Laser flash analysis (LFA) is a widely used technique in the scientific and industrial communities for measuring the thermal diffusivity and conductivity of materials. However, traditional fitting methods based solely on heat conduction do not account for radiation heat transfer in transparent and semi-transparent materials, which becomes significant at high temperatures. In this study, we have developed a coupled radiation-conduction model that considers the optical properties of materials to accurately extract thermal diffusivity from LFA measurements. We conducted LFA measurements on fused silica glass samples of varying thicknesses and within the temperature range of 25 to 1000 °C and fitted the data with the model. Since the coupled model requires optical properties as input parameters, which are often unavailable for new materials, we have also proposed a modified transparent model. Compared to the coupled model, results from the modified transparent model generally overestimate thermal conductivity, but the errors are acceptable in silica glass with small thickness. Here, we also investigated the applicability of the modified transparent model with materials of different optical properties.

14 SOLAR ENERGY↗
DOE OSTI2021

A data-driven global soil heterotrophic respiration dataset and the drivers of its inter-annual variability

Soil heterotrophic respiration (SHR), one of the primary carbon fluxes from terrestrial ecosystems to the atmosphere, is important for carbon-climate feedbacks because of its sensitivity to available litter and soil carbon, climatic conditions, and nutrient availability. However, until recently limited SHR data were available, and most published global SHR estimates have either a short time span, coarse spatial resolution, or reply on overly-simple model formulations. To better understand and quantify the global distribution of SHR and its sensitivity to climate variability, we produced a new global SHR dataset using Random Forest algorithms, up-scaling 455 point data from the Global Soil Respiration Database (SRDB 4.0) with gridded fields of climatic, edaphic and productivity as explanatory variables. We estimated a global total SHR of 46.8 Pg C yr-1 over 1985-2013 (95% confidence interval: 38.6-56.3 Pg C yr-1), with a significant increasing trend of 0.03 Pg C yr-2 during this period. We found that the choice of soil moisture datasets contributes more to the difference among these data-driven SHR members rather than that of productivity, temperature and precipitation data sources. We also analyzed the influence of climatic variables on the inter-annual variability (IAV) of our SHR product. Water availability was the dominant driver of IAV at global scales, although the inferred sensitivity depends on the choice of the soil moisture gridded dataset. At the ecosystem scale, temperature strongly controls the IAV of SHR in tropical forests, while water availability dominates in extra-tropical forest and semi-arid regions. Our machine-learning gridded SHR dataset and outputs from process-based land surface models (TRENDYv6) show agreement for a strong association between water variability and SHR IAV at the global scale, but the two approaches lead to different temporal trend globally and different controlling variables for IAV at the ecosystem scale. Our study provides evidence for the pervasive and important role of water availability in driving SHR, indicating both a direct effect limiting decomposition rates and an indirect effect through the amount of fresh organic matter made available to SHR from productivity. In consideration of potential limitations and uncertainties remaining in our data-driven SHR datasets, we call for a more scientifically designed observation network for SHR, more observation data compilation, and increased use of deep learning methods making maximum use of observation data in hand. This will benefit process-based models, and improve our understanding of SHR response to future anomalous environmental conditions.

Yao, Yitong↗
DOE OSTI2025

Advances in geophysical forensic event monitoring

Forensic analysis of man-made, non-nuclear events (such as industrial accidents, explosion experiments and mine collapses) has become more frequent and detailed owing to advancements in geophysical monitoring. Here, in this Technical Review, we demonstrate how geophysical forensic monitoring using seismic, infrasound and hydroacoustic recordings provides insights on events in the solid earth, atmosphere and underwater. Advanced techniques, including machine-learning-based models, have been developed to detect, identify and investigate these events, providing information on location, subevents, sources and explosive yield. The increase in data availability, application of advanced methods and computation and the growth of multitechnology approaches have increased the accuracy of forensic event analysis and enabled more realistic characterization of uncertainties. For example, the 2020 Beirut explosion in Lebanon demonstrated that various seismic, acoustic and other methods could be used to estimate explosive yield (and yield uncertainties) of about 1 ktonne, providing confidence in the application of these methods to smaller events where data are available. However, forensic investigations remain largely limited to known events with identified sources. Increased access to data, sophisticated analysis methods and high-resolution earth models will improve forensic event analysis further, enabling civil and scientific applications, such as localization in the search for the lost ARA San Juan submarine.

geophysics↗
DOE OSTI2022

Tree mortality in a warming world: causes, patterns, and implications

This ERL focus collection has published 17 papers that have advanced our understanding of different dimensions of warming-induced tree mortality. Here we summarize these focus collection papers, organized by four topics related to tree mortality: pathogens, droughts/heat waves, fire/bark beetles, and teleconnections/air pollution. This focus collection illustrates a variety of methods in measuring and modeling tree-mortality, and adds significant new research findings into the scientific literature on tree mortality from hotter droughts. Some of these results also are useful for policymakers and forest managers in addressing amplified forest stress and tree mortality as a result of increasingly severe warming-induced climate and weather extremes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Building Trustworthy Machine Learning Models for Astronomy

Astronomy is entering an era of data-driven discovery, due in part to modern machine learning (ML) techniques enabling powerful new ways to interpret observations. This shift in our scientific approach requires us to consider whether we can trust the black box. Here, we overview methods for an often-overlooked step in the development of ML models: building community trust in the algorithms. Trust is an essential ingredient not just for creating more robust data analysis techniques, but also for building confidence within the astronomy community to embrace machine learning methods and results.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

Acceleration of Glass Alteration Rates Induced by Zeolite Seeds at Controlled pH

As the glass-water reaction proceeds, certain glass compositions undergo a delayed acceleration in the alteration rate – a phenomenon that is commonly referred to as Stage III behavior – which generally coincides with zeolite formation. However, studying Stage III in the laboratory is difficult because the time scale required to observe Stage III behavior can vary from months to several years, and the solution conditions that initiate this acceleration remain poorly understood. Consequently, the development of a corrosion test method capable of quantifying Stage III rates in a timely manner would be of great benefit to both the scientific community and policy makers concerned with nuclear waste disposal. In this work, we induced and measured the acceleration in the corrosion rate of the AFCI glass by seeding static corrosion tests with zeolite Na-P2 at fixed pH90°C values ranging from 9.5 to 11.5. The induced Stage III rates increased linearly with increasing pH and were measured to be between the forward and residual rates of AFCI. Tests designed to compare induced Stage III rates obtained for different seeding times showed that the induced Stage III rates were faster in the absence of an alteration layer. In summary, the use of the seeded test method allows for a conservative quantification of Stage III rates in a relatively short, one-month time period.

Neeway, James J.↗
DOE OSTI2024

Basic Energy Sciences Roundtable: Foundational Science to Accelerate Nuclear Energy Innovation

Energy security, availability, and reliability are among the greatest challenges facing the nation and the planet. An abundant potential source of energy resides in the fundamental atomic building blocks of the universe in the form of nuclear fission and fusion reactions. In fact, energy from nuclear fission currently provides the majority of the world’s zero-carbon electricity, and future fusion energy systems offer great promise; carbon-free nuclear energy technologies can be key to the world’s decarbonized energy future. Although contemporary fission systems use well-established technologies to supply safe and efficient baseload power, they could be more fuel efficient and less costly. Moving beyond massive light-water fission reactors to a variety of advanced nuclear systems—which will vary in size and operate in extremes of temperature, corrosivity, and other parameters—will place stringent conditions on materials and chemical systems. New demands will be placed on the coolants and solvents, the materials, and the monitoring tools used in these reactors. Fusion-based nuclear energy will require superior materials to withstand extremely high temperatures, plasma exposure, radiation damage, and implanted gases. The advantages associated with these new fission and fusion technologies will be realized only through continued advancements in the fundamental science underpinning our knowledge of the physics and chemistry of nuclear systems gained via improved experimental and computational methods. In July 2022, the U.S. Department of Energy’s Office of Basic Energy Sciences—in coordination with the Offices of Nuclear Energy, Fusion Energy Sciences, and Advanced Scientific Computing Research—held a virtual roundtable titled “Foundational Science to Accelerate Nuclear Energy Innovation” to discuss the scientific and technical barriers for advanced nuclear energy systems. Five priority research opportunities were identified to address these scientific and technical challenges and to accelerate progress toward the realization of next-generation fusion and fission energy systems. The foundational science gaps inhibiting the advancement of nuclear energy technologies are identified and tackled in five priority research opportunities. These opportunities pave the way to accelerate the development and ultimately the adoption of new nuclear energy systems. They include the fundamental aspects of ion-electron interactions; novel properties of next-generation coolants and solvents; interfacial dynamics, not only in solids, but in other aspects of nuclear reactors; novel operando and in situ monitoring and sensing; and artificial intelligence to accelerate condensed phases discovery. Building on the foundation established by previous Basic Energy Sciences workshops, these opportunities encompass recent advances in fundamental knowledge and focus on the experimental and computational methods needed to resolve major technical challenges for nuclear energy technologies. Through developing fundamental scientific insight as well as pushing the frontiers of modeling complex systems and probing the operation of materials and chemical systems in extreme environments, research motivated by the priorities identified here will further develop the promise, potential, and utilization of nuclear energy for a clean energy future.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

Position-specific carbon isotope analysis of serine by gas chromatography/Orbitrap mass spectrometry, and an application to plant metabolism

Position-specific 13 C/ 12 C ratios within amino acids remain largely unexplored in environmental samples due to methodological limitations. We hypothesized that natural-abundance isotope patterns in serine may serve as a proxy for plant metabolic fluxes including photorespiration. Here we describe an Orbitrap method optimized for the position-specific carbon isotope analysis of serine to test our hypothesis and discuss the generalizability of this method to other amino acids. Position-specific carbon isotope ratios of serine were measured using a Thermo Scientific™ Q Exactive™ GC Orbitrap™. Amino acids were hydrolyzed from Arabidopsis biomass, purified from potential matrix interferences, and derivatized alongside standards. Derivatized serine (N,O-bis(trifluoroacetyl)methyl ester) was isolated using gas chromatography, trapped in a reservoir, and purged into the electron ionization source over tens of minutes, producing fragment ions containing different combinations of atoms from the serine-derivative molecule. The 13 C/ 12 C ratios of fragments with monoisotopic masses of 110.0217, 138.0166, and 165.0037 Da were monitored in the mass analyzer and used to calculate position-specific δ 13 C values relative to a working standard. This methodology constrains position-specific δ 13 C values for nanomole amounts of serine isolated from chemically complex mixtures. The δ 13 C values of fragment ions of serine were characterized with ≤1‰ precisions, leading to propagated standard errors of 0.7–5‰ for each carbon position. Position-specific δ 13 C values differed by up to ca 28 ± 5‰ between serine molecules hydrolyzed from plants grown under contrasting pCO 2 , selected to promote different fluxes through photosynthesis and photorespiration. The method was validated using pure serine standards characterized offline. Here this study presents the first Orbitrap-based measurements of natural-abundance, position-specific carbon isotope variation in an amino acid isolated from a biological matrix. We present a method for the precise characterization of isotope ratios in serine and propose applications probing metabolism in plants. We discuss the potential for extending these approaches to other amino acids, paving the way for novel applications.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Masked Particle Modeling on Sets: Towards Self-Supervised High Energy Physics Foundation Models

Abstract We propose masked particle modeling (MPM) as a self-supervised method for learning generic, transferable, and reusable representations on unordered sets of inputs for use in high energy physics (HEP) scientific data. This work provides a novel scheme to perform masked modeling based pre-training to learn permutation invariant functions on sets. More generally, this work provides a step towards building large foundation models for HEP that can be generically pre-trained with self-supervised learning and later fine-tuned for a variety of down-stream tasks. In MPM, particles in a set are masked and the training objective is to recover their identity, as defined by a discretized token representation of a pre-trained vector quantized variational autoencoder. We study the efficacy of the method in samples of high energy jets at collider physics experiments, including studies on the impact of discretization, permutation invariance, and ordering. We also study the fine-tuning capability of the model, showing that it can be adapted to tasks such as supervised and weakly supervised jet classification, and that the model can transfer efficiently with small fine-tuning data sets to new classes and new data domains.

Heinrich, Lukas (ORCID:0000000240487584)↗