Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “heuristic”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39

Numerically Relevant Timescales in the MG2 Microphysics Model

Climate models rely on parameterizations of a variety of processes in the atmospheric physics, but a common concern is that the temporal resolution is too coarse to consistently resolve the behavior that individual parameterizations are designed to capture. This study examines timescales numerically derived from the Morrison-Gettelman (MG2) microphysics as implemented within the Energy Exascale Earth System Model, version 1 (E3SMv1). Numerically relevant timescales in MG2 are derived by computing the eigenspectrum of its Jacobian. These timescales are found to often be smaller than the default 5 min time step used for MG2. The fast timescales are then heuristically connected to individual microphysics processes. By substepping a few particular rain processes within MG2, the time discretization error for those processes was considerably reduced with minimal additional expense to the overall microphysics. While this improvement has a substantial effect on the target processes and on the vertical distribution of stratiform-derived rain within E3SMv1, the overall model climate is found to not be sensitive to MG2 time step. Here, we hypothesize that this is because the surface climate does not depend strongly on certain process rates, especially MG2's rain evaporation rate.

58 GEOSCIENCES↗

A Benchmark to Test Generalization Capabilities of Deep Learning Methods to Classify Severe Convective Storms in a Changing Climate

Abstract This is a test case study assessing the ability of deep learning methods to generalize to a future climate (end of 21st century) when trained to classify thunderstorms in model output representative of the present‐day climate. A convolutional neural network (CNN) was trained to classify strongly rotating thunderstorms from a current climate created using the Weather Research and Forecasting model at high‐resolution, then evaluated against thunderstorms from a future climate and found to perform with skill and comparatively in both climates. Despite training with labels derived from a threshold value of a severe thunderstorm diagnostic (updraft helicity), which was not used as an input attribute, the CNN learned physical characteristics of organized convection and environments that are not captured by the diagnostic heuristic. Physical features were not prescribed but rather learned from the data, such as the importance of dry air at mid‐levels for intense thunderstorm development when low‐level moisture is present (i.e., convective available potential energy). Explanation techniques also revealed that thunderstorms classified as strongly rotating are associated with learned rotation signatures. Results show that the creation of synthetic data with ground truth is a viable alternative to human‐labeled data and that a CNN is able to generalize a target using learned features that would be difficult to encode due to spatial complexity. Most importantly, results from this study show that deep learning is capable of generalizing to future climate extremes and can exhibit out‐of‐sample robustness with hyperparameter tuning in certain applications.

54 ENVIRONMENTAL SCIENCES↗

Evaluating the Potential and Challenges of an Uncertainty Quantification Method for Long Short–Term Memory Models for Soil Moisture Predictions

Recently, recurrent deep networks have shown promise to harness newly available satellite–sensed data for long–term soil moisture projections. However, to be useful in forecasting, deep networks must also provide uncertainty estimates. Here we evaluated Monte Carlo dropout with an input–dependent data noise term (MCD+N), an efficient uncertainty estimation framework originally developed in computer vision, for hydrologic time series predictions. MCD+N simultaneously estimates a heteroscedastic input–dependent data noise term (a trained error model attributable to observational noise) and a network weight uncertainty term (attributable to insufficiently constrained model parameters). Although MCD+N has appealing features, many heuristic approximations were employed during its derivation, and rigorous evaluations and evidence of its asserted capability to detect dissimilarity were lacking. To address this, we provided an in–depth evaluation of the scheme's potential and limitations. We showed that for reproducing soil moisture dynamics recorded by the Soil Moisture Active Passive (SMAP) mission, MCD+N indeed gave a good estimate of predictive error, provided that we tuned a hyperparameter and used a representative training data set. The input–dependent term responded strongly to observational noise, while the model term clearly acted as a detector for physiographic dissimilarity from the training data, behaving as intended. However, when the training and test data were characteristically different, the input–dependent term could be misled, undermining its reliability. Additionally, due to the data–driven nature of the model, data noise also influences network weight uncertainty, and therefore the two uncertainty terms are correlated. Altogether, this approach has promise, but care is needed to interpret the results.

54 ENVIRONMENTAL SCIENCES↗

Integrated, Coordinated, Open, and Networked (ICON) Science to Advance the Geosciences: Introduction and Synthesis of a Special Collection of Commentary Articles

Abstract The sciences struggle to integrate across disciplines, coordinate across data generation and modeling activities, produce connected open data, and build strong networks to engage stakeholders within and beyond the scientific community. The American Geophysical Union (AGU) is divided into 25 sections intended to encompass the breadth of the geosciences. Here, we introduce a special collection of commentary articles spanning 19 AGU sections on challenges and opportunities associated with the use of ICON science principles. These principles focus on research intentionally designed to be Integrated, Coordinated, Open, and Networked (ICON) with the goal of maximizing mutual benefit (among stakeholders) and cross‐system transferability of science outcomes. This article (a) summarizes the ICON principles; (b) discusses the crowdsourced approach to creating the collection; (c) explores insights from across the articles; and (d) proposes steps forward. There were common themes among the commentary articles, including broad agreement that the benefits of using ICON principles outweigh the costs, but that using ICON principles has important risks that need to be understood and mitigated. It was also clear that the ICON principles are not monolithic or static, but should instead be considered a heuristic tool that can and should be modified to meet changing needs. As a whole, the collection is intended as a resource for scientists pursuing ICON science and represents an important inflection point in which the geosciences community has come together to offer insights into ICON principles as a unified approach for improving how science is done across the geosciences and beyond.

Goldman, A. E.↗

Representing Socio‐Economic Uncertainty in Human System Models

Abstract Socio‐economic development pathways and their implications for the environment are highly uncertain, and energy transitions will involve complex interactions among sectors. Here, traditional Monte Carlo analysis is paired with scenario discovery techniques to provide a richer portrait of these complexities. Modeled uncertain input variables include costs of advanced energy technologies, energy efficiency trends, fossil fuel resource availability, elasticities of substitution for labor, capital, and energy across economic sectors, population growth, and labor and capital productivity. The sampled values are simulated through a multi‐sector, multi‐region, recursively dynamic model of the world economy to explore a range of possible future outcomes. We find that many patterns of energy and technology development are possible for various long‐term environmental pathways and that sectoral output for most sectors is little affected through 2050 by the long‐term temperature target, but with tight constraints on emissions, emission intensities must fall much more rapidly. Scenario discovery techniques are applied to the large uncertainty ensembles to explore if there are prevailing storylines behind outcomes of interest. An illustrative investigation focused on different levels of economic growth shows many combinations of pathways and no single storyline emerging for a given economic outcome. This method can be extended to other outcomes of interest, exploring the nature of scenarios with both tail and median outcomes. Sampling from a Monte Carlo generated ensemble provides a rich set of scenarios to investigate, and potentially aids in avoiding heuristic biases in less structured scenario approaches.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Universal fragment descriptors for predicting properties of inorganic crystals

Although historically materials discovery has been driven by a laborious trial-and-error process, knowledge-driven materials design can now be enabled by the rational combination of Machine Learning methods and materials databases. Here, data from the AFLOW repository for ab initio calculations is combined with Quantitative Materials Structure-Property Relationship models to predict important properties: metal/insulator classification, band gap energy, bulk/shear moduli, Debye temperature and heat capacities. The prediction’s accuracy compares well with the quality of the training data for virtually any stoichiometric inorganic crystalline material, reciprocating the available thermomechanical experimental data. The universality of the approach is attributed to the construction of the descriptors: Property-Labelled Materials Fragments. The representations require only minimal structural input allowing straightforward implementations of simple heuristic design rules.

Science & Technology - Other Topics↗

Synthetic and systems biology for microbial production of commodity chemicals

The combination of synthetic and systems biology is a powerful framework to study fundamental questions in biology and produce chemicals of immediate practical application such as biofuels, polymers, or therapeutics. However, we cannot yet engineer biological systems as easily and precisely as we engineer physical systems. In this review, we describe the path from the choice of target molecule to scaling production up to commercial volumes. We present and explain some of the current challenges and gaps in our knowledge that must be overcome in order to bring our bioengineering capabilities to the level of other engineering disciplines. Challenges start at molecule selection, where a difficult balance between economic potential and biological feasibility must be struck. Pathway design and construction have recently been revolutionized by next-generation sequencing and exponentially improving DNA synthesis capabilities. Although pathway optimization can be significantly aided by enzyme expression characterization through proteomics, choosing optimal relative protein expression levels for maximum production is still the subject of heuristic, non-systematic approaches. Toxic metabolic intermediates and proteins can significantly affect production, and dynamic pathway regulation emerges as a powerful but yet immature tool to prevent it. Host engineering arises as a much needed complement to pathway engineering for high bioproduct yields; and systems biology approaches such as stoichiometric modeling or growth coupling strategies are required. A final, and often underestimated, challenge is the successful scale up of processes to commercial volumes. Sustained efforts in improving reproducibility and predictability are needed for further development of bioengineering.

59 BASIC BIOLOGICAL SCIENCES↗

Weakly supervised classification of aortic valve malformations using unlabeled cardiac MRI sequences

Biomedical repositories such as the UK Biobank provide increasing access to prospectively collected cardiac imaging, however these data are unlabeled, which creates barriers to their use in supervised machine learning. We develop a weakly supervised deep learning model for classification of aortic valve malformations using up to 4,000 unlabeled cardiac MRI sequences. Instead of requiring highly curated training data, weak supervision relies on noisy heuristics defined by domain experts to programmatically generate large-scale, imperfect training labels. For aortic valve classification, models trained with imperfect labels substantially outperform a supervised model trained on hand-labeled MRIs. In an orthogonal validation experiment using health outcomes data, our model identifies individuals with a 1.8-fold increase in risk of a major adverse cardiac event. This work formalizes a deep learning baseline for aortic valve classification and outlines a general strategy for using weak supervision to train machine learning models using unlabeled medical images at scale.

60 APPLIED LIFE SCIENCES↗

Infrared spectroscopy data- and physics-driven machine learning for characterizing surface microstructure of complex materials

There is a need to characterize complex materials and their dynamics under reaction conditions to accelerate materials design. Adsorbate vibrational excitations are selective to adsorbate/surface interactions and infrared (IR) spectra associated with activating adsorbate vibrational modes are accurate, capture details of most modes, and can be obtained operando. Current interpretation depends on heuristic peak assignments for simple spectra, precluding the possibility of obtaining detailed structural information. Here, we combine data-based approaches with chemistry-dependent problem formulation to develop physics-driven surrogate models that generate synthetic IR spectra from first-principles calculations. Using synthetic IR spectra of carbon monoxide on platinum, we implement multinomial regression via neural network ensembles to learn probability distributions functions (pdfs) that describe adsorption sites and quantify uncertainty. We use these pdfs to infer detailed surface microstructure from experimental spectra and extend this methodology to other systems as a first step towards characterizing complex interfaces and closing the materials gap.

Science & Technology - Other Topics↗

Cost function dependent barren plateaus in shallow parametrized quantum circuits

Variational quantum algorithms (VQAs) optimize the parameters θ of a parametrized quantum circuit V(θ) to minimize a cost function C. While VQAs may enable practical applications of noisy quantum computers, they are nevertheless heuristic methods with unproven scaling. Here, we rigorously prove two results, assuming V(θ) is an alternating layered ansatz composed of blocks forming local 2-designs. Our first result states that defining C in terms of global observables leads to exponentially vanishing gradients (i.e., barren plateaus) even when V(θ) is shallow. Hence, several VQAs in the literature must revise their proposed costs. On the other hand, our second result states that defining C with local observables leads to at worst a polynomially vanishing gradient, so long as the depth of V(θ) is Ο(logn). Our results establish a connection between locality and trainability. We illustrate these ideas with large-scale simulations, up to 100 qubits, of a quantum autoencoder implementation.

97 MATHEMATICS AND COMPUTING↗

The diversity of three-dimensional photonic crystals

Many butterflies, birds, beetles, and chameleons owe their spectacular colors to the microscopic patterns within their wings, feathers, or skin. When these patterns, or photonic crystals, result in the omnidirectional reflection of commensurate wavelengths of light, it is due to a complete photonic band gap (PBG). The number of natural crystal structures known to have a PBG is relatively small, and those within the even smaller subset of notoriety, including diamond and inverse opal, have proven difficult to synthesize. Here, we report more than 150,000 photonic band calculations for thousands of natural crystal templates from which we predict 351 photonic crystal templates – including nearly 300 previously-unreported structures – that can potentially be realized for a multitude of applications and length scales, including several in the visible range via colloidal self-assembly. With this large variety of 3D photonic crystals, we also revisit and discuss oft-used primary design heuristics for PBG materials.

54 ENVIRONMENTAL SCIENCES↗

Noise-induced barren plateaus in variational quantum algorithms

Abstract Variational Quantum Algorithms (VQAs) may be a path to quantum advantage on Noisy Intermediate-Scale Quantum (NISQ) computers. A natural question is whether noise on NISQ devices places fundamental limitations on VQA performance. We rigorously prove a serious limitation for noisy VQAs, in that the noise causes the training landscape to have a barren plateau (i.e., vanishing gradient). Specifically, for the local Pauli noise considered, we prove that the gradient vanishes exponentially in the number of qubits n if the depth of the ansatz grows linearly with n . These noise-induced barren plateaus (NIBPs) are conceptually different from noise-free barren plateaus, which are linked to random parameter initialization. Our result is formulated for a generic ansatz that includes as special cases the Quantum Alternating Operator Ansatz and the Unitary Coupled Cluster Ansatz, among others. For the former, our numerical heuristics demonstrate the NIBP phenomenon for a realistic hardware noise model.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

The emergence of macroscopic currents in photoconductive sampling of optical fields

Photoconductive field sampling enables petahertz-domain optoelectronic applications that advance our understanding of light-matter interaction. Despite the growing importance of ultrafast photoconductive measurements, a rigorous model for connecting the microscopic electron dynamics to the macroscopic external signal is lacking. This has caused conflicting interpretations about the origin of macroscopic currents. Here, we present systematic experimental studies on the signal formation in gas-phase photoconductive sampling. Our theoretical model, based on the Ramo–Shockley-theorem, overcomes the previously introduced artificial separation into dipole and current contributions. Extensive numerical particle-in-cell-type simulations permit a quantitative comparison with experimental results and help to identify the roles of electron-neutral scattering and mean-field charge interactions. The results show that the heuristic models utilized so far are valid only in a limited range and are affected by macroscopic effects. Our approach can aid in the design of more sensitive and more efficient photoconductive devices.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Towards large-scale quantum optimization solvers with few qubits

Quantum computers hold the promise of more efficient combinatorial optimization solvers, which could be game-changing for a broad range of applications. However, a bottleneck for materializing such advantages is that, in order to challenge classical algorithms in practice, mainstream approaches require a number of qubits prohibitively large for near-term hardware. Here we introduce a variational solver for MaxCut problems over $m={{\mathcal{O}}}({n}^{k})$ binary variables using only n qubits, with tunable k > 1. The number of parameters and circuit depth display mild linear and sublinear scalings in m , respectively. Moreover, we analytically prove that the specific qubit-efficient encoding brings in a super-polynomial mitigation of barren plateaus as a built-in feature. Altogether, this leads to high quantum-solver performances. For instance, for m = 7000, numerical simulations produce solutions competitive in quality with state-of-the-art classical solvers. In turn, for m = 2000, experiments with n = 17 trapped-ion qubits feature MaxCut approximation ratios estimated to be beyond the hardness threshold 0.941. Our findings offer an interesting heuristics for quantum-inspired solvers as well as a promising route towards solving commercially-relevant problems on near-term quantum devices.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Model-free estimation of completeness, uncertainties, and outliers in atomistic machine learning using information theory

Abstract An accurate description of information is relevant for a range of problems in atomistic machine learning (ML), such as crafting training sets, performing uncertainty quantification (UQ), or extracting physical insights from large datasets. However, atomistic ML often relies on unsupervised learning or model predictions to analyze information contents from simulation or training data. Here, we introduce a theoretical framework that provides a rigorous, model-free tool to quantify information contents in atomistic simulations. We demonstrate that the information entropy of a distribution of atom-centered environments explains known heuristics in ML potential developments, from training set sizes to dataset optimality. Using this tool, we propose a model-free UQ method that reliably predicts epistemic uncertainty and detects out-of-distribution samples, including rare events in systems such as nucleation. This method provides a general tool for data-driven atomistic modeling and combines efforts in ML, simulations, and physical explainability.

36 MATERIALS SCIENCE↗

Does provable absence of barren plateaus imply classical simulability?

A large amount of effort has recently been put into understanding the barren plateau phenomenon. In this perspective article, we face the increasingly loud elephant in the room and ask a question that has been hinted at by many but not explicitly addressed: Can the structure that allows one to avoid barren plateaus also be leveraged to efficiently simulate the loss classically? We collect evidence-on a case-by-case basis-that many commonly used models whose loss landscapes avoid barren plateaus can also admit classical simulation, provided that one can collect some classical data from quantum devices during an initial data acquisition phase. This follows from the observation that barren plateaus result from a curse of dimensionality, and that current approaches for solving them end up encoding the problem into some small, classically simulable, subspaces. Thus, while stressing that quantum computers can be essential for collecting data, our analysis sheds doubt on the information processing capabilities of many parametrized quantum circuits with provably barren plateau-free landscapes. We end by discussing the (many) caveats in our arguments including the limitations of average case arguments, the role of smart initializations, models that fall outside our assumptions, the potential for provably superpolynomial advantages and the possibility that, once larger devices become available, parametrized quantum circuits could heuristically outperform our analytic expectations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Revealing multiscale competing processes in the solid-state synthesis of single-crystalline layered oxide positive electrodes

Solid-state synthesis involves a web of coupled chemical reactions and physical changes that unfold across multiple scales. Efforts to fine-tune its parameters have historically followed heuristic, trial-driven workflows that demand significant time and resources. In this study, we aimed to open this black box by employing multiscale in situ synchrotron imaging and diffraction. Using LiNi 0.5 Mn 0.3 Co 0.2 O 2 battery positive electrode material as a model system and Ba-based sintering aids, we reveal dopant segregation, intergranular mass transport, and porosity evolution as key drivers of single-crystalline particle formation. Notably, we uncovered a dynamic competition between particle-level grain coalescence and atomic-scale cation disordering, both of which are thermally activated yet have opposing impacts on battery performance. These findings highlight the coupled, multiscale nature of structure development and offer a mechanistic basis for optimizing the solid-state synthesis process. This framework provides a path toward more controlled, efficient, and scalable production of high-performance battery positive electrode materials.

36 MATERIALS SCIENCE↗

Electronic structure prediction of multi-million atom systems through uncertainty quantification enabled transfer learning

The ground state electron density — obtainable using Kohn-Sham Density Functional Theory (KS-DFT) simulations — contains a wealth of material information, making its prediction via machine learning (ML) models attractive. However, the computational expense of KS-DFT scales cubically with system size which tends to stymie training data generation, making it difficult to develop quantifiably accurate ML models that are applicable across many scales and system configurations. Here, we address this fundamental challenge by employing transfer learning to leverage the multi-scale nature of the training data, while comprehensively sampling system configurations using thermalization. Our ML models are less reliant on heuristics, and being based on Bayesian neural networks, enable uncertainty quantification. We show that our models incur significantly lower data generation costs while allowing confident — and when verifiable, accurate — predictions for a wide variety of bulk systems well beyond training, including systems with defects, different alloy compositions, and at multi-million-atom scales. Moreover, such predictions can be carried out using only modest computational resources.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗