SEARCH · Engineering Papers

Results for “ensemble methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27

All sources NASA NTRS DOE OSTI

DOE OSTI2022

Entanglement features of random neural network quantum states

Restricted Boltzmann machines (RBMs) are a class of neural networks that have been successfully employed as a variational ansatz for quantum many-body wave functions. Here, we develop an analytic method to study quantum many-body spin states encoded by random RBMs with independent and identically distributed complex Gaussian weights. By mapping the computation of ensemble-averaged quantities to statistical mechanics models, we are able to investigate the parameter space of the RBM ensemble in the thermodynamic limit. We discover qualitatively distinct wave functions by varying RBM parameters, which correspond to distinct phases in the equivalent statistical mechanics model. Notably, there is a regime in which the typical RBM states have near-maximal entanglement entropy in the thermodynamic limit, similar to that of Haar-random states. However, these states generically exhibit nonergodic behavior in the Ising basis, and do not form quantum state designs, making them distinguishable from Haar-random states.

36 MATERIALS SCIENCE↗

DOE OSTI2023

Improving multiwell petrophysical interpretation from well logs via machine learning and statistical models

Well-log interpretation estimates in situ rock properties along well trajectory, such as porosity, water saturation, and permeability, to support reserve-volume estimation, production forecasts, and decision making in reservoir development. However, due to measurement errors, variability of well logs caused by multiple measurement vendors, different borehole tools, and nonuniform drilling/borehole conditions, estimations of rock properties with original well logs without proper preprocessing may not be accurate, especially in the context of multiwell estimation. Well-log normalization techniques such as two-point scaling and mean-variance normalization are commonly used to improve the robustness of multiwell rock-property estimation. However, these techniques do not consider the correlation between well logs and require subjective knowledge for their effective implementation. To reduce uncertainties and processing time associated with multiwell rock-property estimation from well logs, we develop discriminative adversarial (DA) and linear constraint models for well-log normalization and rock-property estimation. The DA neural network model developed for well-log normalization and interpretation can perform linear and nonlinear well-log normalization while considering the joint distribution of each well log and rock properties. However, the linear constraint model uses an ensemble of predictions from linear models to constrain well-log normalization and rock-property estimation. We also develop a divergence-based type well identification method to select type (training) wells for a test well based on the statistical similarity of associated well-log distributions instead of the interwell distance. We apply the DA model to perform well-log normalization and prediction of permeability for the Seminole San Andres Unit carbonate reservoir. Compared with the permeability predicted with the classical machine learning model without well-log normalization and models with two-point scaling normalization, the DA model yields the most accurate permeability prediction by decreasing the mean-squared error of permeability prediction by 20%–50%.

Geochemistry & Geophysics↗

DOE OSTI2020

Fluorinated Covalent Organic Frameworks: A Novel Pathway to Enhance Hydrogen Sorption and Control Isosteric Heats of Adsorption; HyMARC Seed Project Final Report

Organic framework materials, as a unique sub-class of carbon-based sorbents, have gained increasing attention for promising attributes toward gas storage. Calculations of the hydrogen capacity of optimized frameworks show potential to achieve greater than 60 g/L storage of hydrogen, placing metal-organic frameworks (MOFs) and COFs near the top of the class of porous materials. However, at the ensemble level, poor stacking creates a quasi-amorphous material with low structural integrity and low effective surface area. The chemical versatility of COFs allows for additional methods for producing long-range order that specifically target the inter-layer interactions in COFs but that leave key pore-accessible linker sites open. These modifications (either during synthesis or post-synthetic) enable a host of strategies to both improve crystalline order for more stable and higher surface, as well as add metals with open coordination for enhanced H 2 binding enthalpy.

08 HYDROGEN↗

DOE OSTI2023

Evaluation of four ground-based retrievals of cloud droplet number concentration in marine stratocumulus with aircraft in situ measurements

Abstract. Cloud droplet number concentration (Nd) is crucial for understanding aerosol–cloud interactions (ACI) and associated radiative effects. We present evaluations of four ground-based Nd retrievals based on comprehensive datasets from the Atmospheric Radiation Measurement (ARM) Aerosol and Cloud Experiments in the Eastern North Atlantic (ACE-ENA) field campaign. The Nd retrieval methods use ARM ENA observatory ground-based remote sensing observations from a micropulse lidar, Raman lidar, cloud radar, and the ARM NDROP (Droplet Number Concentration) value-added product (VAP), all of which also retrieve cloud effective radius (re). The retrievals are compared against aircraft measurements from the fast cloud droplet probe (FCDP) and the cloud and aerosol spectrometer (CAS) obtained from low-level marine boundary layer clouds on 12 flight days during summer and winter seasons. Additionally, the in situ measurements are used to validate the assumptions and characterizations used in the retrieval algorithms. Statistical comparisons of the probability distribution function (PDF) of the Nd and cloud re retrievals with aircraft measurements demonstrate that these retrievals align well with in situ measurements for overcast clouds, but they may substantially differ for broken clouds or clouds with low liquid water path (LWP). The retrievals are applied to 4 years of ground-based remote sensing measurements of overcast marine boundary layer clouds at the ARM ENA observatory to find that Nd (re) values exhibit seasonal variations, with higher (lower) values during the summer season and lower (higher) values during the winter season. The ensemble of various retrievals using different measurements and retrieval algorithms such as those in this paper can help to quantify Nd retrieval uncertainties and identify reliable Nd retrieval scenarios. Of the retrieval methods, we recommend using the micropulse lidar-based method. This method has good agreement with in situ measurements, less sensitivity to issues arising from precipitation and low cloud LWP and/or optical depth, and broad applicability by functioning for both daytime and nighttime conditions.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Evaluation of two-particle properties within finite-temperature self-consistent one-particle Green’s function methods: Theory and application to GW and GF2

One-particle Green’s function methods can model molecular and solid spectra at zero or non-zero temperatures. One-particle Green’s functions directly provide electronic energies and one-particle properties, such as dipole moment. However, the evaluation of two-particle properties, such as $\langle$S 2 $\rangle$ and $\langle$N 2 $\rangle$, can be challenging because they require a solution of the computationally expensive Bethe–Salpeter equation to find two-particle Green’s functions. We demonstrate that the solution of the Bethe–Salpeter equation can be completely avoided. Applying the thermodynamic Hellmann–Feynman theorem to self-consistent one-particle Green’s function methods, we derive expressions for two-particle density matrices in a general case and provide explicit expressions for GF2 and GW methods. Such density matrices can be decomposed into an antisymmetrized product of correlated one-electron density matrices and the two-particle electronic cumulant of the density matrix. Cumulant expressions reveal a deviation from ensemble representability for GW, explaining its known deficiencies. We analyze the temperature dependence of $\langle$S 2 $\rangle$ and $\langle$N 2 $\rangle$ for a set of small closed-shell systems. Interestingly, both GF2 and GW show a non-zero spin contamination and a non-zero fluctuation of the number of particles for closed-shell systems at the zero-temperature limit.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2022

Exploring cryo-electron microscopy with molecular dynamics

Single particle analysis cryo-electron microscopy (EM) and molecular dynamics (MD) have been complimentary methods since cryo-EM was first applied to the field of structural biology. The relationship started by biasing structural models to fit low-resolution cryo-EM maps of large macromolecular complexes not amenable to crystallization. The connection between cryo-EM and MD evolved as cryo-EM maps improved in resolution, allowing advanced sampling algorithms to simultaneously refine backbone and sidechains. Moving beyond a single static snapshot, modern inferencing approaches integrate cryo-EM and MD to generate structural ensembles from cryo-EM map data or directly from the particle images themselves. We summarize the recent history of MD innovations in the area of cryo-EM modeling. The merits for the myriad of MD based cryo-EM modeling methods are discussed, as well as, the discoveries that were made possible by the integration of molecular modeling with cryo-EM. Lastly, current challenges and potential opportunities are reviewed.

Biochemistry & Molecular Biology↗

DOE OSTI2022

How May the Choice of Downscaling Techniques and Meteorological Reference Observations Affect Future Hydroclimate Projections?

Abstract We present an intercomparison of a suite of high‐resolution downscaled climate projections based on a six‐member General Circulation Model (GCM) ensemble from Coupled Models Intercomparison Project (CMIP6). The CMIP6 GCMs have been downscaled using dynamical and statistical downscaling techniques based on two meteorological reference observations over the conterminous United States. We use the regional climate model, RegCM4, for dynamical downscaling, double bias correction constructed analogs method for statistical downscaling, and Daymet and Livneh datasets as the reference observations for statistical training and bias‐correction. We evaluate the performances of downscaled data in both historical and future periods under the SSP585 scenario. While dynamical downscaling improves the simulation of some performance evaluation indices, it adds an extra bias in others, highlighting the need for statistical correction before its use in impact assessments. Downscaled datasets after bias‐correction compare exceptionally well with observations. However, the choice of downscaling techniques and the underlying reference observations influence the hydroclimate characteristics of downscaled data. For instance, the statistical downscaling generally preserves the GCMs climate change signal but overestimates the frequency of hot extremes. Similarly, simulated future changes are sensitive to the choice of reference observations, particularly for precipitation extremes that exhibit a higher projected increase in the ensembles trained and/or corrected by Daymet than Livneh. Overall, these results demonstrate that multiple factors, including downscaling techniques and reference observations, can substantially influence the outcome of downscaled climate projections and stress the need for a comprehensive understanding of such method‐based uncertainties.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

Triangular cross-section grating couplers for integrated quantum nanophotonic hardware in silicon carbide

We design, fabricate, and characterize fishbone grating couplers for triangular cross-section photonics in silicon carbide compatible with color center integration. The periodic and aperiodic grating coupler designs are optimized to outcouple up to 31% of light in the fundamental TE mode of a triangular waveguide. The devices are fabricated using an ion beam etching process in a 4H–SiC sample implanted with NV center ensembles. The room-temperature transmission and the cryogenic NV center photoluminescence collection measurements indicate experimental grating coupler efficiency of up to 24%. This result provides a scalable method to efficiently extract color center light from SiC quantum nanophotonic devices to free-space optics.

Saha, Pranta↗

DOE OSTI2026

Identification of Differential Equations by Dynamics-Guided Weighted Weak Form with Voting

In the identification of differential equations from data, significant progresses have been made with the weak/integral formulation. In this paper, we explore the direction of finding more efficient and robust test functions adaptively given the observed data. While this is a difficult task, we propose weighting a collection of localized test functions for better identification of differential equations from a single trajectory of noisy observations on the differential equation. We find that using high dynamic regions is effective in finding the equation as well as the coefficients, and propose a dynamics indicator per differential term and weight the weak form accordingly. For stable identification against noise, we further introduce a voting strategy to identify the active features from an ensemble of recovered results by selecting the features that frequently occur in different weighting of test functions. Systematic numerical experiments are provided to demonstrate the robustness of our method.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

Feature‐shared adaptive‐boost deep learning for invasiveness classification of pulmonary subsolid nodules in CT images

Purpose In clinical practice, invasiveness is an important reference indicator for differentiating the malignant degree of subsolid pulmonary nodules. These nodules can be classified as atypical adenomatous hyperplasia (AAH), adenocarcinoma in situ (AIS), minimally invasive adenocarcinoma (MIA), or invasive adenocarcinoma (IAC). The automatic determination of a nodule's invasiveness based on chest CT scans can guide treatment planning. However, it is challenging, owing to the insufficiency of training data and their interclass similarity and intraclass variation. To address these challenges, we propose a two‐stage deep learning strategy for this task: prior‐feature learning followed by adaptive‐boost deep learning. Methods The adaptive‐boost deep learning is proposed to train a strong classifier for invasiveness classification of subsolid nodules in chest CT images, using multiple 3D convolutional neural network (CNN)‐based weak classifiers. Because ensembles of multiple deep 3D CNN models have a huge number of parameters and require large computing resources along with more training and testing time, the prior‐feature learning is proposed to reduce the computations by sharing the CNN layers between all weak classifiers. Using this strategy, all weak classifiers can be integrated into a single network. Results Tenfold cross validation of binary classification was conducted on a total of 1357 nodules, including 765 noninvasive (AAH and AIS) and 592 invasive nodules (MIA and IAC). Ablation experimental results indicated that the proposed binary classifier achieved an accuracy of with an AUC of 81.3 . These results are superior compared to those achieved by three experienced chest imaging specialists who achieved an accuracy of , , and , respectively. About 200 additional nodules were also collected. These nodules covered 50 cases for each category (AAH, AIS, MIA, and IAC, respectively). Both binary and multiple classifications were performed on these data and the results demonstrated that the proposed method definitely achieves better performance than the performance achieved by nonensemble deep learning methods. Conclusions It can be concluded that the proposed adaptive‐boost deep learning can significantly improve the performance of invasiveness classification of pulmonary subsolid nodules in CT images, while the prior‐feature learning can significantly reduce the total size of deep models. The promising results on clinical data show that the trained models can be used as an effective lung cancer screening tool in hospitals. Moreover, the proposed strategy can be easily extended to other similar classification tasks in 3D medical images.

Wang, Jun↗

DOE OSTI2023

Using Ultrasound Image Augmentation and Ensemble Predictions to Prevent Machine-Learning Model Overfitting

Deep learning predictive models have the potential to simplify and automate medical imaging diagnostics by lowering the skill threshold for image interpretation. However, this requires predictive models that are generalized to handle subject variability as seen clinically. Here, we highlight methods to improve test accuracy of an image classifier model for shrapnel identification using tissue phantom image sets. Using a previously developed image classifier neural network—termed ShrapML—blind test accuracy was less than 70% and was variable depending on the training/test data setup, as determined by a leave one subject out (LOSO) holdout methodology. Introduction of affine transformations for image augmentation or MixUp methodologies to generate additional training sets improved model performance and overall accuracy improved to 75%. Further improvements were made by aggregating predictions across five LOSO holdouts. This was done by bagging confidences or predictions from all LOSOs or the top-3 LOSO confidence models for each image prediction. Top-3 LOSO confidence bagging performed best, with test accuracy improved to greater than 85% accuracy for two different blind tissue phantoms. This was confirmed by gradient-weighted class activation mapping to highlight that the image classifier was tracking shrapnel in the image sets. Overall, data augmentation and ensemble prediction approaches were suitable for creating more generalized predictive models for ultrasound image analysis, a critical step for real-time diagnostic deployment.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2021

Unsupervised Power System Event Detection and Classification Using Unlabeled PMU Data

This paper proposes a novel data-driven power system event detection and classification method based on 5TB of actual PMU measurements collected from the US western interconnect. Firstly, a set of comprehensive power quality rules are proposed to pre-filter the raw data and extract the regions of interest (ROI). Six distinct event categories are defined and corresponding patterns are chosen as references. Meanwhile, detailed characteristics of patterns are summarized to enhance our understanding of the actual events. Then, the time-independent feature vectors are generated by extracting the statistical, temporal, and spectral features from the raw time-series data. Furthermore, an ensemble model is proposed to cluster the events by combining multiple K-means clustering models using a voting strategy. Besides, both system-level and PMU-level clustering models are developed. The accuracy and robustness of the event detection method are further improved through interactive evaluation of the two-level clustering results. This paper summarizes the actual characteristics of each event category and provides a reliable basis for accurate label generation. The experiments demonstrate the effectiveness of the proposed event detection and classification method.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2021

Unsupervised Power System Event Detection and Classification Using Unlabeled PMU Data

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2021

Explaining and predicting human behavior and social dynamics in simulated virtual worlds: reproducibility, generalizability, and robustness of causal discovery methods

Ground Truth program was designed to evaluate social science modeling approaches using simulation test beds with ground truth intentionally and systematically embedded to understand and model complex Human Domain systems and their dynamics Lazer et al. (Science 369:1060–1062, 2020). Our multidisciplinary team of data scientists, statisticians, experts in Artificial Intelligence (AI) and visual analytics had a unique role on the program to investigate accuracy, reproducibility, generalizability, and robustness of the state-of-the-art (SOTA) causal structure learning approaches applied to fully observed and sampled simulated data across virtual worlds. In addition, we analyzed the feasibility of using machine learning models to predict future social behavior with and without causal knowledge explicitly embedded. In this paper, we first present our causal modeling approach to discover the causal structure of four virtual worlds produced by the simulation teams—Urban Life, Financial Governance, Disaster and Geopolitical Conflict. Our approach adapts the state-of-the-art causal discovery (including ensemble models), machine learning, data analytics, and visualization techniques to allow a human-machine team to reverse-engineer the true causal relations from sampled and fully observed data. We next present our reproducibility analysis of two research methods team’s performance using a range of causal discovery models applied to both sampled and fully observed data, and analyze their effectiveness and limitations. We further investigate the generalizability and robustness to sampling of the SOTA causal discovery approaches on additional simulated datasets with known ground truth. Our results reveal the limitations of existing causal modeling approaches when applied to large-scale, noisy, high-dimensional data with unobserved variables and unknown relationships between them. We show that the SOTA causal models explored in our experiments are not designed to take advantage from vasts amounts of data and have difficulty recovering ground truth when latent confounders are present; they do not generalize well across simulation scenarios and are not robust to sampling; they are vulnerable to data and modeling assumptions, and therefore, the results are hard to reproduce. Finally, when we outline lessons learned and provide recommendations to improve models for causal discovery and prediction of human social behavior from observational data, we highlight the importance of learning data to knowledge representations or transformations to improve causal discovery and describe the benefit of causal feature selection for predictive and prescriptive modeling.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Tailoring Microbial Fitness Through Computational Steering and CRISPRi-Driven Robustness Regulation

The widespread application of genetically modified microorganisms (GMMs) across diverse sectors underscores the pressing need for robust strategies to mitigate the risks associated with their potential uncontrolled escape. This study merges computational modeling with CRISPR interference (CRISPRi) to refine GMM metabolic robustness. Utilizing ensemble modeling, we achieved high-throughput in silico screening for enzymatic targets susceptible to expression alterations. Translating these insights, we developed functional CRISPRi, boosting fitness control via multiplexed gene knockdown. Our method, enhanced by an insulator-improved gRNA structure and an off-switch circuit controlling a compact Cas12m, resulted in rationally engineered strains with escape frequencies below National Institutes of Health standards. The effectiveness of this approach was confirmed under various conditions, showcasing its ability for secure GMM management. This research underscores the resilience of microbial metabolism, strategically modifying key nodes to halt growth without provoking significant resistance, thereby enabling more reliable and precise GMM control. A record of this paper's transparent peer review process is included in the supplemental information.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2020

Automated Integration of Continental-Scale Observations in Near-Real Time for Simulation and Analysis of Biosphere–Atmosphere Interactions

The National Ecological Observatory Network (NEON) is a continental-scale observatory with sites across the US collecting standardized ecological observations that will operate for multiple decades. To maximize the utility of NEON data, we envision edge computing systems that gather, calibrate, aggregate, and ingest measurements in an integrated fashion. Edge systems will employ machine learning methods to cross-calibrate, gap-fill and provision data in near-real time to the NEON Data Portal and to High Performance Computing (HPC) systems, running ensembles of Earth system models (ESMs) that assimilate the data. For the first time gridded EC data products and response functions promise to offset pervasive observational biases through evaluating, benchmarking, optimizing parameters, and training new machine learning parameterizations within ESMs all at the same model-grid scale. Leveraging open-source software for EC data analysis, we are already building software infrastructure for integration of near-real time data streams into the International Land Model Benchmarking (ILAMB) package for use by the wider research community. We will present a perspective on the design and integration of end-to-end infrastructure for data acquisition, edge computing, HPC simulation, analysis, and validation, where Artificial Intelligence (AI) approaches are used throughout the distributed workflow to improve accuracy and computational performance.

Durden, David J.↗

DOE OSTI2021

An Implementation of Replica Exchange with Dynamical Scaling for Efficient Large-Scale Simulations

An implementation of the replica exchange with dynamical scaling (REDS) method in the commonly used molecular dynamics program GROMACS is presented. REDS is a replica exchange method that requires fewer replicas than conventional replica exchange while still providing data over a range of temperatures and can be used in either constant volume or constant pressure ensembles. Details for running REDS simulations are given, and an application to the human islet amyloid polypeptide (hIAPP) 11-25 fragment shows that the model efficiently samples conformational space.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2020

Assembly of Building Blocks by Double-End-Anchored Polymers in the Dilute Regime Mediated by Hydrophobic Interactions at Controlled Distances

Hierarchical assembly of building blocks via competing, orthogonal interactions is a hallmark of many of nature’s composite materials that do not require highly specific ligand-receptor interactions. To mimic this assembly mechanism requires the development of building blocks capable of tunable interactions. In the present work, we explored the interplay between repulsive (steric and electrostatic) and attractive hydrophobic forces. The designed building blocks allow hydrophobic forces to effectively act at controlled, large distances, to create and tune the assembly of membrane-based building blocks under dilute conditions and affect their interactions with cellular membranes via physical cross-bridges. Specifically, we employed double-end-anchored poly(ethylene glycol)s (DEA-PEGs)—hydrophilic PEG tethers with hydrophobic tails on both ends. Using differential-interference-contrast optical microscopy, synchrotron small angle X-ray scattering (SAXS), and cryogenic electron microscopy, we investigated the ability of DEA-PEGs to mediate assembly in the dilute regime on multiple length scales and on practical time scales. The PEG length, anchor hydrophobicity, and molar fraction of DEA-PEG molecules within a membrane strongly affect the assembly properties. Additional tuning of the intermembrane interactions can be achieved by adding repulsive interactions via PEG-lipids (steric) or cationic lipids to the DEA-PEG-mediated attractions. Further, while the optical and electron microscope imaging methods provided qualitative evidence of the ability of DEA-PEGs to assemble liposomes, the SAXS measurements and quantitative line-shape analysis in dilute preparations demonstrated that the ensemble average of loosely organized liposomal assemblies maintains DEA-PEG concentration-dependent tethering on defined nanometer length scales. For cationic liposome–DNA nanoparticles (CL–DNA NPs), aggregation induced by DEA-PEGs decreased internalization of NPs by cells, but tuning the DEA-PEG-induced attractions by adding repulsive steric interactions via PEG-lipids limited aggregation and increased NP uptake. However, confocal microscopy imaging together with colocalization studies with Rab11 and LysoTracker as markers of intracellular pathways showed that modifying CL–DNA NPs with DEA-PEGs alters their interactions with the plasma and endosomal membranes.

- x-ray scattering↗