Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “ensemble methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Triangular cross-section grating couplers for integrated quantum nanophotonic hardware in silicon carbide

We design, fabricate, and characterize fishbone grating couplers for triangular cross-section photonics in silicon carbide compatible with color center integration. The periodic and aperiodic grating coupler designs are optimized to outcouple up to 31% of light in the fundamental TE mode of a triangular waveguide. The devices are fabricated using an ion beam etching process in a 4H–SiC sample implanted with NV center ensembles. The room-temperature transmission and the cryogenic NV center photoluminescence collection measurements indicate experimental grating coupler efficiency of up to 24%. This result provides a scalable method to efficiently extract color center light from SiC quantum nanophotonic devices to free-space optics.

Saha, Pranta↗
DOE OSTI2026

Identification of Differential Equations by Dynamics-Guided Weighted Weak Form with Voting

In the identification of differential equations from data, significant progresses have been made with the weak/integral formulation. In this paper, we explore the direction of finding more efficient and robust test functions adaptively given the observed data. While this is a difficult task, we propose weighting a collection of localized test functions for better identification of differential equations from a single trajectory of noisy observations on the differential equation. We find that using high dynamic regions is effective in finding the equation as well as the coefficients, and propose a dynamics indicator per differential term and weight the weak form accordingly. For stable identification against noise, we further introduce a voting strategy to identify the active features from an ensemble of recovered results by selecting the features that frequently occur in different weighting of test functions. Systematic numerical experiments are provided to demonstrate the robustness of our method.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1972

Thermodynamics of hydrogen-helium mixtures at high pressure and finite temperature

A technique is reviewed for calculating thermodynamic quantities for mixtures of light elements at high pressure, in the metallic state. Ensemble averages are calculated with Monte Carlo techniques and periodic boundary conditions. Interparticle potentials are assumed to be coulombic, screened by the electrons in dielectric function theory. This method is quantitatively accurate for alloys at pressures above about 10 Mbar. An alloy of equal parts hydrogen and helium by mass appears to remain liquid and mixed for temperatures above about 3000 K, at pressures of about 15 Mbar. The additive volume law is satisfied to within about 10%, but the Gruneisen equation of state gives poor results. A calculation at 1300 K shows evidence of a hydrogen-helium phase separation.

Hubbard, W. B.↗
NASA NTRS2016

Multi-Parameter Scattering Sensor and Methods

Methods, detectors and systems detect particles and/or measure particle properties. According to one embodiment, a detector for detecting particles comprises: a sensor for receiving radiation scattered by an ensemble of particles; and a processor for determining a physical parameter for the detector, or an optimal detection angle or a bound for an optimal detection angle, for measuring at least one moment or integrated moment of the ensemble of particles, the physical parameter, or detection angle, or detection angle bound being determined based on one or more of properties (a) and/or (b) and/or (c) and/or (d) or ranges for one or more of properties (a) and/or (b) and/or (c) and/or (d), wherein (a)-(d) are the following: (a) is a wavelength of light incident on the particles, (b) is a count median diameter or other characteristic size parameter of the particle size distribution, (c) is a standard deviation or other characteristic width parameter of the particle size distribution, and (d) is a refractive index of particles.

Greenberg, Paul S.↗
DOE OSTI2020

Feature‐shared adaptive‐boost deep learning for invasiveness classification of pulmonary subsolid nodules in CT images

Purpose In clinical practice, invasiveness is an important reference indicator for differentiating the malignant degree of subsolid pulmonary nodules. These nodules can be classified as atypical adenomatous hyperplasia (AAH), adenocarcinoma in situ (AIS), minimally invasive adenocarcinoma (MIA), or invasive adenocarcinoma (IAC). The automatic determination of a nodule's invasiveness based on chest CT scans can guide treatment planning. However, it is challenging, owing to the insufficiency of training data and their interclass similarity and intraclass variation. To address these challenges, we propose a two‐stage deep learning strategy for this task: prior‐feature learning followed by adaptive‐boost deep learning. Methods The adaptive‐boost deep learning is proposed to train a strong classifier for invasiveness classification of subsolid nodules in chest CT images, using multiple 3D convolutional neural network (CNN)‐based weak classifiers. Because ensembles of multiple deep 3D CNN models have a huge number of parameters and require large computing resources along with more training and testing time, the prior‐feature learning is proposed to reduce the computations by sharing the CNN layers between all weak classifiers. Using this strategy, all weak classifiers can be integrated into a single network. Results Tenfold cross validation of binary classification was conducted on a total of 1357 nodules, including 765 noninvasive (AAH and AIS) and 592 invasive nodules (MIA and IAC). Ablation experimental results indicated that the proposed binary classifier achieved an accuracy of with an AUC of 81.3 . These results are superior compared to those achieved by three experienced chest imaging specialists who achieved an accuracy of , , and , respectively. About 200 additional nodules were also collected. These nodules covered 50 cases for each category (AAH, AIS, MIA, and IAC, respectively). Both binary and multiple classifications were performed on these data and the results demonstrated that the proposed method definitely achieves better performance than the performance achieved by nonensemble deep learning methods. Conclusions It can be concluded that the proposed adaptive‐boost deep learning can significantly improve the performance of invasiveness classification of pulmonary subsolid nodules in CT images, while the prior‐feature learning can significantly reduce the total size of deep models. The promising results on clinical data show that the trained models can be used as an effective lung cancer screening tool in hospitals. Moreover, the proposed strategy can be easily extended to other similar classification tasks in 3D medical images.

Wang, Jun↗
DOE OSTI2023

Using Ultrasound Image Augmentation and Ensemble Predictions to Prevent Machine-Learning Model Overfitting

Deep learning predictive models have the potential to simplify and automate medical imaging diagnostics by lowering the skill threshold for image interpretation. However, this requires predictive models that are generalized to handle subject variability as seen clinically. Here, we highlight methods to improve test accuracy of an image classifier model for shrapnel identification using tissue phantom image sets. Using a previously developed image classifier neural network—termed ShrapML—blind test accuracy was less than 70% and was variable depending on the training/test data setup, as determined by a leave one subject out (LOSO) holdout methodology. Introduction of affine transformations for image augmentation or MixUp methodologies to generate additional training sets improved model performance and overall accuracy improved to 75%. Further improvements were made by aggregating predictions across five LOSO holdouts. This was done by bagging confidences or predictions from all LOSOs or the top-3 LOSO confidence models for each image prediction. Top-3 LOSO confidence bagging performed best, with test accuracy improved to greater than 85% accuracy for two different blind tissue phantoms. This was confirmed by gradient-weighted class activation mapping to highlight that the image classifier was tracking shrapnel in the image sets. Overall, data augmentation and ensemble prediction approaches were suitable for creating more generalized predictive models for ultrasound image analysis, a critical step for real-time diagnostic deployment.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Unsupervised Power System Event Detection and Classification Using Unlabeled PMU Data

This paper proposes a novel data-driven power system event detection and classification method based on 5TB of actual PMU measurements collected from the US western interconnect. Firstly, a set of comprehensive power quality rules are proposed to pre-filter the raw data and extract the regions of interest (ROI). Six distinct event categories are defined and corresponding patterns are chosen as references. Meanwhile, detailed characteristics of patterns are summarized to enhance our understanding of the actual events. Then, the time-independent feature vectors are generated by extracting the statistical, temporal, and spectral features from the raw time-series data. Furthermore, an ensemble model is proposed to cluster the events by combining multiple K-means clustering models using a voting strategy. Besides, both system-level and PMU-level clustering models are developed. The accuracy and robustness of the event detection method are further improved through interactive evaluation of the two-level clustering results. This paper summarizes the actual characteristics of each event category and provides a reliable basis for accurate label generation. The experiments demonstrate the effectiveness of the proposed event detection and classification method.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Unsupervised Power System Event Detection and Classification Using Unlabeled PMU Data

This paper proposes a novel data-driven power system event detection and classification method based on 5TB of actual PMU measurements collected from the US western interconnect. Firstly, a set of comprehensive power quality rules are proposed to pre-filter the raw data and extract the regions of interest (ROI). Six distinct event categories are defined and corresponding patterns are chosen as references. Meanwhile, detailed characteristics of patterns are summarized to enhance our understanding of the actual events. Then, the time-independent feature vectors are generated by extracting the statistical, temporal, and spectral features from the raw time-series data. Furthermore, an ensemble model is proposed to cluster the events by combining multiple K-means clustering models using a voting strategy. Besides, both system-level and PMU-level clustering models are developed. The accuracy and robustness of the event detection method are further improved through interactive evaluation of the two-level clustering results. This paper summarizes the actual characteristics of each event category and provides a reliable basis for accurate label generation. The experiments demonstrate the effectiveness of the proposed event detection and classification method.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Explaining and predicting human behavior and social dynamics in simulated virtual worlds: reproducibility, generalizability, and robustness of causal discovery methods

Ground Truth program was designed to evaluate social science modeling approaches using simulation test beds with ground truth intentionally and systematically embedded to understand and model complex Human Domain systems and their dynamics Lazer et al. (Science 369:1060–1062, 2020). Our multidisciplinary team of data scientists, statisticians, experts in Artificial Intelligence (AI) and visual analytics had a unique role on the program to investigate accuracy, reproducibility, generalizability, and robustness of the state-of-the-art (SOTA) causal structure learning approaches applied to fully observed and sampled simulated data across virtual worlds. In addition, we analyzed the feasibility of using machine learning models to predict future social behavior with and without causal knowledge explicitly embedded. In this paper, we first present our causal modeling approach to discover the causal structure of four virtual worlds produced by the simulation teams—Urban Life, Financial Governance, Disaster and Geopolitical Conflict. Our approach adapts the state-of-the-art causal discovery (including ensemble models), machine learning, data analytics, and visualization techniques to allow a human-machine team to reverse-engineer the true causal relations from sampled and fully observed data. We next present our reproducibility analysis of two research methods team’s performance using a range of causal discovery models applied to both sampled and fully observed data, and analyze their effectiveness and limitations. We further investigate the generalizability and robustness to sampling of the SOTA causal discovery approaches on additional simulated datasets with known ground truth. Our results reveal the limitations of existing causal modeling approaches when applied to large-scale, noisy, high-dimensional data with unobserved variables and unknown relationships between them. We show that the SOTA causal models explored in our experiments are not designed to take advantage from vasts amounts of data and have difficulty recovering ground truth when latent confounders are present; they do not generalize well across simulation scenarios and are not robust to sampling; they are vulnerable to data and modeling assumptions, and therefore, the results are hard to reproduce. Finally, when we outline lessons learned and provide recommendations to improve models for causal discovery and prediction of human social behavior from observational data, we highlight the importance of learning data to knowledge representations or transformations to improve causal discovery and describe the benefit of causal feature selection for predictive and prescriptive modeling.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Tailoring Microbial Fitness Through Computational Steering and CRISPRi-Driven Robustness Regulation

The widespread application of genetically modified microorganisms (GMMs) across diverse sectors underscores the pressing need for robust strategies to mitigate the risks associated with their potential uncontrolled escape. This study merges computational modeling with CRISPR interference (CRISPRi) to refine GMM metabolic robustness. Utilizing ensemble modeling, we achieved high-throughput in silico screening for enzymatic targets susceptible to expression alterations. Translating these insights, we developed functional CRISPRi, boosting fitness control via multiplexed gene knockdown. Our method, enhanced by an insulator-improved gRNA structure and an off-switch circuit controlling a compact Cas12m, resulted in rationally engineered strains with escape frequencies below National Institutes of Health standards. The effectiveness of this approach was confirmed under various conditions, showcasing its ability for secure GMM management. This research underscores the resilience of microbial metabolism, strategically modifying key nodes to halt growth without provoking significant resistance, thereby enabling more reliable and precise GMM control. A record of this paper's transparent peer review process is included in the supplemental information.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Automated Integration of Continental-Scale Observations in Near-Real Time for Simulation and Analysis of Biosphere–Atmosphere Interactions

The National Ecological Observatory Network (NEON) is a continental-scale observatory with sites across the US collecting standardized ecological observations that will operate for multiple decades. To maximize the utility of NEON data, we envision edge computing systems that gather, calibrate, aggregate, and ingest measurements in an integrated fashion. Edge systems will employ machine learning methods to cross-calibrate, gap-fill and provision data in near-real time to the NEON Data Portal and to High Performance Computing (HPC) systems, running ensembles of Earth system models (ESMs) that assimilate the data. For the first time gridded EC data products and response functions promise to offset pervasive observational biases through evaluating, benchmarking, optimizing parameters, and training new machine learning parameterizations within ESMs all at the same model-grid scale. Leveraging open-source software for EC data analysis, we are already building software infrastructure for integration of near-real time data streams into the International Land Model Benchmarking (ILAMB) package for use by the wider research community. We will present a perspective on the design and integration of end-to-end infrastructure for data acquisition, edge computing, HPC simulation, analysis, and validation, where Artificial Intelligence (AI) approaches are used throughout the distributed workflow to improve accuracy and computational performance.

Durden, David J.↗
DOE OSTI2021

An Implementation of Replica Exchange with Dynamical Scaling for Efficient Large-Scale Simulations

An implementation of the replica exchange with dynamical scaling (REDS) method in the commonly used molecular dynamics program GROMACS is presented. REDS is a replica exchange method that requires fewer replicas than conventional replica exchange while still providing data over a range of temperatures and can be used in either constant volume or constant pressure ensembles. Details for running REDS simulations are given, and an application to the human islet amyloid polypeptide (hIAPP) 11-25 fragment shows that the model efficiently samples conformational space.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Assembly of Building Blocks by Double-End-Anchored Polymers in the Dilute Regime Mediated by Hydrophobic Interactions at Controlled Distances

Hierarchical assembly of building blocks via competing, orthogonal interactions is a hallmark of many of nature’s composite materials that do not require highly specific ligand-receptor interactions. To mimic this assembly mechanism requires the development of building blocks capable of tunable interactions. In the present work, we explored the interplay between repulsive (steric and electrostatic) and attractive hydrophobic forces. The designed building blocks allow hydrophobic forces to effectively act at controlled, large distances, to create and tune the assembly of membrane-based building blocks under dilute conditions and affect their interactions with cellular membranes via physical cross-bridges. Specifically, we employed double-end-anchored poly(ethylene glycol)s (DEA-PEGs)—hydrophilic PEG tethers with hydrophobic tails on both ends. Using differential-interference-contrast optical microscopy, synchrotron small angle X-ray scattering (SAXS), and cryogenic electron microscopy, we investigated the ability of DEA-PEGs to mediate assembly in the dilute regime on multiple length scales and on practical time scales. The PEG length, anchor hydrophobicity, and molar fraction of DEA-PEG molecules within a membrane strongly affect the assembly properties. Additional tuning of the intermembrane interactions can be achieved by adding repulsive interactions via PEG-lipids (steric) or cationic lipids to the DEA-PEG-mediated attractions. Further, while the optical and electron microscope imaging methods provided qualitative evidence of the ability of DEA-PEGs to assemble liposomes, the SAXS measurements and quantitative line-shape analysis in dilute preparations demonstrated that the ensemble average of loosely organized liposomal assemblies maintains DEA-PEG concentration-dependent tethering on defined nanometer length scales. For cationic liposome–DNA nanoparticles (CL–DNA NPs), aggregation induced by DEA-PEGs decreased internalization of NPs by cells, but tuning the DEA-PEG-induced attractions by adding repulsive steric interactions via PEG-lipids limited aggregation and increased NP uptake. However, confocal microscopy imaging together with colocalization studies with Rab11 and LysoTracker as markers of intracellular pathways showed that modifying CL–DNA NPs with DEA-PEGs alters their interactions with the plasma and endosomal membranes.

- x-ray scattering↗
DOE OSTI2020

Future Warming and Intensification of Precipitation Extremes: A “Double Whammy” Leading to Increasing Flood Risk in California

This study focuses on quantifying future anthropogenic changes in surface runoff associated with extreme precipitation in California's Sierra Nevada. The method involves driving a land surface model with output from a high resolution regional atmospheric simulation of the most extreme atmospheric rivers (ARs). AR events were selected from an ensemble of global climate model simulations of historical and late 21st century climate under the “high-emission” RCP8.5 scenario. Average precipitation during the future ARs increases by ~25% but a much lower proportion falls as snow. The resulting future runoff increase is dramatic—nearly 50%, reflecting both the precipitation increase and simultaneous conversion of snow to rain. The “double whammy” impact on runoff is largest in the 2,000–2,500 m elevation band, where the snowfall loss and precipitation increase are both especially large. Overall, this huge increase in runoff during the most extreme AR events could present major flood control challenges for the region.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Continuous integration data-driven platform of industrial-scale subsurface storage for real-time analytics

This project helped address the growing need for efficient and scalable models to support geological carbon and energy storage, which are crucial for achieving net-zero emissions. Traditionally accurate high-fidelity numerical models have been used to simulate relevant storage processes under a handful of processes, however such models are computationally demanding, making uncertainty quantification impractical. Consequently, we first developed a machine learning framework, based on Graph Neural Operators (GNOs), to improving the accuracy of model predictions for a fixed computational budget. We then developed an Ensemble of Improved Neural Operators (ENO), which uses bagging and Monte Carlo dropout techniques, to further improve prediction accuracy. Lastly, we developed the way to explain progressive transfer learning methods to reduce the amount of training data and computational cost of training (i.e., reduce trainable parameters) when using our models for multiple storage sites. Our numerical investigation, which used real-world case studies, demonstrated that our framework can significantly improve the safety and efficiency of geological storage operations, with potential applications in other domains such as geothermal reservoirs and climate modeling.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1987

Airborne intercomparisons of carbon monoxide measurement techniques

Results from an airborne intercomparison of techniques to measure tropospheric levels of carbon monoxide (CO) are discussed. The intercomparison was conducted as part of the National Aeronautics and Space Administration's Global Tropospheric Experiment and included a laser differential absorption method and two grab sample/gas chromatograph methods. Measurements were obtained during approximately 90 flight hours, during which the CO mixing ratios ranged from about 60 to 140 ppbv. The level of agreement observed for the ensemble of measurements was well within the overall accuracy stated for each instrument. The correlation observed between the measurements from the respective pairs of instruments ranged from 0.85 to 0.98, with no evidence for the presence of either a constant or proportional bias between any of the instruments.

Hoell, James M., Jr.↗
NASA NTRS1992

Three-dimensional shock-wave/boundary-layer interactions with bleed through a circular hole

Computations were performed to study three-dimensional (3-D), shock-wave/boundary-layer interactions on a flat plate in which fluid in the boundary layer was bled through a circular hole into a plenum to control shock-wave induced separation. Results are presented which show the details of the 3-D flowfield about the bleed hole and how bleed-hole placement relative to shock-wave impingement affect upstream, spanwise, and downstream influence lengths. This study revealed an underlying mechanisms by which bleed holes can affect shock-wave/boundary-layer interactions. This investigation is based on the ensemble-averaged, "full-compressible" Navier-Stokes equations closed by the Baldwin-Lomax turbulence model. Solutions to these equations were obtained by an implicit finite-volume method based on the partially-split, two-factored algorithm of Steger.

Rimlinger, M. J.↗