Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Robustness analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Hyper Suprime-Cam Year 3 results: Cosmology from cosmic shear two-point correlation functions

Here, we perform a blinded cosmology analysis with cosmic shear two-point correlation functions measured from more than 25 million galaxies in the Hyper Suprime-Cam three-year shear catalog in four tomographic redshift bins ranging from 0.3 to 1.5. After conservative masking and galaxy selection, the survey covers 416 deg 2 of the northern sky with an effective galaxy number density of 15 arcmin –2 over the four redshift bins. The 2PCFs adopted for cosmology analysis are measured in the angular range; 7.1 <θ/arcmin < 56.6 for ξ + and 31.2 < θ/arcmin < 248 for ξ – , with a total signal-to-noise ratio of 26.6. We apply a conservative, wide, flat prior on the photometric redshift errors on the last two tomographic bins, and the relative magnitudes of the cosmic shear amplitude across four redshift bins allow us to calibrate the photometric redshift errors. With this flat prior on redshift errors, we find Ω m = 0.25⁢6$^{+0.056}_{–0.044}$ and S 8 ≡ σ 8 ⁢$\sqrt{Ω_{m}/0.3}$ = 0.76⁢9$^{+0.031}_{–0.034}$ (both 68% C.I.) for a flat Λ cold dark matter cosmology. We find, after unblinding, that our constraint on S 8 is consistent with the Fourier space cosmic shear and the 3 × 2 pt analyses on the same HSC dataset. We carefully study the potential systematics from astrophysical and systematic model uncertainties in our fiducial analysis using synthetic data, and report no biases (including projection bias in the posterior space) greater than 0.5σ in the estimation of S 8 . Our analysis hints that the mean redshifts of the two highest tomographic bins are higher than initially estimated. In addition, a number of consistency tests are conducted to assess the robustness of our analysis. Comparing our result with Planck-2018 cosmic microwave background observations, we find a ~2σ tension for the Λ ⁢CDM model.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2017

Triton: Igiugig Fish Video Analysis (Project Report)

This document summarizes the analysis of video data collected around the Ocean Renewable Power Company’s RivGen® device in the Kvichak River during July and August 2015. Human (manual) analysis of the data was undertaken and used to develop automated algorithms to detect fish in the frames and describe interaction behavior. In addition, a web application, EyeSea, was developed to combine manual and automated processing, so that ultimately the automated algorithms could be used to identify where human analysis was needed (i.e., when fish are present in video frames). The aim of the project was to develop algorithms that could identify video frames with fish present that could then be used to enable faster manual analysis. However, the project has also identified recommendations for future data collection, and research that could help analysis and interpretation. The manual analysis started to look at all data from the start of the deployment; this was to ensure rare events were seen, and initially focused on night-time data when more fish were present. This process highlighted the amount of time taken to identify fish, and ultimately only 42.33 hours of video were reviewed due to the time-consuming analysis. The data were classified as ‘Fish’, when the reviewer was confident it was a fish, and ‘Maybe’ fish, when it was difficult to distinguish. This was based on the movement, shape and color characteristics. ‘Fish’ were further classified as ‘adult’, ‘juvenile’, or ‘unidentifiable’. Behavioral attributes were noted, which were broadly divided into passive and avoidance activities. In over 42 hours data, there were only 20 potential contact interactions, of which 3 were ‘Maybe’ classifications, 12 were juveniles and 5 were adults; on only one occasion was an actual contact confirmed, and this was an adult fish with the camera, not the turbine itself. This also highlights the difficulties associated with confirming a strike or collision event as occurring or being a near-miss. More interactions were detected at night; this was probably biased by nighttime artificial light use, which may have attracted fish, but also could have increased detection probability as the light is reflected from the fish itself. For the algorithm development, background subtraction, optical flow, and deep learning techniques were considered. The deep learning approach was determined as needing too much training data for this application, and therefore was not continued. The optical flow analysis was considered promising, but did not give immediate results, so would need further investigation. Therefore, background subtraction was the main focus. Three methods of background subtraction were tried: Robust Principal Components Analysis (RPCA), Gaussian Mixture Model (GMM) and Video Background Extraction(ViBE). A classification technique was then applied to the foreground images to determine fish presence. Using this combination, it was found that fish could be accurately detected when occupying more pixels (>200 pixels, 98.2% correct; 100-200 pixels, 99.6% correct; 5-100 pixels, 85.4% correct; 2-5 pixels, 66.3% correct). In parallel, EyeSea was developed to convert the video data to a usable form and to enable manual and automated analysis of the data that would have a standardized output. Recommendations for further research, and standardized methods for data collection are given.

13 HYDRO ENERGY↗
DOE OSTI2019

How to Host An Effective Data Competition: Statistical Advice for Competition Design and Analysis

Data competitions rely on real-time leaderboards to rank competitor entries and stimulate algorithm improvement. While such competitions have become quite popular and prevalent, particularly in supervised learning formats, their implementations by the host are highly variable. Without careful planning, a supervised learning competition is vulnerable to overfitting, where the winning solutions are so closely tuned to the particular set of provided data that they cannot generalize to the underlying problem of interest to the host. This paper outlines some important considerations for strategically designing relevant and informative data sets to maximize the learning outcome from hosting a competition based on our experience. It also describes a postcompetition analysis that enables robust and efficient assessment of the strengths and weaknesses of solutions from different competitors, as well as greater understanding of the regions of the input space that are well-solved. The postcompetition analysis, which complements the leaderboard, uses exploratory data analysis and generalized linear models (GLMs). The GLMs not only expand the range of results we can explore, they also provide more detailed analysis of individual subquestions including similarities and differences between algorithms across different types of scenarios, universally easy or hard regions of the input space, and different learning objectives. When coupled with a strategically planned data generation approach, the methods provide richer and more informative summaries to enhance the interpretation of results beyond just the rankings on the leaderboard. The methods are illustrated with a recently completed competition to evaluate algorithms capable of detecting, identifying, and locating radioactive materials in an urban environment.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2012

NASA's Carbon Monitoring System Flux-Pilot Project: A Multi-Component Analysis System for Carbon-Cycle Research and Monitoring

The importance of greenhouse gas increases for climate motivates NASA s observing strategy for CO2 from space, including the forthcoming Orbiting Carbon Observatory (OCO-2) mission. Carbon cycle monitoring, including attribution of atmospheric concentrations to regional emissions and uptake, requires a robust modeling and analysis infrastructure to optimally extract information from the observations. NASA's Carbon-Monitoring System Flux-Pilot Project (FPP) is a prototype for such analysis, combining a set of unique tools to facilitate analysis of atmospheric CO2 along with fluxes between the atmosphere and the terrestrial biosphere or ocean. NASA's analysis system is unique, in that it combines information and expertise from the land, oceanic, and atmospheric branches of the carbon cycle and includes some estimates of uncertainty. Numerous existing space-based missions provide information of relevance to the carbon cycle. This study describes the components of the FPP framework, assessing the realism of computed fluxes, thus providing the basis for research and monitoring applications. Fluxes are computed using data-constrained terrestrial biosphere models and physical ocean models, driven by atmospheric observations and assimilating ocean-color information. Use of two estimates provides a measure of uncertainty in the fluxes. Along with inventories of other emissions, these data-derived fluxes are used in transport models to assess their consistency with atmospheric CO2 observations. Closure is achieved by using a four-dimensional data assimilation (inverse) approach that adjusts the terrestrial biosphere fluxes to make them consistent with the atmospheric CO2 observations. Results will be shown, illustrating the year-to-year variations in land biospheric and oceanic fluxes computed in the FPP. The signals of these surface-flux variations on atmospheric CO2 will be isolated using forward modeling tools, which also incorporate estimates of transport error. The results will be discussed in the context of interannual variability of observed atmospheric CO2 distributions.

Pawson, S.↗
DOE OSTI2021

Evaluating Deception Detection Model Robustness To Linguistic Variation

With the increasing use of automated, machine learning-driven tools and the downstream impact that algorithmic judgements can have, it is critical to develop models that are robust to evolving or manipulated inputs. Evaluating the reliability of multimodal models across linguistic variations to understand model susceptibility to intentional linguistic adversarial attacks as well as natural linguistic variations is essential in this pursuit. We present extensive analysis of model robustness and susceptibility to linguistic variations in the setting of deceptive news detection, a difficult classification task that is an increasingly important problem to solve with the impact of misinformation spread online. We evaluate the effectiveness of incorporating adversarial defense strategies and measure model susceptibility to state-of-the-art adversarial attacks using two types of linguistic attacks — character and word perturbations. We consider two multiclass prediction tasks — a 3-way classification of tweets as trustworthy, propaganda, or disinformation; and a 4-way classification as clickbait, hoax, satire, or conspiracy — and compare the performance of three embeddings that have been state-of-the-art for several NLP tasks — GloVe, ELMo, and BERT — to highlight consistent trends in susceptibility, high confidence misclassifications, and high impact failures. We find that character or mixed ensemble models are the most effective defense mechanisms and that character perturbations are a more effective attack than word perturbations for deception classification.

adversarial evaluation↗
DOE OSTI2015

Disentangling multidimensional spatio-temporal data into their common and aberrant responses

With the advent of high-throughput measurement techniques, scientists and engineers are starting to grapple with massive data sets and encountering challenges with how to organize, process and extract information into meaningful structures. Multidimensional spatio-temporal biological data sets such as time series gene expression with various perturbations over different cell lines, or neural spike trains across many experimental trials, have the potential to acquire insight about the dynamic behavior of the system. For this potential to be realized, we need a suitable representation to understand the data. A general question is how to organize the observed data into meaningful structures and how to find an appropriate similarity measure. A natural way of viewing these complex high dimensional data sets is to examine and analyze the large-scale features and then to focus on the interesting details. Since the wide range of experiments and unknown complexity of the underlying system contribute to the heterogeneity of biological data, we develop a new method by proposing an extension of Robust Principal Component Analysis (RPCA), which models common variations across multiple experiments as the lowrank component and anomalies across these experiments as the sparse component. We show that the proposed method is able to find distinct subtypes and classify data sets in a robust way without any prior knowledge by separating these common responses and abnormal responses. Thus, the proposed method provides us a new representation of these data sets which has the potential to help users acquire new insight from data.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2016

Linking AS, SE, V, and MN Behavior to Natural Biostimulated Uranium Cycling

The project “Linking As, Se, V, and Mn behavior to Natural and Biostimulated Uranium Cycling” successfully investigated Arsenic cycling the Rifle Colorado IFRC. This project trained undergraduate and graduate students at the Colorado School of Mines, Vassar College, and Barnard College. This resulted in both undergraduate theses and a PhD thesis and multiple publications. The science was highly successful and we were able to test the main hypotheses. We have shown that (H1) under reducing conditions that promote uranium immobilization arsenic is readily mobilized, that (H2) thioarsenic species are abundant during this mobilization, and (H3) we have examined arsenic mobilization for site sediment. At the Rifle IFRC Acetate was added during experiments to immobilize Uranium. These experiments successfully immobilized uranium but unfortunately would mobilize arsenic. We developed robust sampling and analysis methods for thioarsenic species. We showed that the mobilization occurred under sulfate reducing conditions and the majority of the arsenic was in the form of thioarsenic species. Previous studies had predicted the presence of thioarsenic species but this study used robust field and laboratory methods to quantitatively determine the presence of thioarsenic species. During stimulation in wells with high arsenic the primary species were trithioarsenate and dithioarsenate. In wells with low levels of arsenic release thioarsenates were absent or minor components. Fortunately after the injection of acetate ended the aquifer would become less reducing and the arsenic concentrations would decrease to pre-injection levels. In aquifers where organic carbon is being added as a remedial method or as a contaminant the transient mobility of arsenic during sulfidogenesis should be considered especially in sulfate rich aquifers as this could impact downgradient water quality.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Exploring HOD-dependent systematics for the DESI 2024 Full-Shape galaxy clustering analysis

We analyze the robustness of the DESI 2024 cosmological inference from the full shape of the galaxy power spectrum to uncertainties in the Halo Occupation Distribution (HOD) model of the galaxy-halo connection and the choice of priors on nuisance parameters. We assess variations in the recovered cosmological parameters across a range of mocks populated with different HOD models and find that shifts are often greater than 20% of the expected statistical uncertainties from the DESI data. We encapsulate the effect of such shifts in terms of a systematic covariance term, C HOD , and an additional diagonal contribution quantifying the impact of our choice of nuisance parameter priors on the ability of the effective field theory (EFT) model to correctly recover the cosmological parameters of the simulations. These two covariance contributions are designed to be added to the usual covariance term, C stat , describing the statistical uncertainty in the power spectrum measurement, in order to fairly represent these sources of systematic uncertainty. This novel approach should be more general and robust to the choice of model or additional external datasets used in cosmological fits than the alternative approach of adding systematic uncertainties to the recovered marginalised parameter posteriors. We compare the approaches within the context of a fixed ΛCDM model and demonstrate that our method gives conservative estimates of the systematic uncertainty that nevertheless have little impact on the final posteriors obtained from DESI data.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Stage-resolved gene regulatory network analysis reveals developmental reprogramming and genes with robust stem-preferred expression in sorghum

Sorghum bicolor is a deep-rooted, heat- and drought-tolerant crop that thrives on marginal lands and is increasingly valued for its applications in biofuel, bioenergy, and biopolymer production. The sorghum stem, which can reach 4–5 m in length, serves as the primary reservoir of both lignocellulosic biomass and soluble sugars, making it a promising bioenergy feedstock. Although recent advances in genetic, genomic, and transcriptomic resources have improved our understanding of sorghum biology, comprehensive genome-wide analyses of functional dynamics across diverse organ types and developmental stages remain limited. In particular, candidate genes with stem preferred expression pattern or their associated cis-regulatory elements, which may program key stem-related functions and enable organ- or tissue-specific engineering, have not yet been identified.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS2010

Labyrinth Seal Flutter Analysis and Test Validation in Support of Robust Rocket Engine Design

High energy-density turbomachines, like the SSME turbopumps, utilize labyrinth seals, also referred to as knife-edge seals, to control leakage flow. The pressure drop for such seals is order of magnitude higher than comparable jet engine seals. This is aggravated by the requirement of tight clearances resulting in possible unfavorable fluid-structure interaction of the seal system (seal flutter). To demonstrate these characteristics, a benchmark case of a High Pressure Oxygen Turbopump (HPOTP) outlet Labyrinth seal was studied in detail. First, an analytical assessment of the seal stability was conducted using a Pratt & Whitney legacy seal flutter code. Sensitivity parameters including pressure drop, rotor-to-stator running clearances and cavity volumes were examined and modeling strategies established. Second, a concurrent experimental investigation was undertaken to validate the stability of the seal at the equivalent operating conditions of the pump. Actual pump hardware was used to construct the test rig, also referred to as the (Flutter Rig). The flutter rig did not include rotational effects or temperature. However, the use of Hydrogen gas at high inlet pressure provided good representation of the critical parameters affecting flutter especially the speed of sound. The flutter code predictions showed consistent trends in good agreement with the experimental data. The rig test program produced a stability threshold empirical parameter that separated operation with and without flutter. This empirical parameter was used to establish the seal build clearances to avoid flutter while providing the required cooling flow metering. The calibrated flutter code along with the empirical flutter parameter was used to redesign the baseline seal resulting in a flutter-free robust configuration. Provisions for incorporation of mechanical damping devices were introduced in the redesigned seal to ensure added robustness

El-Aini, Yehia↗
DOE OSTI2024

Automated Immunoprecipitation Workflow for Comprehensive Acetylome Analysis

Immunoprecipitation is one of the most effective methods for enrichment of lysine-acetylated peptides for comprehensive acetylome analysis using mass spectrometry. Manual acetyl peptide enrichment method using non-conjugated antibodies and agarose beads has been developed and applied in various studies. However, it is time consuming, and can introduce contaminants and variability that leads to potential sample loss and decreased sensitivity and robustness of the analysis. Here we describe a fast, automated enrichment protocol that enables reproducible and comprehensive acetylome analysis using a magnetic bead-based immunoprecipitation reagent.

Lysine acetylation, Acetylome, Acetyl peptide enri↗
DOE OSTI2026

The scientific case for concurrent neutron and X-ray scattering and spectroscopy

The interrogation of materials with X-rays or neutrons to determine structure, energetics, and dynamics is fundamental to advancing physical and chemical materials science and enabling innovative material technologies. A persistent challenge in materials development is that progress depends on understanding structure and dynamics across multiple length and time scales in increasingly complex, multicomponent systems featuring interfaces, heterogeneity, and hierarchical organization. Despite rapidly growing demands on materials characterization, current experimental approaches are almost exclusively based on isolated X-ray or neutron scattering and spectroscopy, reflecting a paradigm largely unchanged for decades. To assess the scientific need for a new experimental paradigm, a 3-day workshop sponsored by the U.S. National Science Foundation (NSF) was held at the SpringHill Suites, San Jose, California, from June 2 to 4, 2022. The workshop brought together 70 national and international experts who critically evaluated opportunities enabled by concurrent neutron and X-ray (NeX) scattering, spectroscopy, and imaging experiments. The participants reached a clear consensus that establishing NeX capabilities is crucial for advancing the science of complex materials in the United States. This report illustrates the scientific drivers for NeX experiments through representative examples spanning biomaterials, energy materials, soft matter, nanomaterials, quantum materials, geoscience, and applied materials research. The complementarity of neutrons and X-rays is essential for robust model development and refinement, particularly in multiphase and multicomponent systems. While joint refinement of data from separate experiments is valuable, concurrent measurements uniquely eliminate uncertainties arising from sample evolution, environmental drift, and irreproducibility associated with experiments performed at different locations and times. Realizing NeX capabilities will require the development of new instrumentation, data analysis frameworks, and robust sample environments compatible with both neutron and X-ray probes. Addressing these challenges will enable unambiguous interpretation of complex materials behavior and open new frontiers in materials research.

X-ray↗
DOE OSTI2014

Development of Bayesian analysis program for extraction of polarisation observables at CLAS

At the mass scale of a proton, the strong force is not well understood. Various quark models exist, but it is important to determine which quark model(s) are most accurate. Experimentally, finding resonances predicted by some models and not others would give valuable insight into this fundamental interaction. Several labs around the world use photoproduction experiments to find these missing resonances. The aim of this work is to develop a robust Bayesian data analysis program for extracting polarisation observables from pseudoscalar meson photoproduction experiments using CLAS at Jefferson Lab. This method, known as nested sampling, has been compared to traditional methods and has incorporated data parallelisation and GPU programming. It involves an event-by-event likelihood function, which has no associated loss of information from histogram binning, and results can be easily constrained to the physical region. One of the most important advantages of the nested sampling approach is that data from different experiments can be combined and analysed simultaneously. Results on both simulated and previously analysed experimental data for the K{sup +}Λ channel will be discussed.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
NASA NTRS1992

On the development of explicit robust schemes for implementation of a class of hyperelastic models in large-strain analysis of rubbers

The issue of developing effective and robust schemes to implement a class of the Ogden-type hyperelastic constitutive models, for large-strain analysis of rubber-like materials, is addressed. To this end, explicit forms for the corresponding material tangent-stiffness tensors are developed, and these are valid for the entire deformation range; i.e., with both distinct as well as repeated principal-stretch values. Throughout the analysis the various implications of the underlying property of separability of the strain-energy functions are exploited, thus leading to compact final forms of the tensor expressions. In particular, this facilitated the treatment of the complex cases of uncoupled volumetric/deviatoric formulations for incompressible materials, which are becoming increasingly popular in recent years. The forms derived are also amenable for use with symbolic-manipulation packages for systematic code generation.

Saleeb, A. F.↗
DOE OSTI2016

DARHT Multi-intelligence Seismic and Acoustic Data Analysis

The purpose of this report is to document the analysis of seismic and acoustic data collected at the Dual-Axis Radiographic Hydrodynamic Test (DARHT) facility at Los Alamos National Laboratory for robust, multi-intelligence decision making. The data utilized herein is obtained from two tri-axial seismic sensors and three acoustic sensors, resulting in a total of nine data channels. The goal of this analysis is to develop a generalized, automated framework to determine internal operations at DARHT using informative features extracted from measurements collected external of the facility. Our framework involves four components: (1) feature extraction, (2) data fusion, (3) classification, and finally (4) robustness analysis. Two approaches are taken for extracting features from the data. The first of these, generic feature extraction, involves extraction of statistical features from the nine data channels. The second approach, event detection, identifies specific events relevant to traffic entering and leaving the facility as well as explosive activities at DARHT and nearby explosive testing sites. Event detection is completed using a two stage method, first utilizing signatures in the frequency domain to identify outliers and second extracting short duration events of interest among these outliers by evaluating residuals of an autoregressive exogenous time series model. Features extracted from each data set are then fused to perform analysis with a multi-intelligence paradigm, where information from multiple data sets are combined to generate more information than available through analysis of each independently. The fused feature set is used to train a statistical classifier and predict the state of operations to inform a decision maker. We demonstrate this classification using both generic statistical features and event detection and provide a comparison of the two methods. Finally, the concept of decision robustness is presented through a preliminary analysis where uncertainty is added to the system through noise in the measurements.

58 GEOSCIENCES↗