Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “error estimation and analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

An Experimental Investigation of Human Performance Differences Depending on Simulator Complexity

As a different approach to collect human reliability analysis (HRA) data compared to the full-scope simulator studies, Idaho National Laboratory (INL) has attempted to collect HRA data based on Simplified Human Error Experimental Program (SHEEP), which uses a simplified simulator and student participants. To date, INL has considered the SHEEP approach using simplified simulators such as Rancor Microworld and Compact Nuclear Simulator to complement – not replace – full-scope studies as well as to mainly collect HRA data for estimating nominal/basic human error probabilities (HEPs) needed in the HRA quantification process. This study is a part of the project aiming to suggest how to support full-scope data collection studies based on SHEEP. This paper first introduces major tasks within the SHEEP framework. Then, as one of the major tasks, why and how we have planned to experimentally investigate human performance differences depending on simulator complexity are mainly introduced in this paper.

99 GENERAL AND MISCELLANEOUS↗

Quantifying uncertainty in analysis of shockless dynamic compression experiments on platinum. II. Bayesian model calibration

Dynamic shockless compression experiments provide the ability to explore material behavior at extreme pressures but relatively low temperatures. Typically, the data from these types of experiments are interpreted through an analytic method called Lagrangian analysis. Here, in this work, alternative analysis methods are explored using modern statistical methods. Specifically, Bayesian model calibration is applied to a new set of platinum data shocklessly compressed to 570 GPa. Several platinum equation-of-state models are evaluated, including traditional parametric forms as well as a novel non-parametric model concept. The results are compared to those in Paper I obtained by inverse Lagrangian analysis. The comparisons suggest that Bayesian calibration is not only a viable framework for precise quantification of the compression path, but also reveals insights pertaining to trade-offs surrounding model form selection, sensitivities of the relevant experimental uncertainties, and assumptions and limitations within Lagrangian analysis. The non-parametric model method, in particular, is found to give precise unbiased results and is expected to be useful over a wide range of applications. The calibration results in estimates of the platinum principal isentrope over the full range of experimental pressures to a standard error of 1.6%, which extends the results from Paper I while maintaining the high precision required for the platinum pressure standard.

Brown, Justin Lee↗

Sensitive detection of structural dynamics using a statistical framework for comparative crystallography

Chemical and conformational changes are crucial to protein function and its pharmacological control. X-ray crystallography can reveal these changes in atomic detail, but standard analysis methods, which refine separate datasets, often overlook differences that are subtle or arise in only a subset of molecules. Direct comparison of crystallographic datasets is, in principle, more powerful, but systematic errors (“scales”) often mask changes in the crystallographic observables (“structure factors”). Machine learning algorithms that jointly estimate scales and structure factors can address this limitation. Here, we augment this approach with multivariate, structured priors derived from crystallographic theory, implemented in the variational deep learning framework Careless. Doing so strongly improves the detection of protein dynamics, element-specific anomalous signals, and the binding of drug candidates, offering a robust approach to comparative crystallography and, potentially, to detection of protein dynamics by other structure determination methods.

Hekstra, Doeke R. [Harvard Univ., Cambridge, MA (U↗

BCS (CSP Beam Characterization System) [SWR-23-13]

The Beam Characterization System (BCS) is an image-processing tool for estimating heliostat tracking errors. A large mirror, or heliostat, reflects the sun onto a distant target. A carefully calibrated camera then takes an image of this target to capture the shape of the reflected beam. The software kit hosts a series of scripts to identify key features and run analysis on the captured images.

Kesseli, Devon↗

A Dynamic Amplitude-Correcting Gradient Estimation Technique to Align X-ray Focusing Optics

High-brightness X-rays, as produced at synchrotrons and X-ray free electron laser (XFEL) facilities, are used to characterize materials in a variety of scientific experiments. In most cases, effective use of the high-energy light requires precisely-aligned focusing optics; one example being a compound refractive lens (CRL). To align a CRL, the position and rotation must be optimized along four axes. In practice, this is a labor-intensive, time-consuming manual process that can monopolize scarce experimental time at the necessary X-ray facilities. Models of the expected Xray transmission function suggest that this task can be automated; however, the temporally-varying intensity at X-ray free electron laser facilities preclude the direct use of standard implementations of optimization solvers such as steepest descent algorithms. In this paper, we propose a novel technique to estimate the gradient of noisy functions with temporally-varying amplitudes. We construct this dynamicamplitude correction by systematically sampling a fixed central location within the standard finite difference stencil, accounting for the observed changes in time, and normalizing the difference quotients against those fluctuations. In addition to a rigorous error analysis of the sampling technique, we demonstrate its efficacy in stochastic descent optimization methods. Further, we demonstrate how this approach may be implemented to optimize X-ray focusing optics at synchrotrons or XFEL facilities

97 MATHEMATICS AND COMPUTING↗

Estimating Field-Level Perennial Bioenergy Grass Biomass Yields Using the Normalized Difference Red-Edge Index and Linear Regression Analysis for Central Virginia, USA

We investigated the indicative power of the normalized difference red-edge index (NDRE) for estimating field-level perennial bioenergy grass biomass yields utilizing Sentinel-2 imagery and a linear regression model as a rapid, cost-effective method for biomass yield estimations for bioenergy. We used 2019 data from three study sites containing mature perennial bioenergy grass stands in central Virginia, USA. Of the simulated daily NDRE values based on the temporally weighted averaging of two temporal neighbors, we found the strongest index–yield correlation on 11 August (R = 0.85). We estimated the perennial bioenergy grass biomass yields for (1) all sites using the data pooled from the three sites (all-site estimation) and (2) each site using the data pooled from the other two sites (cross-site estimation). The estimated field-level perennial bioenergy grass biomass yields strongly correlated with the recorded yields (average R2 = 0.76), with a root mean square error (RMSE) of 1.5 Mg/ha and a mean absolute error (MAE) of 1.2 Mg/ha for the all-site estimation. For the cross-site estimation, the site with diverse perennial grass types had the weakest correlation (R2 = 0.44) of the sites, indicating a difficulty in accounting for heterogeneous index–yield relationships in a single model. In addition to identifying a strong indicative power of the NDRE for estimating the overall perennial bioenergy grass biomass yields at a field level, the findings from this study call for an analysis across multiple perennial grasses and a comparison using multiple sites to understand (1) if the indicative power of the index shifts from the biomass of the specific perennial bioenergy grass type to the overall biomass during the growing season and (2) the level of perennial bioenergy grass heterogeneity that may hinder the remotely sensed biomass yield estimation using a single model.

09 BIOMASS FUELS↗

Maximizing energy efficiency in wastewater treatment plants: A data-driven approach for waste heat recovery and an economic analysis using Organic Rankine Cycle and thermal energy storage

Maximizing energy efficiency through waste heat recovery (WHR) processes is crucial for sustainable and ecofriendly operations across multiple industries, notably in wastewater treatment plants (WWTPs). This work proposes a comprehensive approach for assessing the WHR feasibility in WWTPs, structured in two main objectives. Firstly, an Artificial Neural Network (ANN) model is developed to accurately predict WHR based on operational data, including biogas temperature, biogas pressure, daily production in kWh, and WHR values in kWh th . The second objective focuses on economically evaluating the WHR feasibility based on the estimated WHR values obtained by the ANN model, and then realistically assessing the economic feasibility of integrating the Organic Rankine Cycle (ORC) and Seasonal Thermal Energy Storage (STES) systems. With an application to the As-Samra WWTP located in Jordan, the developed ANN model demonstrates promising results in the validation phase, with a root mean square error (RMSE) of 2206 kWh/day, a mean absolute error (MAE) of 1674 kWh/day, and an R-squared (R 2 ) value of 68%. On the other hand, the economic analysis reveals that an optimal ORC system of 412.14 kW e capacity yields a Net Present Value (NPV) of 2.09 million US dollars, a Levelized Cost of Energy (LCOE) of 0.0749 USD/kWh, a Payback Period (PBP) of 4.8 years, and annual revenues of 428 kUSD. This work also investigates the techno-economic feasibility of integrating ORC-STES. Results indicate that the LCOE and PBP are highly affected by the ORC's capital cost, and integrating STES increases the LCOE to 0.0824 USD/kWh, rendering its integration with ORC infeasible. In conclusion, this study aims to advance the understanding and application of WHR in WWTPs, paving the way for more efficient and sustainable practices in the field.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Evaluating Cloud Feedback Components in Observations and Their Representation in Climate Models

This study quantifies the contribution of individual cloud feedbacks to the total short-term cloud feedback in satellite observations over the period 2002–2014 and evaluates how they are represented in climate models. The observed positive total cloud feedback is primarily due to positive high-cloud altitude, extratropical high- and low-cloud optical depth, and land cloud amount feedbacks partially offset by negative tropical marine low-cloud feedback. Seventeen models from the Atmosphere Model Intercomparison Project of the sixth Coupled Model Intercomparison Project are analyzed. The models generally reproduce the observed moderate positive short-term cloud feedback. However, compared to satellite estimates, the models are systematically high-biased in tropical marine low-cloud and land cloud amount feedbacks and systematically low-biased in high-cloud altitude and extratropical high- and low-cloud optical depth feedbacks. Errors in modeled short-term cloud feedback components identified in this analysis highlight the need for improvements in model simulations of the response of high clouds and tropical marine low clouds. Our results suggest that skill in simulating interannual cloud feedback components may not indicate skill in simulating long-term cloud feedback components.

58 GEOSCIENCES↗

Regional Real-Time PV Spinning Reserve Estimator

Curtailed photovoltaic (PV) generation is a zero-marginal-cost spinning reserve that can be used for a number of active power control services. Unlike traditional spinning reserve providers, however, i.e., fossil-fueled generators, which have well-defined operating characteristics, e.g., available headroom or potential high limit (PHL), PV plants have by nature variable and uncertain operating characteristics. To ensure the effective coordination between PV plants and the system operator during an active power control event, accurate knowledge of the PV PHL is essential. It ensures that enough headroom is reserved by the PV plants to deliver the award services in real time and informs feasible dispatch decisions made by the market operator. To tackle this challenge, a novel reference-control grouping-based PV plant reserve estimation method has been proposed by the National Renewable Energy Laboratory under past projects funded by the U.S. Department of Energy Office of Energy Efficiency and Renewable Energy Solar Energy Technologies Office. The estimation method separates inverters within a plant into two groups: a control group and a reference group. While the reference group is reserved to operate at its PHL, the control group can be curtailed to provide the grid services. Real-time outputs from the reference inverters are used to estimate the PHL for the whole plant based on the ratio between capacities of the reference group and of the plant. This work further enhances the methodology by (1) improving the model accuracy through machine learning; (2) automating the reference inverter selection through correlation analysis; (3) considering estimation look-ahead windows; and (4) applying to regional spinning reserve estimation. Significant performance improvement has been observed based on real-world data collected by CAISO, Southern Company, and Terabase Energy. Compared with the original scaling method, the newly proposed machine learning-based approach reduces the estimation errors by 30% and 13% at the plant level and region level, respectively. Results obtained from this project are intended to be used by grid operators, market operators, balancing authorities, and PV plant owners and operators to facilitate PV participation in ancillary service markets. Regulators, policymakers, and system planners can also consider the results of this work in their decision-making processes. In addition to the performance improvement on the existing reference-control based grouping method, we also investigated how the variability of PV generation from a single PV inverter can be used to represent the variability of PV generation at the plant level.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Assessing the Role of Hydrodynamics in Enhancing Height-Above-the-Nearest-Drainage Derived Synthetic Rating Curves: A Comparative Study in the Wu River Basin, Taiwan

The conventional approach to generating synthetic rating curves (SRC) using the Height-Above-the-Nearest-Drainage (HAND) method typically relies on the assumption of uniform flow, such as Manning's equation, to establish stage-discharge ratings. The zero-physics application of the uniform flow equation is insufficient for capturing detailed hydraulic features (e.g., backwater effect) and neglects the hydraulic effects from adjacent channels. This lack of hydrodynamic computation can impact the accuracy and effectiveness of riverine flood risk estimation and management. To reduce this foreseeable error, we introduce the HAND-hd workflow, which integrates sophisticated hydrodynamic computations in the production of HAND-based SRC with hydrodynamic features (SRC hd ). The results indicate that SRC hd demonstrates consistent agreement with both gauge observations and benchmark solutions. Additionally, the comparative analysis suggests that SRC hd provides notable improvements in stage-discharge ratings over conventional HAND-based SRCs, particularly in channels with mild bed gradients, where it reduces water stage prediction errors and percent biases. In steeper channel segments, SRC hd maintains comparable accuracy to conventional methods. The comprehensive evaluation in this study emphasizes the potential discrepancies and inaccuracies associated with the adoption of the uniform flow assumption in the conventional HAND-SRCs and addresses the necessity of including hydrodynamic physics in the application of HAND-based SRC (e.g., inundation map) in channels with mild gradients.

54 ENVIRONMENTAL SCIENCES↗

Analysis of the weighted shifted boundary method for the Poisson and Stokes problems

The Shifted Boundary Method (SBM) belongs to the class of unfitted (or immersed, or embedded) finite element methods, and relies on reformulating the original boundary value problem over a surrogate (approximate) computational domain. Accuracy is maintained by properly shifting the location and values of the boundary conditions. This avoids integration over cut cells and the associated implementation issues. Recently, the Weighted SBM (WSBM) was proposed for the Navier-Stokes equations with free surfaces and the Stokes flow with moving boundaries. The attribute “weighted” in the name WSBM stems from the fact that its variational form is weighted with the elemental volume fraction of active fluid. The motivation for the development of the WSBM was the preservation of the volume of active fluid to a higher degree of accuracy, which in turn resulted in improved stability and robustness characteristics in moving-boundary, time-dependent simulations. In this article, we present the numerical analysis of the WSBM formulations for the Poisson and Stokes problems. We give mathematical conditions under which the bilinear forms defining the discrete variational formulations are uniformly coercive (Poisson problem) or inf-sup stable (Stokes problem). By these results, stability and optimal convergence is proven in the natural norm; L2-error estimates can also be derived.

Approximate domain boundaries↗

Adaptive hyperparameter updating for training restricted Boltzmann machines on quantum annealers

Restricted Boltzmann Machines (RBMs) have been proposed for developing neural networks for a variety of unsupervised machine learning applications such as image recognition, drug discovery, and materials design. The Boltzmann probability distribution is used as a model to identify network parameters by optimizing the likelihood of predicting an output given hidden states trained on available data. Training such networks often requires sampling over a large probability space that must be approximated during gradient based optimization. Quantum annealing has been proposed as a means to search this space more efficiently which has been experimentally investigated on D-Wave hardware. D-Wave implementation requires selection of an effective inverse temperature or hyperparameter (β) within the Boltzmann distribution which can strongly influence optimization. Here, we show how this parameter can be estimated as a hyperparameter applied to D-Wave hardware during neural network training by maximizing the likelihood or minimizing the Shannon entropy. We find both methods improve training RBMs based upon D-Wave hardware experimental validation on an image recognition problem. Neural network image reconstruction errors are evaluated using Bayesian uncertainty analysis which illustrate more than an order magnitude lower image reconstruction error using the maximum likelihood over manually optimizing the hyperparameter. The maximum likelihood method is also shown to out-perform minimizing the Shannon entropy for image reconstruction.

97 MATHEMATICS AND COMPUTING↗

Robust Distributed State Estimator for Interconnected Transmission and Distribution Networks (Final Report RPPR-1)

This project’s objective is to develop a combined transmission and distribution state estimator which accounts for very large system size and model complexity (by way of distributing the computations) and large number of solar PV units connected to the distribution system on multiple feeders. The project not only provides a robust formulation and solution to this problem but also tests the solution by implementing it on a well-established large utility system. It introduces several improvements with respect to the state of the art in existing state estimation software: (a) The developed state estimator (SE) allows robust and accurate monitoring of bidirectional flows in distribution systems which result due to the distributed energy sources which are not observable and thus not incorporated in generation dispatch; (b) Large utility systems with tens of thousands of transmission buses and hundreds of thousands of distribution nodes are difficult to model as a single integrated system. This shortcoming is addressed by developing a “scalable distributed computational framework” which allows splitting the ultra large system models into several small subsystems and coordinating their solution by a robust and practical state estimation formulation; (c) Measurement errors irrespective of their locations are detected and removed by the developed state estimator. Historically, transmission and distribution systems were analyzed and operated as two independent systems. Given the non-transposed short feeder sections, unevenly loaded phases, strictly radial configuration and unidirectional power flows in the absence of remote generation, distribution system analysis was customized to account for these characteristics. However, some of these assumptions are no longer valid (non-radial configuration, bidirectional power flows) and thus distribution system analysis should be revisited. Furthermore, in the past, the interaction between the transmission and distribution systems was quite passive, where distribution substations were modeled as lumped loads in the transmission system model. With substantial generation injected by renewable generation located in the distribution systems, such modeling will no longer be accurate. The developed state estimator facilitates proper monitoring of the interactions between the transmission and distribution systems and enables smart dispatch of these units which are made observable by the state estimator.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A Contrast Calibration Protocol for X-ray Speckle Visibility Spectroscopy

X-ray free electron lasers, with their ultrashort highly coherent pulses, opened up the opportunity of probing ultrafast nano- and atomic-scale dynamics in amorphous and disordered material systems via speckle visibility spectroscopy. However, the anticipated count rate in a typical experiment is usually low. Therefore, visibility needs to be extracted via photon statistics analysis, i.e., by estimating the probabilities of multiple photons per pixel events using pixelated detectors. Considering the realistic X-ray detector responses including charge cloud sharing between pixels, pixel readout noise, and gain non-uniformity, speckle visibility extraction relying on photon assignment algorithms are often computationally demanding and suffer from systematic errors. In this paper, we present a systematic study of the commonly-used algorithms by applying them to an experimental data set containing small-angle coherent scattering with visibility levels ranging from below 1% to ∼60%. We also propose a contrast calibration protocol and show that a computationally lightweight algorithm can be implemented for high-speed correlation evaluation.

47 OTHER INSTRUMENTATION↗

Measurement of D-T Neutron Source Flux by SelfNeutron Activation Analysis with a LaBr3 Detector

Conclusions: • Decay of 78Br produced from the 79Br(n,2n) reaction in LaBr3 is present in the spectrum plotted in the time domain. • The neutron production rate reconstructed from preliminary LaBr3 estimate is smaller than the generator output. • Generator characterization may become more routine if a simple and robust method is made available for applications. Ongoing work: • Implementing bootstrapping to improve error estimates. • Examining threshold and edge effects of LaBr3

SMITH, MURRY↗

Atacama Cosmology Telescope: DR6 gravitational lensing and SDSS BOSS cross-correlation measurement and constraints on gravity with the 𝐸 𝐺 statistic

We derive new constraints on the 𝐸 𝐺 statistic as a test of gravity, combining the cosmic microwave background (CMB) lensing map estimated from Data Release 6 (DR6) of the Atacama Cosmology Telescope with Sloan Digital Sky Survey III Baryon Oscillation Spectroscopic Survey (SDSS BOSS) CMASS and LOWZ galaxy data. We develop an analysis pipeline to measure the cross-correlation between CMB lensing maps and galaxy data, following a blinding policy and testing the approach through null and consistency checks. By testing the equivalence of the spatial and temporal gravitational potentials, the 𝐸 𝐺 statistic can distinguish Λ⁢ CDM from alternative models of gravity. We find 𝐸 𝐺 ⁡(𝑧 eff = 0.555) = 0.3⁢1$^{+0.06}_{−0.05}$ for Atacama Cosmology Telescope (ACT) and CMASS data at 68.28% confidence level, and 𝐸 𝐺 ⁡(𝑧 eff = 0.316) = 0.4⁢9$^{+0.14}_{−0.11}$ for the ACT and LOWZ. Systematic errors are estimated to be 3% and 4%, respectively. Including CMB lensing information from Planck PR4 results in 𝐸 𝐺 ⁡(𝑧 eff = 0.555) = 0.3⁢4$^{+0.05}_{−0.05}$ with CMASS and 𝐸 𝐺 ⁡(𝑧 eff = 0.316) = 0.4⁢3$^{+0.11}_{−0.09}$ with LOWZ. These are consistent with predictions for the Λ⁢ CDM model that best fits the Planck CMB anisotropy and SDSS BOSS baryon acoustic oscillations (BAO), where 𝐸$^{GR}_{𝐺⁡}$(𝑧 eff =0.555) =0.401 ± 0.005 for CMB lensing combined with CMASS and 𝐸$^{GR}_{𝐺}$⁡(𝑧 eff = 0.316) = 0.452 ± 0.005 combined with LOWZ. We also find 𝐸 𝐺 to be scale independent, with probability to exceed >5%, as predicted by general relativity. The methods developed in this work are also applicable to improved future analyses with upcoming spectroscopic galaxy samples and CMB lensing measurements.

79 ASTRONOMY AND ASTROPHYSICS↗

Bayesian Framework for Bioburden Density Estimation in Planetary Protection

To comply with the international planetary protection policy set forth by the Committee on Space Research and NASA Agency level requirements, spacecraft destined to biologically sensitive planetary bodies have to minimize terrestrial biological contamination. Analysis, testing and inspection are the standard forward verification activities that are used to demonstrate compliance with the biological contamination requirements. For testing of spacecraft surface areas, a swab or wipe sample is collected from surfaces prior to last access and subsequently processed in the lab using NASA Approved Planetary Protection Methods for Culture Based Assays. Raw data resulting from this assay is then statistically treated employing a mathematical paradigm stemming from the 1970’s Viking Lander Project to generate the bioburden density and total microbial bioburden present. This standard approach arbitrarily accounts for error and provides an upper conservative bound as it reports the maximum number of spores estimated to be present on flight hardware surfaces. A bioburden density estimate factors in the following variables: the observed bioburden count, representative volume processed, sampling efficiencies. Notably, to account for error in the approach, a 0 observed count is arbitrarily changed to a count of 1 for each hardware grouping. The data generated by spacecraft bioburden verification campaigns in the past have resulted in <80% of wipes and <90% of swabs containing a bioburden count of 0. As such, having a robust and well documented statistical approach for dealing with the probability of low incident rates is necessary to be able to estimate spacecraft bioburden. Being able to statistically describe the bioburden distribution and associated confidence level is a gamechanger for the development of bioburden allocations during mission design and will allow for tighter management of risk throughout spacecraft build. Thus, Empirical Bayes statistical approach was evaluated to estimate the microbial bioburden on spacecraft to mitigate the aforementioned mathematical concerns and provide a probabilistic bioburden distribution of the flight hardware surface. For application of this approach to performing bioburden calculations, a range of non-informative prior assumptions on hardware surfaces are explored for Bayesian analyses while informative priors using posterior distributions from prior assays are utilized for Empirical Bayes analyses. Several non-informative priors are currently under investigation to assess fitness including use of these priors to serve as a foundation to build off of NASA specification values or a basis of risk to account for unknowns during the integration and testing process. Informative priors under consideration are generated using sampled bioburden values from hardware originating within like processing environments (e.g. vendor cleaning process or similar assembly process), temporal spacecraft status events as a prediction for hardware cleanliness of future samples, and heritage system bioburden actuals to predict allocation for subsequent missions. Informative priors and probabilistic bioburden distributions are then validated using data sets from the Mars Exploration Rover, Mars Science Laboratory, and InSight missions. Using Empirical Bayes approach to generate a probabilistic bioburden distribution as demonstrated through mission use cases provides a valid approach for use in the end-to-end requirements verification process.

97 - MATHEMATICS AND COMPUTING↗

Physics-preserving enriched Galerkin method for a fully-coupled thermo-poroelasticity model

This paper proposes a new numerical method for a fully-coupled, quasi-static thermo-poroelasticity model in a unified enriched Galerkin (EG) method framework. In our method, the mechanics sub-problem is solved using a locking-free EG method, and the flow and heat sub-problems are solved using a locally-conservative EG method. The proposed method offers mass and energy conservation properties with much lower costs than other methods with the same properties, including discontinuous Galerkin methods and mixed finite element methods. The well-posedness and optimal a priori error estimates are carefully derived. Here, several numerical tests confirm the theoretical optimal convergence rates and the mass and energy conservation properties of the new method.

15 GEOTHERMAL ENERGY↗