Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Stochastic optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,333 records · Page 74

Control optimization, stabilization and computer algorithms for aircraft applications

Computationally useful algorithms are considered that can aid the control engineer in designing systems control in linear time invariant dynamics for aircraft applications. Structural aspects of system identification, matrix parameterization, and the effect of feedback on identifiability of systems. Adaptive and stochastic control model constructions are projected, and a method for approximate identification of aircraft characteristics and subsequent generation of control signals is outlined.

Mitter, S. K.↗

Bayesian and LASSO Regressions for Comparative Permeability Modeling of Sandstone Reservoirs

In this research, Bayesian model averaging (BMA) and least absolute shrinkage and selection operator regression (LASSO) algorithms were adopted for the core permeability modeling as a function of well log and core measurements. More specifically, the core permeability (dependent factor) was modeled given the well log and core data (independent variables) and then predicted in non-cored intervals of a well in a sandstone formation. The BMA is a stochastic linear modeling and a Bayesian parameter selection. Among 50 linear models generated as a function of the independent variables and depicted in Occam’s window, the best model of the highest posterior probability is determined. The best model has the optimal subset parameters that most influences the response factor. The core permeability modeling was again conducted using the LASSO algorithm, which adopts a completely different way of modeling and subset selection by using the penalized least-squared equation. Both BMA and LASSO resulted in a very accurate prediction of the core permeability by achieving perfect measured and calculated permeability matching. Matches for the two algorithms were quantified by computing the adjusted R-squared and root-mean-squared prediction error. In addition, results of the BMA and LASSO were compared to the conventional multiple linear regression (LM). The LASSO algorithm led to an accurate matching similar to LM, but slightly better than BMA. Therefore, both BMA and LASSO represent integrated procedures for accurate permeability estimation similar to conventional regression analysis.

58 GEOSCIENCES↗

Velocity-space compression from Fermi acceleration with Lorentz scattering

The Fermi acceleration model describes how cosmic ray particles accelerate to great speeds by interacting with moving magnetic fields. In this work, we identify a variation of the model where light ions interact with a moving wall while undergoing pitch angle scattering through Coulomb collisions due to the presence of a heavier ionic species. The collisions introduce a stochastic component which adds complexity to the particle acceleration profile and sets it apart from collisionless Fermi acceleration models. The unusual effect captured by this simplified variation of Fermi acceleration is the nonconservation of phase space, with the possibility for a distribution of particles initially monotonically decreasing in energy to exhibit an energy peak upon compression. A peaked energy distribution might have interesting applications, such as to optimize fusion reactivity or to characterize astrophysical phenomena that exhibit nonthermal features.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

A Moving Target Defense Control Framework for Cyber-Physical Systems

This paper considers the problem of efficiently and securely controlling cyber-physical systems that are operating in uncertain, and adversarial environments. To mitigate sensor, actuator attacks, and performance loss due to such attacks, we formulate a secure control algorithm that consists of a proactive and a reactive defense mechanism. The proactive mechanism, which is based on the principles of moving target defense, utilizes a stochastic switching structure to dynamically and continuously alter the parameters of the system, while hindering the attacker's ability to conduct successful reconnaissance to the system. The unpredictability of the current actuator and sensor is optimized using an information entropy measure, which is induced by probabilistic switching. The reactive mechanism on the other side, detects potentially attacked components, namely sensors and actuators, by leveraging online data to compute an integral Bellman error. A rigorous mathematical framework is presented to guarantee the stability of the equilibrium point of the closed-loop system, and provide a quantified bound on the performance loss when utilizing both reactive and proactive mechanisms. Simulation results show the efficacy of the proposed approaches on a benchmark aircraft model.

42 ENGINEERING↗

Integrating HPC, AI, and Workflows for Scientific Data Analysis: Report from Dagstuhl Seminar 23352

The Dagstuhl Seminar 23352, titled “Integrating HPC, AI, and Workflows for Scientific Data Analysis,” held from August 27 to September 1, 2023, was a significant event focusing on the synergy between High-Performance Computing (HPC), Artificial Intelligence (AI), and scientific workflow technologies. The seminar recognized that modern Big Data analysis in science rests on three pillars: workflow technologies for reproducibility and steering, AI and Machine Learning (ML) for versatile analysis, and HPC for handling large data sets. These elements, while crucial, have traditionally been researched separately, leading to gaps in their integration. The seminar aimed to bridge these gaps, acknowledging the challenges and opportunities at the intersection of these technologies. The event highlighted the complex interplay between HPC, workflows, and ML, noting how ML has increasingly been integrated into scientific workflows, thereby enhancing resource demands and bringing new requirements to HPC architectures, like support for GPUs and iterative computations. The seminar also addressed the challenges in adapting HPC for large-scale ML tasks, including in areas like deep learning, and the need for workflow systems to evolve to leverage ML in data analysis fully. Moreover, the seminar explored how ML could optimize scientific workflow systems and HPC operations, such as through improved scheduling and fault tolerance. A key focus was on identifying prestigious use cases of ML in HPC and understanding their unique, unmet requirements. The stochastic nature of ML and its impact on the reproducibility of data analysis on HPC systems was also a topic of discussion.

97 MATHEMATICS AND COMPUTING↗

Navigation between the planets

Recent advances in spacecraft tracking, chronometry, ephemerides, and orbit and trajectory determinations are reviewed. Improvements in timekeeping are reviewed, as well as precision distance and range measurements; orbit determinations, trajectory-correction maneuvers, flight path optimization, and information provided by rotation of the tracking station with the earth's surface. Doppler and tropospheric wave propagation effects are dealt with. Nongravitational perturbations (solar radiation pressure, release of gases from the spacecraft, stochastic unmodeled accelerations and sequential estimation to cope with them), the effect of the target planet's gravitational field upon close approach, and navigation problems in the outer reaches of the solar system (TV data telemetered back for inertial navigation) are covered. By-products of the research include: refined data on the mass of planets, on planetary mass distributions, planet configurations, on physical properties of the atmospheres and ionospheres of planets, and opportunities for refined tests of gravitation and relativity theories and models.

Melbourne, W. G.↗

Improving Robustness of Spectrogram Classifiers with Neural Stochastic Differential Equations

Signal analysis and classification is fraught with high levels of noise and perturbation. Computer-vision-based deep learning models applied to spectrograms have proven useful in the field of signal classification and detection; however, these methods aren't designed to handle the low signal-to-noise ratios inherent within non-vision signal processing tasks. While they are powerful, they are currently not the method of choice in the inherently noisy and dynamic critical infrastructure domain, such as smart-grid sensing, anomaly detection, and non-intrusive load monitoring. Currently, these models can be brittle, which makes them susceptible to noisy input. This also means they have sub-optimal stability of explanation outputs. Experts and technicians using these models to make decisions in real world scenarios need assurance that a model is performing as it is supposed to. The classification or prediction outputs it generates should be sound and grounded, not likely to change in the presence of shifting noise landscapes. In this work, we explore the idea of Neural Stochastic Differential Equations (NSDE's) to improve the robustness of models trained to classify time series data and the effect of NSDE's on the explainability of outputs. We then test the effectiveness of these approaches by applying them to a non-intrusive load monitoring (NILM) dataset that consists of simulated harmonic signals injected into a real building.

Brogan, Joel↗

Discrete-Time Causal Control of a Wave Energy Converter With Finite Stroke in Stochastic Waves

We consider feedback control design for a wave energy converter (WEC) for which the power takeoff (PTO) system has a finite stroke limit. Stationary stochastic wave loading is assumed, with a known spectrum, and the plant dynamics are assumed to be linear. We develop a technique for the design of a discrete-time controller, which has three design stages. In the first stage, a linear controller is optimized while imposing a relaxation of the maximum stroke constraint on the design. In the second stage, a tandem nonlinear feedback loop is designed for the purpose of stroke protection. In the third stage, the two designs (linear and nonlinear) are fused in a manner that preserves the stability of the overall system. The technique is demonstrated in a simulation of a simple cylindrical buoy. We show that the controller may be tuned through the adjustment of scalar design parameters, which adjust the tradeoff between the mean generated power and the force levels required to protect the stroke.

16 TIDAL AND WAVE POWER↗

Correlation-aware binning for small-angle neutron scattering via Gaussian-process inference

Binning in small-angle neutron scattering (SANS) is typically performed empirically, with fixed parameters chosen for convenience rather than statistical optimality. Such practices often fail to balance statistical precision and spatial resolution, leading to inconsistencies across instruments and datasets. Here we establish a correlation-aware framework that determines the optimal bin width from first principles by extending the classical Freedman–Diaconis (FD) rule to account for inter-bin correlations with a Gaussian process. In this formulation, the scattering intensity is treated as a smooth stochastic field whose statistical coherence is described by a covariance matrix. Analytical expressions of errors derived from this model yield closed-form criteria that separate the total deviation into contributions from counting noise, aliasing distortion and curvature-dependent correlation effects. Expressed in reduced variables, the resulting dimensionless error surface reveals a continuous transition from the uncorrelated FD regime to the correlation-dominated limit, providing a unified description of noise suppression and resolution control. Because the formulation depends only on the profile characteristics of scattering intensity I(Q), specifically its average intensity and first- and second-order derivatives, it applies generally to any SANS measurement regardless of sample, instrument or geometry. Experimental validation using small- and ultra-small-angle neutron scattering data confirms the predicted scaling behavior, demonstrating that correlation-aware inference systematically reduces mean-squared error and enables information-efficient reproducible data reduction across materials and instruments.

Tung, Chi-Huan [ORNL] (ORCID:0000000221972074)↗

The short-term prediction of universal time and length of day using atmospheric angular momentum

The ability to predict short-term variations in the Earth's rotation has gained importance in recent years owing to more precise spacecraft tracking requirements. Universal time (UT1), that component of the Earth's orientation corresponding to the rotation angle, can be measured by number of high-precision space geodetic techniques. A Kalman filter developed at the Jet Propulsion Laboratory (JPL) optimally combines these different data sets and generates a smoothed times series and a set of predictions for UT1, as well as for additional Earth orientation components. These UT1 predictions utilize an empirically derived random walk stochastic model for the length of the day (LOD) and require frequent and up-to-date measurements of either UT1 or LOD to keep errors from quickly accumulating. Recent studies have shown that LOD variations are correlated with changes in the Earth's axial atmospheric angular momentum (AAM) over timescales of several years down to as little as 8 days. AAM estimates and forecasts out to 10 days are routinely available from meteorological analysis centers; these data can supplement geodetic measurements to improve the short-term prediction of LOD and have therefore been incorporated as independent data types in the JPL Kalman filter. We find that AAM and, to a lesser extent, AAM forecast data are extremely helpful in generating accurate near-real-time estimates of UT1 and LOD and in improving short-term predictions of these quantities out to about 10 days.

Freedman, A. P.↗

Laser Powder Bed Fusion Additive Manufacturing In-Process Monitoring and Optimization Using Thermionic Emission Detection

In this project, the emission of electrons during laser powder bed fusion additive manufacturing was identified and investigated to resolve the underlying dynamics driven by laser-material interactions. Laser powder bed fusion involves the selective laser melting of metal powder particles layer by layer which fuse together forming a larger 3D structure. Laser-based additive manufacturing approaches such as laser powder bed fusion hold the potential to revolutionize manufacturing of complex metal components in the aerospace, medical, and automotive industries. However, the difficulty in producing defect-free components by metal 3D printing is a major hurdle for widespread commercial adoption. This project resolved important dynamics in laser powder bed fusion including the identification of plasma formation mechanisms, transitions between laser-induced melting modes and stochastic precursors to defect formation. These findings were realized through implementation of electronic sensing diagnostics into an existing testbed system and harnessing capabilities developed for the time dependent analysis of laser powder bed fusion datasets. Importantly, the results advance our understanding of laser-material interactions and reveal that detection of thermionic emission can also resolve information critical to optimization of the laser powder bed fusion fabrication process. The findings are critical for advancing our fundamental understanding of the laser powder bed fusion process and can help assure the requisite fidelity of fabricated components.

36 MATERIALS SCIENCE↗

Density Large Deviations for Multidimensional Stochastic Hyperbolic Conservation Laws

We investigate the density large deviation function for a multidimensional conservation law in the vanishing viscosity limit, when the probability concentrates on weak solutions of a hyperbolic conservation law. When the mobility and diffusivity matrices are proportional, i.e. an Einstein-like relation is satisfied, the problem has been solved in Bellettini and Mariani (Bull Greek Math Soc 57:31–45, 2010). When this proportionality does not hold, we compute explicitly the large deviation function for a step-like density profile, and we show that the associated optimal current has a non trivial structure. We also derive a lower bound for the large deviation function, valid for a more general weak solution, and leave the general large deviation function upper bound as a conjecture.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Trip Prediction Using GIS for Vehicle Energy Efficiency

In this paper, we present a novel trip prediction process whose main applications include vehicle energy efficiency optimization. The process is composed of multiple parts. First, a Markov chain model is built from quality-checked, real-world vehicle speed data. Secondly, a geographical information system (GIS), ADAS-RP, is used to define a real-world itinerary on a map-based interface. Finally, an algorithm runs the Markov chains under constraints from the GIS. As a result, any number of second-by-second stochastic speed profiles can be generated for a given itinerary. These speed profiles can then be inputs to vehicle powertrain models such as Autonomie, which can be used to predict energy consumption and other operational parameters. An example of the application of speed prediction is also described, involving route-based energy management for plug-in hybrid electric vehicles, in which the knowledge of future speed profiles can be used to find the optimal energy split.

energy efficiency↗

Scientific discovery in a model-centric framework: Reproducibility, innovation, and epistemic diversity

Consistent confirmations obtained independently of each other lend credibility to a scientific result. We refer to results satisfying this consistency as reproducible and assume that reproducibility is a desirable property of scientific discovery. Yet seemingly science also progresses despite irreproducible results, indicating that the relationship between reproducibility and other desirable properties of scientific discovery is not well understood. These properties include early discovery of truth, persistence on truth once it is discovered, and time spent on truth in a long-term scientific inquiry. We build a mathematical model of scientific discovery that presents a viable framework to study its desirable properties including reproducibility. In this framework, we assume that scientists adopt a model-centric approach to discover the true model generating data in a stochastic process of scientific discovery. We analyze the properties of this process using Markov chain theory, Monte Carlo methods, and agent-based modeling. We show that the scientific process may not converge to truth even if scientific results are reproducible and that irreproducible results do not necessarily imply untrue results. The proportion of different research strategies represented in the scientific population, scientists’ choice of methodology, the complexity of truth, and the strength of signal contribute to this counter-intuitive finding. Important insights include that innovative research speeds up the discovery of scientific truth by facilitating the exploration of model space and epistemic diversity optimizes across desirable properties of scientific discovery.

97 MATHEMATICS AND COMPUTING↗

Data-driven predictive probability density function control of fiber length stochastic distribution shaping in refining process

Pulp is the most important raw material in paper in paper industries, whose Fiber Length Stochastic Distribution (FLSD) shaping directly determines the energy consumption and paper quality of the subsequent papermaking processes. However, the mean and variance are insufficient to describe the output FLSD shaping, which display non-Gaussian distribution properties. Therefore, the traditional control, method based on the mean and variance of fiber length is difficult to control the FLSD shaping effectively. In this paper, a novel data-driven predictive probability density function (PDF) control method is proposed for output FLSD shaping in refining process. Primarily, in order to improve the approximation accuracy of the PDF employing RBF neural network, the parameters (center value and width) of each RBF basis functions are tuned via utilizing iterative learning control (ILC) law, and the corresponding estimations of weights law can be obtained. Secondly, considering that the conventional linear model of weights vector has drawbacks of low accuracy and weak generalization ability, random vector functional link networks (RVFLNs) based data driven nonlinear modelling method is employed to characterize the prediction model between the input variables and weights vector. Finally, in order to reduce the randomness of the output FLSD, a minimum entropy control method under mean constraint is employed to design the predictive PDF controller for the output FLSD shaping with the help of the established nonlinear stochastic distribution model. Both simulations and experiments are given to illustrate the effectiveness and practicability of the proposed method.

Probability debsity function, Fiber length distrib↗

Several Small or Single Large? Quantifying the Catchment-Wide Performance of On-Site Wastewater Treatment Plants with Inaccurate Sensors

On-site wastewater treatment plants (OSTs) often lack monitoring, resulting in unreliable treatment performance. They thus appear to be a stopgap solution despite their potential contribution to circular water management. Low-maintenance but inaccurate soft sensors are emerging that address this concern. However, how their inaccuracy impacts the catchment-wide treatment performance of a system of many OSTs has not been quantified. Here, we develop a stochastic model to estimate catchment-wide OST performances with a Monte Carlo simulation. In our study, soft sensors with a 70% accuracy improved the treatment performance from 66% of the time functional to 98%. Soft sensors optimized for specificity, indicating the true negative rate, improve the system performance, while sensors optimized for sensitivity, indicating the true positive rate, quantify the treatment performance more accurately. This new insight leads us to suggest programming two soft sensors in practical settings with the same hardware sensor data as input: one soft sensor geared to high specificity for maintenance scheduling and one geared to high sensitivity for performance quantification. Our findings suggest that a maintenance strategy combining inaccurate sensors with appropriate alarm management can vastly improve the mean catchment-wide treatment performance of a system of OSTs.

54 ENVIRONMENTAL SCIENCES↗

Advancing Multi-Hazard Risk and Safety Considerations for Aging Nuclear Facilities (Revision 1)

This project will demonstrate a multi-hazard time-dependent probabilistic risk assessment (PRA) approach for nuclear facilities considering aging-related deterioration of structures. A generic pressurized water reactor (PWR) reactor subjected to seismic mainshock-aftershock sequences considering the aging of the containment structure will be used as a case study to demonstrate the multi-hazard PRA approach. Using advanced modeling and simulation, seismic mainshock-aftershock fragility functions will be simulated for the containment structure considering aging effects. A multi-hazard PRA model for a generic PWR reactor will be built to quantify the multi-hazard core damage frequency (CDF) and large early release frequency (LERF) with explicit time-dependent modeling of event sequences. To date, the cascading impacts of multi-hazards are not adequately accounted for in the PRA models for nuclear facilities. In addition, for both initial and periodic evaluation of facilities to withstand natural phenomena hazards (NPH), deterioration of the SSCs due to aging and other effects is not adequately considered. By advancing multi-hazard considerations accounting for aging effects, this project will contribute to improved understanding of the safety of aging nuclear facilities. Project outcomes such as the multi-hazard CDF and LERF will also allow facility owners to optimize upgrade and retrofit protocols. This project is divided into two components: (1) advanced modeling and simulations; and (2) multi-hazard PRA. For the first component, Idaho National Laboratory’s (INL) Multi-hazard Analysis for STOchastic time-DOmaiN phenomena (MASTODON) and BlackBear codes will be used to simulate the seismic response and damage of a containment structure under cascading mainshock-aftershock sequences with aging effects. Uncertainties related to the seismic inputs, material parameters, and environmental factors such as temperature and humidity will be identified and propagated to the fragility functions. These fragility functions, which consider aging effects, will be time dependent. The second component will take the fragility information from the first component to build a multi-hazard time-dependent PRA model starting from a generic PWR model to evaluate the multi-hazard CDF and LERF and characterize the associated consequences. For this component, OpenPRA Web Application and SAPHIRE code will be used. Events such as the Fukushima Daiichi accident have highlighted the importance of considering the cascading impacts of multi-hazards for PRA. Moreover, many of the reactors in the current nuclear fleet in the United States (US) are already operating well beyond their initially planned design life, and applications for further extensions to operating licenses are being considered. Therefore, considering multi-hazard effects and aging deterioration in the NPH risk assessment process will contribute to the safety of both existing and future nuclear facilities. Outcomes of this project will thus directly benefit the standards DOE-STD-1020-16 and DOE-HDBK-1224-18.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Improving stability margins in discrete-time LQG controllers

Some of the problems are discussed which are encountered in the design of discrete-time stochastic controllers for problems that may adequately be described by the Linear Quadratic Gaussian (LQG) assumptions; namely, the problems of obtaining acceptable relative stability, robustness, and disturbance rejection properties. A dynamic compensator is proposed to replace the optimal full state feedback regulator gains at steady state, provided that all states are measurable. The compensator increases the stability margins at the plant input, which may possibly be inadequate in practical applications. Though the optimal regulator has desirable properties the observer based controller as implemented with a Kalman filter, in a noisy environment, has inadequate stability margins. The proposed compensator is designed to match the return difference matrix at the plant input to that of the optimal regulator while maintaining the optimality of the state estimates as directed by the measurement noise characteristics.

Oranc, B. Tarik↗