Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Stochastic optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,603 records · Page 89
All sourcesNASA NTRSDOE OSTI
NASA NTRS1989

Stochastic model of the NASA/MSFC ground facility for large space structures with uncertain parameters: The maximum entropy approach, part 2

A validated technology data base is being developed in the areas of control/structures interaction, deployment dynamics, and system performance for Large Space Structures (LSS). A Ground Facility (GF), in which the dynamics and control systems being considered for LSS applications can be verified, was designed and built. One of the important aspects of the GF is to verify the analytical model for the control system design. The procedure is to describe the control system mathematically as well as possible, then to perform tests on the control system, and finally to factor those results into the mathematical model. The reduction of the order of a higher order control plant was addressed. The computer program was improved for the maximum entropy principle adopted in Hyland's MEOP method. The program was tested against the testing problem. It resulted in a very close match. Two methods of model reduction were examined: Wilson's model reduction method and Hyland's optimal projection (OP) method. Design of a computer program for Hyland's OP method was attempted. Due to the difficulty encountered at the stage where a special matrix factorization technique is needed in order to obtain the required projection matrix, the program was successful up to the finding of the Linear Quadratic Gaussian solution but not beyond. Numerical results along with computer programs which employed ORACLS are presented.

Hsia, Wei Shen↗
DOE OSTI2021

Deep Reinforcement Scheduling of Energy Storage Systems for Real-time Voltage Regulation in Unbalanced LV Networks with High PV Penetration

The ever-growing higher penetration of distributed energy resources (DERs) in low-voltage (LV) distribution systems brings both opportunities and challenges to voltage support and regulation. This paper proposes a deep reinforcement learning (DRL)-based scheduling scheme of energy storage systems (ESSs) to mitigate system voltage deviations in unbalanced LV distribution networks. The ESS-based voltage regulation problem is formulated as a multi-stage quadratic stochastic program, with the objective of minimizing the expected total daily voltage regulation cost while satisfying operational constraints. While existing voltage regulation methods are mostly focused on onetime- step control, this paper explores a day-horizon systemwide voltage regulation problem. In other words, the size of action and state spaces are extremely high-dimensional and need to be delicately handled. Furthermore, in order to overcome the difficulty of modeling uncertainties and develop a realtime solution, a learn-to-schedule feedback control framework is proposed by adapting the problem to a model-free DRL setting. The proposed algorithm is tested on a customized 6-bus system and a modified IEEE 34-bus system. Simulation results validate the effectiveness and near-optimality of voltage regulation by ESS in comparison with a deterministic quadratic program solution.

Wang, Shengyi↗
DOE OSTI2020

A Hybrid Gradient Method to Designing Bayesian Experiments for Implicit Models

Bayesian experimental design (BED) aims at designing an experiment to maximize the information gathering from the collected data. The optimal design is usually achieved by maximizing the mutual information (MI) between the data and the model parameters. When the analytical expression of the MI is unavailable, e.g.,having implicit models with intractable data distributions, a neural network-based lower bound of the MI was recently proposed and a gradient ascent method was used to maximize the lower bound [1]. However, the approach in [1] requires a pathwise sampling path to compute the gradient of the MI lower bound with respect to the design variables, and such a pathwise sampling path is usually inaccessible for implicit models. In this work, we propose a hybrid gradient approach that leverages recent advances in variational MI estimator and evolution strategies (ES)combined with black-box stochastic gradient ascent (SGA) to maximize the MI lower bound. This allows the design process to be achieved through a unified scalable procedure for implicit models without sampling path gradients. Several experiments demonstrate that our approach significantly improves the scalability of BED for implicit models in high-dimensional design space.

Zhang, Jiaxin↗
DOE OSTI2025

EVI-EnSitePy (Electric Vehicle Infrastructure – Energy Estimation and Site Optimization Tool in Python) [EVI-X Modeling Suite] [SWR-25-07]

EVI-EnSitePy is a comprehensive agent-based tool designed for the analysis and design of high-power charging sites, encompassing a wide array of site agents including Electric Vehicles (EVs), chargers, energy storage units (ESS), renewable energy resources (DER), and loads. This versatile tool offers diverse functionalities and a modular modeling approach, allowing detailed configuration of agents based on power ratings, port numbers, energy capacities, demand requirements, charger interfaces, and flexibility to customize the tool for project specific goals. By simulating agent interactions and employing various metrics, EVI-EnSitePy enables the assessment of site performance, exploration of energy management systems (EMS), and implementation of innovative EV charging policies. Utilizing EV charge schedules and arrival states, the tool performs thorough charging site simulations, with outputs consisting of agent and site-level power profiles and statistical metrics. Employing a tree graph structure, EVI-EnSitePy supports nested site structures and power distribution modeling. The tool's ability to generate charging schedules deterministically or via stochastic analysis further enhances its versatility. Through its features and capabilities, EVI-EnSitePy offers a powerful platform for informed decision-making in the realm of high-power charging site design and operation.

Jackson, Derek [National Renewable Energy Laborato↗
DOE OSTI2023

Uncertainty quantification in scientific machine learning: Methods, metrics, and comparisons

Neural networks (NNs) are currently changing the computational paradigm on how to combine data with mathematical laws in physics and engineering in a profound way, tackling challenging inverse and ill-posed problems not solvable with traditional methods. However, quantifying errors and uncertainties in NN-based inference is more complicated than in traditional methods. This is because in addition to aleatoric uncertainty associated with noisy data, there is also uncertainty due to limited data, but also due to NN hyperparameters, overparametrization, optimization and sampling errors as well as model misspecification. Although there are some recent works on uncertainty quantification (UQ) in NNs, there is no systematic investigation of suitable methods towards quantifying the total uncertainty effectively and efficiently even for function approximation, and there is even less work on solving partial differential equations and learning operator mappings between infinite-dimensional function spaces using NNs. In this work, we present a comprehensive framework that includes uncertainty modeling, new and existing solution methods, as well as evaluation metrics and post-hoc improvement approaches. Further, to demonstrate the applicability and reliability of our framework, we present an extensive comparative study in which various methods are tested on prototype problems, including problems with mixed input-output data, and stochastic problems in high dimensions. In the Appendix, we include a comprehensive description of all the UQ methods employed. Further, to help facilitate the deployment of UQ in Scientific Machine Learning research and practice, we present and develop in [1] an open-source Python library (github.com/Crunch-UQ4MI/neuraluq), termed NeuralUQ, that is accompanied by an educational tutorial and additional computational experiments.

11 physics-informed neural networks↗
DOE OSTI2022

The Stability of Fiber Spectrographs in the Faint-source Regime

The use of optical fibers in astronomical instrumentation offers high-multiplex and light-gathering flexibility. However, with most previous fiber spectrographs optimized for large fields of view on modest-aperture telescopes, the performance of fibers in the context of faint targets on large telescopes remains largely untested. In this paper, we evaluate aspects of fiber stability, especially as they apply in the context of precision sky subtraction of faint sources at modest spectral resolution ($R$ ~ 3000). After introducing a framework for describing potential systematic errors, we use publicly available data from existing instruments, including instrumentation used by the fourth-generation Sloan Digital Sky Survey’s MaNGA project (MaNGA: Mapping Nearby Galaxies at Apache Point Observatory) and the Very Large Telescope’s FLAMES: Fiber Large Array Multi Element Spectrograph. We isolate sources of fiber systematics and estimate the observed amplitude of persistent residuals as well as stochastic noise contributions resulting from changing fiber stresses. Comparing these levels against their impact on various sky subtraction schemes demonstrates that 0.1% precision sky subtraction with fiber instruments is possible. As a demonstration, we show that the MaNGA instrument can deliver 0.2% residuals on bright near-IR sky lines with nonlocal sky subtraction, if pseudo-slit limitations are addressed by allocating 50% of its fibers to sky. We further highlight recently published deep exposures that achieved a 1$σ$ background level of 27.6 AB per square arc second, equivalent to a precision of 0.2% of the sky background continuum.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS2016

Exhibition of Stochastic Resonance in Vestibular Perception

Astronauts experience sensorimotor changes during spaceflight, particularly during G-transitions. Post flight sensorimotor changes include spatial disorientation, along with postural and gait instability that may degrade operational capabilities of the astronauts and endanger the crew. A sensorimotor countermeasure that mitigates these effects would improve crewmember safety and decrease risk. The goal of this research is to investigate the potential use of stochastic vestibular stimulation (SVS) as a technology to improve sensorimotor function. We hypothesize that low levels of SVS will improve sensorimotor perception through the phenomenon of stochastic resonance (SR), when the response of a nonlinear system to a weak input signal is enhanced by the application of a particular nonzero level of noise. This study aims to advance the development of SVS as a potential countermeasure by 1) demonstrating the exhibition of stochastic resonance in vestibular perception, a vital component of sensorimotor function, 2) investigating the repeatability of SR exhibition, and 3) determining the relative contribution of the semicircular canals (SCC) and otolith (OTO) organs to vestibular perceptual SR. A constant current stimulator was used to deliver bilateral bipolar SVS via electrodes placed on each of the mastoid processes, as previously done. Vestibular perceptual motion recognition thresholds were measured using a 6-degree of freedom MOOG platform and a 150 trial 3-down/1-up staircase procedure. In the first test session, we measured vestibular perceptual thresholds in upright roll-tilt at 0.2 Hz (SCC+OTO) with SVS ranging from 0-700 μA. In a second test session a week later, we re-measured roll-tilt thresholds with 0, optimal (from test session 1), and 1500 μA SVS levels. A subset of these subjects, plus naive subjects, participated in two additional test sessions in which we measured thresholds in supine roll-rotation at 0.2 Hz (SCC) and upright y-translation at 1 Hz (OTO) with SVS up to 700 μA. A sinusoidal galvanic vestibular stimulation (GVS) perceptual threshold was also measured on each test day and used to normalize the SVS levels across subjects. In roll-tilt thresholds with SVS, the characteristic SR curve was qualitatively exhibited in 10 of 12 subjects, and the improvement in motion threshold was significant in 6 subjects, indicating that optimal SVS improved passive body motion perception in a way that is consistent with classical SR theory. A probabilistic comparison to numeric simulations further validated these experimental results. On the second test session, 4 out of the 10 SR exhibitors showed repeated improvement with SVS compared to the no SVS condition. Data collection is ongoing for the last two test sessions in which SCC and OTO only perceptual motion recognition thresholds are being measured with SVS. The final results of these test sessions will give insight into whether vestibular perceptual SR can occur when only one type of vestibular sensor is sensing motion or if it is more evident when sensory integration between the SCC and OTO is occurring during the motion. The overall purpose of this research is to further quantify the effects of SVS on various sensorimotor tasks and to gain a more fundamental understanding of how SVS causes SR in the vestibular system. In the context of human space flight, results from this research will help in understanding how SVS may be practically implemented in the future as a component of a comprehensive countermeasure plan for G-transition adaptation.

Galvan-Garza, R. C.↗
DOE OSTI2018

An efficient Bayesian data-worth analysis using a multilevel Monte Carlo method

Improving the understanding of subsurface systems and thus reducing prediction uncertainty requires collection of data. As the collection of subsurface data is costly, it is important that the data collection scheme is cost-effective. Design of a cost-effective data collection scheme, i.e., data-worth analysis, requires quantifying model parameter, prediction, and both current and potential data uncertainties. Assessment of these uncertainties in large-scale stochastic subsurface hydrological model simulations using standard Monte Carlo (MC) sampling or surrogate modeling is extremely computationally intensive, sometimes even infeasible. In this paper, we propose an efficient Bayesian data-worth analysis using a multilevel Monte Carlo (MLMC) method. Compared to the standard MC that requires a significantly large number of high-fidelity model executions to achieve a prescribed accuracy in estimating expectations, the MLMC can substantially reduce computational costs using multifidelity approximations. Since the Bayesian data-worth analysis involves a great deal of expectation estimation, the cost saving of the MLMC in the assessment can be outstanding. While the proposed MLMC-based data-worth analysis is broadly applicable, we use it for a highly heterogeneous two-phase subsurface flow simulation to select an optimal candidate data set that gives the largest uncertainty reduction in predicting mass flow rates at four production wells. Finally, the choices made by the MLMC estimation are validated by the actual measurements of the potential data, and consistent with the standard MC estimation. But compared to the standard MC, the MLMC greatly reduces the computational costs.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2015

Capacitated arc routing problem and its extensions in waste collection

Capacitated arc routing problem (CARP) is the youngest generation of graph theory that focuses on solving the edge/arc routing for optimality. Since many years, operational research devoted to CARP counterpart, known as vehicle routing problem (VRP), which does not fit to several real cases such like waste collection problem and road maintenance. In this paper, we highlighted several extensions of capacitated arc routing problem (CARP) that represents the real-life problem of vehicle operation in waste collection. By purpose, CARP is designed to find a set of routes for vehicles that satisfies all pre-setting constraints in such that all vehicles must start and end at a depot, service a set of demands on edges (or arcs) exactly once without exceeding the capacity, thus the total fleet cost is minimized. We also addressed the differentiation between CARP and VRP in waste collection. Several issues have been discussed including stochastic demands and time window problems in order to show the complexity and importance of CARP in the related industry. A mathematical model of CARP and its new version is presented by considering several factors such like delivery cost, lateness penalty and delivery time.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2026

Surrogate modeling of Monte Carlo radiation transport with convolutional neural networks for shielding optimization

Here, we present a machine learning (ML)-based surrogate model using convolutional neural networks (CNN) designed to emulate the attenuation of neutron fields as they pass through various shielding materials. This model can compute the outgoing neutron flux almost instantaneously and achieves reasonable accuracy compared to traditional Monte Carlo (MC)-based codes, which are computationally intensive. This emulator alleviates the complexity of neutron radiation transport through shielding materials by reducing the dimensionality and enables shielding optimization for a known radiation environment. This optimization process, which would have taken an unrealistic timeline due to several complex radiation transport simulations, can now be achieved in minutes, thus increasing computational capabilities in radiation shielding assessment. We demonstrate the applications of this emulator in computing effective dose rates and optimizing shielding solutions for a heavy-ion accelerator facility, such as the Facility for Rare Isotope Beams, where secondary neutrons produced via beam interactions dominate the radiation environment.

accelerator shielding↗
DOE OSTI2014

TH-A-BRD-01: Radiation Biology for Radiation Therapy Physicists

Mechanisms by which radiation kills cells and ways cell damage can be repaired will be reviewed. The radiobiological parameters of dose, fractionation, delivery time, dose rate, and LET will be discussed. The linear-quadratic model for cell survival for high and low dose rate treatments and the effect of repopulation will be presented and discussed. The rationale for various radiotherapy techniques such as conventional fractionation, hyperfractionation, hypofractionation, and low and high dose rate brachytherapy, including permanent implants, will be presented. The radiobiological principles underlying radiation protection guidelines and the different radiation dosimetry terms used in radiation biology and in radiation protection will be reviewed. Human data on radiation induced cancer, including increases in the risk of second cancers following radiation therapy, as well as data on radiation induced tissue reactions, such as cardiovascular effects, for follow up times up to 20–40 years, published by ICRP, NCRP and BEIR Committees, will be examined. The latest risk estimates per unit dose will be presented. Their adoption in recent radiation protection standards and guidelines and their impact on patient and workers safety in radiotherapy will be discussed. Biologically-guided radiotherapy (BGRT) provides a systematic method to derive prescription doses that integrate patient-specific information about tumor and normal tissue biology. Treatment individualization based on patient-specific biology requires the identification of biological objective functions to facilitate the design and comparison of competing treatment modalities. Biological objectives provide a more direct approach to plan optimization instead of relying solely on dose-based surrogates and can incorporate factors that alter radiation response, such as DNA repair, tumor hypoxia, and relative biological effectiveness. We review concepts motivating biological objectives and provide examples of how they might be used to address clinically relevant problems. Underlying assumptions and limitations of existing models and their proper application will be discussed. This multidisciplinary educational session combines the fundamentals of radiobiology for radiation therapy and radiation protection with the practical application of biophysical models for treatment planning and evaluation. Learning Objectives: To understand fractionation in teletherapy and dose rate techniques in brachytherapy. To understand how the linear-quadratic models the effect of radiobiological parameters for radiotherapy. To understand the radiobiological basis of radiation protection standards applied to radiotherapy. To distinguish between stochastic effects and tissue reactions. To learn how to apply concepts of biological effective dose and RBE-weighted dose and to incorporate biological factors that alter radiation response. To discuss clinical strategies to increase therapeutic ratio, i.e., maximize local control while minimizing the risk of acute and late normal tissue effects.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

The root cause of disruptive NTMs and paths to stable operation in DIII-D ITER baseline scenario plasmas

Analyses of the DIII-D ITER Baseline Scenario database support that the disruptive m,n=2,1 magnetic islands are pressure gradient driven, non-linear instabilities seeded in a sequence of stochastic transient magnetic perturbations, and that the current profile relaxation does not affect the m,n=2,1 island onset rate. At low torque, these Neoclassical Tearing Modes are most commonly seeded by non-linear 3-wave coupling when the differential rotation between the q=1 & q=2 rational surfaces approaches zero. Lack of statistically significant difference between the current profiles of stable and unstable states, as well as lack of correlation between the tearing mode onset rate and the current profile relaxation both reject causality between the current profile evolution and the 2,1 magnetic island onsets in these plasmas. These support that preserving the differential rotation between the q=1 and q=2 rational surfaces is key to long pulse stable operation in the plasma scenario planned for ITER, while optimization of the current profile within the explored parameter space may lead to much weaker improvements than sustaining the differential rotation.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

An automated approach to the alignment of compound refractive lenses

Compound refractive lenses (CRLs) are established X-ray focusing optics, and are used to focus the beam or image the sample in many beamlines at X-ray facilities. While CRLs are quite established, the stack of single lens elements affords a very small numerical aperture because of the thick lens profile, making them far more difficult to align than classical optical lenses that obey the thin-lens approximation. This means that the alignment must be very precise and is highly sensitive to changes to the incident beam, often requiring regular readjustments. Some groups circumvent the full realignment procedure by using engineering controls ( e.g. mounting optics) that sacrifice some of the beam's focusing precision, i.e. spot size, or resolution. While these choices minimize setup time, there are clear disadvantages. This work presents a new automated approach to align CRLs using a simple alignment apparatus that is easy to adapt and install at different types of X-ray experiments or facilities. This approach builds on recent CRL modeling efforts, using an approach based on the Stochastic Nelder–Mead (SNM) simplex method. This method is outlined and its efficacy is demonstrated with numerical simulation that is tested in real experiments conducted at the Advanced Photon Source to confirm its performance with a synchrotron beam. This work provides an opportunity to automate key instrumentation at X-ray facilities.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRS1991

Generalized covariance analysis for partially autonomous deep space missions

A new covariance analysis method is presented that is suitable for the evaluation of multiple impulsive controllers acting on some stochastic process x. The method accommodates batch and sequential estimators with equal ease and accounts for time-delay effects in a natural manner. The formalism is developed in terms of a generalized state vector that is formed from the system state vector x, augmented by various fixed epoch estimates, and a data vector formed from discrete time observations of the system. Recursions are developed for time transition, measurement incorporation, and impulsive control updating of the generalized covariance matrix. Means of limiting the dimensional growth of the generalized state vector via the processes of estimator epoch adjustment and measurement vector deflation are described and the application of numerically stable matrix factorization methods to the generalized covariance recursions is outlined. The method is applied to the Magellan spacecraft to demonstrate the capability of ground-based optimal estimation and control of gyro/star scanner misalignment.

Boone, Jack N.↗
DOE OSTI2020

Prediction of gas hydrate saturation using machine learning and optimal set of well-logs

We report resistivity and acoustic logs are widely used to estimate gas hydrate saturation in various sedimentary systems using one of the two popular methods ((1) acoustic velocity and (2) electrical resistivity), but the limitations of these two methods are often overlooked, which include (i) well-specific calibration of empirical exponents in the electrical resistivity method, (ii) assumption of known pore morphology for gas hydrates in the acoustic velocity method, and (iii) presence of unknown mineralogy and bulk modulus terms in the acoustic velocity method. NMR-density porosity-derived gas hydrate saturation based on the analysis of the transverse magnetization relaxation time (T2) is considered the most precise method, but acquisition of NMR-based logs is limited at relatively recent drilled sites; additionally, its use in conventional oil and gas reservoirs is not that common due to higher cost and operational deployment limitations associated with acquiring NMR well-logs. This study proposes a new method that predicts gas hydrate saturation (S h ) for any well using porosity, bulk density, and compressional wave (P wave) velocity well-logs with neural network (or stochastic gradient descent regression) without any well-specific calibration and/or other aforementioned shortcomings of the existing methods. The method is developed by examining the underlying dependency between S h and different combinations of well-logs, chosen from 6 routine logs, with 12 different machine learning (ML) algorithms. The accuracy of the proposed method in predicting S h is ~ 84%, which is better than the accuracy of seismic and electrical resistivity methods (≤ 75%) per the results reported by three different studies. The robustness of the method in the specific case of permafrost-associated gas hydrates is demonstrated with well-log data from two wells drilled on the Alaska North Slope.

58 GEOSCIENCES↗
DOE OSTI2019

Function Preserving Projection

With function preserving projection (FPP), we aim to address high-dimensional data exploration challenges common in many scientific applications. Instead of preserving the global or local geometric structure of a dataset like traditional dimensionality reduction methods (e.g., principal component analysis, t-stochastic neighborhood embedding), the proposed approach finds a linear projection that reveal interpretable (yet potentially nonlinear) pattern of the properties of interests defined on a highdimensional domain (e.g., simulation yield defined on the input parameter space). The key insight driving FPP is the fact that while non-linear embeddings are difficult to interpret, humans are highly skilled in understanding complex visual patterns. FPP lets users select the complexity of a pattern they consider interpretable, allows to find a joint projection that explains multiple functions, and provides a confidence statistic (akin to a p-value) indicating how salient the resulting pattern is. We demonstrate the efficacy of the proposed method on several synthetic and scientific datasets for both continuous (regression) and discrete (classification) problems of interests and illustrate the scalability of FPP by finding an optimal projection for close to 40 gigabytes in around 10 minutes.

Liu, SHUSEN↗
DOE OSTI2022

A phase transition for finding needles in nonlinear haystacks with LASSO artificial neural networks

To fit sparse linear associations, a LASSO sparsity inducing penalty with a single hyperparameter provably allows to recover the important features (needles) with high probability in certain regimes even if the sample size is smaller than the dimension of the input vector (haystack). More recently learners known as artificial neural networks (ANN) have shown great successes in many machine learning tasks, in particular fitting nonlinear associations. Small learning rate, stochastic gradient descent algorithm and large training set help to cope with the explosion in the number of parameters present in deep neural networks. Yet few ANN learners have been developed and studied to find needles in nonlinear haystacks. Driven by a single hyperparameter, our ANN learner, like for sparse linear associations, exhibits a phase transition in the probability of retrieving the needles, which we do not observe with other ANN learners. To select our penalty parameter, we generalize the universal threshold of Donoho and Johnstone (Biometrika 81(3):425–455, 1994) which is a better rule than the conservative (too many false detections) and expensive cross-validation. In the spirit of simulated annealing, we propose a warm-start sparsity inducing algorithm to solve the high-dimensional, non-convex and non-differentiable optimization problem. We perform simulated and real data Monte Carlo experiments to quantify the effectiveness of our approach.

97 MATHEMATICS AND COMPUTING↗