Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Automatic Differentiation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Discovering Hidden Geothermal Signatures using Unsupervised Machine Learning

Discovering hidden geothermal resources is a very challenging task. It requires the mining of large datasets, including various diverse data attributes representing subsurface hydrogeological and geothermal conditions. The commonly used Play Fairway Analysis (PFA) typically relies on subject-matter expertise to analyze site or regional data to estimate geothermal conditions and prospectivity. Here, we demonstrate an alternative approach based on machine learning (ML) to process a geothermal dataset of Southwest New Mexico (SWNM). The study region includes low- and medium-temperature hydrothermal systems. However, most of these systems are poorly characterized because of insufficient existing data and limited past explorative studies. This study aims to discover hidden patterns and relationships in the SWNM geothermal dataset to better understand regional hydrothermal conditions. This is achieved by applying an unsupervised machine learning algorithm based on non-negative matrix factorization coupled with customized k-means clustering (NMFk). NMFk can automatically identify (1) hidden (latent) signatures characterizing datasets, (2) the optimal number of these signatures, (3) dominant data attributes associated with each signature, and (4) spatial distribution of the extracted signatures. Here, NMFk is applied to analyze 18 geological, geophysical, hydrogeological, geothermal attributes at 44 locations in SWNM. NMFk successfully finds data patterns and identifies the spatial associations of hydrothermal signatures with the four physiographic provinces in SWNM (Colorado Plateau, Volcanic Field, Basin and Range, and the Rio Grande rift). The algorithm identified up to 5 hydrothermal signatures in the SWNM datasets that differentiate between low- and medium-temperature hydrothermal systems in different provinces. Also, the algorithm identifies two medium-temperature hydrothermal systems in SWNM that require further exploration for geothermal resource development. Based on our analyses, 12 of the attributes are important to identify medium-temperature hydrothermal systems, and the remaining six attributes are critical to characterize low-temperature hydrothermal systems. Based on the obtained results, we identify potential physiographic provinces for further exploration to characterize them as geothermal resources. The resulting NMFk model can be applied to predict geothermal conditions and their uncertainties at new SWNM locations based on limited data from unexplored areas.

58 GEOSCIENCES↗
DOE OSTI2021

Application-driven Privacy-preserving Data Publishing with Correlated Attributes

Recent advances in computing have allowed for the possibility to collect large amounts of data on personal activities and private living spaces. To address the privacy concerns of users in this environment, we propose a novel framework called PR-GAN that offers privacy-preserving mechanism using generative adversarial networks. Given a target application, PR-GAN automatically modifies the data to hide sensitive attributes - which may be hidden and can be inferred by machine learning algorithms - while preserving the data utility in the target application. Unlike prior works, the public's possible knowledge of the correlation between the target application and sensitive attributes is built into our modeling. We formulate our problem as an optimization problem, show that an optimal solution exists and use generative adversarial networks (GAN) to create perturbations. We further show that our method provides privacy guarantees under the Pufferfish framework, an elegant generalization of the differential privacy that allows for the modeling of prior knowledge on data and correlations. Through experiments, we show that our method outperforms conventional methods in effectively hiding the sensitive attributes while guaranteeing high performance in the target application, for both property inference and training purposes. Finally, we demonstrate through further experiments that once our model learns a privacy-preserving task, such as hiding subjects' identity, on a group of individuals, it can perform the same task on a separate group with minimal performance drops.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

hIPPYlib-MUQ: A Bayesian Inference Software Framework for Integration of Data with Complex Predictive Models under Uncertainty

Bayesian inference provides a systematic framework for integration of data with mathematical models to quantify the uncertainty in the solution of the inverse problem. However, the solution of Bayesian inverse problems governed by complex forward models described by partial differential equations (PDEs) remains prohibitive with black-box Markov chain Monte Carlo (MCMC) methods. We present hIPPYlib-MUQ, an extensible and scalable software framework that contains implementations of state-of-the art algorithms aimed to overcome the challenges of high-dimensional, PDE-constrained Bayesian inverse problems. These algorithms accelerate MCMC sampling by exploiting the geometry and intrinsic low-dimensionality of parameter space via derivative information and low rank approximation. The software integrates two complementary open-source software packages, hIPPYlib and MUQ. hIPPYlib solves PDE-constrained inverse problems using automatically-generated adjoint-based derivatives, but it lacks full Bayesian capabilities. MUQ provides a spectrum of powerful Bayesian inversion models and algorithms, but expects forward models to come equipped with gradients and Hessians to permit large-scale solution. By combining these two complementary libraries, we created a robust, scalable, and efficient software framework that realizes the benefits of each and allows us to tackle complex large-scale Bayesian inverse problems across a broad spectrum of scientific and engineering disciplines. To illustrate the capabilities of hIPPYlib-MUQ, we present a comparison of a number of MCMC methods available in the integrated software on several high-dimensional Bayesian inverse problems. These include problems characterized by both linear and nonlinear PDEs, various noise models, and different parameter dimensions. The results demonstrate that large (~ 50×) speedups over conventional black box and gradient-based MCMC algorithms can be obtained by exploiting Hessian information (from the log-posterior), underscoring the power of the integrated hIPPYlib-MUQ framework.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1983

Control device for prosthetic urinary sphincter cuff

A device for controlling flow of fluid to and from a resilient inflatable cuff implanted about the urethra to control flow of urine therethrough. The device comprises a flexible bulb reservoir and a control unit that includes a manually operated valve that opens automatically when the bulb is squeezed to force fluid into the cuff for closing the urethra. The control unit also includes a movable valve seat member having a relatively large area exposed to pressure of fluid in a chamber that is connected to the cuff and which moves to a position in which the valve member is unseated by an abutment when fluid pressure in the chamber exceeds a predetermined value to thereby relieve excess fluid pressure in the cuff. The arrangement is such that the valve element is held closed against the seat member by the full differential in fluid pressures acting on both sides of the valve element until the seat member is moved away from the valve element to thus insure positive closing of the valve element until the seat member is moved out of engagement with the valve element by excess pressure differential.

Reinicke, Robert H.↗
NASA NTRS2002

Turbomachinery Airfoil Design Optimization Using Differential Evolution

An aerodynamic design optimization procedure that is based on a evolutionary algorithm known at Differential Evolution is described. Differential Evolution is a simple, fast, and robust evolutionary strategy that has been proven effective in determining the global optimum for several difficult optimization problems, including highly nonlinear systems with discontinuities and multiple local optima. The method is combined with a Navier-Stokes solver that evaluates the various intermediate designs and provides inputs to the optimization procedure. An efficient constraint handling mechanism is also incorporated. Results are presented for the inverse design of a turbine airfoil from a modern jet engine. The capability of the method to search large design spaces and obtain the optimal airfoils in an automatic fashion is demonstrated. Substantial reductions in the overall computing time requirements are achieved by using the algorithm in conjunction with neural networks.

Madavan, Nateri K.↗
DOE OSTI2021

A 24-Channel Digitizer With a JESD204B-Compliant Serial Interface for High-Speed Detectors

In this report a 24-channel application-specific integrated circuit (ASIC) for the readout of high-speed CMOS active pixel sensors for charged particle detection is presented. The chip comprises 24 preamplifiers, 24 distinct 12-bit, 25 MSPS Pipelined analog-to-digital converters (ADCs) with self-calibration, an internal phase-locked loop (PLL), and a 3 Gbps serial interface that conforms to the JESD204B standard. To simplify interfacing with a variety of sensors, the ASIC also includes an automatic offset calibration loop. The high level of integration of the ASIC reduces overall system cost and area, and exploiting the signal characteristics of the image sensor allows the ADC to be optimized for reduced power dissipation. The use of an integrated serializer and an industry standard protocol simplifies integration of the ASIC into a complete camera system. The ASIC, called the High-Speed Image Preprocessor Targeted for Electron Readout, or HIPSTER, with a die area of 64.26 mm 2 , is packaged in a 480-ball grid array (BGA) and is fabricated in 180-nm CMOS technology. HIPSTER achieves typical differential nonlinearity (DNL) < 0.55 LSB, input-referred thermal noise of $114.5 μV-rms, and a bit error rate (BER) of better than 10-14. The power dissipation is 98 mW/channel.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
NASA NTRS1994

Bias and high-order galaxy correlation functions in the APM galaxy survey

On large scales, the higher order moments of the mass distribution, S(sub J) = bar-zeta(sub J)/bar-zeta(sup J-1)(sub 2), e.g., the skewness S(sub 3) and kurtosis S(sub 4), can be predicted using nonlinear perturbation theory. Comparison of these predictions with moments of the observed galaxy distribution probes the bias between galaxies and mass. Applying this method to models with initially Gaussian fluctuations and power spectra P(k) similar to that of galaxies in the Automatic Plate Measuring (APM) survey, we find that the predicted higher order moments S(sub J)(R) are in good agreement with those directly inferred from the APM survey in the absence of bias. We use this result to place limits on the linear and nonlinear bias parameters. Models in which the extra power observed on large scales (with respect to the standard cold dark matter (CDM) model) is produced by scale-dependent bias match the APM higher order amplitudes only if nonlinear bias (rather than nonlinear gravity) generates the observed higher order moments. When normalized to Cosmic Background Explorer Differential Microwave Radiometer (COBE DMR), these models are siginificantly ruled out by the S(sub 3) observations. The cold plus hot dark matter model normalized to COBE can reproduce the APM higher order correlations if one introduces nonlinear bias terms, while the low-density CDM model with a cosmological constant does not require any bias to fit the large-scale amplitudes.

Gaztanaga, Enrique↗
NASA NTRS2002

Turbomachinery Airfoil Design Optimization Using Differential Evolution

An aerodynamic design optimization procedure that is based on a evolutionary algorithm known at Differential Evolution is described. Differential Evolution is a simple, fast, and robust evolutionary strategy that has been proven effective in determining the global optimum for several difficult optimization problems, including highly nonlinear systems with discontinuities and multiple local optima. The method is combined with a Navier-Stokes solver that evaluates the various intermediate designs and provides inputs to the optimization procedure. An efficient constraint handling mechanism is also incorporated. Results are presented for the inverse design of a turbine airfoil from a modern jet engine and compared to earlier methods. The capability of the method to search large design spaces and obtain the optimal airfoils in an automatic fashion is demonstrated. Substantial reductions in the overall computing time requirements are achieved by using the algorithm in conjunction with neural networks.

Madavan, Nateri K.↗
NASA NTRS1982

IAC control system analysis development

The MultiOptimal Differential Equation Language (MODEL) is described. It provides a means for generating numerical solutions to systems of differential equations using a digital computer. The notation of this language is similar to that usually used in describing physical systems by differential equations. Thus, the learning process is simplified, programming becomes easier, and debugging is more readily accomplished. Programs written in the MultiOptimal Differential Equation Language are machine translated into FORTRAN 4 code which is optimal in several respects. The interactive version of MODEL makes use of interactive system routines so that the user may observe the solution as it is being generated and interact with the program in a manner similar to that associated with analog simulation. The DISCOS-Control version of the MODEL simulation language is used to describe the control system for a plant which is modelled by the DISCOS program. DISCOS plant variables may be referenced in the control system description and all the sensor signals, coupling torques, momentum devices and external loads are automatically linked to the DISCOS plant model.

Frisch, H. P.↗
DOE OSTI2026

Time at Temperature Experiments on Neutron Irradiated Zircaloy-2 using Conventional & Flash DSC

Dryout events in Boiling Water Reactors (BWRs) are currently treated by NRC regulations as automatic disqualification for continued fuel rod operation, even though this criterion does not account for the rate or duration of power increases, associated changes in material behavior, or the possibility of rewetting. Operational history from Anticipated Operational Occurrences (AOOs) shows that short, transient power excursions often demand only modest heat removal, and industry experience suggests that fuel can briefly enter dryout yet return to safe, stable operation. The lack of detailed understanding of the material response during such events motivates the present series of experiments. This study uses unique and innovative methods to investigate microstructural evolution in irradiated Zircaloy-2 exposed to high temperatures in inert environments. Differential Scanning Calorimetry (DSC) and FlashDSC are combined to build a comprehensive experimental framework capable of identifying the a–ß phase transformation in zirconium and examining defect annealing under steep thermal gradients. FlashDSC enables rapid heating and cooling of Focused Ion Beam (FIB)–prepared large-area lift-outs (LALOs) of irradiated Zircaloy-2 at rates of 1,000 K/s to peak temperatures of 600°C, 750°C, and 900°C. The goal is to determine whether these conditions produce measurable microstructural changes that could influence cladding performance in typical BWR environments. Microstructural characterization includes quantifying dislocation density and assessing secondary phase particle (SPP) size and distribution using Transmission Electron Microscopy (TEM). Ongoing analysis, such as diffraction pattern indexing and 4D STEM processing, will further refine these observations.

36 - MATERIALS SCIENCE↗
DOE OSTI2022

Discovering hidden geothermal signatures using non-negative matrix factorization with customized k-means clustering

Discovery of hidden geothermal resources is challenging. It requires the mining of large datasets with diverse data attributes representing subsurface hydrogeological and geothermal conditions. The commonly used play fairway analysis approach typically incorporates subject-matter expertise to analyze regional data to estimate geothermal characteristics and favorability. We demonstrate an alternative approach based on machine learning (ML) to process a geothermal dataset from southwest New Mexico (SWNM). The study region includes low- and medium-temperature hydrothermal systems. Several of these systems are not well characterized because of insufficient existing data and limited past explorative work. This study discovers hidden patterns and relations in the SWNM geothermal dataset to improve our understanding of the regional hydrothermal conditions and energy-production favorability. This understanding is obtained by applying an unsupervised ML algorithm based on non-negative matrix factorization coupled with customized k-means clustering (NMFk). NMFk can automatically identify (1) hidden signatures characterizing analyzed datasets, (2) the optimal number of these signatures, (3) the dominant data attributes associated with each signature, and (4) the spatial distribution of the extracted signatures. Here, in this study, NMFk is applied to analyze 18 geological, geophysical, hydrogeological, and geothermal attributes at 44 locations in SWNM. Using NMFk, we find data patterns and identify the spatial associations of hydrothermal signatures within two physiographic provinces (Colorado Plateau and Basin and Range) and two sub-regions of these provinces (the Mogollon-Datil volcanic field and the Rio Grande rift) in SWNM. The ML algorithm extracted five hydrothermal signatures in the SWNM datasets that differentiate between low (<90°C) and medium (90-150°C)-temperature hydrothermal systems. The algorithm also suggests that the Rio Grande rift and northern Mogollon-Datil volcanic field are the most favorable regions for future geothermal resource discovery. NMFk also identified critical attributes to identify medium-temperature hydrothermal systems in the study area. The resulting NMFk model can be applied to predict geothermal conditions and their uncertainties at new SWNM locations based on limited data from unexplored regions. The code to execute the performed analyses as well as the corresponding data can be found at https://github.com/SmartTensors/GeoThermalCloud.jl.

15 GEOTHERMAL ENERGY↗
DOE OSTI2025

Graph-based Reversible Evaluation and Tangents Library

GRETL is a C++ library for evaluation, re-evaluation and algorithmic differentiation of functional operations on an arbitrary computational graph with limited memory usage. Similar to popular machine learning frameworks in Python, like PyTorch and JAX, it tracks and stores both operations and output data as functions are evaluated. Once this composition of functions is built up, the entire chain of operations can be back propagated to compute sensitivities of the final result with respect to any number of inputs. In contrast to most machine learning applications, memory usage becomes the bottleneck for back propagation in many physics applications, especially for time-dependent PDEs. Dynamic check pointing becomes essential. An important distinguishing feature of GRETL is its ability to limit the maximum memory usage by automatically dynamic checkpointing the data output for each graph operation (see Wang, Moin, Iaccarino, 2009). During backpropagation, parts of the graph that are no longer in memory are automatically re-evaluated from upstream checkpointed states as needed for derivative sensitivity calculations (or more precisely, for vector-Jacobian products). GRETL is particularly beneficial for applications, such as coupled multi-physics, where deriving adjoint-based sensitivities and managing checkpoint memory across modules becomes onerous. Cases which can be readily handled by the GRETL library include: different time-integration algorithms per physics (e.g., coupled predictor-corrector algorithms, IMEX, etc.), sub-cycling, asynchronous integrators, state dependent timestep sizes, iterative solvers and coupling algorithms, controller algorithms, and more.

Tupek, MichaelR [Lawrence Livermore National Labor↗
NASA NTRS1995

Profiles of Gamma-Ray Bursts and Their Component Pulses

One physically informative regularity of their otherwise heterogeneous ensemble, is that many Gamma-Ray Bursts consist of well defined pulses. To objectively quantify the temporal structure of BATSE bursts, we have developed an automatic modeling procedure that separates overlapping pulses and determines the energy-dependence of the pulse-shape parameters. No binning of photon arrival times is needed, so when applied to time-tagged events (TTE) the procedure captures variability information down to the shortest time scales present in the raw data. Maximizing the Bayesian likelihood function Pr(data/model) yields estimates of the model parameters, including the number of pulses present, and allows intercomparison of models of different forms. As with any nonlinear optimization, good initial guesses are crucial to avoid convergence to undesirable local minima. We find excellent initial pulse decompositions by wavelet-denoising a cumulative distribution of the raw photon arrival data; differentiation then gives a time profile mostly free of the systematic effects of degraded resolution (as in ordinary Fourier smoothing) and binning. We present statistical information on pulse rise-time, decay-time, peakedness, and amplitudes, plus their energy dependences - both within a single burst and for a large ensemble of bursts.

Scargle, Jeff D.↗
DOE OSTI2020

Dynamically Reconfigurable Data Readout of Pixel Detectors for Automatic Synchronization with Data Acquisition Systems

Reconfigurable detectors with dynamically selectable sensing and readout modes are highly desirable for implementing edge computing as well as enabling advanced imaging techniques such as foveation. The concept of a camera system capable of simultaneous passive imaging and dynamic ranging in different regions of the detector is presented. Such an adaptive-autonomous detector with both spatial and temporal control requires programmable window of exposure (time frames), ability to switch between readout modes such as full-frame imaging and zero-suppressed data, modification of the number of pixel data bits and independent programmability for distinct detector regions. In this work, a method is presented for seamlessly changing time frames and readout modes without data corruption while still ensuring that the data acquisition system (DAQ) does not need to stop and resynchronize at each change of setting, thus avoiding significant dead time. Data throughput is maximized by using a minimum unique data format, rather than lengthy frame headers, to differentiate between consecutive frames. A data control and transmitter (DCT) synchronizes data transfer from the pixel to the periphery, reconfigures the data to transmit it serially off-chip, while providing optimized decision support based on a DAQ definable mode. Measurements on a test structure demonstrate that the DCT can operate at 1 GHz in a 65 nm LP CMOS process.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
NASA NTRS1995

Air traffic management system design using satellite based geo-positioning and communications assets

The current FAA and ICAO FANS vision of Air Traffic Management will transition the functions of Communications, Navigation, and Surveillance to satellite based assets in the 21st century. Fundamental to widespread acceptance of this vision is a geo-positioning system that can provide worldwide access with best case differential GPS performance, but without the associated problems. A robust communications capability linking-up aircraft and towers to meet the voice and data requirements is also essential. The current GPS constellation does not provide continuous global coverage with a sufficient number of satellites to meet the precision landing requirements as set by the world community. Periodic loss of the minimum number of satellites in view creates an integrity problem, which prevents GPS from becoming the primary system for navigation. Furthermore, there is reluctance on the part of many countries to depend on assets like GPS and GLONASS which are controlled by military communities. This paper addresses these concerns and provides a system solving the key issues associated with navigation, automatic dependent surveillance, and flexible communications. It contains an independent GPS-like navigation system with 27 satellites providing global coverage with a minimum of six in view at all times. Robust communications is provided by a network of TDMA/FDMA communications payloads contained on these satellites. This network can support simultaneous communications for up to 30,000 links, nearly enough to simultaneously support three times the current global fleet of jumbo air passenger aircraft. All of the required hardware is directly traceable to existing designs.

Horkin, Phil↗
DOE OSTI2024

Multiphysics Time-Integration for Turbulent Combustion at the Exascale

Turbulent reacting flow systems are often modeled with coupled time-dependent partial differential equations (PDEs). Solving such equations can easily tax the world's largest supercomputers. One pragmatic strategy for attacking such problems is to split the PDEs into components that can more easily be solved in isolation. This generic operator-splitting strategy leads to a set of ordinary differential equations (ODEs) that need to be solved as part of an "outer-loop" time-stepping approach. In many combustion applications, the ODEs to be solved can be very stiff, exhibiting timescales that span many orders of magnitude. The SUNDIALS library provides a plethora of robust time integration algorithms for solving these ODEs on exascale-capable computing hardware, yet for many complex applications (such multicomponent fuels or emissions predictions), the chemical models remain too complex to solve using reasonable resources. The Quasi-Steady State Approximation (QSSA) can be an effective tool for reducing the size and stiffness of the simulations. In this talk, I will discuss the use of the SUDIALS library of ODE solvers together with automatic code generation tools to solve complex turbulent reacting flow problems using QSSA models.

chemistry↗
DOE OSTI2021

Parametrizations of the spin density matrix

Highlights: • Proposed two methods for parametrizing the SDM of spinning, unstable particles. • All non-negativity conditions fulfilled; adaptability to various constraints. • First method: based on a theorem; applicable in a simple and flexible way. • Second method: particularly suitable for especial conditions. • Applications: two of them interesting in the search for new physics. We propose for the spin density matrix two parametrizations which automatically fulfill the non-negativity conditions, without setting any bound on the parameters. The first one relies on a theorem, that we prove, and it is rather simple and easily adaptable to some specific reactions, where, for example, parity is conserved or angular momentum conservation entails selection rules. Moreover, in the case when the rank is less than the order of the density matrix, we show how to improve the fits to the data, either by implementing previous suggestions, or by elaborating an alternative method, for which we prove a second theorem. Our second parametrization is a variant of previous treatments, it appears suitable for some particular processes. Moreover, we discuss about the possibility of inferring the elements of the density matrix from the differential decay width. Last, we illustrate various examples of current interest, both in strong and weak decays; some of them may be helpful in the investigation of physics beyond the standard model.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2021

Physics-informed machine learning

Despite great progress in simulating multiphysics problems using the numerical discretization of partial differential equations (PDEs), one still cannot seamlessly incorporate noisy data into existing algorithms, mesh generation remains complex, and high-dimensional problems governed by parameterized PDEs cannot be tackled. Moreover, solving inverse problems with hidden physics is often prohibitively expensive and requires different formulations and elaborate computer codes. Machine learning has emerged as a promising alternative, but training deep neural networks requires big data, not always available for scientific problems. Instead, such networks can be trained from additional information obtained by enforcing the physical laws (for example, at random points in the continuous space-time domain). Such physics-informed learning integrates (noisy) data and mathematical models, and implements them through neural networks or other kernel-based regression networks. Moreover, it may be possible to design specialized network architectures that automatically satisfy some of the physical invariants for better accuracy, faster training and improved generalization. Furthermore, we review some of the prevailing trends in embedding physics into machine learning, present some of the current capabilities and limitations and discuss diverse applications of physics-informed learning both for forward and inverse problems, including discovering hidden physics and tackling high-dimensional problems.

97 MATHEMATICS AND COMPUTING↗