Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Transformer model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,801 records · Page 100

Conceptual models of information processing

The conceptual information processing issues are examined. Human information processing is defined as an active cognitive process that is analogous to a system. It is the flow and transformation of information within a human. The human is viewed as an active information seeker who is constantly receiving, processing, and acting upon the surrounding environmental stimuli. Human information processing models are conceptual representations of cognitive behaviors. Models of information processing are useful in representing the different theoretical positions and in attempting to define the limits and capabilities of human memory. It is concluded that an understanding of conceptual human information processing models and their applications to systems design leads to a better human factors approach.

Stewart, L. J.↗

Genome-scale metabolic reconstruction of 7,302 human microorganisms for personalized medicine

The human microbiome influences the efficacy and safety of a wide variety of commonly prescribed drugs. Designing precision medicine approaches that incorporate microbial metabolism would require strain- and molecule-resolved, scalable computational modeling. Here, we extend our previous resource of genome-scale metabolic reconstructions of human gut microorganisms with a greatly expanded version. AGORA2 (assembly of gut organisms through reconstruction and analysis, version 2) accounts for 7,302 strains, includes strain-resolved drug degradation and biotransformation capabilities for 98 drugs, and was extensively curated based on comparative genomics and literature searches. The microbial reconstructions performed very well against three independently assembled experimental datasets with an accuracy of 0.72 to 0.84, surpassing other reconstruction resources and predicted known microbial drug transformations with an accuracy of 0.81. We demonstrate that AGORA2 enables personalized, strain-resolved modeling by predicting the drug conversion potential of the gut microbiomes from 616 patients with colorectal cancer and controls, which greatly varied between individuals and correlated with age, sex, body mass index and disease stages. AGORA2 serves as a knowledge base for the human microbiome and paves the way to personalized, predictive analysis of host–microbiome metabolic interactions.

59 BASIC BIOLOGICAL SCIENCES↗

Study and development of techniques for automatic control of remote manipulators

An overall conceptual design for an autonomous control system of remote manipulators which utilizes feedback was constructed. The system consists of a description of the high-level capabilities of a model from which design algorithms are constructed. The autonomous capability is achieved through automatic planning and locally controlled execution of the plans. The operator gives his commands in high level task-oriented terms. The system transforms these commands into a plan. It uses built-in procedural knowledge of the problem domain and an internal model of the current state of the world.

Shaket, E.↗

Large thermal hysteresis in a single-phase NiTiNb shape memory alloy

Large thermal hysteresis ($T$ hys ) is favorable in shape memory alloys (SMAs) because it renders wide service and storage temperature range of the SMA-made parts. In this letter, we show that large intrinsic $T$ hys up to 100 K is achieved in a low Nb content (2 at.%), β-Nb-free and single-phase NiTiNb SMA fabricated by casting, forging, wire-drawing and annealing. Such a large $T$ hys is comparable to that of the widely used dual-phase NiTiNb SMAs in which high Nb content and β-Nb are required. By exploiting the grain-size-dependence of $T$ hys in our single-phase NiTiNb SMA and that in an equiatomic NiTi SMA, we attribute the large $T$ hys to the enhanced kinetic resistance of transformation by the small grains. In conclusion, the connection between the $T$ hys and the kinetic resistance is demonstrated by a modified dislocation-based kinetic model.

36 MATERIALS SCIENCE↗

Performance Evaluations of Noisy Approximate Quantum Fourier Arithmetic

The Quantum Fourier Transform (QFT) grants competitive advantages, especially in resource usage and circuit approximation, for performing arithmetic operations on quantum computers, and offers a potential route towards a numerical quantum-computational paradigm. In this paper, we utilize efficient techniques to implement QFT-based integer addition and multiplications. These operations are fundamental to various quantum applications including Shor’s algorithm, weighted sum optimization problems in data processing and machine learning and quantum algorithms requiring inner products. We carry out performance evaluations of these implementations based on IBM’s superconducting qubit architecture using different compatible noise models. We isolate the sensitivity of the component quantum circuits on both one-/two-qubit gate error rates, and the number of the arithmetic operands’ superposed integer states. We analyze performance, and identify the most effective approximation depths for quantum add and quantum multiply within the given context. We observe significant dependency of the optimal approximation depth on the degree of machine noise and the number of superposed states in certain performance regimes. Finally, we elaborate on the algorithmic challenges - relevant to signed, unsigned, modular and non-modular versions - that could also be applied to current implementations of QFT-based subtraction, division, exponentiation, and their potential tensor extensions. Here, we analyze performance trends in our results and speculate on possible future development within this computational paradigm.

97 MATHEMATICS AND COMPUTING↗

Quantum simulation of massive Thirring and Gross--Neveu models for arbitrary number of flavors

The study of fermionic quantum field theories is an important problem for realizing the standard model of particle physics on a quantum computer. As a step towards this goal, we consider the massive Thirring and Gross--Neveu models with arbitrary number of fermion flavors, $N_f$, discretized on a spatial one-dimensional lattice of size $L$ in the Hamiltonian formulation. We compute the gate complexity using the higher-order product formula and using block-encoding/qubitization and quantum singular value transformations in the limit of large $N_f$ and $L$. We also prepare the ground states of both models with excellent fidelity for system sizes up to 20 qubits with $N_f = 1,2,3,4$ using the adaptive-variational quantum imaginary time algorithm. In addition, we also classify the dynamical Lie algebras of these relativistic fermionic models and show that they belong to the same isomorphism class. Our work is a concrete step towards the quantum simulation of real-time dynamics of large $N_f$ fermionic quantum field theories models relevant for chiral symmetry breaking, understanding dimensional transmutation, and exploring the conformal window of field theories on near-term and early fault-tolerant quantum computers.

FOS: Physical sciences↗

Dust stars in the minimal exponential measure model

Here, we report the existence of horizonless compact object solutions supported by dust in the minimal exponential measure (MEMe) model, a theory which modifies the couplings between gravity and matter without introducing dynamical degrees of freedom. For a perfect fluid source, the field equations for the MEMe model can be rewritten as the Einstein field equations sourced by a perfect fluid with a transformed equation of state, which can endow a sufficiently dense cloud of dust with an effective pressure. The resulting dust-supported horizonless compact objects can have masses below ∼10 −11 ⁢𝑀 ⊙ , making them suitable as massive compact halo objects comprising a significant mass fraction for dark matter. A necessary condition for the existence of these compact object solutions is that the single free parameter in the MEMe model is positive valued. Additionally, we find that this positive sign for the parameter can provide a mechanism for suppressing the formation of (primordial) black holes from the gravitational collapse of matter below a certain mass scale.

alternative gravity theories↗

Induced Generative Adversarial Particle Transformers

In high energy physics (HEP), machine learning methods have emerged as an effective way to accurately simulate particle collisions at the Large Hadron Collider (LHC). The message-passing generative adversarial network (MPGAN) was the first model to simulate collisions as point, or ``particle'', clouds, with state-of-the-art results, but suffered from quadratic time complexity. Recently, generative adversarial particle transformers (GAPTs) were introduced to address this drawback; however, results did not surpass MPGAN. We introduce induced GAPT (iGAPT) which, by integrating ``induced particle-attention blocks'' and conditioning on global jet attributes, not only offers linear time complexity but is also able to capture intricate jet substructure, surpassing MPGAN in many metrics. Our experiments demonstrate the potential of iGAPT to simulate complex HEP data accurately and efficiently.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Experimenting with the GMAO 4D Data Assimilation

The Global Modeling and Assimilation Office (GMAO) has been working to promote its prototype four-dimensional variational (4DVAR) system to a version that can be exercised at operationally desirable configurations. Beyond a general circulation model (GeM) and an analysis system, traditional 4DV AR requires availability of tangent linear (TL) and adjoint (AD) models of the corresponding GeM. The GMAO prototype 4DVAR uses the finite-volume-based GEOS GeM and the Grid-point Statistical Interpolation (GSI) system for the first two, and TL and AD models derived ITom an early version of the finite-volume hydrodynamics that is scientifically equivalent to the present GEOS nonlinear GeM but computationally rather outdated. Specifically, the TL and AD models hydrodynamics uses a simple (I-dimensional) latitudinal MPI domain decomposition, which has consequent low scalability and prevents the prototype 4DV AR ITom being used in realistic applications. In the near future, GMAO will be upgrading its operational GEOS GCM (and assimilation system) to use a cubed-sphere-based hydrodynamics. This versions of the dynamics scales to thousands of processes and has led to a decision to re-derive the TL and AD models for this more modern dynamics, thus taking advantage of a two-dimensional MPI decomposition and improved scalability properties. With the aid of the Transformation of Algorithms in FORTRAN (l'AF) automatic adjoint generation tool and some hand-coding, a version of the cubed-sphere-based TL and AD models, with a simplified vertical diffusion scheme, is now available, enabling multiple configurations of standard implementations of 4DV AR in GEOS. Concurrent to this development, collaboration with the National Centers for Environmental Prediction (NCEP) and the Earth System Research Laboratory (ESRL) has allowed GMAO to implement a hybrid-ensemble capability within the GEOS data assimilation system. Both 3Dand 4D-ensemble capabilities are presently available thus allowing GMAO to now evaluate the performance and benefit of various ensemble and variational assimilation strategies. This presentation will cover the most recent developments taking place at GMAO and show results from various comparisons from traditional techniques to more recent ensemble-based ones.

Todling, R.↗

Analysis of Salinity Intrusion in the San Francisco Bay-Delta using a GA- Optimized Neural Net, and Application of the Model to Prediction in the Elkhorn Slough Habitat

The San Francisco Bay Delta is a large hydrodynamic complex that incorporates the Sacramento and San Joaquin Estuaries, the Burman Marsh, and the San Francisco Bay proper. Competition exists for the use of this extensive water system both from the fisheries industry, the agricultural industry, and from the marine and estuarine animal species within the Delta. As tidal fluctuations occur, more saline water pushes upstream allowing fish to migrate beyond the Burman Marsh for breeding and habitat occupation. However, the agriculture industry does not want extensive salinity intrusion to impact water quality for human and plant consumption. The balance is regulated by pumping stations located alone the estuaries and reservoirs whereby flushing of fresh water keeps the saline intrusion at bay. The pumping schedule is driven by data collected at various locations within the Bay Delta and by numerical models that predict the salinity intrusion as part of a larger model of the system. The Interagency Ecological Program (IEP) for the San Francisco Bay/Sacramento-San Joaquin Estuary collects, monitors, and archives the data, and the Department of Water Resources provides a numerical model simulation (DSM2) from which predictions are made that drive the pumping schedule. A problem with this procedure is that the numerical simulation takes roughly 16 hours to complete a C:~ prediction. We have created a neural net, optimized with a genetic algorithm, that takes as input the archived data from multiple stations and predicts stage, salinity, and flow at the Carquinez Straits (at the downstream end of the Burman Marsh). This model seems to be robust in its predictions and operates much faster than the current numerical DSM2 model. Because the system is strongly tidal driven, we used both Principal Component Analysis and Fast Fourier Transforms to discover dominant features within the IEP data. We then filtered out the dominant tidal forcing to discover non-primary tidal effects, and used this to enhance the neural network by mapping input-output relationships in a more efficient manner. Furthermore, the neural network implicitly incorporates both the hydrodynamic and water quality models into a single predictive system. Although our model has not yet been enhanced to demonstrate improve pumping schedules, it has the possibility to support better decision-making procedures that may then be implemented by State agencies if desired. Our intention is now to use this model in the smaller Elkhorn Slough complex near Monterey Bay where no such hydrodynamic model currently exists. At the Elkhorn Slough, we are fusing the neural net model of tidally-driven flow with in situ flow data and airborne and satellite remote sensation data. These further constrain the behavior of the model in predicting the longer-term health and future of this vital estuary.

Thompson, David E.↗

Quantifying transport and electrocatalytic reaction processes in a gastight rotating cylinder electrode reactor via integration of Computational Fluid Dynamics modeling and experiments

Understanding the complexity of the multiple processes of mass, momentum, charge, and heat transport, and how these affect reaction kinetics at the electrode/electrolyte interface is one of the major challenges in the field of energy and catalysis. The rapid and rational scale-up of electrocatalytic systems to industrial scales require a detailed understanding of nonlinear transport-reaction processes, accessible only through the building of multi-physics models that capture with high fidelity the complexity of real-world devices. The gastight rotating cylinder electrode (RCE) reactor is a promising lab-scale tool that can decouple transport from intrinsic kinetics to generate data for first-principle models useful in the design of industrial, electrochemical reactors. Computational Fluid Dynamics (CFD) studies have previously been used to investigate the bulk flow in RCE reactors for simple corrosion and electroplating processes. However, the quantification of changes in local concentration within the viscous layer where catalysis takes place requires capturing the correct flow conditions inside the hydrodynamic boundary layer near the surface of the electrode. Further, this requires simulations with spatial resolution in the nm and μm scale and temporal resolutions between ms and s scales that are similar to the timescales for reactions on the electrode surface. In this study, experimental electrocatalysis is combined with CFD modeling to elucidate and parameterize the hydrodynamics in a gastight RCE reactor. CFD simulations of the electrochemical ferricyanide reduction reaction under mass transport limited conditions are used to evaluate the validity of the CFD model parameters by comparing calculated dimensionless mass transport descriptors to dimensionless correlations obtained experimentally. Justifications for assumptions and details of the simulation methods used in this study are presented to provide a detailed understanding of the effect that each model parameter has on the ability to accurately simulate electrocatalysis in RCE systems. The simulation methodology reported here is a first step towards the development of multi-scale models for the study of transport dependent electrocatalytic processes, such as the electrochemical transformation of CO 2 to fuels and chemicals.

42 ENGINEERING↗

Aerodynamic effects on outer ash deposition rates in second generation atmospheric pressure oxy-coal combustion systems

Recent measurements in scenarios representative of second generation atmospheric pressure oxy-coal combustion systems have shown a significant increase in ash deposition rates in comparison to combustion in air. However, the causative mechanisms behind this increase have not been well understood. To fill this void, well-characterized experiments including fuel and deposit particle size distributions (PSDs) were coupled with highly resolved numerical simulations to isolate the aerodynamic effects impacting the deposition process such that mechanisms could be hypothesized. Three combustion scenarios (AIR, OXY27, OXY70) spanning a factor of three variation in flue gas volumetric flow rates were simulated and the deposition characteristics (impaction rates, deposit PSD, temperature, residence times, capture rates) tracked/predicted using a customized deposition module. The measured deposit PSD was significantly different from the PSD of the parent fuel indicating significant physio-chemical transformations (coalescence and particle growth in particular) at play. The use of simplistic modeling approaches (swelling parameter variations) to model particle growth led to inaccurate deposit ash PSD and rate predictions. A more satisfactory agreement between the measurements and simulations was obtained when the functional form of the parent fuel PSD (spread parameter) was modified to conform closely to the deposit PSD while still ensuring the fidelity of temperature and velocity predictions. Based on the measured ash compositions, identical capture criteria were employed across all three scenarios. Here this study further supports the theory that the ash deposition rates in these systems are dominated by aerodynamic effects with the ash PSD playing a dominant role.

42 ENGINEERING↗

Tuning acidity in silica-overcoated oxides for hydroalkoxylation

Mixed oxides are ubiquitious solid acid catalysts for a number of transformations. Here, the chemistry of mixed oxide interfaces was experimentally probed by constructing model SiO 2 on MO x interfaces using a liquid-phase, stoichiometrically-controlled deposition of tetraethyl orthosilicate (TEOS). Catalytically active Brønsted sites were generated in four series of overcoated SiO 2 on metal oxide materials prepared by depositing TEOS onto Al 2 O 3 , anatase TiO 2 , Nb 2 O 5 , and ZrO 2 . Pyridine DRIFTS studies indicate that the acidity of deposited silanol groups was enhanced by interaction with the metal oxide surface, suggesting that pseudo-bridging silanol type structures were formed. Trimethylphosphine oxide (TMPO) 31 P NMR experiments showed that Brønsted acid strength varied in the overcoated materials, with increasing strength in the following order: SiO 2 /ZrO 2 < SiO 2 /TiO 2 < SiO 2 /Nb 2 O 5 < SiO 2 /Al 2 O 3 . This order correlated with the Lewis acidity and chemical hardness of the underlying metal oxides. The catalytic performance of the materials was evaluated in the liquid-phase hydroalkoxylation of dihydropyran with n-octanol, revealing that activity was highly dependent on SiO 2 loading, which impacted the density of acid sites, and scaled exponentially with Brønsted acid strength, determined by the core metal oxide identity. Brønsted acid strength appears to be the key driver of the materials’ activity, with the highest areal rate of 2.2 mmol / m 2 – h being measured over SiO 2 /Al 2 O 3 . Furthermore, this study shows that SiO 2 -overcoated materials are a systematically tunable class of catalysts that can be applied to acid catalyzed reactions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Particle-ray tracing through misaligned lattice elements in accelerators

Particle-ray tracing through misaligned lattice elements can be modelled by sandwiching the transfer-map for the aligned element between two transformations, one applied at the entrance and the other at the exit of the element. Here, we derive the explicit form of these two transformations for an arbitrary misalignment using elementary geometry.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Asynchronicity in opposed-piston RCMs: Does it matter?

Rapid Compression Machines (RCMs) are widely utilized to study combustion phenomena at engine-relevant conditions, and significant efforts are typically made to create a quiescent environment, particularly for investigations of autoignition chemistry. Opposed-piston configurations can be advantageous due to shorter compression times and reduced surface area to volume ratios. Each side must be actuated simultaneously, but this can be challenging in practice. These devices, like most RCMs, utilize hydraulics for actuation, speed control and arrestation of the piston at the end of the stroke; there is no mechanical control or linkage of the two piston trajectories. To quantify the magnitudes and effects of piston asynchronous behavior, this work employs both detailed experimental measurements and, for the first time, high-fidelity, Direct Numerical Simulation (DNS). The boundary conditions are carefully considered applying insight from high-resolution linear variable differential transformer (LVDT) measurements of the piston trajectory and a zero-dimensional kinematics model of the piston-shaft assembly. Sufficient resolution in the piston crevice region is used. The complicated fluid dynamical behavior that can evolve during piston compression and the ensuing delay processes due to offset timings from t offset = 0-10 ms is elucidated. It is found that near t offset = 6 ms and beyond, the boundary layer on the face of the first-seating piston can be sufficiently perturbed, due initially to reemergence of gas from the crevice of the firstseating piston, so that the adiabatic core can become degraded at long ignition delay times. Substantial mixing of colder gas into the interior of the reaction chamber can alter the measurements, similar to effects previously observed for improper piston crevice configuration. In conclusion, experimental techniques to mitigate asynchronous behavior are discussed and demonstrated.

33 ADVANCED PROPULSION SYSTEMS↗

Defect Diffusion Graph Neural Networks for Materials Discovery in High-Temperature Energy Applications

Here, the migration of crystallographic defects dictates material properties and performance for a plethora of technological applications. Density functional theory (DFT)-based nudged elastic band (NEB) calculations are a powerful computational technique for predicting defect migration activation energy barriers, yet they become prohibitively expensive for high-throughput screening of defect diffusivities. Without introducing hand-crafted (i.e., chemistry- or structure-specific) descriptors, we propose a generalized deep learning approach to train surrogate models for NEB energies of vacancy migration by hybridizing graph neural networks with transformer encoders and simply using pristine host structures as input. With sufficient training data, computationally efficient and simultaneous inference of vacancy defect thermodynamics and migration activation energies can be obtained to compute temperature-dependent vacancy diffusivities and to down-select candidates for more thorough DFT analysis or experiments. Thus, as we specifically demonstrate for potential water-splitting materials, candidates with desired defect thermodynamics, kinetics, and host stability properties can be more rapidly targeted from open-source databases of experimentally validated or hypothetical materials.

14 SOLAR ENERGY↗

Stable Glasses of Organic Semiconductor Resist Crystallization

The instability of glassy solids poses a key limitation to their use in several technological applications. Well-packed organic glasses, prepared by physical vapor deposition (PVD), have drawn attention recently because they can exhibit significantly higher thermal and chemical stability than glasses prepared from more traditional routes. We show here that PVD glasses can also show enhanced resistance to crystallization. By controlling the deposition temperature, resistance toward crystallization can be enhanced by at least a factor of ten in PVD glasses of the model organic semiconductor Alq3 (tris(8-hydroxyquinolinato) aluminum). PVD glasses of Alq3 first transform into a supercooled liquid before crystallizing. By controlling the deposition temperature, we increase the glass → liquid transformation time thereby also increasing the overall time for crystallization. Furthermore, we thus demonstrate a new strategy to stabilize glasses of organic semiconductors against crystallization, which is a common failure mechanism in organic light emitting diode devices.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Harnessing Photoelectrochemistry for Wastewater Nitrate Treatment Coupled with Resource Recovery

Wastewater is a misplaced resource well suited to recover nutrients, value-added chemicals, energy, and clean water. A photoelectrochemical device is proposed to transform wastewater nitrates to ammonia and nitrous oxide, coupled with water oxidation. Numerical models were developed to quantify the dependence of process efficiencies and nitrogen-removal rates on light absorber band gaps, electrocatalytic kinetic parameters, competing oxygen reduction and hydrogen evolution reactions, and the reacting nitrate species concentrations that affect the mass-transfer limited current densities. With a single light-absorber and state-of-the-art catalysts, optimal solar-to-chemical efficiencies of 7% and 10% and nitrogen-removal rates of 260 and 395 gN m -2 day -1 are predicted for nitrate reduction to ammonia and nitrous oxide, respectively. The influence of competing reactions on the performance depends on the nitrate concentration and band gap of the light absorber modeled. Oxygen reduction is more dominant than hydrogen evolution to compete with the nitrate reduction reaction, but it is mass-transfer limited. Even with kinetic parameters that enhanced the driving forces for the competing reactions, the performance is only minimally affected by these reactions for optimally selected band gaps and nitrate concentrations larger than 100 mM. Here, theoretically predicted peak nitrogen removal rates and specific energy intensities are competitive with reported estimates for electrochemical and Sharon-Anammox processes for ammonia recovery and nitrogen removal, respectively. This result, together with the added benefit of harnessing sunlight to produce value-added products, indicates promise in the photoelectrochemical approach as a tertiary pathway to recover nutrients and energy from wastewater nitrates.

25 ENERGY STORAGE↗

Refine your search to explore more results.