Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “transformer”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35

Illuminating the pathways to carbon liberation: a systems approach to characterizing the consequential unknowns of carbon transformation and loss from thawing permafrost peatlands (Final Report)

The IsoGenie3 Project delivered new systems-level insights into carbon cycling in thawing permafrost landscapes, with an emphasis on methane and carbon dioxide emissions. From >200 samples from the site collected over a decade, co-analyzed for geochemistry and microbiology, the team recovered ~1,500 assembled microbial genomes and ~1,900 viral population genomes, revealing appreciable genetic novelty - from a new highly abundant bacterial phylum, to novel methane consumers and their activities, to rampant viral novelty. IsoGenie3 linked these organisms to carbon compound transformations (which define the cycling of organic matter in soils, and the loss of the greenhouse gases carbon dioxide and methane), and saw that the microbes at each stage of permafrost thaw had different genetic potential to degrade categories of compounds, expressed that genetic potential differently, and actually transformed carbon compounds into greenhouse gases in different ways. IsoGenie 3 identified that some of the thaw-stage differences were due to plant-microbiome relationships; the plant species across the thaw gradient contributed different carbon compounds into the soil, and hosted distinct microbiota (differing among parts of plants as well as species). Lastly, microbes in the saturated post-thaw conditions appeared likely to contribute to the mobilization and toxification of mercury released during thaw. In parallel with ongoing field sampling and analysis, hypotheses arising from field observations were tested via lab incubation experiments. When communities are taken out of their native habitats, they behave differently, and the team first rigorously quantified the magnitude of this effect on microbiome composition and functional capacity, organic matter composition, and gas production; overall the main system processes were maintained in the lab incubations under the conditions tested. Further, the microbial data could inform geochemical reaction network models of those processes. Then, the team ran experiments with additions of compounds, varying temperature, and “live” vs. “dead” peat (the latter having been gamma irradiated, with a few additional variants to control for methodological artifacts). From these, we (a) determined the importance of plant-derived soluble phenolic compounds in bogs’ extraordinary recalcitrance of organic matter, and carbon gas emissions skewed to carbon dioxide; (b) proposed an abiotic ‘tanning’ mechanism, which could contribute to Sphagnum’s inhibitory effect on anaerobic decomposition through alteration of N availability. IsoGenie3 illuminated longer-term and landscape-scale interactions of permafrost thaw and carbon cycling, advancing knowledge of the drivers of methane dynamics not only across in the permafrost-associated peatland (where hydrology and plant communities dictate microbiomes) but also their interconnected lakes (where sediment carbon quality and resident microbiota are determined by position within lake, and lake features). By leveraging observations of site methane dynamics extending well before this project, the team was able to construct a 44-year portrait of the interplay of permafrost thaw, hydrology, vegetation dynamics, and carbon gas emissions, and the doubling of the fully-thawed fens over this time. From the detailed study of this focal site, IsoGenie3 also aimed to improve model representation of these kinds of sites and processes. To improve predictions of methane transformations, we incorporated acetate and isotope dynamics into the ‘DNDC’ biogeochemistry model. In addition, recovered genomes were grouped into ‘functional groups’, i.e. the genomes that perform a specific function of interest, then used to parameterize maximum growth rate and optimum growth temperature (via signatures in their sequence composition) for the BioCrunch model. The BioCrunch model was then in turn used to test the impact of increasing functional resolution of the microbes, on the carbon gas emissions. Lastly for modeling, the ecosys model was parameterized from the microbial and other data, and used to evaluate drivers of e.g. change in methane emissions. Finally, this project also led to the development of a range of new methods and tools, a new metric of organic matter decomposability, as well as a graph-database solution to multidisciplinary data storage and querying. This project’s ongoing analyses at our focal site also contributed to broader advancements in understanding elements of genetic plasticity and methane metabolism, climate change microbiology and community assembly, global peatland geochemistry and Arctic lakes’ roles in climate feedbacks.

54 ENVIRONMENTAL SCIENCES↗

Low-latency Jet Tagging for HL-LHC Using Transformer Architectures

Transformers are the state-of-the-art model architectures and widely used in application areas of machine learning. However the performance of such architectures is less well explored in the ultra-low latency domains where deployment on FPGAs or ASICs is required. Such domains include the trigger and data acquisition systems of the LHC experiments. We present a transformer-based algorithm for jet tagging built with the HGQ2 framework, which is able to produce a model with heterogeneous bitwidths for fast inference on FPGAs, as required in the trigger systems at the LHC experiments. The bitwidths are acquired during training by minimizing the total bit operations as an additional parameter. By allowing a bitwidth of zero, the model is pruned in-situ during training. Using this quantization-aware approach, our algorithm achieves state-of-the-art performance while also retaining permutation invariance which is a key property for particle physics applications. Due to the strength of transformers in representation learning, our work also serves as a stepping stone for the development of a larger foundation model for trigger applications.

Laatu, Lauri [Imperial Coll., London]↗

Characterizing Natural Organic Matter Transformations by Microbial Communities in Terrestrial Subsurface Ecosystems: A Critical Review of Analytical Techniques and Challenges

Determining the mechanisms, traits, and pathways that regulate microbial transformation of natural organic matter (NOM) is critical to informing our understanding of the microbial impacts on the global carbon cycle. The capillary fringe of subsurface soils is a highly dynamic environment that remains poorly understood. Characterization of organo-mineral chemistry combined with a nuanced understanding of microbial community composition and function is necessary to understand microbial impacts on NOM speciation in the capillary fringe. We present a critical review of the popular analytical and omics techniques used for characterizing complex carbon transformation by microbial communities and focus on how complementary information obtained from the different techniques enable us to connect chemical signatures with microbial genes and pathways. This holistic approach offers a way forward for the comprehensive characterization of the formation, transformation, and mineralization of terrestrial NOM as influenced by microbial communities.

59 BASIC BIOLOGICAL SCIENCES↗

Phase Transformation Pathway of DyPO4 to 21.5 GPa

Interest in the deformation behavior and phase transformations of rare earth orthophosphates (REPO4s) spans several fields of science—from geological impact analysis to ceramic matrix composite engineering. In this study, the phase behavior of polycrystalline, xenotime DyPO4 is studied up to 21.5(16) GPa at ambient temperature using in situ diamond anvil cell synchrotron X-ray diffraction. This experiment reveals a large xenotime–monazite phase coexistence pressure range of 7.6(15) GPa and evidence for the onset of a post-monazite transformation at 13.9(10) GPa to scheelite. The identification of scheelite as the post-monazite phase of DyPO4, though not definitive, is consistent with REPO4 phase transformation pathways reported in both the experimental and the computational literature.

Sharma, Jai (ORCID:0000000339034534)↗

Towards physics-inspired data-driven weather forecasting: integrating data assimilation with a deep spatial-transformer-based U-NET in a case study with ERA5

Abstract. There is growing interest in data-driven weather prediction (DDWP), e.g., using convolutional neural networks such as U-NET that are trained on data from models or reanalysis. Here, we propose three components, inspired by physics, to integrate with commonly used DDWP models in order to improve their forecast accuracy. These components are (1) a deep spatial transformer added to the latent space of U-NET to capture rotation and scaling transformation in the latent space for spatiotemporal data, (2) a data-assimilation (DA) algorithm to ingest noisy observations and improve the initial conditions for next forecasts, and (3) a multi-time-step algorithm, which combines forecasts from DDWP models with different time steps through DA, improving the accuracy of forecasts at short intervals. To show the benefit and feasibility of each component, we use geopotential height at 500 hPa (Z500) from ERA5 reanalysis and examine the short-term forecast accuracy of specific setups of the DDWP framework. Results show that the spatial-transformer-based U-NET (U-STN) clearly outperforms the U-NET, e.g., improving the forecast skill by 45 %. Using a sigma-point ensemble Kalman (SPEnKF) algorithm for DA and U-STN as the forward model, we show that stable, accurate DA cycles are achieved even with high observation noise. This DDWP+DA framework substantially benefits from large (O(1000)) ensembles that are inexpensively generated with the data-driven forward model in each DA cycle. The multi-time-step DDWP+DA framework also shows promise; for example, it reduces the average error by factors of 2–3. These results show the benefits and feasibility of these three components, which are flexible and can be used in a variety of DDWP setups. Furthermore, while here we focus on weather forecasting, the three components can be readily adopted for other parts of the Earth system, such as ocean and land, for which there is a rapid growth of data and need for forecast and assimilation.

54 ENVIRONMENTAL SCIENCES↗

RTN-099: Photometric Transformation Relations for the LSST Data Preview 1

This technical note provides photometric transformation relations between the Vera C. Rubin Observatory's LSSTCam and LSSTComCam systems and other photometric systems. These transformations are derived using both synthetic and empirical data and are intended to support calibration and comparison across survey systems. We present both polynomial equations and lookup-table-based methods, depending on the available data and desired accuracy. The transformations are generally valid for stars with typical spectral energy distributions (SEDs), and caution should be used when applying them to objects with strong emission lines or atypical colors.

79 ASTRONOMY AND ASTROPHYSICS↗

RTN-125: Photometric Transformation Relations for the LSST Data Preview 2

This technical note provides photometric transformation relations between the NSF-DOE Vera C. Rubin Observatory's Data Preview 2 (DP2) and other photometric systems. These transformations are derived using both synthetic and empirical data and are intended to support calibration and comparison across survey systems. We present both polynomial equations and lookup-table-based methods, depending on the available data and desired accuracy. The transformations are generally valid for stars with typical spectral energy distributions (SEDs), and caution should be used when applying them to objects with strong emission lines or atypical colors.

79 ASTRONOMY AND ASTROPHYSICS↗

A transformer of closely spaced pulsed waveforms

Passive circuit, using diodes, transistors, and magnetic cores, transforms the voltage of repetitive positive or negative pulses. It combines a pulse transformer with switching devices to effect a resonant flux reset and can transform various pulsed waveforms that have a nonzero average value and are relatively cosely spaced in time.

Niedra, J.↗

Matrix transformations for spacecraft attitude determination

A common problem for experimental space physicists is the determination of the attitude matrix T which transforms vectors between representations in X and X' coordinate systems according to (vector V sub X) = (T sub XX')(vector V sub X'). A straightforward, simple, and efficient solution for the transformation matrix is a double-cross transformation. It is calculated from any two directions A and B, which are vectors normalized to unit length and are known in both X and X' coordinates. The B direction need be known only well enough to define the plane in which vectors A and B lie. The problem of the intersection of two cones as applicable to attitude solutions is also discussed.

Cauffman, D. P.↗

THREED: A computer program for three dimensional transformation of coordinates

Program THREED was developed for the purpose of a research study on the treatment of control data in lunar phototriangulation. THREED is the code name of a computer program for performing absolute orientation by the method of three-dimensional projective transformation. It has the capability of performing complete error analysis on the computed transformation parameters as well as the transformed coordinates.

Wong, K. W.↗

Reinvestigation of the olivine-spinel transformation in Ni2SiO4 and the incongruent melting of Ni2SiO4 olivine

The olivine-spinel transformation and the melting behavior of Ni2SiO4 were investigated over the PT ranges of 20-40 kbar, 650-1200 C, and 5-13 kbar, 1600-1700 C, respectively. It was confirmed that Ni2SiO4 olivine melts incongruently at high pressures and that it is a stable phase until melting occurs. The PT slope of the incongruent melting curve is approximately 105 bars/deg. The olivine-spinel transformation curve was shown to be a reversible univariant curve, and could be expressed by the linear equation P(bars) equals 23,300 + 11.8 x T(deg C). The transformation curve determined by Akimoto et al. (1965) is nearly parallel to that of the present work, but lies at pressures about 12% lower.

Ma, C.-B.↗

Application and sensitivity investigation of Fourier transforms for microwave radiometric inversions

Existing microwave radiometer technology now provides a suitable method for remote determination of the ocean surface's absolute brightness temperature. To extract the brightness temperature of the water from the antenna temperature equation, an unstable Fredholm integral equation of the first kind was solved. Fast Fourier Transform techniques were used to invert the integral after it is placed into a cross-correlation form. Application and verification of the methods to a two-dimensional modeling of a laboratory wave tank system were included. The instability of the Fredholm equation was then demonstrated and a restoration procedure was included which smooths the resulting oscillations. With the recent availability and advances of Fast Fourier Transform techniques, the method presented becomes very attractive in the evaluation of large quantities of data. Actual radiometric measurements of sea water are inverted using the restoration method, incorporating the advantages of the Fast Fourier Transform algorithm for computations.

Holmes, J. J.↗

Continuous Fourier transform method and apparatus

An input analog signal to be frequency analyzed is separated into N number of simultaneous analog signal components each identical to the original but delayed relative to the original by a successively larger time delay. The separated and delayed analog components are combined together in a suitable number of adders and attenuators in accordance with at least one component product of the continuous Fourier transform and analog signal matrices to separate the analog input signal into at least one of its continuous analog frequency components of bandwidth 1/N times the bandwidth of the original input signal. The original analog input signal can be reconstituted by combining the separate analog frequency components in accordance with the component products of the continuous Fourier transform and analog frequency component matrices. The continuous Fourier transformation is useful for spectrum analysis, filtering, transfer function synthesis, and communications.

Munoz, R. M.↗

Error analysis of householder transformations as applied to the standard and generalized eigenvalue problems

Backward error analyses of the application of Householder transformations to both the standard and the generalized eigenvalue problems are presented. The analysis for the standard eigenvalue problem determines the error from the application of an exact similarity transformation, and the analysis for the generalized eigenvalue problem determines the error from the application of an exact equivalence transformation. Bounds for the norms of the resulting perturbation matrices are presented and compared with existing bounds when known.

Ward, R. C.↗

On the variational equations for Householder transformations in feature selection

Results that suggest the possibility of using a sequential monotone process for solving the feature selection problem using Householder transformations are applied to the divergence separability criterion and an expression for the gradient of the divergence with respect to the generator of a single Householder transformation will be developed. This expression for the gradient is used in any number of differential correction schemes (iterators) that attempt to extremize the divergence. Data sets provided by the Earth Observations Division-JSC are used to demonstrate selecting the Householder transformations that generate the kxn matrix defining the best (in the sense of extremizing the divergence) k linear combinations of features. The tests allow initial comparisons to be made with results. In particular, this technique does not appear to require initial guesses for the iterator to be generated without replacement, exhaustive search, or other similar schemes.

Decell, H. P., Jr.↗

The non-uniform transformation strain problem for an anisotropic ellipsoidal inclusion

The problem of an anisotropic ellipsoidal inclusion which undergoes a stress-free transformation strain (in the sense of J. D. Eshelby) is considered, and the following theorem is proved: if an ellipsoidal region in an infinite anisotropic linear elastic medium undergoes, in the absence of its surroundings, a stress-free transformation strain which is a polynomial of degree M in given position coordinates, then the final stress and strain state in the transformed inclusion, when constrained by its surroundings, is also a polynomial of degree M in those position coordinates.

Asaro, R. J.↗