Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Domain adaptation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

Viscoelastic analysis of mussel threads reveals energy dissipative mechanisms

Mussels use byssal threads to secure themselves to rocks and as shock absorbers during cyclic loading from wave motion. Byssal threads combine high strength and toughness with extensibility of nearly 200%. Researchers attribute tensile properties of byssal threads to their elaborate multi-domain collagenous protein cores. Because the elastic properties have been previously scrutinized, we instead examined byssal thread viscoelastic behaviour, which is crucial for withstanding cyclic loading. By targeting protein domains in the collagenous core via chemical treatments, stress relaxation experiments provided insights on domain contributions and were coupled with in situ small-angle X-ray scattering to investigate relaxation-specific molecular reorganizations. Results show that when silk-like domains in the core were disrupted, the stress relaxation of the threads decreased by nearly 50% and lateral molecular spacing also decreased, suggesting that these domains are essential for energy dissipation and assume a compressed molecular rearrangement when disrupted. A generalized Maxwell model was developed to describe the stress relaxation response. The model predicts that maximal damping (energy dissipation) occurs at around 0.1 Hz which closely resembles the wave frequency along the California coast and implies that these materials may be well adapted to the cyclic loading of the ambient conditions.

36 MATERIALS SCIENCE↗

DEEP CELLULAR RECURRENT NEURAL ARCHITECTURE FOR EFFICIENT MULTIDIMENSIONAL TIME-SERIES DATA PROCESSING

Efficient processing of time series data is a fundamental yet challenging problem in pattern recognition. Though recent developments in machine learning and deep learning have enabled remarkable improvements in processing large scale datasets in many application domains, most are designed and regulated to handle inputs that are static in time. Many real-world data, such as in biomedical, surveillance and security, financial, manufacturing and engineering applications, are rarely static in time, and demand models able to recognize patterns in both space and time. Current machine learning (ML) and deep learning (DL) models adapted for time series processing tend to grow in complexity and size to accommodate the additional dimensionality of time. Specifically, the biologically inspired learning based models known as artificial neural networks that have shown extraordinary success in pattern recognition, tend to grow prohibitively large and cumbersome in the presence of large scale multi-dimensional time series biomedical data such as EEG. Consequently, this work aims to develop representative ML and DL models for robust and efficient large scale time series processing. First, we design a novel ML pipeline with efficient feature engineering to process a large scale multi-channel scalp EEG dataset for automated detection of epileptic seizures. With the use of a sophisticated yet computationally efficient time-frequency analysis technique known as harmonic wavelet packet transform and an efficient self-similarity computation based on fractal dimension, we achieve state-of-the-art performance for automated seizure detection in EEG data. Subsequently, we investigate the development of a novel efficient deep recurrent learning model for large scale time series processing. For this, we first study the functionality and training of a biologically inspired neural network architecture known as cellular simultaneous recurrent neural network (CSRN). We obtain a generalization of this network for multiple topological image processing tasks and investigate the learning efficacy of the complex cellular architecture using several state-of-the?art training methods. Finally, we develop a novel deep cellular recurrent neural network (CDRNN) architecture based on the biologically inspired distributed processing used in CSRN for processing time series data. The proposed DCRNN leverages the cellular recurrent architecture to promote extensive weight sharing and efficient, individualized, synchronous processing of multi-source time series data. Experiments on a large scale multi-channel scalp EEG, and a machine fault detection dataset show that the proposed DCRNN offers state-of-the-art recognition performance while using substantially fewer trainable recurrent units.

Vidyaratne, Lasitha S.↗

Flow structure capturing on overset patched meshes

The present paper describes the application of a simple, robust stable implicit approach to solutions of the conservative equations of gasdynamics on either composite or overset meshes to capture flow structures such as shocks with high resolution in complex geometric domains. Without requiring special flux conservative operators, but rather, interpolating conservative variable data at mesh boundaries, the well posed upwind method provides accurate and oscillation free solutions, even when shocks cross the interior patch boundaries. In three problems with flow complexities that require grid refinement, the paper demonstrates the capability to conveniently carry out for gasdynamics the adaptive refined meshing strategy in overset patches proposed by Berger and Oliger (1984), and it extends this technique to rapidly convergent implicit methods for the Euler and Navier-Stokes equations. The numerical experiments show concretely, in a realistic aerodynamic problem, the savings in mesh points (about an order of magnitude here in two dimensions) for similar accuracy that flow structure aligned adaptive patched meshing affords compared to uniform grid refinement.

Venkatapathy, E.↗

Design of infrasound-detection system via adaptive LMSTDE algorithm

A proposed solution to an aviation safety problem is based on passive detection of turbulent weather phenomena through their infrasonic emission. This thesis describes a system design that is adequate for detection and bearing evaluation of infrasounds. An array of four sensors, with the appropriate hardware, is used for the detection part. Bearing evaluation is based on estimates of time delays between sensor outputs. The generalized cross correlation (GCC), as the conventional time-delay estimation (TDE) method, is first reviewed. An adaptive TDE approach, using the least mean square (LMS) algorithm, is then discussed. A comparison between the two techniques is made and the advantages of the adaptive approach are listed. The behavior of the GCC, as a Roth processor, is examined for the anticipated signals. It is shown that the Roth processor has the desired effect of sharpening the peak of the correlation function. It is also shown that the LMSTDE technique is an equivalent implementation of the Roth processor in the time domain. A LMSTDE lead-lag model, with a variable stability coefficient and a convergence criterion, is designed.

Khalaf, C. S.↗

Studying the Sky/Planets Can Drown You in Images: Machine Learning Solutions at JPL/Caltech

JPL is working to develop a domain-independent system capable of small-scale object recognition in large image databases for science analysis. Two applications discussed are the cataloging of three billion sky objects in the Sky Image Cataloging and Analysis Tool (SKICAT) and the detection of possibly one million small volcanoes visible in the Magellan synthetic aperture radar images of Venus (JPL Adaptive Recognition Tool, JARTool).

geomorphology↗

A block-spectral adaptive H-/$p$-refinement strategy for shock-dominated problems

An adaptive H-/p-refinement strategy using a novel sensor is devised and tested in a block-spectral compressible Euler code equipped with adaptive-mesh refinement (AMR) and high-order flux-reconstruction numerics. At each Gauss quadrature point (or solution point) within each spectral block (or mesh element) the discrete velocity jump ΔU = ∂U/∂y 1 Δy 1 + ∂V/∂y 2 Δy 2 + ∂W/∂y 3 Δy 3 is calculated and normalized by the local speed of sound, a. Here, the grid spacing, Δx i , is calculated in each direction as the distance between auxiliary Gauss-Lobatto points, staggered relative to the solution points. The polynomial order is increased from p = 0 to p = p max in regions of weak compression, (ΔU/a) crit < ΔU/a < 0 and kept at p = p max in regions of flow expansion ΔU/a ≥ 0, while staying at the H = 0 base mesh level. Regions experiencing strong compressions, i.e. ΔU/a < (ΔU/a) crit , are H-refined up to H = H max where H max is applied at the location of maximum compression, ΔU/a = min(ΔU/a) in the domain, while keeping p = 0 to guarantee robustness and monotonicity of the solution in the H refined region. The critical value of (ΔU/a) crit = -0.06 is found to effectively separate smooth and non-smooth solution regions, supported by a 1D detonation initiation test case in ideal gas and a shock-to-detonation transition in high explosives. Using this value, the Sod shock tube, Shu-Osher problem, double Mach reflection and a 2D detonation in a high-explosive are simulated with the proposed adaptive H-/p-refinement. In the Sod shock tube case, p-refinement resolves the (weak) contact discontinuity while H-refinement enhances the grid resolution in the shock exploiting the monotonicity of the p = 0 reconstruction. For the Shu-Osher problem, p-refinement captures the small-scale oscillations trailing the shock that would be otherwise attenuated, while H-refinement triggered by the ΔU-sensor appropriately tracks the shock. In the double Mach reflection problem, H-refinement confines the numerical diffusion around the reflected shock while p-refinement recaptures many physical features trailing the shock. Finally, in the 2D high-explosive detonation case, H-refinement follows the leading shock and resolves the curvature of the detonation wave, while p-refinement adds resolution to the trailing reaction zone. Finally, the proposed methodology is tested in a detonation-wave propagation test case in high-explosives with numerical predictions comparing favorably against experiments.

97 MATHEMATICS AND COMPUTING↗

Image data compression with vector quantization in the transform domain

In this paper, an algorithm is presented for image data compression based upon vector quantization of the two-dimensional discrete cosine transformed coefficients. The ac energies of the transformed blocks are used to classify them into eight different ac classes. The ac coefficients of the transformed blocks of class one are set to zero, while those of classes two through eight are transmitted by seven different code books. The dc coefficients of all eight classes are scalar quantized by an adaptive uniform quantizer. As a result, only 4.5 bits instead of eight bits are required to transmit the dc coefficient with negligible additional degradation. Overall, this algorithm requires approximately 0.75 bits per pixel and gives an average reconstruction error of 7.1.

Abdelwahab, A. A.↗

Seismicity-constrained fault detection and characterization with a multitask machine learning model

Geological fault detection and characterization are crucial for understanding subsurface dynamics across scales. While methods for fault delineation based on either seismicity location analysis or seismic image reflector discontinuity are well-established, a systematic approach that integrates both data types remains absent. We develop a novel machine learning model that unifies seismic reflector images and seismicity location information to automatically identify geological faults and characterize their geometrical properties. The model encodes a seismic image and a seismicity location image separately, and fuses the encoded features with a spatial-channel attention fusion module to improve the learning of important features in both inputs. We design an automated strategy to generate high-quality synthetic training data and labels. To improve the realism of the seismicity location image, we include random seismicity noise and missing seismicity location associated with some of the faults. We validate the model’s efficacy and accuracy using synthetic data examples and two field data examples. Moreover, we show that fine-tuning the trained model with a small, domain-specific dataset enhances its fidelity for field data applications. The results demonstrate that integrating seismicity location and seismic images into a unified framework allows the end-to-end neural network to achieve higher fidelity and accuracy in delineating subsurface faults and their geometrical properties compared with image-only fault detection methods. Our approach offers an adaptive data-driven tool for geological fault characterization and seismic hazard mitigation, bridging the gap between seismicity location and image-based fault detection methods.

58 GEOSCIENCES↗

Machine learning with knowledge constraints for process optimization of open-air perovskite solar cell manufacturing

Perovskite photovoltaics (PV) have achieved rapid development in the past decade in terms of power conversion efficiency of small-area lab-scale devices; however, successful commercialization still requires further development of low-cost, scalable, and high-throughput manufacturing techniques. One of the critical challenges of developing a new fabrication technique is the high-dimensional parameter space for optimization, but machine learning (ML) can readily be used to accelerate perovskite PV scaling. Herein, we present an ML-guided framework of sequential learning for manufacturing process optimization. We apply our methodology to the Rapid Spray Plasma Processing (RSPP) technique for perovskite thin films in ambient conditions. With a limited experimental budget of screening 100 process conditions, we demonstrated an efficiency improvement to 18.5% as the best-in-our-lab device fabricated by RSPP, and we also experimentally found 10 unique process conditions to produce the top-performing devices of more than 17% efficiency, which is 5 times higher rate of success than the control experiments with pseudo-random Latin hypercube sampling. Our model is enabled by three innovations: (a) flexible knowledge transfer between experimental processes by incorporating data from prior experimental data as a probabilistic constraint; (b) incorporation of both subjective human observations and ML insights when selecting next experiments; (c) adaptive strategy of locating the region of interest using Bayesian optimization first, and then conducting local exploration for high-efficiency devices. Furthermore, in virtual benchmarking, our framework achieves faster improvements with limited experimental budgets than traditional design-of-experiments methods (e.g., one-variable-at-a-time sampling). This framework shows the capability of incorporating researchers’ domain knowledge into the ML-guided optimization loop; therefore, it has the potential to facilitate the wider adoption of ML in scaling to perovskite PV manufacturing.

14 SOLAR ENERGY↗

A System for Planning Ahead

A software system that uses artificial intelligence techniques to help with complex Space Shuttle scheduling at Kennedy Space Center is commercially available. Stottler Henke Associates, Inc.(SHAI), is marketing its automatic scheduling system, the Automated Manifest Planner (AMP), to industries that must plan and project changes many different times before the tasks are executed. The system creates optimal schedules while reducing manpower costs. Using information entered into the system by expert planners, the system automatically makes scheduling decisions based upon resource limitations and other constraints. It provides a constraint authoring system for adding other constraints to the scheduling process as needed. AMP is adaptable to assist with a variety of complex scheduling problems in manufacturing, transportation, business, architecture, and construction. AMP can benefit vehicle assembly plants, batch processing plants, semiconductor manufacturing, printing and textiles, surface and underground mining operations, and maintenance shops. For most of SHAI's commercial sales, the company obtains a service contract to customize AMP to a specific domain and then issues the customer a user license.

Source record↗

Indirect Routes to Aminoacyl-tRNA: The Diversity of Prokaryotic Cysteine Encoding Systems

Universally present aminoacyl-tRNA synthetases (aaRSs) stringently recognize their cognate tRNAs and acylate them with one of the proteinogenic amino acids. However, some organisms possess aaRSs that deviate from the accurate translation of the genetic code and exhibit relaxed specificity toward their tRNA and/or amino acid substrates. Typically, these aaRSs are part of an indirect pathway in which multiple enzymes participate in the formation of the correct aminoacyl-tRNA product. The indirect cysteine (Cys)-tRNA pathway, originally thought to be restricted to methanogenic archaea, uses the unique O -phosphoseryl-tRNA synthetase (SepRS), which acylates the non-proteinogenic amino acid O -phosphoserine (Sep) onto tRNA Cys . Together with Sep-tRNA:Cys-tRNA synthase (SepCysS) and the adapter protein SepCysE, SepRS forms a transsulfursome complex responsible for shuttling Sep-tRNA Cys to SepCysS for conversion of the tRNA-bound Sep to Cys. Here, we report a comprehensive bioinformatic analysis of the diversity of indirect Cys encoding systems. These systems are present in more diverse groups of bacteria and archaea than previously known. Given the occurrence and distribution of some genes consistently flanking SepRS, it is likely that this gene was part of an ancient operon that suffered a gradual loss of its original components. Newly identified bacterial SepRS sequences strengthen the suggestion that this lineage of enzymes may not rely on the m 1 G37 identity determinant in tRNA. Some bacterial SepRSs possess an N-terminal fusion resembling a threonyl-tRNA synthetase editing domain, which interestingly is frequently observed in the vicinity of archaeal SepCysS genes. We also found several highly degenerate SepRS genes that likely have altered amino acid specificity. Cross-analysis of selenocysteine (Sec)-utilizing traits confirmed the co-occurrence of SepCysE and the Sec-utilizing machinery in archaea, but also identified an unusual O -phosphoseryl-tRNA Sec kinase fusion with an archaeal Sec elongation factor in some lineages, where it may serve in place of SepCysE to prevent crosstalk between the two minor aminoacylation systems. These results shed new light on the variations in SepRS and SepCysS enzymes that may reflect adaptation to lifestyle and habitat, and provide new information on the evolution of the genetic code.

59 BASIC BIOLOGICAL SCIENCES↗

Trust-Enhancing Probabilistic Transfer Learning for Sparse and Noisy Data Environments

There is an increasing aspiration to utilize machine learning (ML) for various tasks of relevance to national security. ML models have thus far been mostly applied to tasks and domains that, while impactful, have sufficient volume of data. For predictive tasks of national security relevance, ML models of great capacity (ability to approximate nonlinear trends in input-output maps) are often needed to capture the complex underlying physics. However, scientific problems of relevance to national security are often accompanied by various sources of sparse and/or incomplete data, including experiments and simulations, across different regimes of operation, of varying degrees of fidelity, and include noise with different characteristics and/or intensity. State-of-the-art ML models, despite exhibiting superior performance on the task and domain they were trained on, may suffer detrimental loss in performance in such sparse data environments. This report summarizes the results of the Laboratory Directed Research and Development project entitled Trust-Enhancing Probabilistic Transfer Learning for Sparse and Noisy Data Environments. The objective of the project was to develop a new transfer learning (TL) framework that aims to adaptively blend the data across different sources in tackling one task of interest, resulting in enhanced trustworthiness of ML models for mission- and safety-critical systems. The proposed framework determines when it is worth applying TL and how much knowledge is to be transferred, despite uncontrollable uncertainties. The framework accomplishes this by leveraging concepts and techniques from the fields of Bayesian inverse modeling and uncertainty quantification, relying on strong mathematical foundations of probability and measure theories to devise new uncertainty-aware TL workflows.

97 MATHEMATICS AND COMPUTING↗

Design of an L-band Microwave Radiometer with Active Mitigation of Interference

Radio frequency interference (RFI) impairs L-band radiometry outside the protected 20 MHz frequency band around 1413 MHz. However, bandwidths of 100 MHz or more are desired for certain remote sensing applications as well as certain astronomy applications. Because much of the RFI in this band is from radars with pulse lengths on the order of microseconds, traditional radiometers (i.e., those which directly measure total power or power spectral density integrated over time scales of milliseconds or greater) are poorly-suited to this task. Simply reducing integration time and discarding contaminated outputs may not be a practical answer due to the wide variety of modulations and pulse lengths observed in L-band RFI signals, the dynamic and complex nature of the associated propagation channels, and the logistical effort associated with post-measurement data editing. This motivates the design and development of radiometers capable of coherent sampling and adaptive, real-time mitigation of interference. Such a radiometer will be described in this presentation. This design is capable of coherently-sampling up to 100 MHz bandwidth at L-band. RFI mitigation is implemented in FPGA components so that real-time suppression is achieved. The system currently uses a cascade of basic time- and frequency- domain detection and blanking techniques; more advanced algorithms are un- der consideration. The modular FPGA-based architecture provides other benefits, such as the ability to implement extremely stable digital filters and the ability to reconfigure the system "on the fly". An overview of the basic design along with on-the-air results from an initial implementation will be provided in the presentation. Related L-band RFI surveys will be described to illustrate the relevance of this approach in a variety of operating conditions.

Ellingson, S. W.↗

Synergistic Integration of Multiple Wave Energy Converters with Adaptive Resonance and Offshore Floating Wind Turbines through Bayesian Optimization

We developed a synergistic ocean renewable system where an array of Wave Energy Converters (WEC) with adaptive resonance was collocated with a Floating Offshore Wind Turbine (FOWT) such that the WECs, capturing wave energy through the resonance adapting to varying irregular waves, consequently reduced FOWFT loads and turbine motions. Combining Surface-Riding WECs (SR-WEC) individually designed to feasibly relocate their natural frequency at the peak of the wave excitation spectrum for each sea state, and to obtain the highest capture width ratio at one of the frequent sea states for annual average power in a tens of kilowatts scale with a 15 MW FOWT based on a semi-submersible, Bayesian Optimization is implemented to determine the arrangement of WECs that minimize the annual representation of FOWT’s wave excitation spectra. The time-domain simulation of the system in the optimized arrangement is performed, including two sets of interactions: one set is the wind turbine dynamics, mooring lines, and floating body dynamics for FOWT, and the other set is the nonlinear power-take-off dynamics, linear mooring, and individual WECs’ floating body dynamics. Those two sets of interactions are further coupled through the hydrodynamics of diffraction and radiation. For sea states comprising Annual Energy Production, we investigate the capture width ratio of WECs, wave excitation on FOWT, and nacelle acceleration of the turbine compared to their single unit operations. We find that the optimally arranged SR-WECs reduce the wave excitation spectral area of FOWT by up to 60% and lower the turbine’s peak nacelle acceleration by nearly 44% in highly occurring sea states, while multiple WECs often produce more than the single operation, achieving adaptive resonance with a larger wave excitation spectra for those sea states. The synergistic system improves the total Annual Energy Production (AEP) by 1440 MWh, and we address which costs of Levelized Cost Of Energy (LCOE) can be reduced by the collocation.

Engineering↗

Immortal rays: Rethinking random ray neutron transport on GPU architectures

The Random Ray Method (TRRM) is a recently developed adaptation of the Method of Characteristics for neutral particle transport simulations. TRRM has demonstrated excellent performance on 3D nuclear reactor benchmark problems using CPU-based compute systems. When porting to GPU-based systems, however, new performance challenges arise that are unique to processors targeting massive fine-grained parallelism. For smaller problems, or for large problems that are domain decomposed across many computational nodes, the problem size per node has insufficient parallelism to saturate GPU node resources, thus greatly limiting speedup. In this study, we report on a newly developed “immortal ray” variant of TRRM. Here, the immortal ray technique exposes significantly more fine-grained parallelism by fundamentally reformulating the numerical details of ray discretization, resulting in performance tradeoffs with significant overall benefit on GPUs. For very small 2D simulation problems we found the new immortal ray variant allowed for up to a 4.4x speedup when run on a single GPU. For larger 3D simulation problems we found the new variant improved strong scaling by 3x when run on the Summit supercomputer.

97 MATHEMATICS AND COMPUTING↗

U2AF - Hypoxia-induced fas alternative splicing regulator

The splicing machinery heavily contributes to biological complexity and especially to the ability of cells to adapt to altered cellular conditions. Hypoxia also plays a key role in the pathophysiology of many disease states. Recent studies have revealed that tumorigenesis and hypoxia are involved in large-scale alterations in alternative pre-mRNA splicing. Fas pre-mRNA is alternatively spliced by excluding exon 6 to produce soluble Fas (sFas) protein that lacks a transmembrane domain and acts by inhibiting Fas mediated apoptosis. }In the present study we show that U2AF is involved in hypoxia dependent anti-apoptotic Fas mRNA isoform formation. Our performed studies show that U2AF-RNA interaction is reduced in hypoxic cells, leading to reduction of Fas and increased sFas mRNAs formation. Efficient U2AF-RNA interactions of both subunits are important for Fas exon 6 inclusion into forming mRNA in normoxic and hypoxic cells.

60 APPLIED LIFE SCIENCES↗

Potential Academic Research Topics of National Security Relevance

Since even before its establishment as an independent national security laboratory in 1949, Sandia has been devoted to an overarching mission of developing advanced technologies for global peace. These technologies have taken a variety of forms, and they exist in and must address an ever-changing global security environment. An understanding of that global security environment and its possible or likely evolution is therefore critical to ensuring that Sandia can maintain its focus on strategic technology investments that will benefit the nation in the next 20- 30 years. Sandia sustains multiple Systems Analysis organizations whose responsibility includes maintaining an understanding of the global security environment as it applies across multiple mission domains. The topics below include two from Sandia's emerging threats and biodefense mission, three with relevance to Sandia's cyber defense mission, and four of particular but not exclusive relevance to Sandia's nuclear deterrence mission. All are intended to spur independent academic thought that could assist Sandia as well as the broader national security community in anticipating and adapting to a continually changing world. Sandia anticipates periodic interactions between Sandia Systems Analysis staff and SciPol Scholars Program faculty and students who choose to expand upon these topics in order to provide opportunities for feedback and communication throughout 2020-2021.

54 ENVIRONMENTAL SCIENCES↗