Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “science data network”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,657 records · Page 92

A review of the remote sensing of lower tropospheric thermodynamic profiles and its indispensable role for the understanding and the simulation of water and energy cycles: REMOTE SENSING OF THERMODYNAMIC PROFILES

A review of remote sensing technology for lower tropospheric thermodynamic (TD) profiling is presented with focus on high accuracy and high temporal-vertical resolution. The contributions of these instruments to the understanding of the Earth system are assessed with respect to radiative transfer, land surface-atmosphere feedback, convection initiation, and data assimilation. We demonstrate that for progress in weather and climate research, TD profilers are essential. These observational systems must resolve gradients of humidity and temperature in the stable or unstable atmospheric surface layer close to the ground, in the mixed layer, in the interfacial layer—usually characterized by an inversion—and the lower troposphere. A thorough analysis of the current observing systems is performed revealing significant gaps that must be addressed to fulfill existing needs. We analyze whether current and future passive and active remote sensing systems can close these gaps. A methodological analysis and demonstration of measurement capabilities with respect to bias and precision is executed both for passive and active remote sensing including passive infrared and microwave spectroscopy, the global navigation satellite system, as well as water vapor and temperature Raman lidar and water vapor differential absorption lidar. Whereas passive remote sensing systems are already mature with respect to operational applications, active remote sensing systems require further engineering to become operational in networks. However, active remote sensing systems provide a smaller bias as well as higher temporal and vertical resolutions. For a suitable mesoscale network design, TD profiler system developments should be intensified and dedicated observing system simulation experiments should be performed.

58 GEOSCIENCES↗

Quantifying the Dynamics of Protein Self-Organization Using Deep Learning Analysis of Atomic Force Microscopy Data

The dynamics of protein self-assembly on the inorganic surface and the resultant geometric patterns are visualized using high-speed atomic force microscopy. The time dynamics of the classical macroscopic descriptors such as 2D fast Fourier transforms, correlation, and pair distribution functions are explored using the unsupervised linear unmixing, demonstrating the presence of static ordered and dynamic disordered phases and establishing their time dynamics. Here, the deep learning (DL)-based workflow is developed to analyze detailed particle dynamics and explore the evolution of local geometries. Finally, we use a combination of DL feature extraction and mixture modeling to define particle neighborhoods free of physics constraints, allowing for a separation of possible classes of particle behavior and identification of the associated transitions. Overall, this work establishes the workflow for the analysis of the self-organization processes in complex systems from observational data and provides insight into the fundamental mechanisms.

36 MATERIALS SCIENCE↗

Floods and Heavy Precipitation at the Global Scale: 100‐Year Analysis and 180‐Year Reconstruction

Floods and heavy precipitation have disruptive impacts worldwide, but their historical variability remains only partially understood at the global scale. This article aims at reducing this knowledge gap by jointly analyzing seasonal maxima of streamflow and precipitation at more than 3,000 stations over a 100‐year period. The analysis is based on Hidden Climate Indices (HCIs). Like standard climate indices (e.g., Nino 3.4, NAO), HCIs are used as covariates explaining the temporal variability of data, but unlike them, HCIs are estimated from the data. In this work, a distinction is made between common HCIs, that affect both heavy precipitation and floods, and specific HCIs, that exclusively affect one or the other. Overall, HCIs do not show noticeable autocorrelation, but some are affected by noticeable trends. In particular, strong and wide‐ranging trends are identified in precipitation‐specific HCIs, while trends affecting flood‐specific HCIs are weaker and have more localized effects. A probabilistic model is then derived to link HCIs and large‐scale atmospheric variables (pressure, wind, temperature) and to reconstruct HCIs since 1836 using the 20CRv3 reanalysis. In turn this allows estimating the probability of occurrence of floods and heavy precipitation at the global scale. This 180‐year reconstruction highlights flood hot‐spots and hot‐moments in the distant past, well before the establishment of perennial monitoring networks. Finally, the approach presented in this study is generic and paves the way for an improved characterization of historical variability by making a better use of long but highly irregular station data sets.

54 ENVIRONMENTAL SCIENCES↗

Disentangling multidimensional spatio-temporal data into their common and aberrant responses

With the advent of high-throughput measurement techniques, scientists and engineers are starting to grapple with massive data sets and encountering challenges with how to organize, process and extract information into meaningful structures. Multidimensional spatio-temporal biological data sets such as time series gene expression with various perturbations over different cell lines, or neural spike trains across many experimental trials, have the potential to acquire insight about the dynamic behavior of the system. For this potential to be realized, we need a suitable representation to understand the data. A general question is how to organize the observed data into meaningful structures and how to find an appropriate similarity measure. A natural way of viewing these complex high dimensional data sets is to examine and analyze the large-scale features and then to focus on the interesting details. Since the wide range of experiments and unknown complexity of the underlying system contribute to the heterogeneity of biological data, we develop a new method by proposing an extension of Robust Principal Component Analysis (RPCA), which models common variations across multiple experiments as the lowrank component and anomalies across these experiments as the sparse component. We show that the proposed method is able to find distinct subtypes and classify data sets in a robust way without any prior knowledge by separating these common responses and abnormal responses. Thus, the proposed method provides us a new representation of these data sets which has the potential to help users acquire new insight from data.

59 BASIC BIOLOGICAL SCIENCES↗

Physics-Informed Learning for Predictive Multi-Scale Modeling of Water Cycle and Extreme Events

Climate and earth system models have limited skill in predicting water cycle and associated extremes such as intense rain- and wind-producing storms and resulting hazards across all timescales. Water cycle predictions are inherently limited by the predictability of the chaotic system, but large potential for improving predictions remains untapped due to limited use of data-model integration to improve predictive modeling. This white paper proposes a hybrid data-physics paradigm based on physics-informed neural networks (PINNs) to improve the Energy Exascale Earth System Model (E3SM). In particular, we aim to predict and quantify uncertainties of water cycle processes and low probability high impact events.

54 ENVIRONMENTAL SCIENCES↗

Final project report

The proposed overarching goal for this project was the following: Data integration, simulation and visualization will facilitate metabolic and regulatory network prediction, exploration, and formulation of hypotheses. We stated three specific aims to achieve the overarching goal of this project: (1) Integration of multiple levels of information such as mRNA and protein levels, predicted protein-protein interactions/associations and gene function will enable construction of models describing environmental response and dynamic behavior. (2) Flexible tools for network inference will accelerate our understanding of biological systems. (3) Flexible exploration and queries of model hypotheses will provide focus and reveal novel dependencies. The underlying philosophy of these proposed aims is that an iterative cycle of experiments, experimental design, and verification will lead to a comprehensive and predictive model that will shed light on systems level mechanisms involved in responses elicited by living systems upon sensing a change in their environment. In the previous years report we demonstrated considerable progress in development of data standards, regulatory network inference and data visualization and exploration. We are pleased to report that several manuscripts describing these procedures have been published in top international peer reviewed journals including Genome Biology, PNAS, and Cell. The abstracts of these manuscripts are given and they summarize our accomplishments in this project.

59 BASIC BIOLOGICAL SCIENCES↗

Improved Characterization of Soil Organic Matter by Integrating FT-ICR MS, Liquid Chromatography Tandem Mass Spectrometry, and Molecular Networking: A Case Study of Root Litter Decay under Drought Conditions

Understanding of how soil organic matter (SOM) chemistry is altered in a changing climate has advanced considerably; however, most SOM components remain unidentified, impeding the ability to characterize a major fraction of organic matter and predict what types of molecules, and from which sources, will persist in soil. Here we present a novel approach to better characterize SOM extracts by integrating information from three types of analyses, and we deploy this method to characterize decaying root-detritus soil microcosms subjected to either drought or normal conditions. To observe broad differences in composition, we employed direct infusion Fourier-transform ion cyclotron resonance mass spectrometry (DI-FT-ICR MS). We complemented this with liquid chromatography tandem mass spectrometry (LC-MS/MS) to identify components by library matching. Since libraries contain only a small fraction of SOM components, we also used fragment spectral cosine similarity scores to relate unknowns and library matches through molecular networks. This integrated approach allowed us to corroborate DI-FT-ICR MS molecular formulas using library matches, which included fungal metabolites and related polyphenolic compounds. We also inferred structures of unknowns from molecular networks and improved LC-MS/MS annotation rates from ~5 to 35% by considering DI-FT-ICR MS molecular formula assignments. Under drought conditions, we found greater relative amounts of lignin-like vs condensed aromatic polyphenol formulas and lower average nominal oxidation state of carbon, suggesting reduced decomposition of SOM and/or microbes under stress. Our integrated approach provides a framework for enhanced annotation of SOM components that is more comprehensive than performing individual data analyses in parallel.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Keeping LAMMPS cutting edge

Since its inception 30 years ago, LAMMPS has grown to be a world-class molecular dynamics code and a cornerstone of computational materials science research. This project aimed to keep LAMMPS at the forefront of molecular dynamics simulations by adapting LAMMPS to the latest developments in machine learning technology and hardware. Initially, the project set out to provide a unified implementation of active learning for efficient training data generation in LAMMPS, but the research trajectory pivoted to address more immediate and impactful opportunities. On the hardware side, recent record-breaking molecular dynamics simulations were developed on the Cerebras wafer-scale AI chip, and this project has developed an interface between LAMMPS and the hardware-specific molecular dynamics code to accelerate and simplify development and user adoption. On the software side, PyTorch’s Ahead-of-Time (AOT) compilation features promised increased performance for state-of-the-art equivariant neural network potentials, and this project laid the groundwork for their adoption in LAMMPS, resulting in a nearly 20x acceleration in extreme cases. Combined with a comprehensive benchmark study of LAMMPS across all current exascale systems, this project has reinforced LAMMPS’s role as a versatile, high-performance tool for current and future materials science applications.

36 MATERIALS SCIENCE↗

INTERPLANETARY NETWORK LOCALIZATIONS OF KONUS SHORT GAMMA-RAY BURSTS

Between the launch of the Global Geospace Science Wind spacecraft in 1994 November and the end of 2010, the Konus-Wind experiment detected 296 short-duration gamma-ray bursts (including 23 bursts which can be classified as short bursts with extended emission). During this period, the Interplanetary Network (IPN) consisted of up to 11 spacecraft, and using triangulation, the localizations of 271 bursts were obtained. We present the most comprehensive IPN localization data on these events. The short burst detection rate, {approx}18 yr{sup -1}, exceeds that of many individual experiments.

79 ASTRONOMY AND ASTROPHYSICS↗

Robust errant beam prognostics with conditional modeling for particle accelerators

Abstract Particle accelerators are complex and comprise thousands of components, with many pieces of equipment running at their peak power. Consequently, they can fault and abort operations for numerous reasons, lowering efficiency and science output. To avoid these faults, we apply anomaly detection techniques to predict unusual behavior and perform preemptive actions to improve the total availability. Supervised machine learning (ML) techniques such as siamese neural network models can outperform the often-used unsupervised or semi-supervised approaches for anomaly detection by leveraging the label information. One of the challenges specific to anomaly detection for particle accelerators is the data’s variability due to accelerator configuration changes within a production run of several months. ML models fail at providing accurate predictions when data changes due to changes in the configuration. To address this challenge, we include the configuration settings into our models and training to improve the results. Beam configurations are used as a conditional input for the model to learn any cross-correlation between the data from different conditions and retain its performance. We employ conditional siamese neural network (CSNN) models and conditional variational auto encoder (CVAE) models to predict errant beam pulses at the spallation neutron source under different system configurations and compare their performance. We demonstrate that CSNNs outperform CVAEs in our application.

43 PARTICLE ACCELERATORS↗

Parallel asynchronous systems and image processing algorithms

A new hardware approach to implementation of image processing algorithms is described. The approach is based on silicon devices which would permit an independent analog processing channel to be dedicated to evey pixel. A laminar architecture consisting of a stack of planar arrays of the device would form a two-dimensional array processor with a 2-D array of inputs located directly behind a focal plane detector array. A 2-D image data stream would propagate in neuronlike asynchronous pulse coded form through the laminar processor. Such systems would integrate image acquisition and image processing. Acquisition and processing would be performed concurrently as in natural vision systems. The research is aimed at implementation of algorithms, such as the intensity dependent summation algorithm and pyramid processing structures, which are motivated by the operation of natural vision systems. Implementation of natural vision algorithms would benefit from the use of neuronlike information coding and the laminar, 2-D parallel, vision system type architecture. Besides providing a neural network framework for implementation of natural vision algorithms, a 2-D parallel approach could eliminate the serial bottleneck of conventional processing systems. Conversion to serial format would occur only after raw intensity data has been substantially processed. An interesting challenge arises from the fact that the mathematical formulation of natural vision algorithms does not specify the means of implementation, so that hardware implementation poses intriguing questions involving vision science.

Coon, D. D.↗

Development of a Portable, Ground-based Ozone Lidar Instrument for Tropospheric Ozone Research and Educational Training

The objective of this research project is to develop a portable, eye-safe, ground-based ozone lidar instrument specialized for ozone differential absorption lidar (DIAL) measurements in the troposphere. This research project directly supports the goal of NASA's Earth Science Enterprise to understand the distribution and budget of tropospheric ozone (objective 1.5 of the Earth Science Strategic Enterprise Plan, 1998-2002). It can participate in ground validation experiments for TES, a tropospheric ozone satellite mission due to be launched in 2002. It can also be utilized for correlative ground measurements in future GTE (Global Tropospheric Experiment) and space-based ozone lidar missions, such as ORACLE. Multiple ground-based ozone lidar systems would improve the data obtained through current ozone-sonde networks. This prototype instrument could to serve as the basic unit for these and other future monitoring projects requiring multi-instrument networks, such as that proposed for the Global Tropospheric Ozone Project (GTOP). GTOP is currently being formulated by a scientific panel of the International Global Atmospheric Chemistry Project to meet its goal to better understand the processes that control the global distribution of tropospheric ozone. In order for the lidar to be widely deployed in networks, it must be fairly easy to use and maintain as well as being cost-competitive with a ground station launching ozonesondes several times a day. A second 2-year grant to continue this effort with students participating in ground tests and system improvements has been awarded by the Office of Equal Employment Opportunities (OEOP). This project also supports existing NASA lidar missions through its development of advanced, compact lidar technology. Innovations in both transmitters and receivers have been made in this project. Finally, this system could be modified in the future to probe more deeply into the stratosphere. This could be accomplished by increasing the emitted energy or optimizing the wavelengths for this purpose. In addition to NASA, this system has applications to the EPA, NOAA, and the DOD. An AFOSR grant has been awarded based on the results of this effort to fund advanced transmitter development at medium (20-40 mJ) energies. A second proposal to the DOD with a letter of support from Air Force Research Laboratory, has been submitted to extend this uv laser technology to 100 mJ levels. Thus, this project has enabled students and faculty at Hampton University to begin to develop research efforts in support of the mission of the DOD. This instrument will be based at Hampton University (HU) to meet our educational goal to train students in lidar technology as well as atmospheric ozone data analysis and interpretation. It will be also available for off-site measurement campaigns and will serve as a test bed for further instrument development. Later development beyond this grant to extend the scientific usefulness of the instrument may include incorporation of an aerosol channel and upgrading the laser to make stratospheric ozone measurements. Seven undergraduates, three graduate students, and one postdoctoral. researcher (formerly an HU student) have been active participants in this research effort.

Chyba, Thomas↗

Cloud Surprises in Moving NASA EOSDIS Applications into Amazon Web Services

NASA ESDIS has been moving a variety of data ingest, distribution, and science data processing applications into a cloud environment over the last 2 years. As expected, there have been a number of challenges in migrating primarily on-premises applications into a cloud-based environment, related to architecture and taking advantage of cloud-based services. What was not expected is a number of issues that were beyond purely technical application re-architectures. We ran into surprising network policy limitations, billing challenges in a government-based cost model, and difficulty in obtaining certificates in an NASA security-compliant manner. On the other hand, this approach has allowed us to move a number of applications from local hosting to the cloud in a matter of hours (yes, hours!!), and our CMR application now services 95% of granule searches and an astonishing 99% of all collection searches in under a second. And most surprising of all, well, you'll just have to wait and see the realization that caught our entire team off guard!

Cloud↗

Scalable training of graph convolutional neural networks for fast and accurate predictions of HOMO-LUMO gap in molecules

Abstract Graph Convolutional Neural Network (GCNN) is a popular class of deep learning (DL) models in material science to predict material properties from the graph representation of molecular structures. Training an accurate and comprehensive GCNN surrogate for molecular design requires large-scale graph datasets and is usually a time-consuming process. Recent advances in GPUs and distributed computing open a path to reduce the computational cost for GCNN training effectively. However, efficient utilization of high performance computing (HPC) resources for training requires simultaneously optimizing large-scale data management and scalable stochastic batched optimization techniques. In this work, we focus on building GCNN models on HPC systems to predict material properties of millions of molecules. We use HydraGNN, our in-house library for large-scale GCNN training, leveraging distributed data parallelism in PyTorch. We use ADIOS, a high-performance data management framework for efficient storage and reading of large molecular graph data. We perform parallel training on two open-source large-scale graph datasets to build a GCNN predictor for an important quantum property known as the HOMO-LUMO gap. We measure the scalability, accuracy, and convergence of our approach on two DOE supercomputers: the Summit supercomputer at the Oak Ridge Leadership Computing Facility (OLCF) and the Perlmutter system at the National Energy Research Scientific Computing Center (NERSC). We present our experimental results with HydraGNN showing (i) reduction of data loading time up to 4.2 times compared with a conventional method and (ii) linear scaling performance for training up to 1024 GPUs on both Summit and Perlmutter.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

An analysis of bulk data movement patterns in large-scale scientific collaborations

Large-scale research efforts such as LHC experiments, ITER, and climate modelling are built upon large, globally distributed collaborations. For reasons of scalability and agility and to make effective use of existing computing resources, data processing and analysis for these projects is based on distributed computing models. Such projects thus depend on predictable and efficient bulk data movement between collaboration sites. However, the available computing and networking resources to different collaboration sites vary greatly. Large collaboration sites (such as Fermilab, CERN) have created data centres comprising hundreds, and even thousands, of computation nodes to develop massively scaled, highly distributed cluster-computing platforms. These sites are usually well connected to outside worlds with high-speed networks with bandwidth greater than 10Gbps. On the other hand, some small collaboration sites have limited computing resources or poor networking connectivity. Therefore, the bulk data movements across collaboration sites vary greatly. Fermilab is the US-CMS Tier-1 Centre and the main data centre for a few other large-scale research collaborations. Scientific traffic (e.g., CMS) dominates the traffic volumes in both inbound and outbound directions of Fermilab off-site traffic. Fermilab has deployed a Flow-based network traffic collection and analysis system to monitor and analyze the status and patterns of bulk data movement between the Laboratory and its collaboration sites. In this paper, we discuss the current status and patterns of bulk data movement between Fermilab and its collaboration sites.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Self-Healing Ceramics and Mechanical Metamaterials

We performed large scale molecular dynamics (MD) simulations and reactive & quantum molecular dynamics simulations to investigate: (1) faceting, grain growth, and crack healing in ceramics; (2) stress-release mechanism and healing in fibers; and (3) mechanical properties of two-dimensional metamaterials. We also designed highly accurate interatomic potentials and forces using artificial neural networks (ANN) and first-principles molecular dynamics simulation data for use in our MD and reactive MD simulations. We demonstrated the efficacy of modeling quantum materials atomistic simulation data using unsupervised deep learning approaches on a quantum computer. These achievements are elaborated in the following sections.

36 MATERIALS SCIENCE↗