Multi-level structural damage characterization using sparse acoustic sensor networks and knowledge transferred deep learning
Not Available
36 MATERIALS SCIENCE↗
SEARCH · Engineering Papers
Results for “network science”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Locality of centrality measures of networks
Explore the source record for details and available documents.
Computer Science↗
High Penetration Wireless Networking for Nuclear Power Plant Sensing
Explore the source record for details and available documents.
46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
Convolutional Neural Networks Trained on Internal Variability Predict Forced Response of TOA Radiation by Learning the Pattern Effect
Abstract Predicting forced, long‐term radiative feedbacks from internal climate variability has been a decades‐long quest in climate science. We train a convolutional neural network (CNN) to predict annual‐ and global‐mean top of the atmosphere radiation anomalies from time‐varying maps of near‐surface temperature in climate models. Trained on internal variability alone, the nonlinear CNN can predict radiation under strong climate change, outperforms a regularized linear regression approach, and works within and across different climate models. We show with explainable artificial intelligence methods that the CNN draws predictive skill from physically meaningful regions but at much smaller spatial scales than currently assumed.
Rugenstein, Maria [Colorado State University Fort ↗
Improving near real-time precipitation estimation using a U-Net convolutional neural network and geographical information
Reliable near real-time precipitation estimates are essential for monitoring and managing of natural disasters such as floods. Quality of inputs and capability of the retrieval algorithm are two important aspects for developing satellite-based precipitation datasets. Most retrieval algorithms utilize infrared (IR) information as their input due to its fine spatiotemporal resolution and near-instantaneous availability. However, their sole reliance on IR information limits their capability to learn different mechanisms of precipitation during training, resulting in less accurate estimates. Moreover, recent advances in the field of machine learning offer attractive opportunities to improve the precipitation retrieval algorithms. This work investigates the effectiveness of adding geographical information (i.e. latitude and longitude) to IR information and the application of a U-Net-based convolutional neural network for improving the accuracy of retrieval algorithms. This research suggests that applying an appropriate CNN architecture on geographical and IR information provides an opportunity to improve the satellite-based precipitation products.
42 ENGINEERING↗
TeaNet: Universal neural network interatomic potential inspired by iterative electronic relaxations
Not Available
36 MATERIALS SCIENCE↗
Physics-Guided, Physics-Informed, and Physics-Encoded Neural Networks and Operators in Scientific Computing: Fluid and Solid Mechanics
Abstract Advancements in computing power have recently made it possible to utilize machine learning and deep learning to push scientific computing forward in a range of disciplines, such as fluid mechanics, solid mechanics, materials science, etc. The incorporation of neural networks is particularly crucial in this hybridization process. Due to their intrinsic architecture, conventional neural networks cannot be successfully trained and scoped when data are sparse, which is the case in many scientific and engineering domains. Nonetheless, neural networks provide a solid foundation to respect physics-driven or knowledge-based constraints during training. Generally speaking, there are three distinct neural network frameworks to enforce the underlying physics: (i) physics-guided neural networks (PgNNs), (ii) physics-informed neural networks (PiNNs), and (iii) physics-encoded neural networks (PeNNs). These methods provide distinct advantages for accelerating the numerical modeling of complex multiscale multiphysics phenomena. In addition, the recent developments in neural operators (NOs) add another dimension to these new simulation paradigms, especially when the real-time prediction of complex multiphysics systems is required. All these models also come with their own unique drawbacks and limitations that call for further fundamental research. This study aims to present a review of the four neural network frameworks (i.e., PgNNs, PiNNs, PeNNs, and NOs) used in scientific computing research. The state-of-the-art architectures and their applications are reviewed, limitations are discussed, and future research opportunities are presented in terms of improving algorithms, considering causalities, expanding applications, and coupling scientific and deep learning solvers.
Computer Science↗
Integrating continuous atmospheric boundary layer and tower-based flux measurements to advance understanding of land-atmosphere interactions
The atmospheric boundary layer mediates the exchange of energy, matter, and momentum between the land surface and the free troposphere, integrating a range of physical, chemical, and biological processes and is defined as the lowest layer of the atmosphere (ranging from a few meters to 3 km). In this review, we investigate how continuous, automated observations of the atmospheric boundary layer can enhance the scientific value of co-located eddy covariance measurements of land-atmosphere fluxes of carbon, water, and energy, as are being made at FLUXNET sites worldwide. We highlight four key opportunities to integrate tower-based flux measurements with continuous, long-term atmospheric boundary layer measurements: (1) to interpret surface flux and atmospheric boundary layer exchange dynamics and feedbacks at flux tower sites, (2) to support flux footprint modelling, the interpretation of surface fluxes in heterogeneous terrain, and quality control of eddy covariance flux measurements, (3) to support regional-scale modeling and upscaling of surface fluxes to continental scales, and (4) to quantify land-atmosphere coupling and validate its representation in Earth system models. Adding a suite of atmospheric boundary layer measurements to eddy covariance flux tower sites, and supporting the sharing of these data to tower networks, would allow the Earth science community to address new emerging research questions, better interpret ongoing flux tower measurements, and would present novel opportunities for collaborations between FLUXNET scientists and atmospheric and remote sensing scientists.
54 ENVIRONMENTAL SCIENCES↗
Out-of-distribution detection with non-parametric density estimation for models predicting processing history of uranium ore concentrates
The rapid advancement in machine learning (ML) and computer vision (CV) coincides with the growth of interest in deploying these ML/CV models in numerous fields from medicine to social science. Similar to those areas, we have witnessed a great number of works in materials science employing ML/CV models – neural networks in particular – in their studies in recent years. These models have proven to obtain accurate performance in various tasks. However, these models struggle to attain a similar performance when encountering test samples coming from a distribution that is different from the training set. More importantly, they fail without providing any warning to the users. Therefore, we propose a framework for detecting out-of-distribution (OOD) samples to alert users when a human intervention might be necessary in this work. Specifically, we explore the use of a non-parametric density estimation method to detect OOD samples. Here, we assess OOD detection capability of the proposed framework on ML models developed for categorizing precipitation routes of U 3 O 8 when encountering OOD datasets that contain samples (1) undergone different imaging acquisition process, (2) undergone different material synthesis process, and (3) different materials than ID set. Through those experiments, we achieve an average area under the receiver operating characteristic (AUROC) of at least 91% on average in detecting OOD samples. With minimal overhead cost and superior performance, the proposed framework enables a reliable and safe system when deploying in real-world scenarios.
Convolutional neural networks↗
Divide and conquer: separating the two probabilities in seismic phase picking
There are two fundamental probabilities in the seismic phase picking process—the probability of the existence of a seismic phase (detection probability) and the probability associated with the phase arrival time estimation (timing probability). The nearly ubiquitous approach in developing deep learning phase picking models is to use a kernel, such as a truncated Gaussian, to mask the labelled phase arrival time and train a segmentation model. Once a model is trained, the times of the peaks in the output are taken as phase arrival times (picks), and the height of the peaks are taken as ‘probability’ of the picks. Here, we show that this ‘probability’ represents neither the detection nor the timing probability because this approach forces the output to follow the shape of the kernel. We introduce an approach using two models to estimate these two distinct probabilities. We use a binary classifier with a calibrated confidence to address the detection probability and a multiclass classifier to obtain a probability mass function to address the timing probability. This new approach can make the deep learning-based phase picking process more interpretable and provide options to logically control seismic monitoring workflows.
58 GEOSCIENCES↗
Fiats: Functional inference and training for surrogates
Fiats provides a platform for research on the training and deployment of neural-network surrogate models for computational science. Fiats also supports exploring, advancing, and combining functional, object-oriented, and parallel programming patterns in Fortran 2023. As such, the Fiats name has dual expansions: “Functional Inference And Training for Surrogates” or “Fortran Inference And Training for Science.” Fiats inference and training procedures are pure and therefore satisfy a language constraint imposed on procedure invocations inside Fortran’s parallel loop construct: do concurrent. Furthermore, the Fiats training procedures are built around a do concurrent parallel reduction. Several compilers can automatically parallelize do concurrent on Central Processing Units (CPUs) or Graphics Processing Units (GPUs). Fiats thus aims to achieve performance portability through standard language mechanisms.
Rouson, Damian [Lawrence Berkeley National Laborat↗
AutoTandemML: Active Learning Enhanced Tandem Neural Networks for Inverse Design Problems
Inverse design in science and engineering involves determining optimal design parameters that achieve desired performance outcomes, a process often hindered by the complexity and high dimensionality of design spaces, leading to significant computational costs. To tackle this challenge, we propose a novel hybrid approach that combines active learning with Tandem Neural Networks to enhance the efficiency and effectiveness of solving inverse design problems. Active learning allows to selectively sample the most informative data points, reducing the required dataset size without compromising accuracy. We investigate this approach using three benchmark problems: airfoil inverse design, photonic surface inverse design, and scalar boundary condition reconstruction in diffusion partial differential equations. We demonstrate that integrating active learning with Tandem Neural Networks outperforms standard approaches across the benchmark suite, achieving better accuracy with fewer training samples.
97 MATHEMATICS AND COMPUTING↗
2022 LaserNetUS Users' Meeting
Organized and funded in 2018 through the US Department of Energy, Office of Fusion Energy Sciences (FES), LaserNetUS was created to provide vastly improved access to unique lasers for researchers. LaserNetUS is a network of ten high-power laser facilities, both academic and national laboratories, across the United States and Canada. These labs operate many of the premier mid- to large-scale high-intensity laser facilities in the US and Canada that are designed to be used in pioneering experimental studies in high energy density plasma and high field optical science. The network’s principal goal is to provide access to these state-of-the-art laser facilities to a broad range of researchers in the US and abroad. In its over four years of operation, LaserNetUS has awarded beamtime for over 60 user experiments to researchers from 25 different institutions. Over 400 user scientists, many of whom are students and post-docs, have participated in experiments at LaserNetUS facilities so far. The network now has over 1250 members. The LaserNetUS institutions are Colorado State University, Lawrence Berkeley National Lab, Lawrence Livermore National Lab, SLAC National Lab, The Ohio State University, University of Michigan, University of Nebraska-Lincoln, Institut National de la Recherche Scientifique, University of Rochester, and University of Texas at Austin. LaserNetUS hosted its first in-person Annual Users’ Meeting at Colorado State University in Fort Collins, CO, Aug 16-18, 2022. The meeting had 158 attendees, including 39 sponsored students and post-docs whose attendance and travel to the meeting were covered by DOE funds. Attendees included the 2018 Nobel Laureate in Physics, Donna Strickland. The program consisted of 5 plenary talks and several invited and contributed talks, a user community forum, a poster session, and built-in time for networking. The event focused on students and early career professionals. The poster session was held in combination with a reception to facilitate discussions and maximize interactions between the participants. The 39 sponsored students each presented a poster at the poster session, giving them valuable practice in sharing their research with others in the field. Many students and postdocs also gave talks during the main programming. Lunch and coffee breaks were provided for attendees for the duration of the conference on CSU’s campus. This allowed for networking among all participants. The building used to host the conference also had plenty of seating outside the auditorium, which was conducive to smaller one-on-one meetings and discussions between participants. There was also a lab tour of CSU’s Advanced Beam Laboratory. The day before and after the conference also included satellite meetings for the lab PIs and the Scientific Advisory Board. DOE support was used for rental of the auditorium and supporting rooms, student participation, 50% of the food costs, and transportation to the Advanced Beam Lab.
70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
Combining compositional data sets introduces error in covariance network reconstruction
Microbial communities are diverse biological systems that include taxa from across multiple kingdoms of life. Notably, interactions between bacteria and fungi play a significant role in determining community structure. However, these statistical associations across kingdoms are more difficult to infer than intra-kingdom associations due to the nature of the data involved using standard network inference techniques. We quantify the challenges of cross-kingdom network inference from both theoretical and practical points of view using synthetic and real-world microbiome data. We detail the theoretical issue presented by combining compositional data sets drawn from the same environment, e.g. 16S and ITS sequencing of a single set of samples, and we survey common network inference techniques for their ability to handle this error. We then test these techniques for the accuracy and usefulness of their intra- and inter-kingdom associations by inferring networks from a set of simulated samples for which a ground-truth set of associations is known. We show that while the two methods mitigate the error of cross-kingdom inference, there is little difference between techniques for key practical applications including identification of strong correlations and identification of possible keystone taxa (i.e. hub nodes in the network). Furthermore, we identify a signature of the error caused by transkingdom network inference and demonstrate that it appears in networks constructed using real-world environmental microbiome data.
59 BASIC BIOLOGICAL SCIENCES↗
Physics-guided neural networks with engineering domain knowledge for hybrid process modeling
As neural networks are more frequently used to solve problems in science and engineering, the methods used to incorporate scientific knowledge into these networks are becoming increasingly complex. Here, this work breaks down these complicated techniques into a set of basic strategies which can easily be applied to diverse situations. Several novel neural networks are built using the categories laid out in this work. These networks are tested on simulated data from a continuous stirred tank reactor (CSTR) model to evaluate the advantages provided by each network. The three points demonstrated in this work are: (1) architectural hybrid models can speed up convergence and reduce the amount of data necessary to train a model; (2) adding a physics-guided loss function can improve model generalization and make models more physically consistent; (3) using physics-guided initialization and transfer learning improves accuracy and speeds up convergence, but can harm generalizability if used incorrectly.
42 ENGINEERING↗
Grain boundary slip transfer classification and metric selection with artificial neural networks
An artificial neural network is used to evaluate the effectiveness of six metrics and their combinations to assess whether slip transfers across grain boundaries in coarse-grained oligocrystalline Al foils. This approach extends the one- or two-dimensional projections formerly applied to analyze slip transfer. The accuracy of this binary classification reaches around 87% for the best single metric and around 90% when considering two or more metrics simultaneously. Here, the results suggest slip transfer mostly depends on the geometric relationship between grains. Training a double-layer network having 10 nodes per hidden layer with 40 measurements is sufficient to render the maximum accuracy.
36 MATERIALS SCIENCE↗
A novel approach to partitioning evapotranspiration into evaporation and transpiration in flooded ecosystems
Reliable partitioning of micrometeorologically measured evapotranspiration (ET) into evaporation (E) and transpiration (T) would greatly enhance our understanding of the water cycle and its response to climate change related shifts in local-to-regional climate conditions and rising global levels of vapor pressure deficit (VPD). While some methods on ET partitioning have been developed, their underlying assumptions make them difficult to apply more generally, especially in sites with large contributions of E. Here, we report a novel ET partitioning method using artificial neural networks (ANNs) in combination with a range of environmental input variables to predict daytime E from nighttime ET measurements. The study uses eddy covariance data from four restored wetlands in the Sacramento-San Joaquin Delta, California, USA, as well as leaf-level T data for validation. The four wetlands vary in their vegetation make-up and structure, representing a range of ET conditions. The ANNs were built with increasing complexity by adding the input variable that resulted in the next highest average value of model testing R 2 across all sites. The order of variable inclusion (and importance) was: VPD > gap-filled sensible heat flux (H_gf) > air temperature (T air ) > friction velocity (u * ) > other variables. The model using VPD, H_gf, T air , and u * showed the best performance during validation with independent data and had a mean testing R 2 value of 0.853 (averaged across all sites, range from 0.728 to 0.910). In comparison to other methods, our ANN method generated T/ET partitioning results which were more consistent with CO 2 exchange data especially for more heterogeneous sites with large E contributions. Further, our method improves the understanding of T/ET partitioning. While it may be particularly suited to flooded ecosystems, it can also improve T/ET partitioning in other systems, increasing our knowledge of the global water cycle and ecosystem functioning.
59 BASIC BIOLOGICAL SCIENCES↗