Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “event data models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Characterization of Extreme Hydroclimate Events in Earth System Models using ML/AI

Focal Area(s): (1) We put forward the concepts of data assimilation enabled by machine learning, AI, and advanced methods including experimental/network design/optimization and unsupervised learning applied to downscale information within Earth System Models (ESMs). (2) We discuss predictive modeling through the use of AI techniques and other tools to design a prediction system comprising of a hierarchy of models (e.g., AI-driven model/component/parameterization selection) to improve the characterization of extreme hydroclimate events in ESMs. The AI-based models will run five-six order of magnitude times faster, yet will provide similar accuracy, allowing us to provide range bounds on uncertainty faster and thus enabling faster extreme event identification. (3) Further, we consider the insight gleaned from complex data (observed/simulated) using AI, big data analytics, and other advanced methods, including explainable AI and physics- or knowledge-guided AI to improve the characterization of extreme hydroclimate events in ESMs.

54 ENVIRONMENTAL SCIENCES↗

Describing hadronization via histories and observables for Monte-Carlo event reweighting

We introduce a novel method for extracting a fragmentation model directly from experimental data without requiring an explicit parametric form, called Histories and Observables for Monte-Carlo Event Reweighting (HOMER), consisting of three steps: the training of a classifier between simulation and data, the inference of single fragmentation weights, and the calculation of the weight for the full hadronization chain. We illustrate the use of HOMER on a simplified hadronization problem, a q\bar{q} q q ‾ string fragmenting into pions, and extract a modified Lund string fragmentation function f(z) f ( z ) . We then demonstrate the use of HOMER on three types of experimental data: (i) binned distributions of high-level observables, (ii) unbinned event-by-event distributions of these observables, and (iii) full particle cloud information. After demonstrating that f(z) f ( z ) can be extracted from data (the inverse of hadronization), we also show that, at least in this limited setup, the fidelity of the extracted f(z) f ( z ) suffers only limited loss when moving from (i) to (ii) to (iii). Public code is available at https://gitlab.com/uchep/mlhad.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Assessing Simulations of Forest Hurricane Disturbance and Recovery in Puerto Rico by ELM-FATES Using Field Measurements

In the past three decades, Puerto Rico (PR) experienced five hurricanes that met or exceeded category three, and they caused severe forest structural damage and elevated tree mortality. To improve our mechanistic understanding of hurricane impacts on tropical forests and assess hurricane-affected forest dynamics in Earth system models, we use in situ forest measurements at the Bisley Experimental Watersheds in Northeast PR to evaluate the Functionally Assembled Terrestrial Ecosystem Simulator coupled with the Energy Exascale Earth System Model Land Model (ELM-FATES). The observations show that before Hurricane Hugo, 77.3% of the aboveground biomass (AGB) is from the shade-tolerant plant function type (PFT). The Hugo-induced mortality rates are over ~50%, and they induce a ~39% AGB reduction, which recovers to a level like the pre-Hugo condition in 2014, following a second, lower intensity hurricane, Georges. We perform numerical experiments that simulate damage from Hugo and Georges on the forests, including defoliation, sapwood and structural biomass damage, and hurricane-induced mortality. ELM-FATES can reasonably represent coexistence between the two PFTs–light-demanding and shade-tolerant–for both the pre-Hugo and post-Hugo conditions. The model represents a reasonable size distribution of mid-and large-sized trees although it underestimates AGB, likely due to the overestimated nonhurricane mortality. ELM-FATES temporarily stimulated leaf biomass and diameter increment after Georges, an effect that should be tested with observations of future hurricane defoliation events. This research indicates that addressing model-data mismatches in tree mortality and understory dynamics are essential to simulation of more extreme hurricane effects under climate change.

58 GEOSCIENCES↗

Applying Transfer Learning for Street-Scale Nuisance Flood Forecasting in Coastal-Urban Cities

An important challenge with Machine Learning (ML) is its transferability; that is, whether a ML model trained on one set of data can be applied to a second set of data without requiring a full re-training of the model. Transfer Learning (TL) addresses this challenge by transferring knowledge learned in the source domain (the data it was trained on) to the target domain (a second set of data that is statistically different but related, which the model was not trained on). This study investigates the use of TL for street-scale nuisance flood forecasting by exploring whether a ML model trained on data collected for one set of streets can effectively forecast flooding for another set of streets in the same city using TL. The envisioned use case is a city deploying a new flood depth monitoring sensor on a street and using TL to apply a ML model, trained on sensor data from an existing flood depth sensor network, to this new street. Eventually, the new flood depth sensor will have a sufficient dataset for training its own ML model, but TL can be used to fill the gap in time while this new dataset is being generated. This method is explored using a Long Short-Term Memory (LSTM) model trained on data for the flood-prone streets of Norfolk City, Virginia. The data used for training includes environmental time series (rainfall, tide), topographic features (Digital Elevation Model (DEM), Topographic Wetness Index (TWI), Depth To Water (DTW)), and street-scale flood depth time series obtained from a high-fidelity physics-based model, acting as a synthetic street-scale stream depth sensor dataset since actual stream depth sensor data is generally unavailable for most cities. A set of 180 flood-prone streets was used to train a base model, while another set of 180 flood-prone streets was used to re-train that model using different TL strategies. The results show that full-weight re-training proved most effective and minimal re-training of only the output layer was insufficient. The advantage of TL was most pronounced when target data was limited, meaning data collected at the new water depth sensor location included generally less than 18 flood events. As target data increased beyond 18 flood events, the benefit of TL diminished relative to training a ML model directly on the local flood events. These findings can assist cities as they implement street-scale flood sensing systems to create accurate forecasts for new sensing locations that do not yet have sufficient data records to train a local ML model.

Roy, Binata [Univ. of Virginia, Charlottesville, V↗

What Machine Learning Can and Cannot Do for Inertial Confinement Fusion

Machine learning methodologies have played remarkable roles in solving complex systems with large data, well-defined input–output pairs, and clearly definable goals and metrics. The methodologies are effective in image analysis, classification, and systems without long chains of logic. Recently, machine-learning methodologies have been widely applied to inertial confinement fusion (ICF) capsules and the design optimization of OMEGA (Omega Laser Facility) capsule implosion and NIF (National Ignition Facility) ignition capsules, leading to significant progress. As machine learning is being increasingly applied, concerns arise regarding its capabilities and limitations in the context of ICF. ICF is a complicated physical system that relies on physics knowledge and human judgment to guide machine learning. Additionally, the experimental database for ICF ignition is not large enough to provide credible training data. Most researchers in the field of ICF use simulations, or a mix of simulations and experimental results, instead of real data to train machine learning models and related tools. They then use the trained learning model to predict future events. This methodology can be successful, subject to a careful choice of data and simulations. However, because of the extreme sensitivity of the neutron yield to the input implosion parameters, physics-guided machine learning for ICF is extremely important and necessary, especially when the database is small, the uncertain-domain knowledge is large, and the physical capabilities of the learning models are still being developed. In this work, we identify problems in ICF that are suitable for machine learning and circumstances where machine learning is less likely to be successful. This study investigates the applications of machine learning and highlights fundamental research challenges and directions associated with machine learning in ICF.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Diffusion model approach to simulating electron-proton scattering events

Generative artificial intelligence is a fast-growing area of research offering various avenues for exploration in high-energy nuclear physics. In this work, we explore the use of generative models for simulating electron-proton collisions relevant to experiments like the Continuous Electron Beam Accelerator Facility and the future Electron-Ion Collider (EIC). These experiments play a critical role in advancing our understanding of nucleons and nuclei in terms of quark and gluon degrees of freedom. The use of generative models for simulating collider events faces several challenges such as the sparsity of the data, the presence of global or eventwide constraints, and steeply falling particle distributions. In this work, we focus on the implementation of diffusion models for the simulation of electron-proton scattering events at EIC energies. Our results demonstrate that diffusion models can reproduce relevant observables such as momentum distributions and correlations of particles, momentum sum rules, and the leading electron kinematics, all of which are of particular interest in electron-proton collisions. Although the sampling process is relatively slow compared to other machine-learning architectures, we find diffusion models can generate high-quality samples. We foresee various applications of our work including inference for nuclear structure, interpretable generative machine learning, and searches of physics beyond the Standard Model. Published by the American Physical Society 2024

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

A machine learning estimator trained on synthetic data for real-time earthquake ground-shaking predictions in Southern California

Abstract After large-magnitude earthquakes, a crucial task for impact assessment is to rapidly and accurately estimate the ground shaking in the affected region. To satisfy real-time constraints, intensity measures are traditionally evaluated with empirical Ground Motion Models that can drastically limit the accuracy of the estimated values. As an alternative, here we present Machine Learning strategies trained on physics-based simulations that require similar evaluation times. We trained and validated the proposed Machine Learning-based Estimator for ground shaking maps with one of the largest existing datasets (<100M simulated seismograms) from CyberShake developed by the Southern California Earthquake Center covering the Los Angeles basin. For a well-tailored synthetic database, our predictions outperform empirical Ground Motion Models provided that the events considered are compatible with the training data. Using the proposed strategy we show significant error reductions not only for synthetic, but also for five real historical earthquakes, relative to empirical Ground Motion Models.

Environmental Sciences & Ecology↗

A portable parton-level event generator for the high-luminosity LHC

The rapid deployment of computing hardware different from the traditional CPU+RAM model in data centers around the world mandates a change in the design of event generators for the Large Hadron Collider, in order to provide economically and ecologically sustainable simulations for the high-luminosity era of the LHC. Parton-level event generation is one of the most computationally demanding parts of the simulation and is therefore a prime target for improvements. We present a production-ready leading-order parton-level event generation framework capable of utilizing most modern hardware and discuss its performance in the standard candle processes of vector boson and top-quark pair production with up to five additional jets.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Advanced Image Reconstruction for MCP Detector in Event Mode

A two-step data reduction framework is proposed in this study to reconstruct a radiograph from the data collected with a micro-channel plate (MCP) detector operating under event mode. One clustering algorithm and three neutron event back-tracing models are proposed and evaluated using both example data and a full scan data. The reconstructed radiographs are analyzed, the results of which are used to suggest future development.

Zhang, Chen↗

Power System Operational Impacts of Electric Vehicle Dynamic Wireless Charging

The electrification of the transportation sector poses an opportunity for reducing greenhouse gas (GHG) emissions from passenger vehicles. Electric vehicle (EV) charging through dynamic wireless power transfer (DWPT), known as roadway electrification, could shift EV demand profiles to better coincide with renewable electricity generation. However, this would be a very large new load and few studies evaluate the regional impacts of DWPT charging in a power transmission system. This paper defines methods that address dataset generation for passenger vehicle trips and models to evaluate regional impacts for this emerging technology. Household vehicle miles traveled (VMT) data form localized EV demand profiles through discrete-event simulation. This data serves as exogenous inputs for a Production Cost Model (PCM) of a synthetic transmission system based on the Electric Reliability Council of Texas's (ERCOT) network. EV charging methods are compared for both a 2018 baseline generation mixture and a high-renewable generation case incorporating 20 GW of installed solar photovoltaic (PV) capacity. The PCM employs unit commitment and economic dispatch (UC&ED) models to compare financial, environmental, and grid reliability impacts from EV charging across passenger EV adoption levels. In-transit charging could reduce grid operational costs by as much as 1.49%, with up to $13.7B saved in annual vehicle operational costs for consumers compared to gas-powered vehicles. Health impacts analysis from power plant and vehicle tailpipe emissions from this study show net health benefits increase by 40% for in-transit charging coupled with high renewable generation. Renewable resources provide an avenue for cost-effective in-transit charging with reduced emissions. The combination of dataset generation and open-source power system modeling establish a foundation for the holistic evaluation of regional DWPT impacts.

dynamic wireless power transfer↗

Biological particles and aerosol-cloud interactions in the Southern Great Plains (Final Report)

The United States Southern Great Plains (SGP) is the genesis for much of the warm season precipitation in the central and eastern United States. While atmospheric thermodynamics and large-scale dynamics play an important role in formation of precipitation, precipitation mechanisms are also sensitive to aerosols. Aerosols can suppress precipitation as cloud condensation nuclei (CCN) or act as ice nucleating particles (INP) in deep convective clouds. This project focused on understanding the role of primary biological aerosol particles (PBAP) in the region and its influence on cloud formation. Specifically, we focused on biological aerosol in the form of pollen, one type of PBAP that is emitted in large yet variable quantities from vegetation in the mid latitudes. Field observations provide evidence of pollen in the planetary boundary layer and pollen components in cloud droplets and fine particulate matter. Further, pollen grains can easily rupture when wet, forming smaller, sub pollen particles with sizes less than one micron. We evaluated the potential for PBAP events at the Department of Energy (DoE) SGP Atmospheric Radiation Measurement (ARM) research facility due to the rich dataset available. We also developed model simulations that accounted for pollen emission and the generation of sub pollen particles, which have been shown to be both cloud condensation nuclei and ice nucleating particles. The proposed work was designed to address the following questions: 1. What are the physical and chemical signatures of biological aerosol such as pollen in SGP ARM measurements? 2. What is the role of pollen-derived particles on deep convection and precipitation in the Central US? Using measurements from the DoE SGP ARM site and recent airborne campaigns, we evaluated the signatures of pollen and pollen-derived aerosols on optical properties, cloud properties and precipitation (Subba et al., 2021). We identified pollen-driven events over the data record and used the Weather Research and Forecasting Model with fully coupled chemistry (WRF-Chem) to conduct chemically realistic simulations of aerosols during and summer mesoscale convective events in the Southern Great Plains (Subba et al., in review). This work improved our understanding of the role of biological aerosol on clouds and precipitation in the Central United States and placed these results in context with anthropogenically-driven processes.

54 ENVIRONMENTAL SCIENCES↗

Biological particles and aerosol-cloud interactions in the Southern Great Plains

The United States Southern Great Plains (SGP) is the genesis for much of the warm season precipitation in the central and eastern United States. While atmospheric thermodynamics and large-scale dynamics play an important role in formation of precipitation, precipitation mechanisms are also sensitive to aerosols. Aerosols can suppress precipitation as cloud condensation nuclei (CCN) or act as ice nucleating particles (INP) in deep convective clouds. This project focused on understanding the role of primary biological aerosol particles (PBAP) in the region and its influence on cloud formation. Specifically, we focused on biological aerosol in the form of pollen, one type of PBAP that is emitted in large yet variable quantities from vegetation in the mid latitudes. Field observations provide evidence of pollen in the planetary boundary layer and pollen components in cloud droplets and fine particulate matter. Further, pollen grains can easily rupture when wet, forming smaller, sub pollen particles with sizes less than one micron. We evaluated the potential for PBAP events at the Department of Energy (DoE) SGP Atmospheric Radiation Measurement (ARM) research facility due to the rich dataset available. We also developed model simulations that accounted for pollen emission and the generation of sub pollen particles, which have been shown to be both cloud condensation nuclei and ice nucleating particles. The proposed work was designed to address the following questions: 1. What are the physical and chemical signatures of biological aerosol such as pollen in SGP ARM measurements? 2. What is the role of pollen-derived particles on deep convection and precipitation in the Central US? Using measurements from the DoE SGP ARM site and recent airborne campaigns, we evaluated the signatures of pollen and pollen-derived aerosols on optical properties, cloud properties and precipitation (Subba et al., 2021). We identified pollen-driven events over the data record and used the Weather Research and Forecasting Model with fully coupled chemistry (WRF-Chem) to conduct chemically realistic simulations of aerosols during and summer mesoscale convective events in the Southern Great Plains (Subba et al., in review). This work improved our understanding of the role of biological aerosol on clouds and precipitation in the Central United States and placed these results in context with anthropogenically-driven processes.

54 ENVIRONMENTAL SCIENCES↗

Identifying mitigation strategies for $\mathrm{COVID}$-$\mathrm{19}$ superspreading on flights using models that account for passenger movement

Despite commercial airlines mandating masks, there have been multiple documented events of COVID-19 superspreading on flights. Conventional models do not adequately explain superspreading patterns on flights, with infection spread wider than expected from proximity based on passenger seating. An important reason for this is that models typically do not consider the movement of passengers during the flight, boarding, or deplaning. Understanding the risks for each of these aspects could provide insight into effective mitigation measures. We modeled infection risk from seating and fine-grained movement patterns – boarding, deplaning, and inflight movement. We estimated infection model parameters from a prior superspreading event. We validated the model and the impact of interventions using available data from three flights, including cabin layout and seat locations of infected and uninfected passengers, to suggest interventions to mitigate COVID-19 superspreading events during air travel. Specifically, we studied: 1) London to Hanoi with 201 passengers, including 13 secondary infections among passengers; 2) Singapore to Hangzhou with 321 passengers, including 12 to 14 secondary infections; 3) a non-superspreading event on a private jet in Japan with 9 passengers and no secondary infections. Here our results show that the inclusion of passenger movement better explains the infection spread patterns than conventional models do. We also found that FFP2/N95 mask usage would have reduced infection by 95–100%, while cloth masks would have reduced it by only 40–80%. Results indicate that leaving the middle seat vacant is effective in reducing infection, and the effectiveness increases when combined with good quality masks. However, with a good mask, the risk is quite low even without the middle seats being empty. Our results suggest the need for more stringent guidelines to reduce aviation-related superspreading events of COVID-19.

54 ENVIRONMENTAL SCIENCES↗

Natural Language Processing for Text Based Event Extraction: Identifying Events of Interest Related to Worldwide State-Sponsored Civil Nuclear Power

Beginning in FY20, SRNL was funded by the National Nuclear Security Administration’s Office of Defense Nuclear Non-Proliferation Research and Development to develop a prototype natural language processing/natural language understating machine learning-based modeling and analysis pipeline to extract and forecast events of interest from massive open data sources. The working hypothesis within the approach is that contextual shifts in key words and phrases act as indicators of events of interest over time. Therefore, by identifying points in time where contextual shifts occur, events of interest can be extracted along with explicit and implicit connections of entities and activities. The development of the preliminary prototype pipeline proved successful, meriting further testing of the pipeline on more broad topical domains and in a worldwide data environment. Therefore, SRNL, in collaboration with the Sanghani Center for Artificial Intelligence and Data Analytics at Virginia Tech, have continued development with a test case of identifying events of interest related to worldwide state-sponsored civil nuclear power in open data sources. In the first year of this follow-on effort, the team has curated domain-specific data corpuses using an automated scheme and applied the modeling and analysis pipeline. This robust, focused, and efficient approach consists of an ensemble of analyses applied to time dependent word embedding models that are trained on the data corpuses. In this report, the team has demonstrated the capability of the existing pipeline (as development has continued in parallel) by exploring several specific case-studies centered around Rosatom’s international activities regarding the planning, construction, operation, and/or shutdown of nuclear reactors. A basic timeline events has been generated by manually cataloging known “milestone” events that have occurred at reactors in Turkey, Finland, Hungary, and Egypt and compared with the output of the modeling pipeline. In this approach, the team has characterized the lead time using the prototype pipeline, as well as the ability to capture relevant information, which proved 100% successful. A deep dive example of the Akkuyu reactor (Turkey) is presented that shows the breadth of information that can be captured using the approach. In this case study, events were extracted pertaining to the planning/construction of Akkuyu including protests from the population, information campaigns in response to the protests, forged regulatory documents and lawsuits, budgetary/shareholder information, geopolitical tensions, and the various construction milestones. This has demonstrated the pipeline’s utility as a research aid or real-time event extraction tool, where summary-level information and detailed text extractions from millions of articles or Tweets across long time periods can be generated with significantly less effort than current techniques.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Search for resonant production of dark quarks in the dijet final state with the ATLAS detector

This paper presents a search for a new Z' resonance decaying into a pair of dark quarks which hadronise into dark hadrons before promptly decaying back as Standard Model particles. This analysis is based on proton-proton collision data recorded at $\sqrt{s}$ = 13 TeV with the ATLAS detector at the Large Hadron Collider between 2015 and 2018, corresponding to an integrated luminosity of 139 fb –1 . After selecting events containing large-radius jets with high track multiplicity, the invariant mass distribution of the two highest-transverse-momentum jets is scanned to look for an excess above a data-driven estimate of the Standard Model multijet background. No significant excess of events is observed and the results are thus used to set 95% confidence-level upper limits on the production cross-section times branching ratio of the Z' to dark quarks as a function of the Z' mass for various dark-quark scenarios.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Spatiotemporal Super-Resolution with Generative Machine Learning for Creating Renewable Energy Resource Data Under Climate Change Scenarios

As we plan for a future with higher penetrations of renewables and increasing electrification, it becomes more important to understand how the electricity grid will operate under a variety of weather events. We must also consider that the weather our future grid will experience will be different and possibly more extreme than the historical weather that we have extensive data for. We can use data from global climate models (GCMs) to help understand how our climate may change over the next several decades, but there is often a significant gap between the low-resolution GCM data and the high-resolution weather data required to study power systems under specific weather events. Therefore, our objective in this work is to develop tools that can bridge this gap by using low-resolution GCM data to create realistic high-resolution weather datasets that can be used to study renewable energy generation and electricity demand. To accomplish this objective, we have developed a set of generative machine learning models that can rapidly downscale GCM daily average output data at an approximate grid resolution of 100km to hourly data at an approximate 4 km grid resolution. The models can be used to create high resolution data from nearly any GCM included in the Coupled Model Intercomparison Project (CMIP) Phase 5 or 6. Our methods include all datasets regularly used to study the integration of wind and solar power plants as well as changes in electricity demand due to heating and cooling loads. These models and datasets enable power systems modelers to study climate change-influenced weather events and their impact on the grid. We have downscaled and validated wind, solar, temperature, and humidity data with very promising results. The generative machine learning methods are computationally efficient and produce data that has similar statistical characteristics to current state-of-the-art historical datasets. We have trained initial generative models and produced an initial dataset collectively referred to as Sup3rCC: Super-Resolved Renewable Energy Resource Data with Climate Change Impacts. The data covers a (mostly) historical period from 2015-2025 and a future period from 2050-2059. We have also taken hypothetical high-electrification load data and scaled the heating and cooling loads with respect to the 2050-2059 high-resolution Sup3rCC meteorology. The results show how future levels of renewable energy generation and electrified load may be impacted by climate change, setting the stage for capacity expansion models to consider a dynamic climate through model years.

climate change↗

The Bias-Variance-Correlation Tradeoff and Its Implications for ML Applications in HEP

The bias-variance tradeoff is a well-recognized phenomenon in statistics and machine learning. In this talk, I will discuss an extension, dubbed the bias-variance-correlation tradeoff. Roughly speaking, as the flexibility of a model decreases, the correlations in the outputs of a trained model for different inputs increases. Such correlations have implications for several applications of machine learning in high energy physics, e.g., the use generative models for event generation. In particular, I will argue that claims in the literature of data amplification by generative models stem from ignoring important correlations between the model's outputs for different inputs.

Shyamsundar, Prasanth [Fermilab] (ORCID:0000000227↗

Data-driven Modeling for Grid Edge IBRs: A Digital Twin Perspective of User-Defined Models

Recent events in Odessa have brought attention to the challenges associated with the interaction between Inverter- Based Resources (IBRs) and the transmission and distribution system. The NERC event diagnosis report has highlighted sev- eral issues, emphasizing the need for continuous performance monitoring of these IBRs by system operators. Key areas of concern include the mismatch of control and protection perfor- mance of IBRs between the original equipment manufacturer (OEM)-provided models and field measurements. The inability to replicate the realistic response can result in incorrect reliability and resilience studies. In this paper, we developed an approach on how to emulate the behavior of an IBR using measurement data obtained for system operators to utilize in real-time and long- term planning. Two experiments are conducted in the phasor domain and electromagnetic transients (EMT) domain to emulate the behavior for grid forming and grid following inverters under various operating conditions and the effectiveness of the proposed model is demonstrated in terms of accuracy and ease of utilizing user-defined models (UDMs)

Mahapatra, Kaveri [BATTELLE (PACIFIC NW LAB)]↗