Recent and Planned Improvements to the System Advisor Model (SAM)
This presentation from the PV Performance Modeling Collaborative Workshop in May 2019 highlights the recent and upcoming improvements to the System Advisor Model (SAM).
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
This presentation from the PV Performance Modeling Collaborative Workshop in May 2019 highlights the recent and upcoming improvements to the System Advisor Model (SAM).
Alkali–silica reaction (ASR) is a type of material degradation in concrete structures that leads to concrete cracking and rebar corrosion, thereby reducing the material’s structural integrity and the overall structure’s lifetime and raising safety concerns. Ultrasonic nondestructive evaluation (NDE) has been proven to be a valuable technique for assessing concrete properties and monitoring ASR progression in concrete. However, the deployment and analysis of ultrasonic NDE and its data requires specialized expertise, often relying on the engineer’s subjective interpretation. With the surge in computational power, artificial intelligence (AI) and machine learning (ML) algorithms have become popular in automating NDE data analysis. Various industrial sectors are increasingly adopting ML algorithms for NDE data analysis with a growing emphasis on AI–assisted automation. Regulatory agencies are also preparing for this technological shift, anticipating corresponding revisions in standards. Thus, there is an urgent need to identify the capabilities and limitations of current ML technologies for the evaluation of concrete material properties and damage status. Furthermore, the effects of various factors on ML model performance must be thoroughly investigated. The study summarized herein evaluated the effectiveness of two ML models (i.e., support vector regression (SVR) and deep neural network (DNN)) in predicting concrete material damage induced by ASR based on the long-term ultrasonic monitoring data. Four distinct concrete specimens were cast with artificially induced ASR, and over a period exceeding 500 days, ultrasonic signals and expansion data were continuously collected. For the SVR model, wave velocity and 12 other wave features were extracted from the ultrasonic signals, with 6 out of 13 features selected as input for the model. Different combinations of training and testing datasets were designed to explore factors influencing prediction performance, including the range of data within training and testing sets, in addition to various signal preprocessing methodologies. These findings suggest the importance of using a training dataset with a broader data range compared with testing datasets for improved model performance alongside consistent signal preprocessing across datasets.
Abstract Machine learning (ML)‐based approaches to battery design are relatively new but demonstrate significant promise for accelerating the timeline for new materials discovery, process optimization, and cell lifetime prediction. Battery modeling represents an interesting and unconventional application area for ML, as datasets are often small but some degree of physical understanding of the underlying processes may exist. This review article provides discussion and analysis of several important and increasingly common questions: how ML‐based battery modeling works, how much data are required, how to judge model performance, and recommendations for building models in the small data regime. This article begins with an introduction to ML in general, highlighting several important concepts for small data applications. Previous ionic conductivity modeling efforts are discussed in depth as a case study to illustrate these modeling concepts. Finally, an overview of modeling efforts in major areas of battery design is provided and several areas for promising future efforts are identified, within the context of typical small data constraints.
Continental shallow cumulus (ShCu) clouds observed on 30 August 2016 during the Holistic Interactions of Shallow Clouds, Aerosols, and Land-Ecosystems (HI-SCALE) field campaign are simulated by using an observation-constrained cloud-system resolving model. On this day, ShCu forms over Oklahoma and southern Kansas and some of these clouds transition to deeper, precipitating convection during the afternoon. We apply a four-dimensional ensemble-variational (4DEnVar) hybrid technique in the Community Gridpoint Statistical Interpolation (GSI) system to assimilate operational data sets and unique boundary layer measurements including a Raman lidar, radar wind profilers, radiosondes, and surface stations collected by the U.S. Department of Energy's (DOE) Atmospheric Radiation Measurement (ARM) Southern Great Plains (SGP) atmospheric observatory into the Weather Research and Forecasting (WRF) model to ascertain how improved environmental conditions can influence forecasts of ShCu populations and the transition to deeper convection. Independent observations from aircraft, satellite, as well as ARM's remote sensors are used to evaluate model performance in different aspects. Several model experiments are conducted to identify the impact of data assimilation (DA) on the prediction of clouds evolution. The analyses indicate that ShCu populations are more accurately reproduced after DA in terms of cloud initiation time and cloud base height, which can be attributed to an improved representation of the ambient meteorological conditions and the convective boundary layer. Extending the assimilation to 18 UTC (local noon) also improved the simulation of shallow-to-deep transitions of convective clouds.
Abstract This work documents version two of the Department of Energy's Energy Exascale Earth System Model (E3SM). E3SMv2 is a significant evolution from its predecessor E3SMv1, resulting in a model that is nearly twice as fast and with a simulated climate that is improved in many metrics. We describe the physical climate model in its lower horizontal resolution configuration consisting of 110 km atmosphere, 165 km land, 0.5° river routing model, and an ocean and sea ice with mesh spacing varying between 60 km in the mid‐latitudes and 30 km at the equator and poles. The model performance is evaluated with Coupled Model Intercomparison Project Phase 6 Diagnosis, Evaluation, and Characterization of Klima simulations augmented with historical simulations as well as simulations to evaluate impacts of different forcing agents. The simulated climate has many realistic features of the climate system, with notable improvements in clouds and precipitation compared to E3SMv1. E3SMv1 suffered from an excessively high equilibrium climate sensitivity (ECS) of 5.3 K. In E3SMv2, ECS is reduced to 4.0 K which is now within the plausible range based on a recent World Climate Research Program assessment. However, a number of important biases remain including a weak Atlantic Meridional Overturning Circulation, deficiencies in the characteristics and spectral distribution of tropical atmospheric variability, and a significant underestimation of the observed warming in the second half of the historical period. An analysis of single‐forcing simulations indicates that correcting the historical temperature bias would require a substantial reduction in the magnitude of the aerosol‐related forcing.
Various machine learning (ML) and deep learning (DL) techniques have been recently applied to the forecasting of laboratory earthquakes from friction experiments. The magnitude and timing of shear failures in stick-slip cycles are predicted using features extracted from the recorded ultrasonic or acoustic emission (AE) signals. In addition, the Rate and State Friction (RSF) constitutive laws are extensively used to model the frictional behavior of faults. In this work, we use data from shear experiments coupled with passive acoustic (variance, kurtosis, and AE rate) interleaved with active source ultrasonic monitoring (transmitted wave amplitude) to develop physics-informed neural network (PINN) models incorporating the RSF law and AE rate generation equation with wave amplitude serving as a proxy for friction state variable. This PINN framework allows learning RSF parameters from stick-slip experiments rather than measuring them through a series of velocity step experiments. We observe that when the stick-slip cycles are irregular, the PINN models outperform the data-driven DL models. Transfer learning (TL) PINN models are also developed by pre-training on data collected at one normal stress level followed by forecasting shear failures and retrieving RSF parameters at other stress levels (i.e., with different recurrence intervals) after retraining on a limited amount of new data. Our findings suggest that TL models perform better compared to standalone models. Both standalone and TL PINN-estimated RSF parameters and their ground truth values show excellent agreements thus demonstrating that RSF parameters can be retrieved from laboratory stick-slip experiments using the corresponding acoustic data and that the transmitted wave amplitude provides a good representation of the evolving frictional state during stick-slips.
There is growing support and interest in postsecondary interdisciplinary environmental education which integrate concepts and disciplines in addition to providing varied perspectives. There is a need to assess student learning in these programs as well as rigorous evaluation of educational practices, especially of complex synthesis concepts. This work tests a text classification machine learning model as a tool to assess student systems thinking capabilities using two questions anchored by the Food-Energy-Water (FEW) Nexus phenomena by answering two questions (1) Can machine learning models be used to identify instructor-determined important concepts in student responses? (2) What do college students know about the interconnections between food, energy and water, and how have students assimilated systems thinking into their constructed responses about FEW? Reported here are a broad range of model performances across 26 text classification models associated with two different assessment items, with model accuracy ranging from 0.755 to 0.992. Expert-like responses were infrequent in our dataset compared to responses providing simpler, incomplete explanations of the systems presented in the question. For those students moving from describing individual effects to multiple effects, their reasoning about the mechanism behind the system indicates advanced systems thinking ability. Specifically, students exhibit higher expertise for explaining changing water usage than discussing tradeoffs for such changing usage. This research represents one of the first attempts to assess the links between foundational, discipline-specific concepts and systems thinking ability. These text classification approaches to scoring student FEW Nexus Constructed Responses (CR) indicate how these approaches can be used, in addition to several future research priorities for interdisciplinary, practice-based education research. Development of further complex question items using machine learning would allow evaluation of the relationship between foundational concept understanding and integration of those concepts as well as more nuanced understanding of student comprehension of complex interdisciplinary concepts.
Sophisticated numerical models that contain fluid interfaces rely upon interface evolution models to approximate the transition to turbulence near interfaces, in the presence of Rayleigh–Taylor (RTI) or Richtmyer–Meshkov (RMI) instability. Semi-analytical models have been developed in recent decades to predict the interface growth from an initial state into the nonlinear regime. Two of these models are considered in this study. They are the Goncharov and the z-models. Both of these interface models have strengths and weaknesses, which are examined here. Both of them have been implemented in the xRAGE compressible flow solver, which models fluid interfaces. The flow solver provides the fluids acceleration as a body force to the interface model. The purpose of such interface model is to evolve the early times of interface position as a subgrid model within a compressible flow simulation in order to then initialize a turbulence model. In this work, the interface models are assessed and compared for their evolution of RTI and RMI. The z-model performed better than the Goncharov model for all cases that were explored.
Large-scale meteorological pattern (LSMP)–based analysis is used in a novel way to understand meteorological conditions before and during short-duration dry spells over the northeastern United States. These LSMPs are useful to assess models and select better-performing models for future projections. Dry-spell events are identified from histograms of consecutive dry days below a daily precipitation threshold. Events lasting 12 days or longer, which correspond to ~10% of dry-spell events, are examined. The 500-hPa stream-function anomaly fields for the first 12 days of each event are time averaged, and k -means clustering is applied to isolate the dry-spell-related LSMPs. The first cluster has a strong low pressure anomaly over the Atlantic Ocean, southeast of the region, and is more common in winter and spring. The second cluster has strong high pressure over east-central North America and is most common during autumn. Over the region, both clusters have negative specific humidity anomalies, negative integrated vapor transport from the north, and subsidence associated with a midlatitude jet stream dipole structure that reinforces upper-level convergence. Subsidence is supported by cold-air advection in the first cluster and the location on the east side of the lower-level high pressure in the second cluster. Extratropical cyclone storm tracks are generally shifted southward of the region during the dry spells. Individual events lie on a continuum between two distinct clusters. These clusters have similar local, but different remote, properties. Although dry spells occur with greater frequency during drought months, most dry spells occur during nondrought months. Significance Statement: This study examines the large-scale weather patterns and meteorological conditions associated with dry-spell events lasting at least 2 weeks while affecting the northeastern United States. A statistical approach groups events together on the basis of similar atmospheric features. We find two distinct sets of patterns that we call large-scale meteorological patterns. These patterns reduce moisture, foster localized sinking, and shift the storm track southward along the Atlantic seaboard, all of which reduce precipitation. Besides greater understanding, knowing the meteorological patterns during short-term dryness in the region provides an important tool to assess how well atmospheric models reproduce these specific patterns. More dry spells occur in non-drought months than in drought months, which means that dry spells can occur without preexisting drought conditions.
Coarse woody debris (CWD) is a significant component of the forest biomass pool; hence a model is warranted to predict CWD decomposition and its role in forest carbon (C) and nutrient cycling under varying management and climatic conditions. A process-based model, CWDDAT (Coarse Woody Debris Decomposition Assessment Tool) was calibrated and validated using data from the FACE (Free Air Carbon Dioxide Enrichment) Wood Decomposition Experiment utilizing pine ( Pinus taeda ), aspen ( Populous tremuloides ) and birch ( Betula papyrifera ) on nine Experimental Forests (EF) covering a range of climate, hydrology, and soil conditions across the continental USA. The model predictions were evaluated against measured FACE log mass loss over 6 years. Four widely applied metrics of model performance demonstrated that the CWDDAT model can accurately predict CWD decomposition. The R 2 (squared Pearson’s correlation coefficient) between the simulation and measurement was 0.80 for the model calibration and 0.82 for the model validation ( P <0.01). The predicted mean mass loss from all logs was 5.4% lower than the measured mass loss and 1.4% lower than the calculated loss. The model was also used to assess the decomposition of mixed pine-hardwood CWD produced by Hurricane Hugo in 1989 on the Santee Experimental Forest in South Carolina, USA. The simulation reflected rapid CWD decomposition of the forest in this subtropical setting. The predicted dissolved organic carbon (DOC) derived from the CWD decomposition and incorporated into the mineral soil averaged 1.01 g C m -2 y -1 over the 30 years. The main agents for CWD mass loss were fungi (72.0%) and termites (24.5%), the remainder was attributed to a mix of other wood decomposers. These findings demonstrate the applicability of CWDDAT for large-scale assessments of CWD dynamics, and fine-scale considerations regarding the fate of CWD carbon.
The Continuous Electron Beam Accelerator Facility (CEBAF) operates hundreds of superconducting radio frequency (SRF) cavities in its two main linear accelerators. Field emission can occur when the cavities are set to high operating RF gradients and is an ongoing operational challenge. This is especially true in newer, higher gradient SRF cavities. Field emission results in damage to accelerator hardware, generates high levels of neutron and gamma radiation, and has deleterious effects on CEBAF operations. So, field emission reduction is imperative for the reliable, high gradient operation of CEBAF that is required by experimenters. Here we explore the use of deep learning architectures via multilayer perceptron to simultaneously model radiation measurements at multiple detectors in response to arbitrary gradient distributions. These models are trained on collected data and could be used to minimize the radiation production through gradient redistribution. This work builds on previous efforts in developing machine learning (ML) models, and is able to produce similar model performance as our previous ML model without requiring knowledge of the field emission onset for each cavity.
The Continuous Electron Beam Accelerator Facility (CEBAF) operates hundreds of superconducting radio frequency (SRF) cavities in its two main linear accelerators. Field emission can occur when the cavities are set to high operating RF gradients and is an ongoing operational challenge. This is especially true in newer, higher gradient SRF cavities. Field emission results in damage to accelerator hardware, generates high levels of neutron and gamma radiation, and has deleterious effects on CEBAF operations. So, field emission reduction is imperative for the reliable, high gradient operation of CEBAF that is required by experimenters. Here we explore the use of deep learning architectures via multilayer perceptron to simultaneously model radiation measurements at multiple detectors in response to arbitrary gradient distributions. These models are trained on collected data and could be used to minimize the radiation production through gradient redistribution. This work builds on previous efforts in developing machine learning (ML) models, and is able to produce similar model performance as our previous ML model without requiring knowledge of the field emission onset for each cavity.
Type I interferons (IFNs) are cytokines with both antiviral properties and protective roles in innate immune responses to viral infection. They induce an antiviral cellular state and link innate and adaptive immune responses. Yet, viruses have evolved different strategies to inhibit such host responses. One of them is the existence of viral proteins which subvert type I IFN responses to allow quick and successful viral replication, thus, sustaining the infection within a host. We propose mathematical models to characterise the intra-cellular mechanisms involved in viral protein antagonism of type I IFN responses, and compare three different molecular inhibition strategies. We study the Ebola viral protein, VP35, with this mathematical approach. Approximate Bayesian computation sequential Monte Carlo, together with experimental data and the mathematical models proposed, are used to perform model calibration, as well as model selection of the different hypotheses considered. Finally, we assess if model parameters are identifiable and discuss how such identifiability can be improved with new experimental data.
Abstract. Wind farm design and analysis heavily rely on computationally efficient engineering models that are evaluated many times to find an optimal solution. A recent article compared the state-of-the-art Gauss-curl hybrid (GCH) model to historical data of three offshore wind farms. Two points of model discrepancy were identified therein: poor wake predictions for turbines experiencing a lot of wakes and wake interactions between two turbines over long distances. The present article addresses those two concerns and presents the cumulative-curl (CC) model. Comparison of the CC model to high-fidelity simulation data and historical data of three offshore wind farms confirms the improved accuracy of the CC model over the GCH model in situations with large wake losses and wake recovery over large inter-turbine distances. Additionally, the CC model performs comparably to the GCH model for single- and fewer-turbine wake interactions, which were already accurately modeled. Lastly, the CC model has been implemented in a vectorized form, greatly reducing the computation time for many wind conditions. The CC model now enables reliable simulation studies for both small and large offshore wind farms at a low computational cost, thereby making it an ideal candidate for wake-steering optimization and layout optimization.
With the elimination of underground nuclear testing and declining defense budgets, science-based stockpile stewardship requires increased reliance on high performance modeling and simulation of weapon systems. Today's weapon systems are comprised of various electrical components and systems. As a result, there is a need for tools that will allow the use of massively parallel modeling and simulation techniques on high performance computers in existing and future weapons' electrical systems models. The Xyce Parallel Electronic Simulator is a SPICE (Simulation Program with Integrated Circuit Emphasis)- compatible circuit simulator designed to run on large-scale parallel computing platforms, though it can also execute efficiently on a variety of architectures including single processor workstations. As a mature platform for large-scale parallel circuit simulation, Xyce supports standard capabilities available in commercial simulators, in addition to various devices and models specific to Sandia's needs. Specifically, Xyce aids in the design and verification of electrical and electronic circuits and systems prior to weapons' manufacturing and deployment.
With the elimination of underground nuclear testing and declining defense budgets, science-based stockpile stewardship requires increased reliance on high performance modeling and simulation of weapon systems. Today's weapon systems are comprised of various electrical components and systems. As a result, there is a need for tools that will allow the use of massively parallel modeling and simulation techniques on high performance computers in existing and future weapons' electrical systems models. The Xyce Parallel Electronic Simulator is a SPICE (Simulation Program with Integrated Circuit Emphasis)- compatible circuit simulator designed to run on large-scale parallel computing platforms, though it can also execute efficiently on a variety of architectures including single processor workstations. As a mature platform for large-scale parallel circuit simulation, Xyce supports standard capabilities available in commercial simulators, in addition to various devices and models specific to Sandia's needs. Specifically, Xyce aids in the design and verification of electrical and electronic circuits and systems prior to weapons' manufacturing and deployment.
In this report we investigate adapting the Graph Neural Interpretation Engine (GENIE), an associator developed for three-component dense monitoring networks, to regional to teleseismic association using a sparse network of array stations. We expand GENIE’s input features to include first-P detection time, azimuth, and slowness estimates. Additionally, we include a probability of detection (PDET) term which measures a station’s likelihood of detecting an event. To assess each feature’s relative importance, we train four models, each using an increasing set of node features and find that the PDET models perform the best. We define two measures of event complexity which demonstrate that all GENIE model versions perform better than the standard backprojection stack.
This work will compare the Allen method and Walker method of accounting for subhourly inverter clipping power losses in hourly PV performance models. The Allen method uses a matrix lookup based on DNI clearness and clipping potential to assign a clipping correction loss at each simulation timestep. The Walker method models the PV DC power input to the inverter as a distribution over the hourly timestep and uses integration over the timestep to determine the amount of clipping that occurs within the timestep. Both these models have been recently implemented in the System Advisor Model's (SAM) open-source code, and will be applied to hourly SURFRAD datasets to analyze the subhourly clipping loss predicted by each model for different system designs and inverter loading conditions. Both models will be compared to "true" 1-minute SURFRAD data simulations to see their accuracy against more accurate 1-minute clipping correction loss predictions. This model comparisons will be investigated in more detail at the PVSC conference in Seattle, Washington June 2024.