Engineering PapersSearch

SEARCH · Engineering Papers

Results for “MODELS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Automated ICRF heating surrogate modeling via machine learning

This work introduces automated machine learning workflows that address critical bottlenecks in surrogate model development for Ion Cyclotron Range of Frequencies (ICRF) heating applications. The automated framework includes data analysis tools that transform raw datasets into actionable insights in seconds, replacing weeks of manual exploratory effort and ensuring consistent, reproducible dataset characterization. By integrating advanced hyperparameter optimization (HPO) methods including Bayesian optimization via BoTorch and Tree-structured Parzen Estimators (TPE), the framework significantly reduces model development time from weeks to hours, decreasing computational cost and required expertise, while enabling high-accuracy surrogate models. Compared to traditional hyperparameter scanning (HPS) techniques such as methodical, randomized, and grid searches, HPO methods achieve superior convergence and predictive performance, even when compared to already well-tuned reference models. On NSTX High Harmonic Fast Wave (HHFW) heating datasets, both Random Forest Regressor (RFR) and neural network surrogates demonstrate improved accuracy, achieving R 2 values beyond 0.97 and 0.98, respectively. The results show that while HPO gains are modest for robust architectures like RFR, they become essential for more sensitive models such as neural networks, highlighting the trade-offs across optimization strategies. Through automated workflows that eliminate manual hyperparameter tuning and require minimal ML expertise, this work enables widespread adoption of high-fidelity surrogate models across the fusion community for real-time plasma control, uncertainty quantification, rapid experimental scenario development, and integrated system optimization.

Sanchez-Villar, Alvaro [Princeton Plasma Physics L

Synthesis of Correct Digital Controller Models from Specifications by Model Transformation (21-0320)

The design of high consequence controllers (in weapons systems, autonomy, etc.) that do what they are supposed to do is a significant challenge. Testing simply does not come close to meeting the requirements for assurance. Today circuit designers at Sandia (and elsewhere) typically capture the core behavior of their components using state models in tools such as STATEFLOW. They then check that their models meet certain requirements (e.g. “The system bus must not deadlock” or “both traffic lights at an intersection must not be green at the same time”) using tools called model checkers. If the model checker returns “yes” then the property is guaranteed to be satisfied by the model. However, there are several drawbacks to this industry practice: (1) there is a lot of detail to get right, this is particularly challenging when there are multiple components requiring complex coordination (2) any errors returned by the model checker have to be traced back through the design and fixed, necessitating rework, (3) there are severe scalability problems with this approach, particularly when dealing with concurrency. All this places high demands on the designers who now face not only an accelerated schedule but also controllers of increasing complexity. This report describes a new and fundamentally different approach to the construction of safety-critical digital controllers. Instead of directly constructing a complete model and then trying to verify it, the designer can start with an initial abstract (think “sketch”) model plus the requirements, from which a correct concrete model is automatically synthesized. There is no need for post-hoc verification of required functional properties. Having tool to carry this out will significantly impact the nation’s ability to ensure the safety of high-consequence digital systems. The approach has been implemented in a prototype tool, along with a suite of examples, including ones that reflect actual problems faced by designers. Our approach operates on a variant of Statecharts developed at Sandia called Qspecs. Statecharts are a widely used formalism for developing concurrent reactive systems, supporting scalability through allowing state models containing composite states, which are the serial or parallel composition of substates which can themselves contain statecharts. Statecharts enable an incremental style of development, in which states are progressively refined to incorporate greater detail in an incremental model of software development. Our approach formulates a set of constraints from the structure of the models and the requirements and propagates these constraints to a fixpoint. The solution to the constraints is an inductive invariant along with guards on the transitions. We also show how our approach extends to implementation refinement, decomposition, composition, and elaboration. We currently handle safety requirements written in LTL (Linear Temporal Logic)

42 ENGINEERING

Improving North American Wildfire Prediction by Integrating a Machine-Learning Fire Model in a Land Surface Model

Wildfires have shown increasing trends in both frequency and severity across the Contiguous United States (CONUS). However, process-based fire models have difficulties in accurately simulating the burned area over the CONUS due to a simplification of the physical process and cannot capture the interplay among fire, ignition, climate, and human activities. The deficiency of burned area simulation deteriorates the description of fire impact on energy balance, water budget, and carbon fluxes in the Earth System Models (ESMs). Alternatively, machine learning (ML) based fire models, which capture statistical relationships between the burned area and environmental factors, have shown promising burned area predictions and corresponding fire impact simulation. We develop a hybrid framework (ML4Fire-XGB) that integrates a pretrained eXtreme Gradient Boosting (XGBoost) wildfire model with the Energy Exascale Earth System Model (E3SM) land model (ELM) version 2.1. A Fortran-C-Python deep learning bridge is adapted to support online communication between ELM and the ML fire model. Specifically, the burned area predicted by the ML-based wildfire model is directly passed to ELM to adjust the carbon pool and vegetation dynamics after disturbance, which are then used as predictors in the ML-based fire model in the next time step. Evaluated against the historical burned area from Global Fire Emissions Database 5 from 2001-2020, the ML4Fire-XGB model outperforms process-based fire models in terms of spatial distribution and seasonal variations. Sensitivity analysis confirms that the ML4Fire-XGB well captures the responses of the burned area to rising temperatures. The ML4Fire-XGB model has proved to be a new tool for studying vegetation-fire interactions, and more importantly, enables seamless exploration of climate-fire feedback, working as an active component in E3SM.

54 ENVIRONMENTAL SCIENCES

Mesoscale Convective Systems During SCSMEX: Simulations with a Regional Climate Model and a Cloud-Resolving Model

The South China Sea Monsoon Experiment (SCSMEX) was conducted in May-June 1998. One of its major objectives is to better understand the key physical processes for the onset and evolution of the summer monsoon over Southeast Asia and southern China (Lau et al. 2000). Multiple observation platforms (e.g., soundings, Doppler radar, ships, wind seafarers, radiometers, etc.) during SCSMEX provided a first attempt at investigating the detailed characteristics of convection and circulation changes, associated with monsoons over the South China Sea region. SCSMEX also provided precipitation derived from atmospheric budgets (Johnson and Ciesielski 2002) and comparison to those obtained from the Tropical Rainfall Measuring Mission (TRMM). In this paper, a regional climate model and a cloud-resolving model are used to perform multi-day integrations to understand the precipitation processes associated with the summer monsoon over Southeast Asia and southern China. The regional climate model is used to understand the soil - precipitation interaction and feedback associated with a flood event that occurred in and around China's Atlantic River during SCSMEX. Sensitivity tests on various land surface models, cumulus parameterization schemes (CASE), sea surface temperature (SST) variations and midlatitude influences are also performed to understand the processes associated with the onset of the monsoon over the S. China Sea during SCSMEX. Cloud-resolving models (CRMs) use more sophisticated and physically realistic parameterizations of cloud microphysical processes with very fine spatial and temporal resolution. One of the major characteristics of CRMs is an explicit interaction between clouds, radiation and the land/ocean surface. It is for this reason that GEWEX (Global Energy and Water Cycle Experiment) has formed the GCSS (GEWEX Cloud System Study) expressly for the purpose of improving the representation of the moist processes in large-scale models using CRMs. The Goddard Cumulus Ensemble (GCE) model is a CRM and is used to simulate convective systems associated with the onset of the South China Sea monsoon in 1998. The BRUCE model includes the same land surface model, cloud physics, and radiation scheme used in the regional climate model. A comparison between the results from the GCE model and regional climate model is performed.

Tao, W. K.

Remote Sensing and Spatial Growth Modeling Coupled with Air Quality Modeling to Assess the Impact of Atlanta, Georgia on the Local and Regional Environment

The growth of cities, both in population and areal extent, appears as an inexorable process. Urbanization continues at a rapid rate, and it is estimated that by the year 2025, 80 percent of the world s population will live in cities. Directly aligned with the expansion of cities is urban sprawl. Urban expansion has profound impacts on a host of biophysical, environmental, and atmospheric processes. A reduction in air quality over cities is a major result of these impacts. Strategies that can be directly or indirectly implemented to help remediate air quality problems in cities and that can be accepted by political decision makers and the general public are now being explored to help bring down air pollutants and improve air quality. The urban landscape is inherently complex and this complexity is not adequately captured in air quality models, particularly the Community Multiscale Air Quality (CMAQ) model that is used to assess whether urban areas are in attainment of EPA air quality standards, primarily for ground level ozone. This inadequacy of the CMAQ model to sufficiently respond to the heterogeneous nature of the urban landscape can impact how well the model predicts ozone pollutant levels over metropolitan areas and ultimately, whether cities exceed EPA ozone air quality standards. We are exploring the utility of high-resolution remote sensing data and urban spatial growth modeling (SGM) projections as improved inputs to the meteorology component of the CMAQ model focusing on the Atlanta, Georgia metropolitan area as a case study. These growth projections include "business as usual" and "smart growth" scenarios out to 2030. The growth projections illustrate the effects of employing urban heat island mitigation strategies, such as increasing tree canopy and albedo across the Atlanta metro area, which in turn, are used to model how ozone and air temperature can potentially be moderated as impacts on elevating ground-level ozone, as opposed to not utilizing heat island mitigation strategies. The National Land Cover Dataset at 30m resolution is being used as the land use/land cover input and aggregated to the 4km scale for the MM5 mesoscale meteorological model and the (CMAQ) modeling schemes. Use of these data have been found to better characterize low density/suburban development as compared with USGS 1km land use/land cover data that have traditionally been used in modeling. Air quality prediction for future scenarios to 2030 is being facilitated by land use projections using a spatial growth model. Land use projections were developed using the 2030 Regional Transportation Plan developed by the Atlanta Regional Commission, the regional planning agency for the area. This allows the State Environmental Protection agency to evaluate how these transportation plans will affect future air quality. The coupled SGM and air quality modeling approach provides insight on what the impacts of Atlanta s growth will be on the local and regional environment and exists as a mechanism that can be used by policy makers to make rationale decisions on urban growth and sustainability for the metropolitan area in the future.

Quattrochi, Dale A.

Spatial Growth Modeling and High Resolution Remote Sensing Data Coupled with Air Quality Modeling to Assess the Impact of Atlanta, Georgia on the Local and Regional Environment

The growth of cities, both in population and areal extent, appears as an inexorable process. Urbanization continues at a rapid rate, and it is estimated that by the year 2025, 60 percent of the world s population will live in cities. Urban expansion has profound impacts on a host of biophysical, environmental, and atmospheric processes within an urban ecosystems perspective. A reduction in air quality over cities is a major result of these impacts. Because of its complexity, the urban landscape is not adequately captured in air quality models such as the Community Multiscale Air Quality (CMAQ) model that is used to assess whether urban areas are in attainment of EPA air quality standards, primarily for ground level ozone. This inadequacy of the CMAQ model to sufficiently respond to the heterogeneous nature of the urban landscape can impact how well the model predicts ozone levels over metropolitan areas and ultimately, whether cities exceed EPA ozone air quality standards. We are exploring the utility of high-resolution remote sensing data and urban spatial growth modeling (SGM) projections as improved inputs to a meteorological/air quality modeling system focusing on the Atlanta, Georgia metropolitan area as a case study. These growth projections include business as usual and smart growth scenarios out to 2030. The growth projections illustrate the effects of employing urban heat island mitigation strategies, such as increasing tree canopy and albedo across the Atlanta metro area, which in turn, are used to model how air temperature can potentially be moderated as impacts on elevating ground-level ozone, as opposed to not utilizing heat island mitigation strategies. The National Land Cover Dataset at 30m resolution is being used as the land use/land cover input and aggregated to the 4km scale for the MM5 mesoscale meteorological model and the CMAQ modeling schemes. Use of these data has been found to better characterize low density/suburban development as compared with USGS lkm land use/land cover data that have traditionally been used in modeling. Air quality prediction for future scenarios to 2030 is being facilitated by land use projections using a spatial growth model. Land use projections were developed using the 2030 Regional Transportation Plan developed by the Atlanta Regional Commission, the regional planning agency for the area. This allows the Georgia Environmental Protection Division to evaluate how these transportation plans will affect future air quality. The coupled SGM and air quality modeling approach provides insight on what the impacts of Atlanta s growth will be on the local and regional environment and exists as a mechanism that can be used by policy makers to make rational decisions on urban growth and sustainability for the metropolitan area in the future.

Quattrochi, Dale A.

An Integrated Snow Radiance and Snow Physics Modeling Framework for Cold Land Surface Modeling

Recent developments in forward radiative transfer modeling and physical land surface modeling are converging to allow the assembly of an integrated snow/cold lands modeling framework for land surface modeling and data assimilation applications. The key elements of this framework include: a forward radiative transfer model (FRTM) for snow, a snowpack physical model, a land surface water/energy cycle model, and a data assimilation scheme. Together these form a flexible framework for self-consistent remote sensing and water/energy cycle studies. In this paper we will describe the elements and the integration plan. Each element of this framework is modular so the choice of element can be tailored to match the emphasis of a particular study. For example, within our framework, four choices of a FRTM are available to simulate the brightness temperature of snow: Two models are available to model the physical evolution of the snowpack and underlying soil, and two models are available to handle the water/energy balance at the land surface. Since the framework is modular, other models-physical or statistical--can be accommodated, too. All modules will operate within the framework of the Land Information System (LIS), a land surface modeling framework with data assimilation capabilities running on a parallel-node computing cluster at the NASA Goddard Space Flight Center. The advantages of such an integrated modular framework built on the LIS will be described through examples-e.g., studies to analyze snow field experiment observations, and simulations of future satellite missions for snow and cold land processes.

Kim, Edward J.

Dst Index in the 2008 GEM Modeling Challenge - Model Performance for Moderate and Strong Magnetic Storms

The GEM 2008 modeling challenge efforts are expanding beyond comparing in-situ measurements in the magnetosphere and ionosphere to include the computation of indices to be compared. The Dst index measures the largest deviations of the horizontal magnetic field at 4 equatorial magnetometers from the quiet-time background field and is commonly used to track the strength of the magnetic disturbance of the magnetosphere during storms. Models can calculate a proxy Dst index in various ways, including using the Dessler-Parker Sckopke relation and the energy of the ring current and Biot-Savart integration of electric currents in the magnetosphere. The GEM modeling challenge investigates 4 space weather events and we compare models available at CCMC against each other and the observed values of Ost. Models used include SWMF/BATSRUS, OpenGGCM, LFM, GUMICS (3D magnetosphere MHD models), Fok-RC, CRCM, RAM-SCB (kinetic drift models of the ring current), WINDMI (magnetosphere-ionosphere electric circuit model), and predictions based on an impulse response function (IRF) model and analytic coupling functions with inputs of solar wind data. In addition to the analysis of model-observation comparisons we look at the way Dst is computed in global magnetosphere models. The default value of Dst computed by the SWMF model is for Bz the Earth's center. In addition to this, we present results obtained at different locations on the Earth's surface. We choose equatorial locations at local noon, dusk (18:00 hours), midnight and dawn (6:00 hours). The different virtual observatory locations reveal the variation around the earth-centered Dst value resulting from the distribution of electric currents in the magnetosphere during different phases of a storm.

Rastaetter, Lutz

Integration of the Radiation Belt Environment Model Into the Space Weather Modeling Framework

We have integrated the Fok radiation belt environment (RBE) model into the space weather modeling framework (SWMF). RBE is coupled to the global magnetohydrodynamics component (represented by the Block-Adaptive-Tree Solar-wind Roe-type Upwind Scheme, BATS-R-US, code) and the Ionosphere Electrodynamics component of the SWMF, following initial results using the Weimer empirical model for the ionospheric potential. The radiation belt (RB) model solves the convection-diffusion equation of the plasma in the energy range of 10 keV to a few MeV. In stand-alone mode RBE uses Tsyganenko's empirical models for the magnetic field, and Weimer's empirical model for the ionospheric potential. In the SWMF the BATS-R-US model provides the time dependent magnetic field by efficiently tracing the closed magnetic field-lines and passing the geometrical and field strength information to RBE at a regular cadence. The ionosphere electrodynamics component uses a two-dimensional vertical potential solver to provide new potential maps to the RBE model at regular intervals. We discuss the coupling algorithm and show some preliminary results with the coupled code. We run our newly coupled model for periods of steady solar wind conditions and compare our results to the RB model using an empirical magnetic field and potential model. We also simulate the RB for an active time period and find that there are substantial differences in the RB model results when changing either the magnetic field or the electric field, including the creation of an outer belt enhancement via rapid inward transport on the time scale of tens of minutes.

Glocer, A.

The lagRST Model: A Turbulence Model for Non-Equilibrium Flows

This study presents a new class of turbulence model designed for wall bounded, high Reynolds number flows with separation. The model addresses deficiencies seen in the modeling of nonequilibrium turbulent flows. These flows generally have variable adverse pressure gradients which cause the turbulent quantities to react at a finite rate to changes in the mean flow quantities. This "lag" in the response of the turbulent quantities can t be modeled by most standard turbulence models, which are designed to model equilibrium turbulent boundary layers. The model presented uses a standard 2-equation model as the baseline for turbulent equilibrium calculations, but adds transport equations to account directly for non-equilibrium effects in the Reynolds Stress Tensor (RST) that are seen in large pressure gradients involving shock waves and separation. Comparisons are made to several standard turbulence modeling validation cases, including an incompressible boundary layer (both neutral and adverse pressure gradients), an incompressible mixing layer and a transonic bump flow. In addition, a hypersonic Shock Wave Turbulent Boundary Layer Interaction with separation is assessed along with a transonic capsule flow. Results show a substantial improvement over the baseline models for transonic separated flows. The results are mixed for the SWTBLI flows assessed. Separation predictions are not as good as the baseline models, but the over prediction of the peak heat flux downstream of the reattachment shock that plagues many models is reduced.

Lillard, Randolph P.

The Impact of Model and Rainfall Forcing Errors on Characterizing Soil Moisture Uncertainty in Land Surface Modeling

The contribution of rainfall forcing errors relative to model (structural and parameter) uncertainty in the prediction of soil moisture is investigated by integrating the NASA Catchment Land Surface Model (CLSM), forced with hydro-meteorological data, in the Oklahoma region. Rainfall-forcing uncertainty is introduced using a stochastic error model that generates ensemble rainfall fields from satellite rainfall products. The ensemble satellite rain fields are propagated through CLSM to produce soil moisture ensembles. Errors in CLSM are modeled with two different approaches: either by perturbing model parameters (representing model parameter uncertainty) or by adding randomly generated noise (representing model structure and parameter uncertainty) to the model prognostic variables. Our findings highlight that the method currently used in the NASA GEOS-5 Land Data Assimilation System to perturb CLSM variables poorly describes the uncertainty in the predicted soil moisture, even when combined with rainfall model perturbations. On the other hand, by adding model parameter perturbations to rainfall forcing perturbations, a better characterization of uncertainty in soil moisture simulations is observed. Specifically, an analysis of the rank histograms shows that the most consistent ensemble of soil moisture is obtained by combining rainfall and model parameter perturbations. When rainfall forcing and model prognostic perturbations are added, the rank histogram shows a U-shape at the domain average scale, which corresponds to a lack of variability in the forecast ensemble. The more accurate estimation of the soil moisture prediction uncertainty obtained by combining rainfall and parameter perturbations is encouraging for the application of this approach in ensemble data assimilation systems.

Maggioni, V.

Applying NASA-STD-7009 Standard for Models and Simulations to Surrogate and Other Statistical Models

NASA-STD-7009A, Standard for Models and Simulations, contains a worthy and insightfully-crafted credibility assessment. That set of metrics is intended to accumulate and communicate information that can be critical for users and their customers in evaluating findings due to a model or simulation. Was the model designed for the present use? Is it validated in the domain it’s being applied to? And so on. The standard was originally focused on physics-based models, but it can be applied more generally. It can – and should – be applied to high-impact statistical models, including surrogate models based on larger models and sims and regression models based directly on data. A key issue with many of such models is their relative simplicity compared to most M&S despite their use in high-risk engineering decisions. This report will make a case for using this Standard for a wider class of models, and how it might actually add value in excess of its cost for not only stakeholders, but modelers themselves. A rough example showing compliance for a statistical model is included.

K L Johnson

An Evaluation of A Physics-Based Firn Model and A Semi-Empirical Firn Model Across the Greenland Ice Sheet (1980–2020)

The Greenland Ice Sheet's (GrIS) firn layer buffers the ice sheet's contribution to sea level rise by storing meltwater in its pore space. However, available pore space and meltwater retention capability is lost due to ablation of the firn layer and refreezing of meltwater as near-surface ice slabs in the firn. Understanding how firn properties respond to climate is important for constraining the GrIS's future contribution to sea level rise in a warming climate. Observations of firn density provide detailed information about firn properties, but they are spatially and temporally limited. Here we use two firn models, the physics-based SNOWPACK model and the Community Firn Model configured with a semi-empirical densification equation (CFM-GSFC), to quantify firn properties across the GrIS from 1980 through 2020. We use an identical forcing (Modern-Era Retrospective Analysis for Research and Applications, version 2 (MERRA-2) atmospheric reanalysis) for SNOWPACK and the CFM-GSFC in order to isolate firn model differences. To evaluate the models, we compare simulated firn properties, including firn air content (FAC), to measurements from the Surface Mass Balance and Snow on Sea Ice Working Group (SUMup) dataset of snow and firn density. Both models perform well (mean absolute percentage errors of 14 % in SNOWPACK and 16 % in the CFM-GSFC), though their performance is hindered by the spatial resolution of the atmospheric forcing. In the ice-sheet-wide simulations, the 1980–1995 average spatially integrated FAC (i.e., air volume in the firn) for the upper 100 m is 34 645 km 3 from SNOWPACK and 28 581 km 3 from the CFM-GSFC. The discrepancy in the magnitude of the modeled FAC stems from differences in densification with depth and variations in the sensitivity of the models to atmospheric forcing. In more recent years (2005–2020), both models simulate substantial depletion of pore space. During this period, the spatially integrated FAC across the entire GrIS decreases by 3.2 % (−66.6 km 3 yr −1 ) in SNOWPACK and 1.5 % (−17.4 km 3 yr −1 ) in the CFM-GSFC. These differing magnitudes demonstrate how model differences propagate throughout the FAC record. Over the full modeled record (1980–2020), SNOWPACK simulates a loss of pore space equivalent to 3 mm of sea level rise buffering, while the CFM-GSFC simulates a loss of 1 mm. The greatest depletion in FAC is along the margins and especially along the western margin where observations and models show the formation of near-surface, low-permeability ice slabs that may inhibit meltwater storage.

Megan Thompson-Munson

Supporting Space Weather Modelling at the Community Coordinated Modeling Center (CCMC)

Space weather models are essential to our ability to understand and predict space weather events. Nonetheless, some of the most cutting-edge models may struggle to move past the initial research stage, remaining unknown and inaccessible to a wider research audience, thereby hindering validation, intercomparison and adoption of the models. The Community Coordinated Modeling Center (CCMC, https://ccmc.gsfc.nasa.gov) closes this gap by providing a convenient platform for hosting space weather models and associated services. Using these services, researchers and other end-users may exercise, evaluate, and intercompare contributed models, as well as collaborate on a growing archive of model run results. In this presentation, we will discuss current and planned capabilities in some of the model services at CCMC, including Runs-on-Request, Instant Runs, and Real-Time Continuous Runs. We will also review new models added to the extensive collection of space weather models hosted at CCMC. Finally, we will talk about our efforts at streamlining model delivery to CCMC, including support for containerized models and establishment of an open collaborative environment based on Amazon Web Services (AWS).

space weather

Power modeling of degraded PV systems: Case studies using a dynamically updated physical model (PV-Pro)

Power modeling, widely applied for health monitoring and power prediction, is crucial for the efficiency and reliability of Photovoltaic (PV) systems. The most common approach for power modeling uses a physical equivalent circuit model, with the core challenge being the estimation of model parameters. Traditional parameter estimation either relies on datasheet information, which does not reflect the system's current health status, especially for degraded PV systems, or requires additional I-V characterization, which is generally unavailable for large-scale PV systems. Thus, we build upon our previously developed tool, PV-Pro (originally proposed for degradation analysis), to enhance its application for power modeling of degraded PV systems. PV-Pro extracts model parameters from production data without requiring I-V characterization. This dynamic model, periodically updated, can closely capture the actual degradation status, enabling precise power modeling. PV-Pro is compared with popular power modeling techniques, including persistence, nominal physical, and various machine learning models. The results indicate that PV-Pro achieves outstanding power modeling performance, with an average nMAE of 1.4 % across four field-degraded PV systems, reducing error by 17.6 % compared to the best alternative technique. Furthermore, PV-Pro demonstrates robustness across different seasons and severities of degradation. The tool is available as a Python package at https://github.com/DuraMAT/pvpro.

14 SOLAR ENERGY

Model Generation to Support Model-Based Testing Applied on NASA DAT - An Experience Report

Model-based Testing (MBT), where a model of the system under tests (SUT) behavior is used to automatically generate executable test cases, is a promising and versatile testing technology. Nevertheless, adoption of MBT technologies in industry is slow and many testing tasks are performed via manually created executable test cases (i.e. test programs such as JUnit). In order to adopt MBT, testers must learn how to construct models and use these models to generate test cases, which might be a hurdle. An interesting observation in our previous work is that the existing manually created test cases often provided invaluable insights for the manual creation of the testing models of the system. In this paper we present an approach that allows the tester to first create and debug a set of test cases. When the tester is happy with the test cases, the next step is to automatically generate a model from the test cases. The generated model is derived from the test cases, which are actions that the system can perform (e.g. a button clicks) and their expected outputs in form of assert statements (e.g. assert data entered). The model is a Finite State Machine (FSM) model that can be employed with little or no manual changes to generate additional test cases for the SUT. We successfully applied the approach in a feasibility study to the NASA Data Access Toolkit (DAT), which is a web-based GUI. One compelling finding is that the test cases that were generated from the automatically generated models were able to detect issues that were not detected by the original set of manually created test cases. We present the findings from the case study and discuss best practices for incorporating model generation techniques into an existing testing process.

State Machines

Kamodo’s Model-Agnostic Satellite Flythrough: Lowering the Utilization Barrier for Heliophysics Model Outputs

Heliophysics model outputs are increasingly accessible, but typically are not usable by the majority of the community unless directly collaborating with the relevant model developers. Prohibitive factors include complex file output formats, cryptic metadata, unspecified and often customized coordinate systems, and non-linear coordinate grids. Some pockets of progress exist, giving interfaces to various simulation outputs, but only for a small set of outputs and typically not with open-source, freely available packages. Additionally, the increasing array of tools built upon these sporadic interfaces are typically model-specific. We present Kamodo’s model-agnostic satellite flythrough capabilities as the solution to the utilization barrier for heliophysics model outputs. Developed at the Community Coordinated Modeling Center, these flythrough capabilities are built in Python upon a network of model-agnostic interfaces developed in collaboration with model developers, providing interpolation results the community can trust. Kamodo’s flythrough capabilities present the user with a growing variety of flythrough tools based upon a rapidly expanding library of heliophysics model outputs in several domains, currently including a variety of Ionosphere-Thermosphere-Mesosphere and global magnetosphere model outputs. Each capability is designed to be easily accessible via simplistic model-agnostic syntax, with the entire package freely available in the cloud on Github. Here, we describe the tools developed, include several sample applications for common science questions, demonstrate interoperability with selected packages, and summarize ongoing developments.

Software

Toward equitable environmental exposure modeling through convergence of data, open, and citizen sciences: an example of air pollution exposure modeling amidst increasing wildfire smoke

Exposure modeling is critical in environmental epidemiology and human health but may face challenges (e.g., skewed data, unequal error, context-insensitive validation, and computational demands). Modeling decisions reflect the intended use of the models and the values that modelers prioritize. We aimed to provide a conceptual framework and machine learning (ML) modeling protocols that address these issues. With 500m-gridded hourly PM 2.5 and O 3 levels in Illinois before, during, and after the 2023 Canadian wildfire season as a motivating example, we conducted modeling experiments to evaluate modeling methods, guided by three domains we propose based on theories of science: 1) Data Diversity, leveraging open and citizen science data to enhance inclusivity, parsimony, and representativeness; 2) Equitable Accuracy, ensuring fairly distributed uncertainties across subpopulations; and 3) Sustainable Modeling, balancing accuracy with reducing computational demands to promote accessibility for under-resourced researchers. Here, we found that ML with publicly available data can achieve high accuracy. Depending on methods, performance may vary substantially, even with identical input data. Large but skewed data may reduce performance. Misuse of cross-validation protocols can underestimate prediction error; although we observed R 2 s of ∼98 %, the modeled estimates varied significantly, indicating the need for careful model validation. By using new modeling protocols including representativeness-considered training and validation data and a new loss function, we achieved high agreement between estimates and ground-based measurements (e.g., R 2 = ∼90 % for PM 2.5 ; ∼80 % for O 3 ), equally distributed errors across sociodemographic strata and urban–rural divides, and reduction in computation time—from several weeks or months to a few days.

Exposure assessment