Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Risk Informed Decision Making”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Chemical-specific Parameters Dataset

The chemical-specific parameters dataset is searchable for physicochemical information for multiple chemicals simultaneously. After selecting chemicals of interest and the desired parameters, the RAIS will generate a table containing the values, chosen according to an established hierarchy. Results can be downloaded in Excel format. Over 40 parameters are available, including melting point, boiling point, density, density, vapor pressure, water solubility, and Henry’s Law constants. Thirteen primary sources are used to populate the dataset of chemical-specific parameters. These values should be used in cancer risk and noncancer hazard assessments for the calculation of preliminary remediation goals (PRGs), hazard characterization, and transport modeling. Users can select up to 1000 chemicals per query. The dataset supports environmental risk assessments, regulatory decision-making, and environmental planning with tools for benchmarking against risk-based standards. This structured approach ensures a robust evaluation of environmental risks tailored to regulatory needs.

Dolislager, Fred [Oak Ridge National Laboratory (O↗
DOE OSTI2024

Digital risk analysis in nuclear engineering projects: Designing for safety, performance, reliability, and security

Cyber-informed engineering and security-by-design frameworks are important in promoting the need to identify cybersecurity concerns early in the systems engineering lifecycle so risks from adversarial cyber-attacks can be eliminated or reduced through engineering design practices. In addition to adversarial risk, risk in operational technology systems also includes non-adversarial and unintentional risk from other factors such as human performance errors, environmental conditions, design flaws, and device degradation or failure. This paper introduces a new concept for characterizing digital risk, both adversarial and non-adversarial, and provides the basis for initial research into a novel digital risk analysis approach focused on incorporating attack difficulty into a multi-attribute analysis technique using robust decision-making. This digital risk characterization is also used to frame a discussion on the challenges of competing objectives and competing stakeholder requirements in an integrated energy system project that incorporates a small modular reactor and industrial facility.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

Produced Water-Economic, Socio, Environmental Simulation Model (PW-ESEim) Model: Proof-of-Concept for Southeastern New Mexico

A proof-of-concept tool, the Produced Water-Economic, Socio, Environmental Simulation model (PW-ESESim), was developed to support ease of analysis. The tool was designed to facilitate head-to-head comparison of alternative produced water source, treatment, and reuse water management strategies. A graphical user interface (GUI) guides the user through the selection and design of alternative produced water treatment and reuse strategies and the associated health and safety risk and economic benefits. At the highest conceptual level, alternative water strategies include the selection of a source water (locally or regionally available produced water), treatment strategy (pre-treatment, physical, chemical, biological, desalination, and post-treatment processes) and product water purpose (e.g., irrigation, industrial processing, environmental). After selection of these details, the PW-ESESim output a number of key economic, societal, environmental, public/ecological health and safety metrics to support user decision-making; specific examples include, cost of treatment, improvements in freshwater availability, human and ecologic health impacts and growth in local jobs and the economy. Through the simulation of different produced water treatment and management strategies, tradeoffs are identified and used to inform fit-for-purpose produced water treatment and reuse management decisions. While the tool was initially designed using Southeastern New Mexico (Permian Basin) as a case study, the general design of the PW-ESESim model can be extended to support other oil and gas regions of the U.S.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Demonstration and Evaluation of Explainable and Trustworthy Predictive Technology for Condition-based Maintenance

The domestic nuclear power plant (NPP) fleet has historically relied on labor-intensive and time-consuming predictive maintenance (PdM) programs, thus driving up operation and maintenance (O&M) costs to achieve high-capacity factors. Artificial intelligence (AI) and machine-learning (ML) can help simplify complex problems such as diagnosing equipment degradation to enable more effective decision-making efforts. The benefits of AI will be felt through more efficient plant O&M, improved work processes, and better integration of people and technology. Together, these benefits hold the promise to make nuclear power more sustainable by reducing O&M costs while improving employee engagement. While AI and ML technologies hold significant promise for the nuclear industry, there are challenges or barriers to their adoption. Explainability and trustworthiness of AI are two salient challenges that need to be addressed for wider deployment of these technologies in NPPs. This research focuses specifically on addressing the explainability and trustworthiness of AI technologies to advance the human, technical, and organization (HTO) readiness levels in adopting a risk-informed PdM strategy at commercial NPPs. In addition, this approach can be adapted to enhance the acceptability of AI in other nuclear applications with a few application-specific modifications. The technical approach ensuring wider adoption of AI technologies was developed by Idaho National Laboratory (INL)—in collaboration with Public Service Enterprise Group (PSEG), Nuclear, LLC—by utilizing the circulating water system (CWS) at two PSEG-owned plant sites for demonstration. Focused user studies were performed in collaboration with subject matter experts (SMEs) from PSEG and other nuclear domains to enhance human and organization readiness by building trust in AI-informed technologies. VIsualization for PrEdictive maintenance Recommendation (VIPER)—a Battelle Energy Alliance, LLC, copyrighted software—was developed and expanded to provide a user-centric visualization by incorporating inputs from the collaborating utility, human factors engineering guidelines, and data analysts. The VIPER software enables users, who may be unfamiliar with ML in general, to be interactively engaged by asking technical questions about PdM, work orders, diagnosis results and their confidence levels, the kind of data being used, and the types of ML algorithms employed. This interactive engagement enhances explainability and builds trust. One of the enabling accomplishments was the integration of large language models (LLMs), both text-based and vision-based, in the VIPER software.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Weather radar in Nepal: opportunities and challenges in a mountainous region

Extreme rainfall is one of the major causes of natural hazards in the central Himalayan region, including Nepal. The performance of strategies to manage hazards and related risks relies on the accuracy of quantitative hydrometeorological prediction. Rain gauges have traditionally been used to measure the rainfall amount. However, point measurements with limited gauge coverage cannot accurately represent spatial precipitation variability in complex topography. Weather radar have shown potential for useful information on accurate areal rainfall estimates. The Department of Hydrology and Meteorology (DHM) in Nepal installed their first weather radar in 2019 in the western region of the country. Two more radars will be added to the planned radar network in the near future, in the country's central and eastern regions, respectively. We highlight both the opportunities and challenges with radar installation and observation in the mountainous regions. Radar-rainfall estimates across the Himalayas can be useful to inform decision-making in a broad range of infrastructure sectors, including water, energy, construction, transportation, and agriculture.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Classical-Quantum Algorithm for Solving Stochastic Programs

Stochastic programming provides a rigorous mathematical framework for making decisions under uncertainty in a risk-aware manner. Two-stage stochastic programming is, perhaps, the simplest form of this framework. Here the first-stage variables represent decisions that must be made "here and now" in the face of uncertainty, while the second-stage variables are decisions made after uncertain events. However, the broad adoption of stochastic programming has been hindered by computational challenges caused by the two-stage stochastic programming formulation which requires solving an ensemble of optimization problems. Using quantum amplitude estimation (QAE), quantum computers have shown the theoretic ability to compute expectations with Monte-Carlo methods with quadratically fewer samples than classical methods. In this work, we present a quantum algorithm for computing the expectation term using QAE for given first-stage decisions. Further, we detail methods of computing gradient information from the quantum calculation enabling the application of classical gradient-based optimization techniques. The result is a classical-quantum hybrid method of solving two-stage stochastic programs. These techniques are demonstrated with computational experiments based an engineering optimization problem.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Carbon Capture, Transport, And Storage (CTS) Cost Modeling Of The Onshore Gulf Coast

The onshore Gulf of Mexico region presents significant opportunities for CO2 capture, transport, and storage due to its numerous CO2 sources, such as power plants, refineries, and its substantial CO2 storage potential. However, operators face critical decisions in designing an efficient and cost-effective CO2 pipeline network. This study examines the economic implications of two primary strategies: constructing a trunkline with excess initial capacity versus developing dedicated pipelines incrementally as new CO2 sources come online. Building a trunkline first offers the advantage of future-proofing the network, allowing for the accommodation of increased CO2 volumes from various sources over time. However, this approach incurs higher upfront costs and risks underutilizing the transport capacity in the initial stages, potentially resulting in economic inefficiencies. Conversely, constructing dedicated pipelines for each new CO2 source as it becomes operational may avoid the initial overcapacity issue but fails to capitalize on the economies of scale. This could lead to higher overall costs due to the duplication of infrastructure and increased complexity in network management. This research employs a comprehensive cost-benefit analysis, integrating factors such as capital expenditure, operational costs, projected CO2 volumes, and potential economies of scale. Through this analysis, we aim to provide operators with insights into the most economically viable strategy for CO2 pipeline network design in the region. The findings underscore the importance of strategic planning and highlight the trade-offs between immediate capacity utilization and long-term cost savings, ultimately guiding stakeholders towards informed decision-making in the development of CO2 transport infrastructure. Presented at the 41st USAEE/IAEE North American Conference, 3-6 November 2024, Baton Rouge, LA, United States.

Shih, Chung Yan↗
DOE OSTI2020

A Preliminary Radiological Risk Assessment Model for Disposition of Remote-Handled Transuranic Wastes at Los Alamos National Laboratory Area G - 20116

The U.S. Department of Energy (DOE) operates a low-level radioactive waste (LLW) disposal site at Material Disposal Area G, in Los Alamos, New Mexico, USA. Area G has been the primary LLW disposal site for Los Alamos National Laboratory (LANL) since the 1960's. In addition to LLW, Area G is host to a variety of other wastes, the disposition of which must be determined before closure of the site. A probabilistic Radiological Risk Assessment (RRA) for Area G is used in order to support decision making regarding some wastes that are not addressed in the extant Area G Performance Assessment (PA) and Composite Analysis (CA). Between 1979 and 1987, 33 special shafts were augered into the Bandelier Tuff at Area G. This volcanic tuff is present across Pajarito Plateau on the eastern slopes of the Jemez Mountains, and varies widely in its consistency, from weakly indurated non-welded layers to welded layers that uphold the mesa cliffs of the Plateau. These mesas are home to LANL, Area G, and the townsites of Los Alamos and White Rock, with residences about 1400 m from Area G. The 33 Shafts were lined with steel casing, and contain remote-handled (RH) transuranic wastes (TRU) resulting from experiments and analysis performed in special glove boxes at the Chemistry and Metallurgy Research (CMR) facility at LANL. Some of these wastes originated as used nuclear fuel. The purpose of the Area G RRA is to evaluate the potential future risk to humans and the environment from the RH TRU in the 33 Shafts in the context of the risk associated with the surrounding wastes at Area G. The analysis is responsive to expectations outlined in DOE Order 458.1, Radiation Protection of the Public and the Environment, and is informed by the Manual and Guidance accompanying DOE O 435.1, Radioactive Waste Management. Because the waste meets the definition of TRU, the regulatory context necessarily takes into consideration the regulation governing the disposal of TRU from the U.S. Environmental Protection Agency (EPA): 40 CFR 191, Environmental Radiation Protection Standards for Management and Disposal of Spent Nuclear Fuel, High-Level and Transuranic Radioactive Wastes. Given the broader regulatory context for the RRA, the analysis is subject to different assumptions from those made in the existing DOE O 435.1 PA and CA, such as allowing for future occupation of the site. The analysis begins with a comprehensive evaluation of features, events, processes, and exposure scenarios (FEPS) for Area G and the wastes it contains. These FEPSs are screened to eliminate from further consideration those of extremely low probability and/or consequence, and a conceptual site model (CSM) is subsequently developed. The scope and structure of the Area G RRA Model is informed by this CSM, and the Area G RRA Model is developed using the GoldSim systems analysis modeling platform. This paper presents the initial version of a defensible, transparent, and reasonably realistic model, which is based on the state of knowledge of the wastes, the site, and the FEPSs that govern contaminant transport from wastes into the environment and subsequent exposures to humans and other biota. Probabilistic model input distributions represent uncertainties inherent in the real and modeled systems. The results of the Area G RRA Model inform decisions regarding the disposition of the RH TRU in the 33 Shafts. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2024

From Text to Maps: LLM-Driven Extraction and Geotagging of Epidemiological Data

Epidemiological datasets are essential for public health analysis and decision-making, yet they remain scarce and often difficult to compile due to inconsistent data formats, language barriers, and evolving political boundaries. Traditional methods of creating such datasets involve extensive manual effort and are prone to errors in accurate location extraction. To address these challenges, we propose utilizing large language models (LLMs) to automate the extraction and geotagging of epidemiological data from textual documents. Our approach significantly reduces the manual effort required, limiting human intervention to validating a subset of records against text snippets and verifying the geotagging reasoning, as opposed to reviewing multiple entire documents manually to extract, clean, and geotag. Additionally, the LLMs identify information often overlooked by human annotators, further enhancing the dataset’s completeness. Our findings demonstrate that LLMs can be effectively used to semi-automate the extraction and geotagging of epidemiological data, offering several key advantages: (1) comprehensive information extraction with minimal risk of missing critical details; (2) minimal human intervention; (3) higher-resolution data with more precise geotagging; and (4) significantly reduced resource demands compared to traditional methods.

Harrod, Karly↗
DOE OSTI2025

Forecasting Multi-Step-Ahead Street-Scale Nuisance Flooding using a seq2seq LSTM Surrogate Model for Real-Time Application in a Coastal-Urban City

In coastal-urban cities facing an elevated risk of nuisance flooding (by rain and tide) due to increased heavy rainfall, sea level rise, urbanization, and aging drainage systems, real-time flood forecasting at the street-scale can provide useful information to transportation decision-makers. Physics-Based Models (PBMs) that offer high accuracy come with high computational runtimes and costs that limit their application for real-time flood forecasting. To address this challenge, Machine Learning (ML) surrogate models trained from PBMs have been proposed to provide street-scale flood forecasts. Previous related studies have focused on using Long Short-Term Memory (LSTM) architectures to model hourly flood depth on streets. While LSTM models can capture input sequences effectively, they fall short in accurately preserving output sequences, limiting their suitability for multi-step-ahead forecasts. The seq2seq LSTM architecture offers a key advantage here by capturing the full sequence of input–output, making it potentially more suitable for multi-step-ahead flood forecasts compared to traditional LSTM models. However, seq2seq LSTM has not been tested for street-scale flood forecasting, particularly for rapidly fluctuating nuisance flooding events which require special attention to its temporal sequences. Hence, in this study, we applied the seq2seq LSTM model to explore multi-step-ahead street-scale nuisance flooding and compared its results to the traditional LSTM model as a benchmark model. LSTM and seq2seq LSTM surrogate models were applied to 22 flood-prone streets in Norfolk, Virginia, as a case study with a 4-hr (short-term) and 8-hr (long-term) lead time. The models were trained with environmental (rainfall and tide) and topographic (elevation, Topographic Wetness Index, and Depth-To-Water) features along with PBM-derived water depths for different storm events. The results demonstrated satisfactory performance of both LSTM and seq2seq LSTM surrogate models throughout the forecast period compared to the PBM. However, the seq2seq LSTM showed lower Mean Absolute Error (MAE)/ Root Mean Square Error (RMSE) and higher Nash–Sutcliffe Efficiency (NSE)/ correlation than the LSTM across most lead times, particularly for long-term forecasting due to its supremacy in handling both input–output sequences together, which is missing in the traditional LSTM. For example, in the long-term, the average RMSE ranges were 0.0268–0.0373 m for LSTM and 0.0226–0.0319 m for seq2seq LSTM, while in the short-term, they were 0.0263–0.0293 m and 0.0261–0.0283 m, respectively. Additionally, while both models exhibited similar performance in distinguishing flooded and non-flooded streets for flood depth ≥ 0.1 m, the seq2seq LSTM model demonstrated superior performance for higher flood depths (such as ≥ 0.2 m and ≥ 0.3 m). Once trained, inference took only 0.09 to 0.11 s (short-term) and 0.30 to 0.35 s (long-term) per storm event for the 22 streets, making the application highly suitable for real-time decision-making during nuisance flood events.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

AI Benchmark Democratization and Carpentry

Benchmarks are a cornerstone of modern machine learning, enabling reproducibility, comparison, and scientific progress. However, AI benchmarks are increasingly complex, requiring dynamic, AI-focused workflows. Rapid evolution in model architectures, scale, datasets, and deployment contexts makes evaluation a moving target. Large language models often memorize static benchmarks, causing a gap between benchmark results and real-world performance. Beyond traditional static benchmarks, continuous adaptive benchmarking frameworks are needed to align scientific assessment with deployment risks. This calls for skills and education in AI Benchmark Carpentry. From our experience with MLCommons, educational initiatives, and programs like the DOE's Trillion Parameter Consortium, key barriers include high resource demands, limited access to specialized hardware, lack of benchmark design expertise, and uncertainty in relating results to application domains. Current benchmarks often emphasize peak performance on top-tier hardware, offering limited guidance for diverse, real-world scenarios. Benchmarking must become dynamic, incorporating evolving models, updated data, and heterogeneous platforms while maintaining transparency, reproducibility, and interpretability. Democratization requires both technical innovation and systematic education across levels, building sustained expertise in benchmark design and use. Benchmarks should support application-relevant comparisons, enabling informed, context-sensitive decisions. Dynamic, inclusive benchmarking will ensure evaluation keeps pace with AI evolution and supports responsible, reproducible, and accessible AI deployment. Community efforts can provide a foundation for AI Benchmark Carpentry.

von Laszewski, Gregor [Virginia U.]↗
DOE OSTI2022

Towards Software Bill of Materials in the Nuclear Industry

Large, modern industrial facilities often incorporate thousands of digital assets in their operational technology. Regulated facilities, such as nuclear power plants (NPPs), maintain robust cybersecurity and configuration management programs that often use bills of materials (BOMs) for these assets, including make, model, and version of hardware, firmware, and software. However, these BOMs typically capture only first- or second-tier information provided by the original equipment manufacturer (OEM). Unfortunately, as indicated by the increasing number and sophistication of software supply chain attacks, this level of detail is insufficient for identifying all the potential vulnerabilities and risks in software applications. Software BOMs (SBOMs) provide detailed enumeration of components and dependencies within the product or devices, including firmware. SBOMs can be combined with vulnerability data sources and vendor vulnerability attestations to improve vulnerability management and enable rapid identification of affected components when new software vulnerabilities are discovered. Ideally, SBOMs are created by the OEM prior to installation. However, since this practice is not yet commonplace and since NPPs are typically slow to adopt new technology, most NPPs do not incorporate SBOMs into their asset or configuration management programs. Fortunately, SBOMs can be generated by NPPs on existing digital assets to provide further insight into risk management decisions. This report provides an overview of the current SBOM ecosystem and recommends guidance on how to get started in a “crawl, walk, run” manner to develop and implement a sustainable SBOM program for digital assets in an NPP.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Autonomous Inversion of In Situ Deformation Measurement Data for Injection-Induced Stress Change

Geologic carbon storage (GCS) is likely to play a key part of the global effort to dramatically reduce CO2 emissions and perhaps even reduce atmospheric CO2 concentrations through carbon negative operations. A critical part of effort to commercialize and widely deploy this technology is developing the capability to rapidly assimilate real-time monitoring data into a form that will enable site operators to make decisions to manage the safe and efficient operations. Two of the risks associate with GCS are the risk of inducing fractures in the sealing formations that can create leakage pathways and the risk of inducing earthquakes of sufficient magnitude to cause public concern, property damage, or safety risks. To properly manage these risks the site operator needs to know the initial state of stress, the change in stress induced by injection, and the relationship between operational parameters such as injection rate and pressure and the change in stress. Current methods of estimating the change in stress require choosing the type of constitutive model and the model parameters based on core, log, and geophysical data during the characterization phase, with little feedback from operational observations to validate or refine these choices. These characterization methods interrogate the geologic formations using length scales, loading rates or magnitudes that are quite different from those encountered by the actual storage system. It is shown that errors in the assumed constitutive response, even when informed by laboratory tests on core samples, are likely to be common, large, and underestimate the magnitude of stress change caused by injection. Recent advances in borehole-based strain instruments and borehole and surface-based tilt and displacement instruments have now enabled monitoring of the deformation of the storage system throughout its operational lifespan. This data can enable validation and refinement of the knowledge of the geomechanical properties and state of the system, but brings with it a challenge to transform the raw data into actionable knowledge. We demonstrate a method that uses automatic differentiation and a finite-element based geomechanical model perform a gradient-based deterministic inversion of geomechanical monitoring data. This approach allows autonomous integration of the instrument data without the need for time consuming manual interpretation and selection of updated model parameters. Furthermore, only isotropic linear elasticity is considered in this paper, the approach presented is very flexible as to what type of geomechanical constitutive response can be used. The approach is easily adaptable to nonlinear physics-based constitutive models to account for common rock behaviors such as creep and plasticity. The approach also enables training of machine learning-based constitutive models by allowing back propagation of errors through the finite element calculations. This enables strongly enforcing known physics, such as conservation of momentum and continuity, while allowing data-driven models to learn the truly unknown physics such as the constitutive or petrophysical responses.

Burghardt, Jeffrey A.↗
DOE OSTI2022

Modeling protected species distributions and habitats to inform siting and management of pioneering ocean industries: A case study for Gulf of Mexico aquaculture

Marine Spatial Planning (MSP) provides a process that uses spatial data and models to evaluate environmental, social, economic, cultural, and management trade-offs when siting (i.e., strategically locating) ocean industries. Aquaculture is the fastest-growing food sector in the world. The United States (U.S.) has substantial opportunity for offshore aquaculture development given the size of its exclusive economic zone, habitat diversity, and variety of candidate species for cultivation. However, promising aquaculture areas overlap many protected species habitats. Aquaculture siting surveys, construction, operations, and decommissioning can alter protected species habitat and behavior. Additionally, aquaculture-associated vessel activity, underwater noise, and physical interactions between protected species and farms can increase the risk of injury and mortality. In 2020, the U.S. Gulf of Mexico was identified as one of the first regions to be evaluated for offshore aquaculture opportunities as directed by a Presidential Executive Order. We developed a transparent and repeatable method to identify aquaculture opportunity areas (AOAs) with the least conflict with protected species. First, we developed a generalized scoring approach for protected species that captures their vulnerability to adverse effects from anthropogenic activities using conservation status and demographic information. Next, we applied this approach to data layers for eight species listed under the Endangered Species Act, including five species of sea turtles, Rice’s whale, smalltooth sawfish, and giant manta ray. Next, we evaluated four methods for mathematically combining scores (i.e., Arithmetic mean, Geometric mean, Product, Lowest Scoring layer) to generate a combined protected species data layer. The Product approach provided the most logical ordering of, and the greatest contrast in, site suitability scores. Finally, we integrated the combined protected species data layer into a multi-criteria decision-making modeling framework for MSP. This process identified AOAs with reduced potential for protected species conflict. These modeling methods are transferable to other regions, to other sensitive or protected species, and for spatial planning for other ocean-uses.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Long duration battery sizing, siting, and operation under wildfire risk using progressive hedging

Battery sizing and siting problems are computationally challenging due to the need to make long-term planning decisions that are cognizant of short-term operational decisions. This paper considers sizing, siting, and operating batteries in a power grid to maximize their benefits, including price arbitrage and load shed mitigation, during both normal operations and periods with high wildfire ignition risk. Here we formulate a multi-scenario optimization problem for long duration battery storage while considering the possibility of load shedding during Public Safety Power Shutoff (PSPS) events that de-energize lines to mitigate severe wildfire ignition risk. To enable a computationally scalable solution of this problem with many scenarios of wildfire risk and power injection variability, we develop a customized temporal decomposition method based on a progressive hedging framework. Extending traditional progressive hedging techniques, we consider coupling in both placement variables across all scenarios and state-of-charge variables at temporal boundaries. This enforces consistency across scenarios while enabling parallel computations despite both spatial and temporal coupling. The proposed decomposition facilitates efficient and scalable modeling of a full year of hourly operational decisions to inform the sizing and siting of batteries. With this decomposition, we model a year of hourly operational decisions to inform optimal battery placement for a 240-bus WECC model in under 70 min of wall-clock time.

25 ENERGY STORAGE↗
DOE OSTI2021

A time-varying vulnerability index for COVID-19 in New Mexico, USA using generalized propensity scores

The coronavirus disease (COVID-19) pandemic has highlighted systemic inequities in the United States and resulted in a larger burden of negative social outcomes for marginalized communities. New Mexico, a state in the southwestern US, has a unique population with a large racial minority population and a high rate of poverty that may make communities more vulnerable to negative social outcomes from COVID-19. To identify which communities may be at the highest relative risk, we created a county-level vulnerability index. After the first COVID-19 case was reported in New Mexico on March 11, 2020, we fit a generalized propensity score model that incorporates sociodemographic factors to predict county-level viral exposure and thus, the generic risk to negative social outcomes such as unemployment or mental health impacts. We used four static sociodemographic covariates important for the state of New Mexico—population, poverty, household size, and minority population—and weekly cumulative case counts to iteratively run our model each week and normalize the exposure score to create a time-varying vulnerability index. We found the relative vulnerability between counties varied in the first eight weeks from the initial COVID-19 case before stabilizing. This framework for creating a location-specific vulnerability index in response to an ongoing disaster may be used as a quick, deployable metric to inform health policy decisions such as allocating state resources to the county level.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Secure Route: Roadway Risk Mapping for Transportation Planners

The secure transport of sensitive materials across U.S. road networks pose unique challenges for local, state, and federal agencies. Threats range from random events (e.g., accidents, medical emergencies, mechanical failures) to opportunistic or organized tactical assaults. Although the probability of such attacks is very low, the consequences of material loss to foreign states or terrorists can be catastrophic, qualifying these scenarios as “grey swan” events—low-probability, high-impact occurrences that are predictable but difficult to quantify. Traditional risk assessments struggle in these contexts, necessitating a shift toward subjective risk perception to inform planning. Risk perception in transport planning is shaped by various factors, including knowledge of adversarial capabilities, vehicle defenses, manifest details, and geographic features along the route. Geographic features such as bridges, tunnels, roadside elevation, and gaps in cellular coverage introduce vulnerabilities, while mitigative features include safe havens, police stations, and medical services. Temporal variables such as congestion, accidents, and weather further complicate route planning. Despite their importance, existing routing tools like Google Maps and commercial software do not explicitly account for geographic risk features, requiring planners to rely on personal familiarity with routes—a time-intensive, non-scalable approach. This work addresses these gaps by: (1) developing datasets that catalog geographic risk features along U.S. roadways, (2) eliciting risk perceptions from experienced transportation security experts, and (3) linking these perceptions to roadway conditions and geographic data. We implement these capabilities within Secure Route a novel mapping tool for classifying route segment risks associated with roadway conditions. This system provides transportation planners with an intuitive interface to assess and contextualize risk along potential routes, improving decision-making for secure transport. We present current progress in this effort and identify next steps.

Stewart, Robert [ORNL] (ORCID:0000000281867559)↗
DOE OSTI2025

MLCommons Science Benchmarks

Benchmarks are a cornerstone of modern machine learning practice, providing standardized eval- uations that enable reproducibility, comparison, and scientific progress. Yet, as AI systems particularly deep learning models become increasingly dynamic, traditional static benchmarking approaches are losing their relevance. Models rapidly evolve in architecture, scale, and capability; datasets shift; and deployment contexts continuously change, creating a moving target for evaluation. Without adaptive benchmarking frame- works, both scientific assessment and real-world de- ployment risk becoming misaligned with actual system behavior. Drawing on our experience from MLCommons, educa- tional initiatives, and government programs such as the DOE s Million Parameter Consortium, we identify key barriers that hinder the broader adoption and utility of benchmarking in AI. These include substantial resource demands, limited access to specialized hardware, lack of expertise in benchmark design, and uncertainty among practitioners about how to relate benchmark results to their own application domains. Moreover, current benchmarks often emphasize peak performance on leadership-class hardware, offering limited guidance for more diverse, real-world deployment scenarios. We argue that benchmarking itself must become dy- namic in order to incorporate evolving models, updated data, and heterogeneous computational platforms while maintaining transparency, reproducibility, and inter- pretability. Democratizing this process requires not only technical innovation, but also systematic educational efforts spanning undergraduate to professional levels to develop sustained expertise in benchmark design and use. Finally, benchmarks should be framed and com- municated to support application-relevant comparisons, enabling both developers and users to make informed, context-sensitive decisions. Advancing dynamic and inclusive benchmarking practices will be essential to ensure that evaluation keeps pace with the evolving AI landscape and supports responsible, reproducible, and accessible AI deployment.

Hawks, Benjamin G. [Fermilab]↗