Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 829 records · Page 46

Steepest-descent algorithm for simulating plasma-wave caustics via metaplectic geometrical optics

The design and optimization of radiofrequency-wave systems for fusion applications is often performed using ray-tracing codes, which rely on the geometrical-optics (GO) approximation. However, GO fails at wave cutoffs and caustics. To accurately model the wave behavior in these regions, more advanced and computationally expensive “full-wave” simulations are typically used, but this is not strictly necessary. A new generalized formulation called metaplectic geometrical optics (MGO) has been proposed that reinstates GO near caustics. The MGO framework yields an integral representation of the wavefield that must be evaluated numerically in general. We present an algorithm for computing these integrals using Gauss-Freud quadrature along the steepest-descent contours. Benchmarking is performed on the standard Airy problem, for which the exact solution is known analytically. Furthermore, the numerical MGO solution provided by the new algorithm agrees remarkably well with the exact solution and significantly improves on previously derived analytical approximations of the MGO integral.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Normalizing Flows for Microscopic Many-Body Calculations: An Application to the Nuclear Equation of State

We report that normalizing flows are a class of machine learning models used to construct a complex distribution through a bijective mapping of a simple base distribution. We demonstrate that normalizing flows are particularly well suited as a Monte Carlo integration framework for quantum many-body calculations that require the repeated evaluation of high-dimensional integrals across smoothly varying integrands and integration regions. As an example, we consider the finite-temperature nuclear equation of state. An important advantage of normalizing flows is the ability to build highly expressive models of the target integrand, which we demonstrate enables precise evaluations of the nuclear free energy and its derivatives. Furthermore, we show that a normalizing flow model trained on one target integrand can be used to efficiently calculate related integrals when the temperature, density, or nuclear force is varied. This work will support future efforts to build microscopic equations of state for numerical simulations of supernovae and neutron star mergers that employ state-of-the-art nuclear forces and many-body methods.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Decision-Dependent Uncertainty-Aware Distribution System Planning Under Wildfire Risk

The interaction between power systems and wildfires can be dangerous and costly. Distribution grids can be liable for the outbreak of wildfires during extreme weather. In wildfire-prone areas, investment planning should consider the impact of operational actions on wildfire-related uncertainties affecting line failure likelihood. Here, in this case, endogenous-based uncertainty modeling should comprise the backbone of the investment planning model viz-a-viz the inability of standard exogenous-based uncertainty modeling. Therefore, we propose a decision-dependent uncertainty (DDU) aware methodology to optimize investment portfolios for distribution systems, considering that high power-flow levels in high-threat areas can ignite wildfires and increase line failure probability. The methodology identifies the best combination of upgrades (new lines, hardening existing lines, and placing switching devices). Methodologically, we propose a two-stage distributionally robust planning optimization problem with DDU that considers the distribution system's multiperiod operation. The first stage determines optimal switching actions and line investments, and the second stage evaluates the worst-case expected operational cost under a DDU framework designed to account for the endogenous impact of power-flow levels and hardening investment decisions in the line failure probabilities. An iterative method is tailored to handle the problem and numerical experiments demonstrate a more prepared grid to deal with wildfire risk.

Power systems investment planning↗

BioSTEAMDevelopmentGroup/biosteam

BioSTEAM is a fast and flexible package for the design, simulation, and techno-economic analysis of biorefineries under uncertainty. BioSTEAM’s framework is built to streamline and automate early-stage technology evaluations and to enable rigorous sensitivity and uncertainty analyses. Complete biorefinery configurations are available at the Bioindustrial-Park GitHub repository, BioSTEAM’s premier repository for biorefinery models and results. The long-term growth and maintenance of BioSTEAM is supported through both community-led development and the research institutions invested in BioSTEAM. Through the open-source and community-lead platform, BioSTEAM aims to foster communication and transparency within the biorefinery research community for an integrated effort to expedite the evaluation of candidate biofuels and bioproducts. Additionally, an agile life cycle assessment (LCA) platform has been designed to interface with BioSTEAM, BioSTEAM-LCA. This open-source, installable package allows users to perform streamlined LCAs of biorefineries. The focus of BioSTEAM-LCA is to streamline and automate early-stage environmental impact analyses of processes and technologies, and to enable rigorous sensitivity and uncertainty analyses linking process design, performance, economics, and environmental impacts.

Cortes-Peña, Yoel↗

Promoting Sustainable Transportation Modes: A Systematic Review of Behavior-Change Strategies

In previous studies, many travel-behavior-change strategies often relied on single behavior determinants or psychological theories, overlooking the incorporation of sociopsychological theories for guidance in their design. Integrating these theories could offer consistent guidance for program developers and enhance intervention effectiveness. This paper systematically reviews interventions targeting travel-behavior change, with a focus on self-determination theory and its principles of satisfying individuals’ competence, autonomy, and relatedness needs for enacting change. Additionally, experiment design methods, including randomized controlled trials and quasi-experimental designs, are reviewed and discussed. Key findings highlight the effectiveness of personalized interventions and integrating feedback with goal-setting strategies. Given the limited direct references to sociopsychological theories in existing studies, we explore relevant sociopsychological theories applicable to travel-behavior-change programs to provide examples of how strategies could be designed based on them. This review contributes valuable insights into the development of strategies for changing travel behavior, offering a theoretical framework for researchers and practitioners to guide intervention design, experimentation, and evaluation. In conclusion, leveraging these theories not only facilitates reproducibility but also provides a standardized approach for transportation demand management program developers.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Carbon Storage Planning Framework Dashboard

The Carbon Storage Planning Framework dashboard (beta version) provides easy access to explore, query, and evaluate multiple data layers to support and accelerate carbon storage resource and feasibility assessments and planning efforts. The interactive dashboard currently contains a range of authoritative datasets associated with geologic, technical, social, and environmental factors. The data sets can be filtered geographically for an area of interest to update statistics and charts within the dashboard. Terms of Use: NETL is sharing this beta/prototype tool with the request that users will provide feedback to NETL about the function and content of the dashboard, alerting NETL to any bugs or providing suggestions for additional resources to help mature the platform.

CCS,EDX4CCS,carbon storage,dashboard↗

General Analysis of Data Collected from DOE Lidar Buoy Deployments Off Virginia and New Jersey

Pacific Northwest National Laboratory (PNNL) operates two AXYS WindSentinel lidar buoys for the U.S. Department of Energy’s Wind Energy Technologies. The purpose of these buoys is to collect hub-height winds and supporting meteorological and oceanographic information to facilitate the development of offshore wind energy in the U.S. In general, each buoy is deployed for a year or more at a given location in order to capture at least a full annual cycle of weather conditions. The initial deployment for one buoy was off the coast of Virginia beginning in 2015, and the other buoy was first deployed off the coast of New Jersey beginning in 2016. Over the last two years, PNNL has had an opportunity to analyze the data collected during these first two deployments. This report describes a substantial analysis of data collected by the two lidar buoys operated off the coasts of Virginia and New Jersey. The centerpiece instrument for each buoy as deployed off Virginia and New Jersey is a lidar system, which is designed to measure the horizontal wind vector from approximately 40 m to 200 m above the sea surface with vertical resolution of 40 m. Since the initial deployments, the original lidars have been replaced with more powerful Leosphere 866 v2 systems. The analyses in this report will apply to the original Vindicator systems. In addition to the wind profiles from the lidars, the buoys collect near-surface measurements of wind speed and direction, air temperature, relative humidity, barometric pressure, and solar irradiance. Oceanographic variables measured include the two-dimensional wave spectrum, water temperature and conductivity, and ocean current vectors to a depth of 90 m. An assessment of overall data recovery and a basic analysis of the data collected was provided in a previous report This report substantially extends that analysis. The various sections describe the development and application of an inertial measurement unit (IMU) data recovery scheme for the New Jersey deployment; a climatological analysis of winds at hub height and at the surface together with thermodynamic variables measured at the surface for the full deployment periods; an analysis of oceanographic observations describe sea state; the development of a refinement for NOAA’s WaveWatch III model to allow its application to near-shore areas; a basic climatology of ocean currents observed from the buoys; an analysis of observed winds in the framework of Monin-Obukhov Similarity Theory; and the development and evaluation of techniques to extract turbulence intensity and turbulence kinetic energy from the lidars. The analyses contained in this report provide a great deal of new information about offshore conditions on the U.S. East Coast. In addition, the experience gained will inform both configurations and analysis of data from future deployments of these lidar buoy systems.

17 WIND ENERGY↗

Sensor Impacts Evaluation and Verification: Expert Interview Responses

The sensor configuration/deployment method has critical impacts on energy efficient building control and thermal comfort. However, traditional sensor techniques for building operation and fault detection and diagnostics (FDD) are not necessarily optimal in terms of energy efficiency and thermal comfort, and their global effects are not thoroughly investigated. In an effort to address and overcome this limitation, a multilaboratory and multiyear project, “Sensor Impact Evaluation and Verification,” was proposed. Its purpose is to develop a framework to investigate the impacts of sensor deployment and configuration on building energy optimization, FDD, occupant thermal comfort, and potentially grid efficiency. The first project task was a literature review to establish a solid knowledge of and a background related to sensor technologies and placement. To accomplish this task, an extensive review of previous research literature was performed. A series of expert interviews were conducted to augment the findings of the literature review. This report summarizes the interview design and interview results and findings. The interview was designed and performed to (1) investigate the current status and limitations of sensor configuration, (2) identify the research gaps and expectations for potential improvements in sensor configuration and deployment, and (3) integrate expert (e.g., researcher, building operation practitioner) knowledge and experience to develop use-case scenarios.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Statistically-driven Experimental Design to Improve Reference-free Quantification of Small Molecules by Liquid Chromatography-Mass Spectrometry

Non-targeted analysis of small molecules and metabolites in unknown, complex samples using liquid chromatography-tandem mass spectrometry remains challenging. One of the main bottlenecks is the extensive unannotated regions of metabolomics mass spectrometry data, resulting in knowledge gaps. Small molecule annotation in mass spectrometry data has conventionally relied on reference standards and libraries for compound identification and confirmation, which can constrain compound identification to those molecules already known, thus limiting the ability to discover new knowledge and new markers. Retention time prediction can facilitate and expedite unknown compound identification in non-targeted analysis of complex metabolomics samples. Additionally, accurate retention time predictions can also inform sample mixture design for LC-MS/MS analyses. However, current machine learning-based methods for retention time prediction are typically developed for specific chromatographic platforms and are not generalizable across scales. And while technologies and methods to improve reference-free metabolite identification for more comprehensive annotation of unknowns has received much attention, development of the same for quantitation without reference standards has been much more limited, despite its importance in toxicological, environmental, food safety, forensics, and clinical applications. We believe that a reference-free quantitation strategy that exploits mass spectrometry data already collected for reference-free identification can provide much more insight on unknowns, and move the metabolomics field for more complete unknowns characterization. As such, we pursue two efforts to improve upon current state-of-the-art methods in non-targeted analysis: (1) machine learning-based retention time prediction and (2) statistical design of experiments framework for reference-free quantitation. In this work, we develop and demonstrate (1) a generalizable retention time prediction capability across chromatographic conditions and scales, and (2) a statistical design-based framework for response factor contribution elucidation and reference-free quantitation. Evaluation of our retention time prediction model, PrediToR, showed approximately 24% improvement over current models, and we observed approximately 10X improvement in concentration estimation accuracy from our statistical design-based response factor model over a primarily ionization efficiency-based model. We expect that future efforts to improve upon these new capabilities will further advance non-targeted analysis of small molecules towards truly reference-free metabolomics.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Capability Building Progression of an Insider Threat Mitigation Program at an International Research Reactor

The nuclear industry recognizes the difficulties involved in developing effective managerial and leadership skills in a highly technical and proficient workforce such as that found in nuclear facilities. Implementing an insider threat mitigation program (ITMP) within the nuclear industry is a complex and ongoing process that demands a comprehensive understanding of human behavior, an organization’s security culture, and rigorous regulatory requirements yet also accounts for facility characteristics, physical security, material flow, and activities involving nuclear material. Given the high-consequence nature of research reactor operations, even minor lapses can lead to safety, security, and reputational risks. An effective ITMP requires a defense-in-depth approach that incorporates behavioral analysis, robust vetting procedures, continuous monitoring, and cross-disciplinary coordination. It must also promote a culture of vigilance and accountability at all levels up to and including executive leadership but be flexible enough to adapt to evolving global threats and technological advances. Insider threat mitigation is not a one-time effort but rather a sustained commitment to excellence in safety and security. Establishing a culture in which personnel proactively report incidents and issues that could affect nuclear safety and security is vital to maintaining a safe and secure operational environment. This document was developed to guide senior management and research reactor organizations in creating comprehensive programs to effectively manage and mitigate insider threat behaviors and actions. It focuses on the key pillars of an effective ITMP, including the national legal framework, security culture, preventive and protective measures, cyber security, and performance evaluation. By using a systematic approach during implementation, facilities can foster environments conducive to insider threat detection and support long-term program sustainability. The document also provides strategies for improving communication across all levels of an organization, helping to eliminate barriers that hinder the development of robust ITMPs and enhance overall security culture. In today’s organizations, the concept of leveraging safety and security culture lessons to facilitate knowledge transfer is rapidly evolving to expedite insider threat management and security culture improvements. This document outlines the rationale for evaluating an ITMP based on national customs, culture, and stakeholders. The elements are all germane to reliability and trustworthiness and relate to security concerns that states may encounter. The document focuses not only on individual perceptions regarding security issues and capability building but also on team building and how to resolve concerns. The implementers of a facility’s ITMP may zero in on indicators of insider threats within their enterprise. This material will benefit organizations when it is applied using a systematic and structured approach as demonstrated throughout the document.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Jet charge modification in dense QCD matter

In these proceedings we report a recent calculation of the jet charge modification in heavy-ion relative to proton collisions at the LHC. Jets have played an essential role in constraining theories of in-medium parton shower evolution and in determining the properties of the quark-gluon plasma created in ultra-relativistic nuclear reactions. It is important to extend these studies to flavor-tagged jets and explore observables that are sensitive to their partonic origin. The average jet charge, introduced early on in the history of quantum chromodynamics, is a proxy for the electric charge of the quark or gluon that initiates the jet. In the framework of soft-collinear effective theory, we show how to evaluate the jet charge in a dense strongly-interacting matter environments. We identify observables that can isolate the contribution of in-medium branching from isospin effects and present predictions for the transverse momentum dependence of the jet charge distribution in nucleus-nucleus collisions and its modification relative to the proton case.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Effective Field Theory of Random Quantum Circuits

Quantum circuits have been widely used as a platform to simulate generic quantum many-body systems. In particular, random quantum circuits provide a means to probe universal features of many-body quantum chaos and ergodicity. Some such features have already been experimentally demonstrated in noisy intermediate-scale quantum (NISQ) devices. On the theory side, properties of random quantum circuits have been studied on a case-by-case basis and for certain specific systems, and a hallmark of quantum chaos—universal Wigner–Dyson level statistics—has been derived. This work develops an effective field theory for a large class of random quantum circuits. The theory has the form of a replica sigma model and is similar to the low-energy approach to diffusion in disordered systems. The method is used to explicitly derive the universal random matrix behavior of a large family of random circuits. In particular, we rederive the Wigner–Dyson spectral statistics of the brickwork circuit model by Chan, De Luca, and Chalker [Phys. Rev. X 8, 041019 (2018)] and show within the same calculation that its various permutations and higher-dimensional generalizations preserve the universal level statistics. Finally, we use the replica sigma model framework to rederive the Weingarten calculus, which is a method of evaluating integrals of polynomials of matrix elements with respect to the Haar measure over compact groups and has many applications in the study of quantum circuits. The effective field theory derived here provides both a method to quantitatively characterize the quantum dynamics of random Floquet systems (e.g., calculating operator and entanglement spreading) and a path to understanding the general fundamental mechanism behind quantum chaos and thermalization in these systems.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

FEMP Facility Evaluation (Audit) Decision Tree

This document is a resource to be used in concert with FEMP Audit Definitions, FEMP Consolidated Facility Management Guidance, and agency best practices and expert judgment—for agencies to use to determine the best approaches to evaluate their facilities. It features a decision tree that provides a framework for agencies to interpret gathered facility data to understand the existing conditions; benchmark the facility against others in the portfolio to determine whether an on-site or remote audit is appropriate for a facility; determine the best remote or on-site audit level of detail to meet agency facility auditing goals, such as meeting Energy Independence and Security Act of 2007 requirements and developing projects; and improve their energy and water management programs.

auditing↗

Making Data-Driven Policy Decisions for the Nation’s First Building Energy Performance Standards

Nearly every major U.S. city has committed itself to ambitious climate action goals – for Washington, DC this means a 50 percent reduction in greenhouse gases by 2032 and carbon neutrality by 2050. In support of these goals, Washington, DC has passed one of the most aggressive and practical climate action bills in the nation—with the Clean Energy DC Omnibus Act, DC became the first city in the U.S. to adopt energy performance standards for existing buildings. DC’s Building Energy Performance Standards (BEPS) require energy efficiency improvements for all commercial and multifamily buildings that do not meet a sector-specific minimum ENERGY STAR score or equivalent metric, with iterative compliance cycles every five years that will accelerate the pace of whole building retrofits. This paper explores this revolutionary policy framework and uses two data analysis projects that DC conducted to evaluate the potential impact of the BEPS and move towards carbon neutrality. First, we analyze the potential energy savings and greenhouse gas reductions, as well as potential cost impacts, from the implementation of a BEPS policy in DC We then examine the role of BEPS in a carbon neutrality strategy, how BEPS savings iterate over time, and what additional existing building improvements will be driven by the gravitational pull of new building codes on median performance. The paper highlights the benefits and limitations of such data-driven approaches to support policy decisions. Finally, we will review ongoing BEPS implementation, including expected policy directions, critical supportive programs, and lessons learned to date.

Bergfeld, Katie↗

Developing IEEE Std 2800-Compliant Algorithms for Transmission-Connected Inverter-Based Resources: Preprint

This study addresses the compliance of Inverter-based Resources (IBRs) with the IEEE Std 2800, a leading standard that defines interconnection and interoperability requirements for IBRs integrated into transmission systems. Focusing on abnormal grid scenarios, the research evaluates the specific demands on IBRs, proposing a comprehensive controller development framework. This framework caters to maintaining ride-trhough operation or implementing strategic disconnections in line with IEEE Std 2800, alongside managing currents during voltage ride-through scenarios. The effectiveness of this proposed controller framework is rigorously validated through case studies, employing a MATLAB/Simulink model of an IBR to test its performance under diverse grid fault conditions, ensuring the IBRs' alignment with standard requirements and their robust performance in enhancing grid reliability.

IEEE Std 2800↗

Privacy-Aware RAG-Enabled LLMs for Collaborative AI in Organizations

Recent advancements in Large Language Models (LLMs) based on Transformer architectures have significantly improved capabilities in natural language processing and generation. However, deploying LLMs for inter-organizational communication poses challenges, in ensuring privacy and facilitating effective collaboration. This paper introduces a novel decentralized inference meta-agent chatbot that leverages privacy-aware Retrieval-Augmented Generation (RAG)-enabled LLMs for collaborative AI communication across organizations. Built on Microsoft’s Autogen, the platform enables LLMs to autonomously refine responses, enhancing accuracy and relevance. It incorporates advanced hallucination mitigation techniques using Uptrain and a privacy-focused RAG framework that employs synthetic document generation to protect sensitive information. Comprehensive evaluations demonstrate the platform’s effectiveness in maintaining contextual relevance and stringent privacy standards, effectively addressing critical challenges in LLM-enhanced collaborative AI communication. This work represents a significant step toward secure and efficient inter-organizational collaboration using advanced generative AI technologies.

97 - MATHEMATICS AND COMPUTING↗

Community size-spectra applied to recreational freshwater fisheries in Puerto Rican reservoirs

We developed a management framework based on community size-spectra (CSS) to establish targets to maximize desirable gamefish. We evaluated the influence of relative abundance of fish functional groups and watershed characteristics on the slope of the CSS or ecological efficiency. Both ecological efficiency and capacity were strongly influenced by relative abundance of fish functional groups and the degree of water level variation. Steeper slopes indicated overfished gamefish populations, whereas flatter slopes indicated systems dominated by undesirable invasive large-bodied low trophic position fish. We hypothesize that a desirable fishery would have a target range of CSS slopes that provides a deterministic community-based framework of predictable responses to environmental and food web changes that can be used to evaluate outcomes of management actions and a means to assess annual progress toward desirable conditions.

60 APPLIED LIFE SCIENCES↗

Ecological acclimation: A framework to integrate fast and slow responses to climate change

Ecological responses to climate change occur across vastly different time-scales, from minutes for physiological plasticity to decades or centuries for community turnover and evolutionary adaptation. Accurately predicting the range of ecosystem trajectories will require models that incorporate both fast processes that may keep pace with climate change and slower ones likely to lag behind and generate disequilibrium dynamics. However, the knowledge necessary for this integration is currently fragmented across disciplines. We develop ‘ecological acclimation’ as a unifying framework to emphasize the similarity of dynamics driven by processes operating on dramatically different time-scales and levels of biological organization. The framework focuses on ecoclimate sensitivities, measured as the change in an ecological response variable per unit of climate change. Acclimation processes acting at different time-scales cause these sensitivities to shift in magnitude and even direction over time. We highlight shifting ecoclimate sensitivities in case studies from diverse ecosystems, including terrestrial plant communities, coral reefs and soil microbiomes. Models predicting future ecosystem states inevitably make assumptions about acclimation processes; these assumptions must be explicit for users to evaluate whether a model is appropriate for a given forecast horizon. Similarly, decision frameworks that clearly account for multiple acclimation processes and their distinct time-scales will help natural resource managers plan for ecological impacts of climate change from years to many decades into the future. We outline a synthetic research programme focused on the time-scales of ecological acclimation to reduce uncertainty in ecological forecasts.

climate adaptation↗