Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data systems standards”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Evaluation of the excitation spectra with diffusion Monte Carlo on an auxiliary bosonic ground state

We aim to improve upon the variational Monte Carlo (VMC) approach for excitations replacing the Jastrow factor by an auxiliary bosonic (AB) ground state and multiplying it by a fermionic component factor. The instantaneous change in imaginary time of an arbitrary excitation in the original interacting fermionic system is obtained by measuring observables via the ground-state distribution of walkers of an AB system that is subject to an auxiliary effective potential. The effective potential is used to (i) drive the AB system’s ground-state configuration space toward the configuration space of the excitations of the original fermionic system and (ii) subtract from a diffusion Monte Carlo (DMC) calculation contributions that can be included in conventional approximations, such as mean-field and configuration interaction (CI) methods. In this novel approach, the AB ground state is treated statistically in DMC, whereas the fermionic component of the original system is expanded in a basis. The excitation energies of the fermionic eigenstates are obtained by sampling a fermion–boson coupling term on the AB ground state. We show that this approach can take advantage of and correct for approximate eigenstates obtained via mean-field calculations or truncated interactions. We demonstrate that the AB ground-state factor incorporates the correlations missed by standard Jastrow factors, further reducing basis truncation errors. Relevant parts of the theory have been tested in soluble model systems and exhibit excellent agreement with exact analytical data and CI and VMC approaches. In particular, for limited basis set expansions and sufficient statistics, AB approaches outperform CI and VMC in terms of basis size for the same systems. The implementation of this method in current codes, despite being demanding, will be facilitated by reusing procedures already developed for calculating ground-state properties with DMC and excitations with VMC.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Towards a Stronger Foundation: Digitizing Commercial Buildings with Brick to Enable Portable Advanced Applications

Most large commercial buildings have digital controls for their heating, ventilation, and air-conditioning (HVAC) and lighting systems with the potential to implement advanced control strategies and data analytics. However, advanced control strategies and data analytics are rarely deployed at scale due to non-standard naming conventions and heterogenous building configurations. Semantic metadata standards, like Brick, show promise to proliferate these applications across many buildings, but they have not been widely adopted by industry due to barriers such as perceived risk and unfamiliarity with the technology. This paper describes the workflow we established and evaluated while using it to develop over ten Brick models of existing buildings. Through this process, we observed that digitizing existing commercial buildings is a cost and labor-intensive effort in which understanding the buildings’ data streams is the major bottleneck. Yet, we conclude this investment is worthwhile since various use case applications such as fault detection and diagnostics, thermal comfort analysis, and HVAC control optimization can utilize the same Brick model. The paper also explores the challenges and lessons learned we encountered while creating these data models, such as: 1) difficulties in finding metadata descriptions and relationships for existing buildings; 2) handling missing concepts in the schema needed to model a building; 3) lack of guidance on how to structure the data model or how much detail to include; 4) unfamiliarity with technologies, which makes the learning curve steep for applications developers. Finally, we also describe future directions for semantic metadata research and development to make such transformative technologies more accessible to practitioners.

Roa, Carlos Duarte↗
DOE OSTI2026

APOLLO: a facility-scale differentiable virtual accelerator for Fermilab

As the design complexity of modern accelerators grows, there is more interest in using advanced simulations that have fast execution time or yield additional insights like gradients. The FAST/IOTA facility has been working on implementing and experimentally validating an end-to-end digital twin that is both fast and gradient-aware, allowing for rapid prototyping of new software and experiments with minimal beam time costs. Our framework integrates physics and ML codes for linac and ring simulation through a set of generic interfaces between surrogate and physics-based sections. To reproduce device inputs and outputs, system state is exposed as a deterministic discrete event simulator. Because Fermilab is undergoing control system transition, both EPICS and ACNET frontends are supported. Recently, we have begun transitioning to a new community lattice standard, PALS, as well as developing standardized infrastructure for data ingest and normalization to prepare for model calibration during FAST proton injector commissioning. We discuss implementation details as well as challenges, and future plans to extend modelling to main complex proton accelerators like PIPII and Booster.

Kuklev, Nikita [Fermilab]↗
DOE OSTI2020

GCAM-Demeter LU dataset

The dataset includes the projected global gridded land cover (excluding the Antarctic) for the period of 2015-2100 at 0.05-degree resolution and 5-year time step under fifteen SSP-RCP scenarios driven by five GCMs (i.e., gfdl, hadgem, ipsl, miroc, and noresm), using the Global Change Analysis Model (GCAM) and a geospatial downscaling model (Demeter). The data has been stored in self-describing NetCDF format. The dataset also includes the mean and standard deviation of the results driven by the five GCMs. More specifically, the data in each year includes grid-explicit fraction (in percent) of each of the 32 plant functional types that are widely used in current Earth system models. The NetCDF files are named as “GCAM_Demeter_LU_SSP_RCP_Model_Year.nc”, where “SSP” and “RCP” denote the SSP and RCP scenarios, including 'ssp1_rcp26', 'ssp1_rcp45', 'ssp1_rcp60', 'ssp2_rcp26', 'ssp2_rcp45', 'ssp2_rcp60', 'ssp3_rcp45', 'ssp3_rcp60', 'ssp4_rcp26', 'ssp4_rcp45', 'ssp4_rcp60', 'ssp5_rcp26', 'ssp5_rcp45', 'ssp5_rcp60', and 'ssp5_rcp85'. “Year” denotes the year of the land use data, and “GCM” denotes the source driving forcing data from five global climate models (gfdl, hadgem, ipsl, miroc, and noresm), or the mean (“modelmean”) and the standard deviation (“modelstd”) of the results from the five GCMs.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

GCAM-Demeter-LU

This GCAM-Demeter-LU is made available under the Open Data Commons Attribution License:http://opendatacommons.org/licenses/by/1.0/. The dataset includes the projected global gridded land cover (excluding the Antarctic) for the period of 2015-2100 at 0.05-degree resolution and 5-year time step under fifteen SSP-RCP scenarios driven by five GCMs (i.e., gfdl, hadgem, ipsl, miroc, and noresm), using the Global Change Analysis Model (GCAM) and a geospatial downscaling model (Demeter). The data has been stored in self-describing NetCDF format. The dataset also includes the mean and standard deviation of the results driven by the five GCMs. More specifically, the data in each year includes grid-explicit fraction (in percent) of each of the 32 plant functional types that are widely used in current Earth system models. The NetCDF files are named as “GCAM_Demeter_LU_SSP_RCP_Model_Year.nc”, where “SSP” and “RCP” denote the SSP and RCP scenarios, including 'ssp1_rcp26', 'ssp1_rcp45', 'ssp1_rcp60', 'ssp2_rcp26', 'ssp2_rcp45', 'ssp2_rcp60', 'ssp3_rcp45', 'ssp3_rcp60', 'ssp4_rcp26', 'ssp4_rcp45', 'ssp4_rcp60', 'ssp5_rcp26', 'ssp5_rcp45', 'ssp5_rcp60', and 'ssp5_rcp85'. “Year” denotes the year of the land use data, and “GCM” denotes the source driving forcing data from five global climate models (gfdl, hadgem, ipsl, miroc, and noresm), or the mean (“modelmean”) and the standard deviation (“modelstd”) of the results from the five GCMs.See https://github.com/JGCRI/chen_et_al_2020a for details on how to reproduce this data. Rights and permissions Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver http://creativecommons.org/publicdomain/zero/1.0/ applies to the metadata files associated with this article

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2024

Transfer functions for Q A /Q B international regulatory limits for the safe transport of radioactive materials

This paper presents a proposed revision of the International Atomic Energy Agency transport regulations, related to the A 1 and A 2 limit values used to determine the radioactive transport classification. Based on the 'Q system', a novel methodology was introduced to derive Q A and Q B values related to scenarios involving external exposure from a distant source. These values are key parameters that respectively represent the total effective dose and total equivalent dose to the skin, from all primary and secondary particles contributing to radiation exposure. The International Working Group (WG A 1 /A 2 ) is established and associated with the TRANSSC Technical Expert Group on Radiation Protection. A review of the A 1 and A 2 values is performed in response to identified limitations within the existing Q system. The followed approach is based on Monte Carlo simulations that enabled the development of transfer functions aimed at reducing computational time and increasing the flexibility of dose evaluations for any radionuclide with known particle emission spectra. This method allows updating the Q A and Q B values to account for future data evolutions (decay data, fluence-to-dose conversion coefficients) and standardizing the calculation of regulation limits across all referenced radionuclides and scenarios related to external exposure. The transfer functions are established using three Monte Carlo simulation codes—FLUKA, Geant4, and MCNP—and address the previous limitations of the 'Q system', reflecting the latest International Commission for Radiation Protection recommendations and improvements in calculation techniques. The results of the WG show consistent agreement across the codes, with minor discrepancies observed at low primary energies due to statistical uncertainties and different handling of stopping power for electrons/positrons in the codes. This revised approach aligns with current standards and recommendations, ensuring that the radiological consequences of transport accidents are acceptable for the new A 1 and A 2 limits from a radiological protection perspective.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2024

A Novel Standard Gibbs Energy of Formation Model for High-Enthalpy Water Systems

This work provides an advanced standard molar Gibbs energy of formation model, informed by molecular statistical thermodynamics (MST), and validated by mineral solubility and ion association reactions. This new model aligns with experimental data within uncertainties and highlights the role of specific MST interactions around the critical point. This work will provide a reliable tool for the optimization of industrial processes operating at the edges of the supercritical domain.

Hall, Derek↗
DOE OSTI2026

Public Reference Data for Megawatt-Scale Hydrogen Electrolysis - NLR Historical Wind

The U.S. Department of Energy and the National Laboratory of the Rockies (NLR) demonstrate hydrogen electrolysis from variable sources, hydrogen compression and storage, and hydrogen fuel cell power production using megawatt-scale equipment at NLR’s Flatirons Campus as part of the Advanced Research on Integrated Energy Systems (ARIES) initiative. This dataset represents part of that effort and is intended for academic, national laboratory, industrial, and other stakeholders to plan, design, and validate models of megawatt-scale hydrogen technologies and diverse energy infrastructure nationwide. These data provide a baseline for how existing hydrogen electrolysis technologies perform when coupled with various energy technologies. Future datasets will demonstrate how existing hydrogen fuel cell technologies can provide controllable, dispatchable, and variable power output for artificial intelligence (AI) data centers and other variable loads. This dataset entry describes hydrogen production by conducting a statistical analysis of historical wind data over a five-year period (2020-2025) from a single 1.5MW turbine manufactured by General Electric (GE) located at NLR’s Flatirons Campus, to generate an experimental test profile that was deployed on a 1.25-MW proton exchange membrane type MC250 electrolyzer system manufactured by Nel Hydrogen . [1] While the electrolyzer balance-of-plant supports up to 2.5 MW of electrolysis, NLR only has a single 1.25-MW electrolysis stack. The historical wind data provided several metrics, however, the analysis particularly focused on the measured power output by the wind turbine. The power output time series of data for each day was categorized by total energy generation and standard deviation, and the day that represented the highest combination of these two metrics was chosen – December 25th, 2022. This process was then repeated for a moving four-hour window within this day to identify the most statistically variable period. Finally, this four-hour period was scaled by 65% to match the 1.25 MW electrolyzer. The electrolysis system controls hydrogen production by varying DC current applied to the stack, from a maximum of 3000 A to a minimum safe operation of 300 A, or 10%. Because the current – voltage characteristic changes as the stack ages and efficiency degrades, the actual minimum safe operating power changes over time. The historical wind profiles were translated from power (kilowatts) to current (amperes) using a curve fit with calibration data and sent to the electrolyzer power supply at 1 Hz frequency. For more details on the statistical analysis process, see the presentation labeled “ Public Reference Data for Megawatt-Scale Hydrogen Electrolysis” provided with each data entry. These datasets report relevant hydrogen balance-of-plant and system data, all captured at 1 Hz, including hydrogen mass production measured with an Emerson Coriolis flow meter. Each .zip file represents a single wind turbine electrolysis experiment and is formatted as follows: {technology}_{scaling factor}-{electrolyzer ramp rate in amperes/second} For instance, “wind-GE1.5MW_0.65-400.zip” represents the hour-long experiment using historical data from the wind-GE1.5MW turbine, scaled to 65%, with the electrolyzer power supply set to a maximum ramp rate (gain and slew) of 400 A/s. Each .zip folder contains the following files: A .csv file containing raw data An .xlsx file explaining all the fields in the raw data. A .png plot showing the time series of hydrogen production, electrolysis power consumption, and wind power input. A PDF file detailing the historical wind data statistical analysis used to generate the wind profile. An experiment labeled “characterization_200.zip” demonstrates the MC250 electrolyzer steady-state response with 30-minute load steps for a total duration of 5 hours. Finally, a .csv file is provided with all simulated wind experiments combined into one dataset labeled "combined_historical_wind_experiments.csv". NLR also built an AI/machine-learning predictive model based on these datasets. The model ingests the electrolyzer current command in amperes, as well as various pressures and temperatures across the system, and predicts hydrogen output in kilograms per hour. The complete model can be found at https://huggingface.co/NatLabRockies/ptmelt-hydrogen-electrolysis [1] nelhydrogen.com/product/mc-series-electrolyser .

08 HYDROGEN↗
DOE OSTI2026

Observational Data for Next-Generation Climate Model Evaluation: Requirements, Considerations, and Best Practices

Climate model simulations are an important source of information about our planet’s climate system and also enable informed decision-making under different future scenarios. As a new archive of results from the next generation of climate models is anticipated to become available with the Coupled Model Intercomparison Project phase 7 (CMIP7), the need to develop efficient and robust methods to evaluate models is paramount. Observations are an integral part of model evaluation, providing a means to quantify and understand the degree to which climate models can faithfully reproduce Earth system processes. Such analysis is critical for constraining climate projections, identifying areas of focus for model development, and assisting analysts in deciphering the utility of models for specific applications. Observations of Earth system come from a diversity of sources, span different space–time domains, and are produced by different communities, and each dataset features different data structures and formats, metadata standards, and its own unique uncertainties. Uncertainties in an observational dataset may stem from gaps in temporal and spatial coverage, instrumentation errors, or assumptions in retrieval and processing methods. How then does one ensure that observational data are ready for use and utilized in the most appropriate way for robust, rapid, and routine climate model evaluation? The CMIP7 Model Benchmarking Task Team with input from the broader climate modeling, model evaluation, and observational data communities present a vision and considerations for best practices toward the optimal and appropriate use of observational data to support next-generation climate model evaluation.

Climate models↗
DOE OSTI2026

Accelerating lattice gauge theory studies with Agentic AI

Lattice gauge theory research, with its computationally intensive simulations and complex multi‑stage workflows, is well positioned to benefit from agentic AI systems. We demonstrate how such tools can support key components of lattice gauge theory research, including novel simulation code development using standard LQCD frameworks, HPC job orchestration, simulation data analysis, and expert‑guided tuning of algorithmic parameters such as Hasenbusch mass preconditioning and multigrid solvers. Our results show that agentic AI can reduce manual effort, improve productivity, and accelerate the research cycle while maintaining essential human oversight.

Ayyar, Venkitesh [Fermilab]↗
DOE OSTI2023

Pursuit of paired dijet resonances in the Run 2 dataset with ATLAS

New particles with large masses that decay into hadronically interacting particles are predicted by many models of physics beyond the Standard Model. A search for a massive resonance that decays into pairs of dijet resonances is performed using 140 fb –1 of proton-proton collisions at $\sqrt{s}$ = 13 TeV recorded by the ATLAS detector during Run 2 of the Large Hadron Collider. Resonances are searched for in the invariant mass of the tetrajet system, and in the average invariant mass of the pair of dijet systems. A data-driven background estimate is obtained by fitting the tetrajet and dijet invariant mass distributions with a four-parameter dijet function and a search for local excesses from resonant production of dijet pairs is performed. No significant excess of events beyond the Standard Model expectation is observed, and upper limits are set on the production cross sections of new physics scenarios.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Impact of Hydrological Data on Power System Operational Studies: Preprint

Hydropower is expected to play an important role in maintaining grid reliability and flexibility as the share of of variable renewable energy increases. While the current hydropower operational models have been studied and used widely, they haven't been updated for decades to meet new performance standards. For example, current steady state and dynamic models often neglect hydrological conditions, which may lead to unrealistic expectations when relying on hydropower for energy and ancillary services. To study this impact, a multi-timescale hydrological model was created by leveraging the National Renewable Energy Laboratory-developed Multi-timescale Integrated Dynamics and Scheduling (MIDAS) tool. Using MIDAS, we compare the impact of considering hydrological conditions in a day-ahead unit commitment (DAUC) schedule on the reduced 240-bus Western Interconnect (WI) test system under winter and summer case studies. We show that neglecting current hydrological conditions of hydropower plants in power system models can lead to an overestimation of hydropower capabilities, which could lead to power balancing issues. For example, power system DAUC simulation results of our reduced test system show that in the case where hydrological conditions are not considered in the model, an approximate 31% overestimation of hydropower capabilities occurs in the summer case and approximately 60% occurs in the winter case compared to what is available. Additionally, results show an underestimation of WI day-ahead power system generation costs by approximately $54M - $80M in the weekly summer scenario and $116M - $126M in the weekly winter scenario. This analysis helps to underscore the importance of considering hydrological data in power system operational studies.

ENERGY PLANNING, POLICY, AND ECONOMY,HYDRO ENERGY↗
DOE OSTI2022

Melt pool temperature measurement and monitoring during laser powder bed fusion based additive manufacturing via single-camera two-wavelength imaging pyrometry (STWIP)

Melt pool (MP) temperature is one of the determining factors and a key signature for evaluating the properties of printed components in metal additive manufacturing (AM). The state-of-the-art measurement systems are hindered, primarily by the large-scale data acquisition and processing demands. In this work, we introduce a novel coaxial, high-speed, single-camera two-wavelength imaging pyrometer (STWIP) system as opposed to the typical utilization of multiple cameras for measuring MP temperature profiles in laser powder bed fusion (LPBF) processes. Developed on a commercial LPBF machine (EOS M290), the STWIP system demonstrated its ability to quantitatively monitor the MP temperature and its variation for 50 layers at high framerates (>30,000 fps) for a real-world application (standard fatigue specimens) print. High performance computing is employed to analyze the acquired big data (MP images), for determining each MP's average temperature and 2D temperature profile. The MP temperature evolution in the gage section of a fatigue specimen is also examined at a temporal resolution of 1 ms, by evaluating the MP temperatures in the samples' first, middle, and last layers. This report is the first of its kind on monitoring MP temperature distribution and evolution at such a large, detailed scale for longer durations in practical applications.

42 ENGINEERING↗
DOE OSTI2025

Search for heavy pseudoscalar and scalar bosons decaying to a top quark pair in proton–proton collisions at $\sqrt{s}$ = 13 TeV

A search for pseudoscalar or scalar bosons decaying to a top quark pair ($\textrm{t}$$\bar{\textrm{t}}$) in final states with one or two charged leptons is presented. The analyzed proton–proton collision data was recorded at $\sqrt{s}$ = 13 TeV by the CMS experiment at the CERN LHC and corresponds to an integrated luminosity of 138 fb -1 . The invariant mass $m_{{\textrm{t}}{\bar{\textrm{t}}}}$ of the reconstructed $\textrm{t}$$\bar{\textrm{t}}$ system and variables sensitive to its spin and parity are used to discriminate against the standard model background. Interference between pseudoscalar or scalar boson production and the standard model $\textrm{t}$$\bar{\textrm{t}}$ continuum is included, leading to peak-dip structures in the $m_{{\textrm{t}}{\bar{\textrm{t}}}}$ distribution. An excess of the data above the background prediction, based on perturbative quantum chromodynamics (QCD) calculations, is observed near the kinematic $\textrm{t}$$\bar{\textrm{t}}$ production threshold, while good agreement is found for high $m_{{\textrm{t}}{\bar{\textrm{t}}}}$. The data are consistent with the background prediction if the contribution from a simplified model of a color-singlet $^1\textrm{S}^{|1|}_0$ ${{\textrm{t}}{\bar{\textrm{t}}}}$ quasi-bound state $η_{\textrm{t}}$, inspired by nonrelativistic QCD, is added. Upper limits at 95% confidence level are set on the coupling between the pseudoscalar or scalar bosons and the top quark for boson masses in the range 365–1000 GeV, relative widths between 0.5% and 25%, and two background scenarios with or without $η_{\textrm{t}}$ contribution.

CMS↗
DOE OSTI2022

Follow-On Status Report on FY2022 Model Development within the Integrated Energy Systems Hybrid Repository

This publication details newly created energy storage and reactor models developed within the HYBRID modeling repository as part of the Department of Energy Office of Nuclear Energy (DOE-NE) Integrated Energy Systems (IES) program, led by Idaho National Laboratory (INL). Model development to-date includes creation of dynamic systems-level models of a pebble bed high temperature gas reactor (HTGR), compressed air energy storage (CAES), and Modelica standard library based two-tank sensible heat storage (SHS) in the IES-based HYBRID repository. Models are developed using the latest publicly available data and incorporate the possibility of control strategy inclusion for use with the existing IES modeling, analysis, and optimization toolset. Simulations showcase the abilities of each technology to flexibly operate in ways consistent with IES operation expectations. When these models are available, they can be utilized within different integrated energy park concepts to understand optimal system operation, control, and dispatching. Moreover, given the generic nature of the models, industrial partner technologies can be quickly added to the repository using the existing models as a basis. Additional dynamic models for thermal energy storage concepts can be developed and added to the HYBRID repository as needed.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2020

Recommended Functionalities for Improving Cybersecurity of Distributed Energy Resources

The current electric grid is transitioning through increasing penetration of distributed energy resources (DERs), which include intermittent renewable generation resources on the distribution side. Both the monitoring and control of DERs require extensive data-exchange and communication networks. These networks lead to cyber vulnerabilities and risks of new kinds of cyberattacks that may be extremely destructive for power system operations. Although current standards, such as IEEE Std. 1547-2018, do not discuss cybersecurity measures for DERs, cybersecurity controls should be developed for securing DER systems at the device level, communications level, and applications level. This paper discusses the current industry's best practices related to DER cybersecurity and proposes recommended functionalities for improving the cybersecurity posture of DERs, specifically at the device/distribution level. These practical recommendations have been discussed and verified with the industry through a DER cybersecurity working group.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Optimal band selection for target detection with a LWIR multispectral imager

Multispectral imaging can offer many benefits in cost, complexity, resolution, size, weight, and power, relative to hyperspectral imaging. When designing a multispectral system, spectral bandpasses can be selected using optimization algorithms configured to maximally separate target detection scores between target and background regions. A hyperspectral image (HSI) can serve as the source of data from which band groupings can be tested for optimality. The output of an adaptive cosine estimator target detection algorithm is used in an objective function. Three optimization algorithms are compared: particle swarm, dual annealing, and differential evolution. A global optimum is also found using a brute force approach on the Livermore Computing Syrah supercomputer. Three materials are investigated: calcite, gypsum, and limestone. This is done for 3-, 4-, and 5-band systems. The data originate from a longwave infrared HSI of a material display board. The optimization algorithms were run 30 times for every scenario. Performance statistics (maximum, minimum, mean, standard deviation, and median) based on the separation values are given. Additional characterization was performed using receiver operator characteristic (ROC) curves and the area under the ROC curve. While good performance was obtained for the three optimization algorithms, the dual annealing algorithm produced the highest and most consistent detection separation scores on average.

47 OTHER INSTRUMENTATION↗