Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Proposal and application of ROM-Lasso method for sensitivity coefficient evaluation

We propose a novel method for evaluating sensitivity coefficients of neutronics parameters to cross sections, so-called the reduced-order modeling technique ROM-Lasso. In this method, cross sections of interest are randomly sampled, and corresponding perturbed core analyses are performed. Then, the sensitivity coefficient vector of the higher-level model is expanded via the active subspace bases obtained with the lower-level model whose dimensional complexity is smaller than that of the higher-level model, and the expansion coefficients are estimated by the Lasso regression. A unique feature of the ROM-Lasso method allows the use of different bases optimized for each neutronics parameter. We conducted a verification calculation for an accelerator-driven system and demonstrated that the ROM-Lasso method can reproduce the sensitivity coefficients with a much smaller number of forward calculations than the direct method. The proposed method can be used to practically evaluate sensitivity coefficients. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2025

Remote sensing images, DEM, and point clouds associated with “Accuracy evaluation of cost-effective 3D reconstruction approaches for hydrobiogeochemical processes in non-perennial stream riverbeds”

This data package is associated with the publication “Accuracy evaluation of cost-effective 3D reconstruction approaches for hydrobiogeochemical processes in non-perennial stream riverbeds” published in Frontiers in Environmental Science, Environmental Informatics and Remote Sensing (Bao et al., 2026; doi: 10.3389/fenvs.2026.1725258). This data package includes the drone photos for a section of Umtanum Creek in Washington, Unted States. The photos were used to reconstruct the 3-dimensional (3D) digital elevation model (DEM) of the riverbed for the investigated stream section. The reconstruction results from four approaches are provided: (1) unoccupied aerial vehicle (UAV, colloquially known as drone) imagery-based Structure-from-Motion (SfM), (2) a machine learning-based 3D reconstruction model, Visual Geometry Grounded Deep Structure from Motion (VGGSfM), (3) Visual Geometry Grounded Transformer for long sequence of images (VGGT-Long), and (4) handheld smartphone LiDAR scanning. The ground truth measurements by tripod-mounted optical level kit and ground control points GPS locations for evaluating the accuracy of the four reconstruction approaches are also provided in this data package. A preliminary version of this data package was published in October 2025 at the time of manuscript submission. It was updated in March 2026, at the time of manuscript acceptance, to include additional metadata (this readme, data dictionary, and file level metadata). The data did not change. For details on how to navigate data packages generated by this project, see https://data.ess-dive.lbl.gov/portals/PNNLRiverCorridorSFA/About. In addition to a readme, this data package also includes a file-level metadata (FLMD) file that describes each file and a data dictionary (DD) that describes all column/row headers and variable definitions. This dataset is comprised of (1) 8 folders; (2) the detailed flight configuration html files; (3) field metadata; (4) a readme; (5) a data dictionary; and (6) file-level metadata. The folders “2024_10_18_d01” and “2024_10_18_d02” contain the original drone photos for the two drone flights (d01 and d02) on October 18, 2024. The reconstruction results from each of the approaches are in the folders called “ODM_SfM”, “VGGSfM”, “VGGTLong”, and “LiDAR”. The ground truth measurements are in the folder called “optical_level_kit”. Lastly, results comparing the different approaches are in the folder called “comparisons”. All files are .csv, .html, .jpg, .obj, .txt, and .npy. For information on using the .obj and .npy files, see the readme files within the same folder as the files.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

LLM Benchmarking with LLaMA2: Evaluating Code Development Performance Across Multiple Programming Languages

The rapid evolution of large language models (LLMs) has opened new possibilities for automating various tasks in software development. This paper evaluates the capabilities of the LLaMA 2-70B model in automating these tasks for scientific applications written in commonly used programming languages. Using representative test problems, we assess the model's capacity to generate code, documentation, and unit tests, as well as its ability to translate existing code between commonly used programming languages. Our comprehensive analysis evaluates the compilation, runtime behavior, and correctness of the generated and translated code. Additionally, we assess the quality of automatically generated code, documentation, and unit tests. Here, our results indicate that while LLaMA 2-70B frequently generates syntactically correct and functional code for simpler numerical tasks, it encounters substantial difficulties with more complex, parallelized, or distributed computations, requiring considerable manual corrections. We identify key limitations and suggest areas for future improvements to better leverage AI-driven automation in scientific computing workflows.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

A Million Person Study Innovation: Evaluating Cognitive Impairment and other Morbidity Outcomes from Chronic Radiation Exposure Through Linkages with the Centers for Medicaid and Medicare Services Assessment and Claims Data

Here, the study of One Million U.S. Radiation Workers and Veterans, the Million Person Study (MPS), examines the health consequences, both cancer and non-cancer, of exposure to ionizing radiation received gradually over time. Recently the MPS has focused on mortality patterns from neurological and behavioral conditions, e.g., Parkinson's disease, Alzheimer's disease, dementia, and motor neuron disease such as amyotrophic lateral sclerosis. A fuller picture of radiation-related late effects comes from studying both mortality and the occurrence (incidence) of conditions not leading to death. Accordingly, the MPS is identifying neurocognitive diagnoses from fee-for-service insurance claims from the Centers for Medicare and Medicaid Services (CMS), among Medicare beneficiaries beginning in 1999 (the earliest date claims data are available). Linkages to date have identified ∼540,000 workers with available health information. Such linkages provide individual information on important co-factor and confounding variables such as smoking, alcohol consumption, blood pressure, obesity, diabetes and many other health and demographic characteristics. The total person-level set of time-dependent variables, outcomes, organ-specific dose measures, co-factors, and demographics will be massive and much too large to be evaluated with standard software. Thus, development of specialized open-source software designed for large datasets (Colossus) is nearly complete. The wealth of information available from CMS claims data, coupled with individual dose reconstructions, will thus greatly enhance the quality and precision of health evaluations for this new field of low-dose radiation and neurocognitive effects.

Dauer, Lawrence T.↗
DOE OSTI2022

Supplementary Data for "Evaluation of the Economic Implications of Varied Pressure Drawdown Strategies Generated Using a Real-time, Rapid Predictive, Multi-fidelity Model for Unconventional Oil and Gas Wells" by Bello, K., Vikara, D., Sheriff, A., Viswanathan, H., Carr, T., Sweeney, M., O'Malley, D., Marquis, M., Vactor, R.T., and Cunha, L.

The Bello et al. study evaluates the impact of contrasting pressure drawdown on gas productivity and the resulting economics of a well in the Marcellus Shale of the Appalachian Basin. This research applies a techno-economic analysis approach to help identify potential ways pressure management strategies can be used to improve cumulative recovery of hydraulically fractured horizontal wells while maintaining project profitability. Gas production forecast outlook scenarios of the Marcellus Shale Energy and Environment Laboratory Laboratory's MIP-3H well were generated under varying pressure drawdowns using two approaches: 1) a novel physics-informed machine learning (PIML) workflow and 2) via traditional reservoir simulation in Computer Modeling Group’s (CMG) GEM Compositional & Unconventional Simulator. Cash flow and other economic metrics of interest were compiled on the production outlook using the U.S. Department of Energy's (DOE) National Energy Technology Laboratory (NETL) Unconventional Shale Well Economic Model (UShWEM).The sheets within this Microsoft ExcelTM workbook provide the economic metric outputs for the baseline condition and the one-at-a-time (OAT) sensitivity analysis of UShWEM's input parameters for each of the production scenarios evaluated.

Fracture Network Model↗
DOE OSTI2025

CO2 Enhanced Oil Recovery Evaluation System (CO2_E_EvSystem), Version 2025

The United States Department of Energy’s (DOE’s) Office of Fossil Energy and the National Energy Technology Laboratory (NETL) developed a suite of screening-level, techno-economic models/tools, known as the CO2_E_EvSystem, to evaluate technical aspects and costs of using carbon dioxide (CO2) enhanced oil recovery (EOR) to store CO2 and produce oil. CO2_E_EvSystem has three software components and several input and output files. The software components are CO2_E_EvTool, CO2_Prophet, and CO2_E_COM. Almost all computational work is performed by CO2_Prophet and CO2_E_COM, which are both Fortran programs. The primary role of CO2_E_EvTool is to manage input and output files for the two programs, run the two programs, allow multiple oilfields to be evaluated in a single run, and generate files that summarize the results for all the oilfields run. This version of the CO2_E_EvSystem includes a residual oil zone dataset from the San Andres formation, Permian Basin, to demonstrate the system and guide users on attributes needed for dataset inputs.

AS↗
DOE OSTI2023

Evaluation of the first version of the new RFPI system dedicated to PIP-II project accelerator

The Low-Level Radio Frequency (LLRF) control system is one of the most critical superconducting linac infrastructures responsible for the parameters of the beam acceleration. The LLRF system mainly focuses on the electromagnetic field parameters inside the cavity. While it incorporates fast feedback algorithms to optimize energy transfer to the passing particle beam it does not follow other cryomodule or cavity parameter changes. The Radio Frequency Protection Interlock (RFPI) system closely monitors various factors (like cryomodule vacuum, beamline vacuum, field emission probe current level, temperature, RF signal leakage, etc). Its simple but reliable logic has to provide an instant decision about the LLRF system or high-power amplifier output signal blocking in case of safety region excitation. This contribution presents a new version of the RFPI system which logic is implemented in the FPGA chip. The initial work on the prototype of the new system design resulted in the PoC (Proof of Concept) device. The PoC offers the possibility of various protection logic configurations, input signals parameters evaluation, and modularity aspects verification. The structure and test results from the device evaluation are summarized and discussed in this contribution.

43 PARTICLE ACCELERATORS↗
DOE OSTI2024

Evaluating the Effectiveness of Retrieval-Augmented Large Language Models in Scientific Document Reasoning

Despite the dramatic progress in Large Language Model (LLM) development, LLMs often provide seemingly plausible but not factual information, often referred as hallucinations. Retrieval-augmented LLMs provide a non-parametric approach to solve these issues by retrieving relevant information from external data sources and augment the training process. These models helps to trace evidence from an externally provided knowledge base allowing the model predictions to be better interpreted and verified. In this work, we critically evaluate these models in their ability to perform in scientific document reasoning tasks. To this end, we tuned multiple such model variants with science-focused instructions and evaluated them on a scientific document reasoning benchmark for the usefulness of the retrieved document passages. Our findings suggest that models justify predictions in science tasks with fabricated evidence and leveraging scientific corpus as pretraining data does not alleviate the risk of evidence fabrication.

• Artificial intelligence (AI) / machine learning ↗
DOE OSTI2023

Evaluating one-loop string amplitudes

We evaluate one-loop open-string amplitudes at finite \alpha' α ′ for the first time. Our method involves a deformation of the integration contour over the modular parameter \tau τ to a fractal contour introduced by Rademacher in the context of analytic number theory. This procedure leads to explicit and practical formulas for the one-loop four-point amplitudes in type-I superstring theory, amenable to numerical evaluation. We plot the amplitudes as a function of the Mandelstam invariants s s and t t and directly verify long-standing conjectures about their behaviour at high energies.

Eberhardt, Lorenz↗
DOE OSTI2022

Object-Based Evaluation of Tropical Precipitation Systems in DYAMOND Simulations over the Maritime Continent

The present study uses an object-based evaluation metric to examine the precipitation bias over the Maritime Continent in the global cloud-resolving models. We specifically focus on the difference between the models that directly resolve convection and those using convection parameterization. The 40-day hindcast experiments of the DYnamics of the Atmospheric general circulation Modeled On Non-hydrostatic Domain (DYAMOND) intercomparison project are evaluated against the high-resolution satellite rainfall products. The hindcast of the Central Weather Bureau Global Forecast System (CWBGFS) under the DYAMOND protocol is also included. The results indicate that most models simulate insufficient numbers of large precipitation system [object-based precipitation system (OPS), > 370 km in scale], indicating weaker convection organization. The observation indicates that the maximum precipitation within the OPS intensifies with increasing object size. All of the models capture this positive relationship, but most of them overestimate the sensitivity. Most of the models overestimate both the frequency and intensity of small OPS (< 160 km), except for the models with convection parameterization [i.e., CWBGFS, European Centre for Medium-Range Weather Forecasts Integrated Forecasting System (IFS)-9 km]. Although most of the models can reproduce the observed peak time of diurnal precipitation over the land area in the Maritime Continent, the simulated fractional contribution of different sizes of OPS to the total precipitation varies from model to model, and their peak times do not follow the observed ones with delayed peak times as the size of OPS increases from small, mid-size, to large categories. Most of the models reasonably capture the mean diurnal cycle peak time, but only the models with convection parameterization and Model for Prediction Across Scales (MPAS) can represent the diurnal evolution of fractional contribution from different OPSs. The implications of the current results to the upscale processes of the tropical convection systems in the global models are also discussed.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Evaluation of the Large-Scale and Regional Climatic Response Across North Africa to Natural Variability in Oceanic Modes and Terrestrial Vegetation Among the CMIP5 Models

Hydrologic variability is a serious threat to the poverty-stricken regions of North Africa. Meanwhile, the scientific community struggles to attribute these extreme climatic episodes to specific oceanic and land drivers. Prior modeling studies have not assessed simulated feedbacks over North Africa against an established observational benchmark, so their results are considered as untested, model-specific findings. The Coupled Model Intercomparison Project Phase Five (CMIP5) archive represents the state-of-the-art in climate projections, with most CMIP5 models now containing interactive vegetation phenology; however, there have been no studies to date of their simulated vegetation feedbacks. The capability of CMIP5 models at accurately simulating the forcing of both sea-surface temperature (SST) and regional leaf area index (LAI) anomalies on North African climate needs to be a key consideration in assessing the models’ overall credibility and determining appropriate model weighting for developing climate projections. The Generalized Equilibrium Feedback Assessment (GEFA) is a promising statistical method, which can be applied to either model output or observations, for isolating the local and remote impacts of individual oceanic or terrestrial forcings on regional climate. We performed a combined observational and modeling assessment of land-ocean-atmosphere interactions across the distinct ecological and moisture gradients of North Africa. We evaluated and demonstrated the reliability of the GEFA statistical method over North Africa using the Community Earth System Model (CESM), applied GEFA to observational data to quantify the observed forcing of ocean basin SST anomalies and regional LAI anomalies on North African climate, evaluated the CMIP5 models’ performance in terms of representing these key observed feedbacks, and formulated CMIP5 feedback performance metrics for weighting North African climate projections. Our study represented the first attempt to separate the observed roles of oceanic and vegetation feedbacks across North Africa, the first systematic assessment and intercomparison of land-ocean-atmosphere feedbacks in CMIP5, and the first exploration of vegetation feedbacks among CMIP5 models. The following work was accomplished. (1) The team generated 14 scientific publications and 30 presentations based on the DOE-funded research. (2) A stepwise version of the GEFA statistical method was developed in which unimportant forcings were dropped to increase the reliability of the results. (3) SGEFA was successfully validated through experiments with CESM in terms of its ability to isolate the atmospheric responses to individual oceanic or land forcings. (4) Observational evidence was revealed for the Sahel’s positive vegetation-rainfall feedback on the seasonal to interannual time scale, and it was attributed to a moisture recycling mechanism rather than an albedo mechanism. (5) An approach with SGEFA was developed in which the individual contributions of soil moisture versus vegetation forcings could be separated, revealing that the former forcing outweighed the latter for sub-Saharan Africa. (6) Tropical ocean temperatures were found to be key regulators of pan-tropical vegetation variability, especially for arid and semi-arid regions, including sub-Saharan Africa. (7) The CMIP5 models largely underestimated the importance of land feedbacks across the Sahel. (8) The general consensus among CMIP5 models indicates, for the late 21st century, a diminished seasonal predictability of sub-Saharan African regional climate and an elevated role of the land surface compared to oceanic drivers in regulating regional climate variability. (9) Land-ocean-atmosphere interactions were demonstrated to be key contributors to the seasonal predictability of African wildfire activity. (10) The El Djouf was determined to be of greater importance than the Bodélé depression in terms of providing trans-Atlantic dust transport to the Americas.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Evaluation of short-term initial performance of a “Molekule Air” portable air cleaner

The aim of this project was to evaluate and characterize the performance of a MOLEKULE AIR air cleaner unit. The testing protocol comprised the evaluation of an unused Molekule Air unit operating at maximum (“boost” setting) fan speed setting. The device was tested over initial short-term periods of 70-80 h of continuous operation. The tested air cleaner was challenged in separate experiments with a well-characterized mixture of volatile organic compounds (VOCs), and with ozone. All tests were performed at realistic pollutant levels in a 20-m 3 environmental stainless-steel chamber. Variables controlled and measured in this study included the chamber temperature, relative humidity, the composition and concentration of the challenge VOCs, and the concentrations of ozone. Potential formation of byproducts was also investigated to assess the overall performance.

47 OTHER INSTRUMENTATION↗
DOE OSTI2020

Improved Fireset Acceptance Using Established Evaluation Measurements

As new insight is gained into the relationship between firesets and detonators, tighter control of the circuit parameters is desired to maintain consistent and optimum system performance. An analysis of the established acceptance method reveals that it has insufficient precision to guarantee a uniform population of units. While the production has been historically very uniform, the uniformity has been primarily due to the quality and consistency of the manufacturing process rather than to the stringency of the acceptance criteria. The established method of evaluating and accepting firesets for the stockpile has been to discharge the units into a representative load and to record the output current waveform. Three characteristics of the output waveform (Peak Current, Rise Time, and Pulse Width) are then analyzed and an acceptance window is applied directly to these measurements. The purpose of this paper is to introduce a new approach that incorporates these same established measurements. However, instead of applying acceptance criteria to the three measurements directly, rather these measurements are used to evaluate the circuit values of capacitance, inductance and resistance to provide a more stringent and uniform acceptance criteria.

42 ENGINEERING↗
DOE OSTI2020

Evaluation of the Nanometrics Centaur Digitizer

Sandia National Laboratories has tested and evaluated a new digitizer, the Centaur, manufactured by Nanometrics, Inc. This digitizer is used to record sensor output for seismic and infrasound monitoring applications. The purpose of the digitizer evaluation was to measure the performance characteristics in such areas as power, sensitivity, self-noise, dynamic range, system noise, modified noise power ration, relative transfer function, analog bandwidth, harmonic distortion, common mode, cross talk, timing tag accuracy and timing drift. The Centaur provides six channels of 24 bit digitization, three of which may be transmitted utilizing CD1.1 protocol.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

Kinemetrics Q330M+ Digitizer Evaluation

Sandia National Laboratories has tested and evaluated a new digitizer, the Q330M+, manufactured by Quanterra, a division of Kinemetrics Inc. This digitizer is used to record sensor output for seismic and infrasound monitoring applications. The purpose of the digitizer evaluation was to measure the performance characteristics in such areas as sensitivity, input impedance, power consumption, self noise, dynamic range, system noise, relative transfer function, analog bandwidth, modified noise power ratio, harmonic distortion, common mode, cross talk, timing tag accuracy and timing drift. The Q330M+ provides six channels of 24 bit digitization, all of which may be transmitted utilizing CD1.1 protocol, at multiple sample rates.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

Guralp Affinity Digitizer Evaluation

Sandia National Laboratories has tested and evaluated a new digitizer, the Affinity, manufactured by Guralp Systems. This digitizer is used to record sensor output for seismic and infrasound monitoring applications. The purpose of the digitizer evaluation was to measure the performance characteristics in such areas as sensitivity, power, self-noise, dynamic range, system noise, relative transfer function, modified noise power ratio, analog bandwidth, harmonic distortion, common mode, cross talk, timing tag accuracy and timing drift. The Affinity provides eight, rather the typical six, channels of 24 bit high sample rate digitization, all of which may be transmitted utilizing the CD1.1 protocol, at multiple sample rates.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

Evaluation of Sites for Advanced Reactor Demonstrations at Idaho National Laboratory

The purpose of this siting evaluation is to identify a list of candidate site locations or areas within INL boundaries for onsite demonstration of advanced reactors. A comparison of suitable advanced reactor sites is provided and includes evaluation of existing buildings, previously developed sites, and undeveloped sites across the INL Site.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2020

Comparison of DTRA/NACT Next Generation Digitizer Evaluations

Sandia National Laboratories has tested and evaluated three digitizers, the Affinity, manufactured by Guralp Systems, the Centaur, manufactured by Nanometrics, and the Q330M+, manufactured by Quanterra, a division of Kinemetrics. These digitizers are used to record sensor output for seismic and infrasound monitoring applications. The purpose of this document is to highlight various results and observations collected during comprehensive evaluations conducted on each unit.

42 ENGINEERING↗