Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation process”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,369 records · Page 76

An Integrated Sustainability Evaluation of Indirect Liquefaction of Biomass to Liquid Fuels

Developing a more sustainable biofuel production process holds the key for displacing fossil fuels with biofuels for sustainable greenhouse gas emissions and natural resource consumption mitigation. A holistic sustainability analysis for the production of biofuel plays a critical role on the improvement of the overall life cycle sustainability. Once a conceptual conversion process is developed, the next step is to evaluate its overall sustainability, preferably based on a process sustainability evaluation methodology using various indicators. The EPA's GREENSCOPE methodology evaluates processes in four areas: environment, energy, economics, and efficiency. The method develops relative scores for indicators that allow comparisons across various technologies. In this study, we have implemented GREENSCOPE methodology for a sustainability performance assessment of NREL's indirect liquefaction of biomass to high-octane gasoline blendstock by evaluating a range of metrics beyond the typical minimum fuel selling price and greenhouse gas considerations. We applied this methodology to evaluate the sustainability performance of this gate-to-gate conceptual design. One outcome of the sustainability evaluation is to allow researchers to identify process areas in need of sustainability improvement, as well as the challenges and opportunities for achieving the best possible sustainability target.

09 BIOMASS FUELS↗

An AI-driven framework for evaluating local and state authorities’ permitting processes

The demand for new energy infrastructure is increasing across the United States, but heterogenous permitting processes and embedded requirements across different local jurisdictions can cause project delays, increase “soft costs,” and hinder developer expansion. This study analyzes the variability in local permitting requirements across the U.S. and develops a quantitative approach to describe their clarity and effectiveness in enabling infrastructure project development. By using an Energy Language Model (ELM), a large language model (LLM) for energy technologies, we systematically gathered permitting information from nearly 300 state-, county-, and city-level documents, creating a structured dataset of requirements and procedures on an unprecedented scale and speed. Our analysis revealed that local (city and county) permitting requirement documents are underrepresented compared to state-level guidance documents, which can impede timely and cost-effective installation of new electric infrastructure. Our validation process showed that the final database has an accuracy of approximately 95%. We, further, created a new quantitative method to score permitting requirements for clarity and efficiency, with electric vehicle supply equipment as an initial use case. The average local permitting document scored a 1.8 out of 5, which we interpret as meaning that half of the requirements developers face when installing electric infrastructure are ambiguous, increasing both cost and time. We also created a “Generalized Permit Process”, highlighting common procedural steps and identifying specific opportunities for municipalities to improve their documentation. This research establishes a systematic and scalable framework for evaluating the complexities of local infrastructure permitting processes by combining LLM-powered data collection and quantitative scoring. The framework enables policymakers and developers to identify and mitigate procedural bottlenecks, with the expectation that these improvements can accelerate application review and approval, reduce project costs, and expedite connection to utility distribution grids. As a foundational approach for streamlining local project development processes, this study’s methods are intended to be extended to a wide range of energy applications.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Optimizing neural networks

A system and method design and optimize neural networks. The system and method include a data store that stores a plurality of gene vectors that represent diverse and distinct neural networks and an evaluation queue stored with the plurality of gene vectors. Secondary nodes construct, train, and evaluate the neural network and automatically render a plurality of fitness values asynchronously. A primary node executes a gene amplification on a select plurality of gene vectors, a crossing-over of the amplified gene vectors, and a mutation of the crossing-over gene vectors automatically and asynchronously, which are then transmitted to the evaluation queue. The process continuously repeats itself by processing the gene vectors inserted into the evaluation queue until a fitness level is reached, a network's accuracy level plateaus, a processing time period expires, or when some stopping condition or performance metric is met or exceeded.

97 MATHEMATICS AND COMPUTING↗

Simulations of 7 Be and 10 Be with the GEOS-Chem global model v14.0.2 using state-of-the-art production rates

The cosmogenic radionuclides 7 Be and 10 Be are useful aerosol tracers for atmospheric transport studies. Combining 7 Be and 10 Be measurements with an atmospheric transport model can not only improve our understanding of the radionuclide transport and deposition processes but also provide an evaluation of the transport process in the model. To simulate these aerosol tracers, it is critical to evaluate the influence of radionuclides production uncertainties on simulations. Here we use the GEOS-Chem chemical transport model driven by the MERRA-2 reanalysis to simulate 7 Be and 10 Be with different production scenarios: the default production rate in GEOS-Chem based on an empirical approach (Lal and Peters, 1967; denoted as LP67), and two production rates from the CRAC:Be (Cosmic Ray Atmospheric Cascade: Beryllium; Poluianov et al., 2016) model considering only geomagnetic cut-off rigidities for a geocentric axial dipole (denoted as P16) or realistic spatial geomagnetic cut-off rigidity variations due to non-dipole moments of the geomagnetic field (denoted as P16spa). The model results are comprehensively evaluated with a large number of measurements including surface air concentrations and deposition fluxes. The model with the P16spa production can reproduce the absolute values and temporal variability of 7 Be and 10 Be surface concentrations and deposition fluxes on annual and sub-annual scales, as well as the vertical profiles of air concentrations. Simulations with the LP67 production tend to overestimate the absolute values of 7 Be and 10 Be concentrations. The P16 simulations suggest less than 10% differences compared to P16spa but tend to produce a significant positive bias (>20%) in the 7 Be deposition fluxes over East Asia. We find that the deposition fluxes are more sensitive to the production in the troposphere and downward transport from the stratosphere. Independent of the production models, surface air concentrations and deposition fluxes from all simulations show similar seasonal variations, suggesting a dominant meteorological influence. The model can also simulate reasonably the stratosphere-troposphere exchange process of 7 Be and 10 Be by producing stratospheric contribution and 10 Be/ 7 Be ratio values that agree with measurements. Finally, we illustrate the importance of including the time-varying solar modulation in the production calculation, which can significantly improve the agreement between model results and measurements, especially at mid- and high- latitudes. Reduced uncertainties in the production rates, as demonstrated in this study, improve the utility of 7 Be and 10 Be as aerosol tracers for evaluating and testing transport and scavenging processes in global models.

Minjie Zheng↗

Seasat measurement system evaluation - Achievements and limitations

The Seasat project, which demonstrated the feasibility of microwave oceanographic remote sensing, was sponsored by the National Aeronautics and Space Administration and managed by the Jet Propulsion Laboratory. The evaluation of the measurement system (elements of the satellite, the sensors, the data handling, and data processing subsystems) was a key activity of the Seasat project. This paper summarizes the primary achievements and highlights the generic limitations of the evaluation process. Other papers in this issue present details of the geophysical evaluation process carried out under the auspices of the Seasat project.

Lame, D. B.↗

Identification of agricultural crops by computer processing of ERTS MSS data

Quantitative evaluation of computer-processed ERTS MSS data classifications has shown that major crop species (corn and soybeans) can be accurately identified. The classifications of satellite data over a 2000 square mile area not only covered more than 100 times the area previously covered using aircraft, but also yielded improved results through the use of temporal and spatial data in addition to the spectral information. Furthermore, training sets could be extended over far larger areas than was ever possible with aircraft scanner data. And, preliminary comparisons of acreage estimates from ERTS data and ground-based systems agreed well. The results demonstrate the potential utility of this technology for obtaining crop production information.

Bauer, M. E.↗

UNREVIEWED DISPOSAL QUESTION EVALUATION: Disposal of the TRU Waste Processing Center Mixed Low Level Waste at the Area 5 Radioactive Waste Management Site, Nevada National Security Site, Nye County, Nevada

This Unreviewed Disposal Question Evaluation (UDQE) assesses whether the U.S. Department of Energy (DOE), National Nuclear Security Administration (NNSA) Transuranic (TRU) Waste Processing Center Mixed Low Level Waste (MLLW), FWORCHMLLW103, Revision 13 [TWPC 2021]), is suitable for shallow land burial (SLB) at the Area 5 Radioactive Waste Management Site (RWMS) on the Nevada National Security Site (NNSS). Disposal of the TRU Waste Processing Center MLLW meets all performance objectives of DOE Manual DOE M 435.1-1, Radioactive Waste Management Manual, Chapter IV, Section P (DOE 1999). The TRU Waste Processing Center MLLW waste stream is recommended for acceptance without conditions.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

A Versatile Simulated Data Transport Layer for in Situ Workflows Performance Evaluation

In situ processing does not only allow scientific applications to face the explosion in data volume and velocity but also to address the time constraints of many simulation-analysis workflows by providing scientists with early insights about their applications at runtime. Multiple frameworks implement the concept of a data transport layer (DTL) to enable such in situ workflows. These tools are very versatile, directly or indirectly access the data generated on the same node, another node of the same compute cluster, or a completely distinct node, and allow data publishers and subscribers to run on the same computing resources or not. This versatility puts on researchers the onus of taking key decisions related to resource allocation and how to transport data to ensure the most efficient execution of their in situ workflows. However, domain scientists and workflow practitioners lack the appropriate tools to assess the respective performance of particular design and deployment options. In this paper we introduce a versatile simulated DTL designed to provide researchers with insights on the respective performance of different execution scenarios of in situ workflows. This open-source, standalone library builds on the SimGrid toolkit and can be linked to any SimGrid-based simulator. It facilitates the evaluation of the performance behavior, at scale, of different data transport configurations and the study of the effects of resource allocation strategies. We demonstrate the scalability, versatility, and accuracy of this simulated DTL by reproducing the execution of two synthetic benchmarks and of a real-world in situ workflow composed of an MPI application and a parallel data analysis. Results of simulations run on a single core show that the proposed library can simulate the interactions of tens of thousands of simulated processes deployed on two interconnected commodity clusters in a few seconds, and the execution by a thousand simulated processes of an in situ workflow in less than three minutes.

Suter, Fred [ORNL] (ORCID:0000000319021955)↗

Evaluation methodologies for an advanced information processing system

The system concept and requirements for an Advanced Information Processing System (AIPS) are briefly described, but the emphasis of this paper is on the evaluation methodologies being developed and utilized in the AIPS program. The evaluation tasks include hardware reliability, maintainability and availability, software reliability, performance, and performability. Hardware RMA and software reliability are addressed with Markov modeling techniques. The performance analysis for AIPS is based on queueing theory. Performability is a measure of merit which combines system reliability and performance measures. The probability laws of the performance measures are obtained from the Markov reliability models. Scalar functions of this law such as the mean and variance provide measures of merit in the AIPS performability evaluations.

Schabowsky, R. S., Jr.↗

Impacts on High-level Systems-of-Systems Figures of Merit due to Integrated Architecture Sizing and Technology Evaluation at the Subsystem-Level

Understanding the impacts on high-level system-of-systems (SOS) figures of merit (FOMs) due to the design of architectures and technologies is critical in providing decision makers sufficient information in selecting suitable alternatives in an effort to reduce costly financial and schedule overruns. Several techniques exist within academia and industry for performing SOS architecture design and technology evaluation. However, these techniques fail to solve the problem in an integrated fashion when defined at the subsystem-level. In order to understand the impacts on high-level SOS FOMs due to integrated architecture sizing and technology evaluation, a general concept exploration process is utilized to perform a notional 2033 manned Mars fly by study. The notional study draws out observation with regard to specific FOMs traditionally used during the subsystem-level sizing and technology evaluation processes which can result in misleading conclusions regarding the overall SOS design. Furthermore, these observations suggest that selection of FOMs for the subsystems of an architecture should be influenced by the desired objectives of the high-level SOS objectives and FOMs.

Trent, Douglas J.↗

Systematic Discrimination of Advanced Hydrogen Production Technologies

The U.S. Department of Energy, in concert with industry, is developing a high-temperature gas-cooled reactor at the Idaho National Laboratory (INL) to demonstrate high temperature heat applications to produce hydrogen and electricity or to support other industrial applications. A key part of this program is the production of hydrogen from water that would significantly reduce carbon emissions compared to current production using natural gas. In 2009 the INL led the methodical evaluation of promising advanced hydrogen production technologies in order to focus future resources on the most viable processes. This paper describes how the evaluation process was systematically planned and executed. As a result, High-Temperature Steam Electrolysis was selected as the most viable near-term technology to deploy as a part of the Next Generation Nuclear Plant Project.

08 HYDROGEN↗

Scalable in situ non-destructive evaluation of additively manufactured components using process monitoring, sensor fusion, and machine learning

Laser Powder Bed Fusion (L-PBF) Additive Manufacturing (AM) is among the metal 3D printing technologies most broadly adopted by the manufacturing industry. However, the current industry qualification paradigm for critical-application L-PBF parts relies heavily on expensive non-destructive inspection techniques, which significantly limits the use-cases of L-PBF. In situ monitoring of the process promises a less expensive alternative to ex situ testing, but existing sensor technologies and data analysis techniques struggle to detect sub-surface flaws (e.g., porosity and cracking) on production-scale L-PBF printers. In this work, an in situ NDE (INDE) system was engineered to detect subsurface flaws detected in X-Ray Computed Tomography (XCT) directly from process monitoring data. A multilayer, multimodal data input allowed the INDE system to detect numerous subsurface flaws in the size range of 200–1000µm using a novel human-in-the-loop annotation procedure. Furthermore, a framework was established for generating probability-of-detection (POD) and probability-of-false-alarm (PFA) curves compliant with NDE standards by systematically comparing instances of detected subsurface flaws to post-build XCT data. Here, we also introduce for the first time in the AM in situ sensing literature the a 90/95 – the flaw size corresponding to a 90% detection rate on the lower 95% confidence interval of the POD curve. The INDE system successfully demonstrated POD capabilities commensurate with traditional NDE methods. Traditional ML performance metrics were also shown to be inadequate for assessing the ability of the INDE system’s flaw detection performance. It is the hope of the authors that future studies will adopt the POD and PFA approach outlined here to provide better insight into the utility of process monitoring for AM.

36 MATERIALS SCIENCE↗

Evaluation of an experimental system for spaceborne processing of multispectral image data

An experimental data processing system has been developed to demonstrate the feasibility of processing high speed, multispectral image data on board the spacecraft. The design incorporates real-time processing with adaptable operation in an expandable architecture. The experimental hardware is coupled to test support and computing equipment to provide a laboratory tool for evaluating and demonstrating each of the processing functions as well as the overall system operation. An evaluation of the high speed processor was conducted to ensure that the desired system throughput was achieved without sacrificing processing accuracy. A description of the system is presented along with the results of the test and evaluation activity.

Meredith, B. D.↗

Bayesian Treed Multivariate Gaussian Process with Adaptive Design: Application to a Carbon Capture Unit

Computer experiments (numerical simulations) are widely used in scientific research to study and predict the behavior of complex systems, which usually have responses consisting of a set of distinct outputs. The computational cost of the simulations at high resolution are often expensive and become impractical for parametric studies at different input values. To overcome these difficulties we develop a Bayesian treed multivariate Gaussian process (BTMGP) as an extension of the Bayesian treed Gaussian process (BTGP) in order to model and evaluate a multivariate process. A suitable choice of covariance function and the prior distributions facilitates the different Markov chain Monte Carlo (MCMC) movements. We utilize this model to sequentially sample the input space for the most informative values, taking into account model uncertainty and expertise gained. A simulation study demonstrates the use of the proposed method and compares it with alternative approaches. We apply the sequential sampling technique and BTMGP to model the multiphase flow in a full scale regenerator of a carbon capture unit. The application presented in this paper is an important tool for research into carbon dioxide emissions from thermal power plants.

Konomi, Bledar A.↗

Unresolved resonance region cross section measurements and validation [Slides]

This presentation discusses the ENDF format and its implication for experimental data. The effect of self-shielding on measured cross sections some call this effect transmission enhancement (to be explained). Additionally discussed: from experiment to evaluation. And finally, Processing “high energy resolution” transmission for URR evaluation.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

KSC Shuttle ground turnaround evaluation

Payload/mission development, processing flows, facilities/systems, and the various environments to which a payload is exposed during ground processing are described. These considerations are important for payload design and ground processing requirements development.

Ragusa, J. M.↗

Development of metallization process

Pastes are evaluated that contain additives to aid in the silicon to metallization contact. None are completely successful. Pastes are evaluated using a heated stage scanning electron microscope (SEM). This equipment shows promise for future evaluations.

Garcia, A., III↗