Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “program evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,657 records · Page 92

The Off-Site Plowshare and Vela Uniform Programs: Assessing Potential Environmental Liabilities through an Examination of Proposed Nuclear Projects, High Explosive Experiments, and High Explosive Construction Activities: Volume 1 of 3

This document presents the results of nearly six years (2002-2008) of historical research and field studies concerned with evaluating potential environmental liabilities associated with U.S. Atomic Energy Commission projects from the Plowshare and Vela Uniform Programs. The Plowshare Program's primary purpose was to develop peaceful uses for nuclear explosives. The Vela Uniform Program focused on improving the capability of detecting, monitoring and identifying underground nuclear detonations. As a result of the Project Chariot site restoration efforts in the early 1990s, there were concerns that there might be other project locations with potential environmental liabilities. The Desert Research Institute conducted archival research to identify projects, an analysis of project field activities, and completed field studies at locations where substantial fieldwork had been undertaken for the projects. Although the Plowshare and Vela Uniform nuclear projects are well known, the projects that are included in this research are relatively unknown. They are proposed nuclear projects that were not executed, proposed and executed high explosive experiments, and proposed and executed high explosive construction activities off the Nevada Test Site. The research identified 170 Plowshare and Vela Uniform off-site projects and many of these had little or no field activity associated with them. However, there were 27 projects that merited further investigation and field studies were conducted at 15 locations.

(2002-2008)↗

The Off-Site Plowshare and Vela Uniform Programs: Assessing Potential Environmental Liabilities through an Examination of Proposed Nuclear Projects, High Explosive Experiments, and High Explosive Construction Activities: Volume 2 of 3

This document presents the results of nearly six years (2002-2008) of historical research and field studies concerned with evaluating potential environmental liabilities associated with U.S. Atomic Energy Commission projects from the Plowshare and Vela Uniform Programs. The Plowshare Program's primary purpose was to develop peaceful uses for nuclear explosives. The Vela Uniform Program focused on improving the capability of detecting, monitoring and identifying underground nuclear detonations. As a result of the Project Chariot site restoration efforts in the early 1990s, there were concerns that there might be other project locations with potential environmental liabilities. The Desert Research Institute conducted archival research to identify projects, an analysis of project field activities, and completed field studies at locations where substantial fieldwork had been undertaken for the projects. Although the Plowshare and Vela Uniform nuclear projects are well known, the projects that are included in this research are relatively unknown. They are proposed nuclear projects that were not executed, proposed and executed high explosive experiments, and proposed and executed high explosive construction activities off the Nevada Test Site. The research identified 170 Plowshare and Vela Uniform off-site projects and many of these had little or no field activity associated with them. However, there were 27 projects that merited further investigation and field studies were conducted at 15 locations.

(2002-2008)↗

The Off-Site Plowshare and Vela Uniform Programs: Assessing Potential Environmental Liabilities through an Examination of Proposed Nuclear Projects, High Explosive Experiments, and High Explosive Construction Activities: Volume 3 of 3

This document presents the results of nearly six years (2002-2008) of historical research and field studies concerned with evaluating potential environmental liabilities associated with U.S. Atomic Energy Commission projects from the Plowshare and Vela Uniform Programs. The Plowshare Program's primary purpose was to develop peaceful uses for nuclear explosives. The Vela Uniform Program focused on improving the capability of detecting, monitoring and identifying underground nuclear detonations. As a result of the Project Chariot site restoration efforts in the early 1990s, there were concerns that there might be other project locations with potential environmental liabilities. The Desert Research Institute conducted archival research to identify projects, an analysis of project field activities, and completed field studies at locations where substantial fieldwork had been undertaken for the projects. Although the Plowshare and Vela Uniform nuclear projects are well known, the projects that are included in this research are relatively unknown. They are proposed nuclear projects that were not executed, proposed and executed high explosive experiments, and proposed and executed high explosive construction activities off the Nevada Test Site. The research identified 170 Plowshare and Vela Uniform off-site projects and many of these had little or no field activity associated with them. However, there were 27 projects that merited further investigation and field studies were conducted at 15 locations.

(2002-2008)↗

pystorms: A simulation sandbox for the development and evaluation of stormwater control algorithms

Advances in cyber–physical technologies have enabled real-time sensing and adaptive control of stormwater infrastructure. These smart stormwater systems allow for inexpensive, minimally-invasive stormwater control interventions in lieu of new construction. Importantly, however promising the area of smart stormwater control, there still remain barriers – for experts and novices alike – to access shared tools and methods for investigating, developing, and contributing to it. In an effort to make smart stormwater control research more methodical and accessible, we present pystorms, an open-source Python-based simulation sandbox that facilitates the quantitative evaluation and comparison of control strategies. pystorms consists of a collection of real world-inspired smart stormwater control scenarios on which any number of control strategies can be applied and tested via an accompanying Python programming interface and coupled stormwater simulator. pystorms provides a framework for the rigorous and efficient evaluation of smart stormwater control methodologies across diverse watersheds with only a few lines of code.

54 ENVIRONMENTAL SCIENCES↗

China Green Low-Carbon City Index

The main purpose of the new China Green Low-Carbon City Index (CGLCI, or City Index) is to evaluate the status of green and low-carbon development for a large number of Chinese cities. Chinese cities are formulating plans and implementing programs to address national initiatives, especially the national low-carbon pilot program for 36 cities and six provinces. However, there is not yet an established framework for measuring, reporting, or evaluating low-carbon progress across Chinese cities, despite the development of a number of Chinese and international city indicator systems. The new China City Index highlights energy use and carbon emissions of Chinese cities, along with environmental and socio-economic indicators. We selected metrics (indicators) that have data available in China’s statistical system, are commonly used internationally, and reflect Chinese policy goals. We then benchmarked and ranked Chinese cities in terms of their status and progress, identified potential areas for improvement, and identified top-runners.

54 ENVIRONMENTAL SCIENCES↗

A report documenting the completion of the Los Alamos National Laboratory portion of the ASC level II milestone ""Visualization on the supercomputing platform

This report provides documentation for the completion of the Los Alamos portion of the ASC Level II 'Visualization on the Supercomputing Platform' milestone. This ASC Level II milestone is a joint milestone between Sandia National Laboratory and Los Alamos National Laboratory. The milestone text is shown in Figure 1 with the Los Alamos portions highlighted in boldfaced text. Visualization and analysis of petascale data is limited by several factors which must be addressed as ACES delivers the Cielo platform. Two primary difficulties are: (1) Performance of interactive rendering, which is the most computationally intensive portion of the visualization process. For terascale platforms, commodity clusters with graphics processors (GPUs) have been used for interactive rendering. For petascale platforms, visualization and rendering may be able to run efficiently on the supercomputer platform itself. (2) I/O bandwidth, which limits how much information can be written to disk. If we simply analyze the sparse information that is saved to disk we miss the opportunity to analyze the rich information produced every timestep by the simulation. For the first issue, we are pursuing in-situ analysis, in which simulations are coupled directly with analysis libraries at runtime. This milestone will evaluate the visualization and rendering performance of current and next generation supercomputers in contrast to GPU-based visualization clusters, and evaluate the perfromance of common analysis libraries coupled with the simulation that analyze and write data to disk during a running simulation. This milestone will explore, evaluate and advance the maturity level of these technologies and their applicability to problems of interest to the ASC program. In conclusion, we improved CPU-based rendering performance by a a factor of 2-10 times on our tests. In addition, we evaluated CPU and CPU-based rendering performance. We encourage production visualization experts to consider using CPU-based rendering solutions when it is appropriate. For example, on remote supercomputers CPU-based rendering can offer a means of viewing data without having to offload the data or geometry onto a CPU-based visualization system. In terms of comparative performance of the CPU and CPU we believe that further optimizations of the performance of both CPU or CPU-based rendering are possible. The simulation community is currently confronting this reality as they work to port their simulations to different hardware architectures. What is interesting about CPU rendering of massive datasets is that for part two decades CPU performance has significantly outperformed CPU-based systems. Based on our advancements, evaluations and explorations we believe that CPU-based rendering has returned as one viable option for the visualization of massive datasets.

97 MATHEMATICS AND COMPUTING↗

HEU Systems at Low Temperatures [Slides]

This project is sponsored by the Nuclear Criticality Safety Program (NCSP) in collaboration with Lawrence Livermore National Laboratory (LLNL) with a novel interest surrounding the transportation of fissile material: there is a concern regarding the inadvertent introduction of the material in a low-temperature environment. The low-temperature environment will be bounded down to temperatures not below -40 ºC, since this is the limit allotted for packages containing general radioactive material exposed to air. Eventually, the goal of the project is to conduct experiments spanning multiple fission energies at these low temperatures, concluding in an International Criticality Safety Benchmark Evaluation Project (ICSBEP) benchmark.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

From Theory to Practice: Lessons Learned from an Advanced M&V Commercial Pilot

Advanced measurement & verification (M&V), or M&V 2.0, is an energy data analysis method using advanced metering infrastructure (AMI) data in combination with analytics to quantify energy efficiency project savings. Advanced M&V is viewed as an enabler for underutilized behavioral, retrocommissioning, and holistic multi-measure efficiency efforts, as quantifying savings for these programs with existing methods has typically been very challenging. Despite its promise, there are still several unanswered questions about the use of advanced M&V such as: How accurately can these tools quantify energy savings? How can advanced M&V satisfy regulatory requirements for rigorous savings estimates? Where and how does advanced M&V intersect with traditional impact evaluation and the principles of ‘embedded’ evaluation, measurement & verification (EM&V)? Pilots are being pursued in various regions and program contexts to address these research questions. However, results from these pilots are rarely made public, meaning that lessons may not be widely shared and the scope of analyses varies widely. The paper presents encouraging results from a recent advanced M&V pilot and discusses key process-related aspects such as managing AMI data and refining analysis methodologies. An approach to reviewing and classifying projects based on savings characteristics and magnitude is demonstrated, as a potential risk management tool. The authors also demonstrate how advanced M&V can identify underperforming projects and non-routine events in a timely manner. The paper also outlines lessons learned from this and other recent pilot activity and barriers to be overcome in moving toward the goal of widespread adoption of holistic meter-based programs.

Crowe, Eliot↗

A quality assurance framework for the fully automated and objective evaluation of image quality in cone-beam computed tomography

Purpose: Thousands of cone-beam computed tomography (CBCT) scanners for vascular, maxillofacial, neurological, and body imaging are in clinical use today, but there is no consensus on uniform acceptance and constancy testing for image quality (IQ) and dose yet. The authors developed a quality assurance (QA) framework for fully automated and time-efficient performance evaluation of these systems. In addition, the dependence of objective Fourier-based IQ metrics on direction and position in 3D volumes was investigated for CBCT. Methods: The authors designed a dedicated QA phantom 10 cm in length consisting of five compartments, each with a diameter of 10 cm, and an optional extension ring 16 cm in diameter. A homogeneous section of water-equivalent material allows measuring CT value accuracy, image noise and uniformity, and multidimensional global and local noise power spectra (NPS). For the quantitative determination of 3D high-contrast spatial resolution, the modulation transfer function (MTF) of centrally and peripherally positioned aluminum spheres was computed from edge profiles. Additional in-plane and axial resolution patterns were used to assess resolution qualitatively. The characterization of low-contrast detectability as well as CT value linearity and artifact behavior was tested by utilizing sections with soft-tissue-equivalent and metallic inserts. For an automated QA procedure, a phantom detection algorithm was implemented. All tests used in the dedicated QA program were initially verified in simulation studies and experimentally confirmed on a clinical dental CBCT system. Results: The automated IQ evaluation of volume data sets of the dental CBCT system was achieved with the proposed phantom requiring only one scan for the determination of all desired parameters. Typically, less than 5 min were needed for phantom set-up, scanning, and data analysis. Quantitative evaluation of system performance over time by comparison to previous examinations was also verified. The maximum percentage interscan variation of repeated measurements was less than 4% and 1.7% on average for all investigated quality criteria. The NPS-based image noise differed by less than 5% from the conventional standard deviation approach and spatially selective 10% MTF values were well comparable to subjective results obtained with 3D resolution pattern. Determining only transverse spatial resolution and global noise behavior in the central field of measurement turned out to be insufficient. Conclusions: The proposed framework transfers QA routines employed in conventional CT in an advanced version to CBCT for fully automated and time-efficient evaluation of technical equipment. With the modular phantom design, a routine as well as an expert version for assessing IQ is provided. The QA program can be used for arbitrary CT units to evaluate 3D imaging characteristics automatically.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Quantification of the 35 Cl($\textit{n, p}$) reaction channel

The evaluated 35 Cl($\textit{n, p}$) cross sections in the ENDF/B-VIII.0 nuclear data library remain uncertain because of the lack of measured data in the neutron energy range between 100-600 keV. In this energy region, the R-matrix analysis relies heavily on estimated ($\textit{n, p}$) partial widths and level density information. This resulted in significant differences of the evaluated cross sections and predicted reactivity in nuclear reactor applications with respect to previous nuclear data libraries. Here, we present a methodology to quantify the cross sections for the 35 Cl($\textit{n, p}$) reaction channel from the combination of measured total cross sections and model calculations.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Automated Reconstruction of Control Logic for Programmable Logic Controller Forensics

This paper presents Similo, an automated scalable framework for control logic forensics in industrial control systems. Similo is designed to investigate denial of engineering operations (DEO) attacks, recently demonstrated to hide malicious control logic in a programmable logic controller (PLC) at field sites from an engineering software (at control center). The network traffic (if captured) contains substantial evidence to investigate DEO attacks including manipulation of control logic. Laddis, a state-of-the-art forensic approach for DEO attacks, is a binary-logic decompiler for the Allen-Bradley’s RSLogix engineering software and MicroLogix 1400 PLC. It is developed with extensive manual reverse engineering effort of the underlying proprietary network protocol and the binary control logic. Unfortunately, Laddis is not scalable and requires similar efforts to extend on other engineering software/PLCs. The proposed solution, Similo, is based on the observation that engineering software of different vendors are equipped with decompilers. Similo is a virtual-PLC framework that integrates the decompilers with their respective (previously-captured) ICS network traffic of control logic. It recovers the binary logic into a high-level source code (of the programming languages defined by IEC 61131-3 standard) automatically. Similo can work with both proprietary/open protocols without requiring protocol specifications and the binary formats of control logic. Thus, it is scalable to different ICS vendors. We evaluate Similo on three PLCs of two ICS vendors, i.e. MicroLogix 1400, MicroLogix 1100, and Modicon M221. These PLCs support proprietary protocols and the control logics written in two programming languages: Ladder Logic and Instruction List. The evaluation results show that Similo can accurately reconstruct a control logic from an ICS network traffic and can be used to investigate the DEO attacks effectively.

Ali qasim, Syed↗

Optimal sizing of battery energy storage systems for peak shaving and demand response using a degradation-aware Bayesian Optimization-Mixed-Integer Linear Programming framework

The increasing integration of renewable energy and rising electricity demand highlight the importance of battery energy storage systems for peak shaving and demand response. Unlike prior approaches that overlook operational impacts on degradation, this study proposes a Bayesian Optimization–Mixed Integer Linear Programming framework for optimal battery energy storage system sizing. In this framework, Mixed Integer Linear Programming determines short-term scheduling while a calibrated electrochemical model iteratively evaluates degradation. The central hypothesis is that the framework can efficiently identify optimal sizes that yield realistic and economically robust outcomes. The method is tested across three scenarios: peak shaving, peak shaving with energy-reduction demand response, and peak shaving with power-reduction demand response. Results show that the framework converge to the optimum within 20 iterations out of 150 possible sizes. Under baseline conditions, the framework consistently selects the smallest feasible system, minimizing unnecessary degradation costs from oversized storage. Sensitivity analyses reveal that larger systems are favored as demand rates or incentives increase. Comparisons of demand response programs indicate that power-reduction demand response offers greater economic benefits than energy-reduction demand response, although demand savings from peak shaving remain the dominant contributor to overall performance. This study demonstrates that the proposed framework balances computational tractability with degradation fidelity, identifies critical economic thresholds for investment, and offers a practical, flexible tool to guide industrial stakeholders in cost-effective battery energy storage system deployment.

Batteries↗

Evaluation & Development of Algorithms & Techniques for Streaming Detector Readout

The advancement in microelectronics capabilities, computing, and data science in the last decade has been remarkable. With the start of the 12 GeV Science Program at Jefferson Lab (JLab) and the conceptual detector design for the upcoming Ion Collider (EIC) in mind, we have evaluated and developed the possibility of evolving and improving the existing nuclear science research workflow based on these advances. Specifically, we have prototyped components of streaming readout.

43 PARTICLE ACCELERATORS↗

A decision analysis framework to support long-term planning for nuclear fuel cycle technology research, development, demonstration and deployment

To address challenges and gaps in nuclear fuel cycle option assessment and to support research, develop and demonstration programs oriented toward commercial deployment, EPRI (Electric Power Research Institute) is seeking to develop and maintain an independent analysis and assessment capability by building a suite of assessment tools based on a platform of software, simplified relationships, and explicit decision-making and evaluation guidelines. As a demonstration of the decision-support framework, EPRI examines a relatively near-term fuel cycle option, i.e., use of reactor-grade mixed-oxide fuel (MOX) in U.S. light water reactors. The results appear as a list of significant concerns (like cooling of spent fuels, criticality risk...) that have to be taken into account for the final decision.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Thermal Neutron Scattering Law Evaluations for Zirconium Carbide and Critical Mass Calculations [Slides]

Zirconium Carbide (ZrC) is a refractory material currently being investigated for high temperature reactor applications. ZrC was studied as a base of (U,Zr)C solid solution and UC 2 composite fuels for NERVA-type cores during the Rover program. Testing of the material was performed at Nuclear Furnace 1 (NF-1) located at Los Alamos. Thermal Scattering Law (TSL) evaluations generated with FLASSH are a new contribution to ENDF/B-VIII.1.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

WE-H-BRC-02: Failure Mode and Effect Analysis of Liver Stereotactic Body Radiotherapy

Purpose: To identify areas of improvement in our liver stereotactic body radiation therapy (SBRT) program, using failure mode and effect analysis (FMEA). Methods: A multidisciplinary group consisting of one physician, three physicists, one dosimetrist and two therapists was formed. A process map covering 10 major stages of the liver SBRT program from the initial diagnosis to post treatment follow-up was generated. A total of 102 failure modes, together with their causes and effects, were identified. The occurrence (O), severity (S) and lack of detectability (D) were independently scored. The ranking was done using the risk probability number (RPN) defined as the product of average O, S and D numbers for each mode. The scores were normalized to remove inter-observer variability, while preserving individual ranking order. Further, a correlation analysis on the overall agreement on rank order of all failure modes resulted in positive values for successive pairs of evaluators. The failure modes with the highest RPN value were considered for further investigation. Results: The average normalized RPN values for all modes were 39 with a range of 9 to 103. The FMEA analysis resulted in the identification of the top 10 critical failures modes as: Incorrect CT-MR registration, MR scan not performed in treatment position, patient movement between CBCT acquisition and treatment, daily IGRT QA not verified, incorrect or incomplete ITV delineation, OAR contours not verified, inaccurate normal liver effective dose (Veff) calculation, failure of bolus tracking for 4D CT scan, setup instructions not followed for treatment and plan evaluation metrics missed. Conclusion: The application of FMEA to our liver SBRT program led to the identification and possible improvement of areas affecting patient safety.

60 APPLIED LIFE SCIENCES↗

Post-closure program streamlining at the Nevada national security site - 15290

More than 200 sites on the Nevada National Security Site (NNSS), Nevada Test and Training Range (NTTR), and Tonopah Test Range (TTR) have been closed in place. At these sites, contamination has been left in place, and protection of human health, safety, and the environment is ensured through the establishment of use restrictions (URs). Post-closure requirements were initially established in the Closure Report (CR) for each site and include a variety of inspection, monitoring, maintenance, and reporting commitments. Post-closure requirements and site controls (fences, monuments, soil covers, and postings) may vary depending on site location, accessibility, land use scenario, and the nature of contaminants left in place. Corrective Action Sites (CASs) on the NNSS, NTTR, and TTR have been identified for closure under the Federal Facility Agreement and Consent Order (FFACO), which was signed in 1996. Over 1,900 CASs have been closed under the framework of the FFACO, and more than 200 of those have URs. Many post-closure requirements have been modified over time. In addition, because the scope of the program has spanned almost 20 years, the post-closure requirements have varied due to changing strategies and expectations. Because of the number of sites closed over the course of the program, post-closure requirements are found in hundreds of closure documents, addendums, errata sheets, Records of Technical Change, inspection reports, permit modifications, and correspondence. Furthermore, resources such as personnel and funding necessary to conduct the post-closure program have diminished, while computer capabilities and configuration control principles have improved since closure activities under the FFACO began. Because of these factors, to effectively manage the post-closure program, ensure that all commitments are being met, and improve the ease of identifying the most current post-closure requirements for each UR, the current requirements for every use-restricted site under the purview of the U.S. Department of Energy, National Nuclear Security Administration Nevada Field Office will be consolidated into a single Post-Closure Plan. The Consolidated Post-Closure Plan will also outline a strategy and present possible criteria that may be used for future evaluation of post-closure requirements. Continual assessment of the post-closure program will ensure that the post-closure requirements for URs across the NNSS, NTTR, and TTR are consistently justifiable and sufficient to protect site workers, the public, and the environment while increasing efficiency. Future changes to post-closure requirements and justification for those changes will be recorded in revisions to the Consolidated Post-Closure Plan. This process will provide a comprehensive, consistent, and streamlined method for evaluation of post-closure requirements and implementation of changes. (authors)

54 ENVIRONMENTAL SCIENCES↗