Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Performance Evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,423 records · Page 79

Creating Benchmark Data for Artificial Intelligence and Machine Learning Space Biology Research

To identify an appropriate AI/ML approach for a specific problem, the best practice is to measure algorithm performance through the benchmarking process. A scientific benchmark consists of an AI-ready dataset and a reference implementation on a specific scientific question. The NASA Science Mission Directorate (SMD) has started the “Benchmark Initiative for AI/ML to create scientific benchmark datasets in three applications: 1) scientific benchmarking, which finds the best algorithm for a specific problem; 2) application benchmarking, which measures algorithm performance against a set of parameters; and 3) system benchmarking, which evaluates performance of hardware and software architecture. Currently, there are no standardized datasets available to benchmark AI/ML algorithms in the domain of space biology. In this work, we constructed two AI/ML-ready biological datasets from experiments in space-flown mice: cellular imaging and RNA-seq. First, radiation-exposed immune cells harbor DNA damage foci that can be fluorescently marked to visualize the amount of damage following exposure to ionizing radiation. However, such large datasets are difficult to analyze visually, due to imaging inconsistencies and human bias, and classical image processing approaches can fail on imaging artifacts. AI/ML are therefore exciting alternative, providing the speed of machines and the accuracy of humans. We have made this dataset available at https://registry.opendata.aws/bps_microscopy/. Second, high-throughput nucleic acid sequencing (DNA-seq, RNA-seq) has become widespread in biomedical research due to the growing availability and affordability of these assays. However, most sequencing datasets suffer from high dimensionality and low sample count. In this work, we used a generative adversarial network to synthesize a standardized, AI-ready, publicly available benchmark dataset for space biology RNA-seq data with sufficient space-flown and ground control mouse liver samples from NASA GeneLab. This dataset is available at https://registry.opendata.aws/bps_rnaseq/. These datasets are now fully open the Space Biology community to test their favorite AI/ML approaches.

James Casaletto↗

Easy and Enticing: How a Collaborative Approach to Emerging Technology Adoption in the Commercial Building Sector Has Made Its Mark

In 2012, the U.S. Department of Energy (DOE), in collaboration with interested partners (e.g., applicable trade groups), initiated a novel market transformation approach, technology adoption campaigns, to speed the adoption of new technologies that save energy and money in buildings—first with lighting and later with other building technologies. This approach couples technical performance evaluation, guidance, data tracking and technical assistance with recognition for exemplary performance and best practices. Campaigns can be designed around emerging technologies that have significant, cost-effective national energy savings potential and where there is strong public- and private-sector interest in sharing performance criteria and outcomes. Participants in the campaigns share project data with the national laboratories and DOE, benefit from technical support and assistance from objective experts, and highly value recognition for their accomplishments. DOE and its campaign partners benefit from accelerated adoption of new energy-saving technologies and engagement with manufacturers and end users that allows for data collection and insights into technology research needs. This paper documents the success, challenges, lessons learned, and energy and cost savings of lighting campaigns, and in many cases compares these findings with other campaign efforts. This paper also presents recommendations for how other programs of various sizes can employ this model.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Easy and Enticing: How a Collaborative Approach to Emerging Technology Adoption in the Commercial Building Sector Has Made its Mark

In 2012, the U.S. Department of Energy (DOE), in collaboration with interested partners (e.g., applicable trade groups), initiated a novel market transformation approach, technology adoption campaigns, to speed the adoption of new technologies that save energy and money in buildings - first with lighting and later with other building technologies. This approach couples technical performance evaluation, guidance, data tracking and technical assistance with recognition for exemplary performance and best practices. Campaigns can be designed around emerging technologies that have significant, cost-effective national energy savings potential and where there is strong public- and private-sector interest in sharing performance criteria and outcomes. Participants in the campaigns share project data with the national laboratories and DOE, benefit from technical support and assistance from objective experts, and highly value recognition for their accomplishments. DOE and its campaign partners benefit from accelerated adoption of new energy-saving technologies and engagement with manufacturers and end users that allows for data collection and insights into technology research needs. This paper documents the success, challenges, lessons learned, and energy and cost savings of lighting campaigns, and in many cases compares these findings with other campaign efforts. This paper also presents recommendations for how other programs of various sizes can employ this model.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Easy and Enticing: How a Collaborative Approach to Emerging Technology Adoption in the Commercial Building Sector Has Made Its Mark

In 2012, the U.S. Department of Energy (DOE), in collaboration with interested partners (e.g., applicable trade groups), initiated a novel market transformation approach, technology adoption campaigns, to speed the adoption of new technologies that save energy and money in buildings—first with lighting and later with other building technologies. This approach couples technical performance evaluation, guidance, data tracking and technical assistance with recognition for exemplary performance and best practices. Campaigns can be designed around emerging technologies that have significant, cost-effective national energy savings potential and where there is strong public- and private-sector interest in sharing performance criteria and outcomes. Participants in the campaigns share project data with the national laboratories and DOE, benefit from technical support and assistance from objective experts, and highly value recognition for their accomplishments. DOE and its campaign partners benefit from accelerated adoption of new energy-saving technologies and engagement with manufacturers and end users that allows for data collection and insights into technology research needs. This paper documents the success, challenges, lessons learned, and energy and cost savings of lighting campaigns, and in many cases compares these findings with other campaign efforts. This paper also presents recommendations for how other programs of various sizes can employ this model.

Myer, Michael↗

Performance of the active sidewall boundary-layer removal system for the Langley 0.3-meter Transonic Cryogenic Tunnel

A performance evaluation of an active sidewall boundary-layer removal system for the Langley 0.3-m Transonic Cryogenic Tunnel (TCT) was evaluated in 1988. This system uses a compressor and two throttling digital valves to control the boundary-layer mass flow removal from the tunnel. The compressor operates near the maximum pressure ratio for all conditions. The system uses a surge prevention and flow recirculation scheme. A microprocessor based controller is used to provide the necessary mass flow and compressor pressure ratio control. Initial tests on the system indicated problems in realizing smooth mass flow control while running the compressor at high speed and high pressure ratios. An alternate method has been conceived to realize boundary-layer mass flow control which avoids the recirculation of the compressor mass flow and operation near the compressor surge point. This scheme is based on varying the speed of the compressor for a sufficient pressure ratio to provide needed mass flow removal. The system has a mass flow removal capability of about 10 percent of test section flow at M = 0.3 and 4 percent at M = 0.8. The system performance has been evaluated in the form of the compressor map, and compressor tunnel interface characteristics covering most of the 0.3-m TCT operational envelope.

Balakrishna, S.↗

Evaluation of Smart Grid Technologies Employed for System Reliability Improvement: Pacific Northwest Smart Grid Demonstration Experience

The Pacific Northwest Smart Grid Demonstration (PNWSGD) was a smart grid technology performance evaluation project that included multiple U.S. states and cooperation from multiple electric utilities in the northwest region. One of the local objectives for the project was to achieve improved distribution system reliability. Toward this end, some PNWSGD utilities automated their distribution systems, including the application of fault detection, isolation, and restoration and advanced metering infrastructure. In light of this investment, a major challenge was to establish a correlation between implementation of these smart grid technologies and actual improvements of distribution system reliability. This paper proposes using Welch’s t-test to objectively determine and quantify whether distribution system reliability is improving over time. The proposed methodology is generic, and it can be implemented by any utility after calculation of the standard reliability indices. The effectiveness of the proposed hypothesis testing approach is demonstrated through comprehensive practical results. It is believed that wider adoption of the proposed approach can help utilities to evaluate a realistic long-term performance of smart grid technologies.

Agalgaonkar, Yashodhan P. (ORCID:0000000290061848)↗

The 'Brick Wall' radio loss approximation and the performance of strong channel codes for deep space applications at high data rates

In order to evaluate performance of strong channel codes in presence of imperfect carrier phase tracking for residual carrier BPSK modulation in this paper an approximate 'brick wall' model is developed which is independent of the channel code type for high data rates. It is shown that this approximation is reasonably accurate (less than 0.7dB for low FERs for (1784,1/6) code and less than 0.35dB for low FERs for (5920,1/6) code). Based on the approximation's accuracy, it is concluded that the effects of imperfect carrier tracking are more or less independent of the channel code type for strong channel codes. Therefore, the advantage that one strong channel code has over another with perfect carrier tracking translates to nearly the same advantage under imperfect carrier tracking conditions. This will allow the link designers to incorporate projected channel code performance of strong channel codes into their design tables without worrying about their behavior in the face of imperfect carrier phase tracking.

turbo codes↗

Supervisory Control with Dual Tasking in Post G-Transition Vehicle Landings

BACKGROUND Landing during exploration spaceflight may consist of both planned automated supervisory control and unplanned crew override. Supervisory control, particularly when performed under cognitive load with additional monitoring tasks, is essential for ensuring overall mission success during landing contingencies. Evaluating performance in a relevant Human Landing System (HLS) supervisory landing task after long-duration microgravity exposure can help identify potential risks from human error and sensorimotor alterations. Adaptive changes in the sensorimotor system can manifest during g-transitions as spatial disorientation. Although training and landing aids facilitate successful landings despite disorientation, these adaptive changes may heighten cognitive demand, which must be considered in the landing strategy. It is important to characterize these effects as soon as possible following the G-transition while the sensorimotor system remains in a state of adaptive flux to inform appropriate countermeasures. METHODS A Multi-attribute Lunar Table Battery (MALTB) task was developed for an iOS tablet device to provide flexible crew testing and training capabilities in-flight and on the ground. Elements of the tablet task were derived from the Multi-Attribute Task Battery (MATB, Cegarra et al. 2020). The task requires crew members to study a map of a planned landing site and memorizing the terrain and surface landmarks to inform potential divert maneuvers during landing. The user will oversee a series of approaches through touchdown simulations on the tablet with an external camera view of the Lunar surface. The primary responsibility of the crew member will be to execute a divert if the guidance recommended site is erroneous (e.g., the guidance projected landing target is not within 10m of the planned landing site center), or the projected landing site is no longer suitable due to surface obstacles. Considering vehicle maneuverability and fuel reserves, the divert capabilities will diminish as the task progresses. In cases where a divert is initiated, a new landing target will need to be designated by the user and will be evaluated for the proximity to the original pre-planned site. A secondary operational monitoring task will challenge the user's cognitive reserve by requiring the user to maintain several gauges within acceptable limits and respond to a visual indicator while completing the landing approach. Outcome measures include distance from the planned landing site to the user-initiate divert landing location, ground slope at the new landing site, time to divert, the ability to accomplish the secondary monitoring tasks, and perceived workload. The tablet task is being evaluated in a ground-based study to determine the learning effect of first-time users. The tablet task will be utilized in a flight study to test performance multiple times postflight. Future potential testing in-flight have been identified for capsules with iOS tablet devices. Multi-attribute Lunar Table Battery Task MALTB comprises video footage of thirty distinct landing conditions. The landing scenarios feature various landing sites (n = 3), hazardous object sizes (n = 6), sun azimuth degrees (n = 4), camera modes (i.e., fixed or gimbaled), and navigation bias (i.e., true or false). Each seventy second trial uses a sixty-degree constant glideslope trajectory. The application architecture and layout include user identification setup and data storing, a guided walkthrough of the task and interface components, practice mode for task familiarization, and a modified Bedford workload scale administered following task completion. The time-based dependent measures are saved locally to the iOS Files application and post-processing scripts have been developed to evaluate the remaining measures of performance. RELEVANCE This project will deliver an operational demonstration of crew monitoring capability following spaceflight and identify potential deficits that may require remediation. Comparison of individual vestibular and cognitive changes with crew performance will help better characterize the landing risks associated with sensorimotor alterations. ACKNOWLEDGEMENTS: This project is funded by NASA’s Human Research Program Human Health Countermeasures Element. REFERENCES Cegarra J, Valery B, Avril E, Calmettes C, Navarro J (2020) OpenMATB: A Multi-Attribute Task Battery promoting task customization, software extensibility and experiment replicability. Behav Res Methods 52:1980-1990 doi: 10.3758/s13428-020-01364-w

Matthew McDonnell↗

Economic evaluation of DSS 13 unattended operations demonstration

The goals and data collection requirements to be used for the economic and performance evaluation indexes and life cycle cost parameters for the upcoming operations demonstration of an automated Deep Space Station (DSS) run unattended and controlled remotely from JPL are presented. These evaluation indexes compare the remote operation of telemetry at DSS 13 with the cost and performance of a comparable manned operation at DSS 11. A description is presented of the data that needs to be collected, how the data will be analyzed, and what can and cannot be learned from this operations demonstration.

Remer, D. S.↗

AGR-2 safety test predictions using the PARFUME code

This report documents calculations performed to predict failure probability of TRISO-coated fuel particles and diffusion of fission products through these particles during safety tests following the second irradiation test of the Advanced Gas Reactor program (AGR-2). The calculations include the modeling of the AGR-2 irradiation that occurred from June 2010 to October 2013 in the Advanced Test Reactor (ATR) and the modeling of a safety testing phase to support safety tests planned at Oak Ridge National Laboratory and at Idaho National Laboratory (INL) for a selection of AGR-2 compacts. The heat-up of AGR-2 compacts is a critical component of the AGR-2 fuel performance evaluation, and its objectives are to identify the effect of accident test temperature, burnup, and irradiation temperature on the performance of the fuel at elevated temperature. Safety testing of compacts will be followed by detailed examinations of the fuel particles to further evaluate fission product retention and behavior of the kernel and coatings. The modeling was performed using the particle fuel model computer code PARFUME developed at INL. PARFUME is an advanced gas-cooled reactor fuel performance modeling and analysis code (Miller 2009). It has been developed as an integrated mechanistic code that evaluates the thermal, mechanical, and physico-chemical behavior of fuel particles during irradiation to determine the failure probability of a population of fuel particles given the particle-to-particle statistical variations in physical dimensions and material properties that arise from the fuel fabrication process, accounting for all viable mechanisms that can lead to particle failure. The code also determines the diffusion of fission products from the fuel through the particle coating layers, and through the fuel matrix to the coolant boundary. The subsequent release of fission products is calculated at the compact level (release of fission products from the compact). PARFUME calculates the release fraction as the ratio of the number of atoms released from the compact to the amount produced in the compact fuel kernels and through uranium contamination. These safety test predictions aim at giving guidance for the upcoming safety tests to be conducted at ORNL and INL. The AGR-2 compacts modeled in this study belong to the four U.S. capsules of the AGR-2 irradiation test train. For each capsule, the compacts with the lowest and highest burnups were selected to provide a prediction envelope. The objective of this document is to present results of calculations and analyses made by PARFUME on these selected AGR-2 compacts. These results include: • Fuel failure probability • Palladium penetration • Fractional release of fission products Details associated with completion of these calculations are provided in the remainder of this document: the AGR-2 Safety Testing plan is briefly introduced in Section 2, PARFUME modeling is outlined in Section 3, results are described in Section 4, conclusions are given in Section 5, and references are listed in Section 6.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Design and performance of A 3 He-free coincidence counter based on parallel plate boron-lined proportional technology

Thermal neutron counters utilized and developed for deployment as non-destructive assay (NDA) instruments in the field of nuclear safeguards traditionally rely on 3He-based proportional counting systems. 3 He-based proportional counters have provided core NDA detection capabilities for several decades and have proven to be extremely reliable with range of features highly desirable for nuclear facility deployment. Facing the current depletion of 3He gas supply and the continuing uncertainty of options for future resupply, a search for detection technologies that could provide feasible short-term alternative to 3 He gas was initiated worldwide. As part of this effort, Los Alamos National Laboratory (LANL) designed and built a 3 He-free full scale thermal neutron coincidence counter based on boron-lined proportional technology. The boronlined technology was selected in a comprehensive inter-comparison exercise based on its favorable performance against safeguards specific parameters. This paper provides an overview of the design and initial performance evaluation of the prototype High Level Neutron counter – Boron (HLNB). The initial results suggest that current HLNB design is capable to provide ~80% performance of a selected reference 3 He-based coincidence counter (High Level Neutron Coincidence Counter, HLNCC). Similar samples are expected to be measurable in both systems, however, slightly longer measurement times may be anticipated for large samples in HLNB. The initial evaluation helped to identify potential for further performance improvements via additional tailoring of boron-layer thickness.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Advanced propulsion for LEO-Moon transport. 1: A method for evaluating advanced propulsion performance

This report describes a study to evaluate the benefits of advanced propulsion technologies for transporting materials between low Earth orbit and the Moon. A relatively conventional reference transportation system, and several other systems, each of which includes one advanced technology component, are compared in terms of how well they perform a chosen mission objective. The evaluation method is based on a pairwise life-cycle cost comparison of each of the advanced systems with the reference system. Somewhat novel and economically important features of the procedure are the inclusion not only of mass payback ratios based on Earth launch costs, but also of repair and capital acquisition costs, and of adjustments in the latter to reflect the technological maturity of the advanced technologies. The required input information is developed by panels of experts. The overall scope and approach of the study are presented in the introduction. The bulk of the paper describes the evaluation method; the reference system and an advanced transportation system, including a spinning tether in an eccentric Earth orbit, are used to illustrate it.

Stern, Martin O.↗

OpenACC Unified Programming Environment for Multi-hybrid Acceleration with GPU and FPGA

Accelerated computing in HPC such as with GPU, plays a central role in HPC nowadays. However, in some complicated applications with partially different performance behavior is hard to solve with a single type of accelerator where GPU is not the perfect solution in these cases. We are developing a framework and transpiler allowing the users to program the codes with a single notation of OpenACC to be compiled for multi-hybrid accelerators, named MHOAT (Multi-Hybrid OpenACC Translator) for HPC applications. MHOAT parses the original code with directives to identify the target accelerating devices, currently supporting NVIDIA GPU and Intel FPGA, dispatching these specific partial codes to background compilers such as NVIDIA HPC SDK for GPU and OpenARC research compiler for FPGA, then assembles binaries for the final object with FPGA bitstream file. In this paper, we present the concept, design, implementation, and performance evaluation of a practical astrophysics simulation code where we successfully enhanced the performance up to 10 times faster than the GPU-only solution.

Boku, Taisuke↗

Optimal planning and design of a renewable energy based supply system for microgrids

This paper presents a technique for optimal planning and design of hybrid renewable energy systems for microgrid applications. The Distributed Energy Resources Customer Adoption Model (DER-CAM) is used to determine the optimal size and type of distributed energy resources (DERs) and their operating schedules for a sample utility distribution system. Using the DER-CAM results, an evaluation is performed to evaluate the electrical performance of the distribution circuit if the DERs selected by the DER-CAM optimization analyses are incorporated. Results of analyses regarding the economic benefits of utilizing the optimal locations identified for the selected DER within the system are also presented. The actual Brookhaven National Laboratory (BNL) campus electrical network is used as an example to show the effectiveness of this approach. The results show that these technical and economic analyses of hybrid renewable energy systems are essential for the efficient utilization of renewable energy resources for microgird applications.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

The use of artificial neural networks and multiple linear regression to predict rate of medical waste generation

Prediction of the amount of hospital waste production will be helpful in the storage, transportation and disposal of hospital waste management. Based on this fact, two predictor models including artificial neural networks (ANNs) and multiple linear regression (MLR) were applied to predict the rate of medical waste generation totally and in different types of sharp, infectious and general. In this study, a 5-fold cross-validation procedure on a database containing total of 50 hospitals of Fars province (Iran) were used to verify the performance of the models. Three performance measures including MAR, RMSE and R{sup 2} were used to evaluate performance of models. The MLR as a conventional model obtained poor prediction performance measure values. However, MLR distinguished hospital capacity and bed occupancy as more significant parameters. On the other hand, ANNs as a more powerful model, which has not been introduced in predicting rate of medical waste generation, showed high performance measure values, especially 0.99 value of R{sup 2} confirming the good fit of the data. Such satisfactory results could be attributed to the non-linear nature of ANNs in problem solving which provides the opportunity for relating independent variables to dependent ones non-linearly. In conclusion, the obtained results showed that our ANN-based model approach is very promising and may play a useful role in developing a better cost-effective strategy for waste management in future.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Health Insurance Portability and Accountability Act-Compliant Ocular Telehealth Network for the Remote Diagnosis and Management of Diabetic Retinopathy

In this article, we present the design and implementation of a regional ocular telehealth network for remote assessment and management of diabetic retinopathy (DR), including the design requirements, network topology, protocol design, system work flow, graphics user interfaces, and performance evaluation. The Telemedical Retinal Image Analysis and Diagnosis Network is a computer-aided, image analysis telehealth paradigm for the diagnosis of DR and other retinal diseases using fundus images acquired from primary care end users delivering care to underserved patient populations in the mid-South and southeastern United States.

59 BASIC BIOLOGICAL SCIENCES↗

Disposal R&D in the Used Fuel Disposition Campaign: A Discussion of Opportunities for Active International Collaboration

For DOE's Used Fuel Disposition Campaign (UFDC), international collaboration is a beneficial and cost-effective strategy for advancing disposal science with regards to multiple disposal options and different geologic environments. While the United States disposal program focused solely on Yucca Mountain tuff as host rock over the past decades, several international programs have made significant progress in the characterization and performance evaluation of other geologic repository options, most of which are very different from the Yucca Mountain site in design and host rock characteristics. Because Yucca Mountain was so unique (e.g., no backfill, unsaturated densely fractured tuff), areas of direct collaboration with international disposal programs were quite limited during that time. The decision by the U.S. Department of Energy to no longer pursue the disposal of high-level radioactive waste and spent fuel at Yucca Mountain has shifted UFDC's interest to disposal options and geologic environments similar to those being investigated by disposal programs in other nations. Much can be gained by close collaboration with these programs, including access to valuable experience and data collected over recent decades. Such collaboration can help to efficiently achieve UFDC's long-term goals of conducting 'experiments to fill data needs and confirm advanced modeling approaches' (by 2015) and of having a 'robust modeling and experimental basis for evaluation of multiple disposal system options' (by 2020). This report discusses selected opportunities of active international collaboration, with focus on both Natural Barrier System (NBS) and Engineered Barrier System (EBS) aspects and those opportunities that provide access to field data (and respective interpretation/modeling) or allow participation in ongoing field experiments. This discussion serves as a basis for the DOE/NE-53 and UFDC planning process for FY12 and beyond.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗