Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation platform”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Federated benchmarking of medical artificial intelligence with MedPerf

Medical artificial intelligence (AI) has tremendous potential to advance healthcare by supporting and contributing to the evidence-based practice of medicine, personalizing patient treatment, reducing costs, and improving both healthcare provider and patient experience. Unlocking this potential requires systematic, quantitative evaluation of the performance of medical AI models on large-scale, heterogeneous data capturing diverse patient populations. Here, to meet this need, we introduce MedPerf, an open platform for benchmarking AI models in the medical domain. MedPerf focuses on enabling federated evaluation of AI models, by securely distributing them to different facilities, such as healthcare organizations. This process of bringing the model to the data empowers each facility to assess and verify the performance of AI models in an efficient and human-supervised process, while prioritizing privacy. We describe the current challenges healthcare and AI communities face, the need for an open platform, the design philosophy of MedPerf, its current implementation status and real-world deployment, our roadmap and, importantly, the use of MedPerf with multiple international institutions within cloud-based technology and on-premises scenarios. Finally, we welcome new contributions by researchers and organizations to further strengthen MedPerf as an open benchmarking platform.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

Heat pump water heater enhanced with phase change materials thermal energy storage: Modeling study

A promising solution to improve the first hour rating (FHR) of a heat pump water heater (HPWH) involves employing a secondary tank which contains phase change material (PCM) capsules. To better understand the influence of PCM thermal storage on the HPWH operational performance, a dynamic model was developed to simulate and analyze the behavior of a newly developed HPWH technology that incorporates PCM storage into a standard HPWH to optimize key parameters such as the uniform energy factor and FHR. Mathematical models of several key components of the proposed HPWH-PCM integrated thermal energy storage (TES) system, e.g., water heater tank, PCM TES tank, evaporator, compressor, and expansion valve, have been elaborated. Also, a model-based control co-simulation platform was developed to integrate a embed PCM storage HPWH dynamic model with a control model for better supporting control design, analysis, verification, and validation. The model accuracy has been validated through comparing simulation results with lab test results, with a mean average percentage error of <5.5% for most of the selected performance variables. In addition, using the developed co-simulation platform, the demand response control strategy was studied to evaluate the load flexibility of the combined HPWH-PCM storage system by shifting system power usage to outside of the 3.5 h peak load period.

25 ENERGY STORAGE↗
DOE OSTI2022

Prospects and Limitations of Predicting Fuel Ignition Properties from Low-Temperature Speciation Data

Using chemical kinetic modeling and statistical analysis, we investigate the possibility of correlating key chemical “markers”–typically small molecules–formed during very lean (φ ~ 0.001) oxidation experiments with near-stoichiometric (φ ~ 1) fuel ignition properties. One goal of this work is to evaluate the feasibility of designing a fuel-screening platform, based on small laboratory reactors that operate at low temperatures and use minimal fuel volume. Buras et al. [Combust. Flame2020,216, 472–484] have shown that convolutional neural net (CNN) fitting can be used to correlate first-stage ignition delay times (IDTs) with OH/HO2 measurements during very lean oxidation in low-T flow reactors with better than factor-of-2 accuracy. In this work, we test the limits of applying this correlation-based approach to predict the low-temperature heat release (LTHR) and total IDT, including the sensitivity of total IDT to the equivalence ratio, φ. We demonstrate that first-stage IDT can be reliably correlated with very lean oxidation measurements using compressed sensing (CS), which is simpler to implement than CNN fitting. LTHR can also be predicted via CS analysis, although the correlation quality is somewhat lower than for first-stage IDT. In contrast, the accuracy of total IDT prediction at φ = 1 is significantly lower (within a factor of 4 or worse). Furthermore, these results can be rationalized by the fact that the first-stage IDT and LTHR are primarily determined by low-temperature chemistry, whereas total IDT depends on low-, intermediate-, and high-temperature chemistry. Oxidation reactions are most important at low temperatures, and therefore, measurements of universal molecular markers of oxidation do not capture the full chemical complexity required to accurately predict the total IDT even at a single equivalence ratio. As a result, we find that φ-sensitivity of ignition delay cannot be predicted at all using solely correlation with lean low-T chemical speciation measurements.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Platform for Automated Anomaly Detection in the Mercury Process System at the Target System in the Spallation Neutron Source

The Spallation Neutron Source (SNS) at Oak Ridge National Laboratory accelerates proton beams, which are directed toward a mercury target to generate the world’s most intense neutron beams via spallation. The target system consists of several interconnected subsystems and accounts for a major share of the facility’s overall downtime. Early detection of anomalies in the target system response can thus provide the possibility of taking corrective actions to reduce downtime. Accelerator facilities have largely focused on the beam side for data-driven fault prognostics. On the target side, SNS relies on operational shift technicians (OSTs), who respond to alarms and manually flag anomalies onto the System Tracking and Reliability (STAR) platform. This paper presents one of the first studies of using machine learning (ML) to automate anomaly detection in the target system. The study focused on the mercury process system as the first use case and employed reconstruction-based anomaly detection on minutely sampled time series signals. The pipeline was integrated into the STAR platform to autonomously rank and flag anomalies every week. The STAR platform provides a user interface for the OSTs to evaluate the flagged anomalies, thereby incorporating human feedback.

Anomaly detection↗
DOE OSTI2020

Comparison of loads from HAWC2 and OpenFAST for the IEA Wind 15 MW Reference Wind Turbine

Reference wind turbines (RWTs) that reflect the state-of-the-art of current wind energy technology are necessary in order to properly evaluate innovative methods in wind turbine design and evaluation. The International Energy Agency (IEA) Wind Technology Collaboration Platform (TCP) Task 37 has recently developed a new RWT geared towards offshore floating-foundation applications: the IEA Wind 15 MW. The model has been implemented in two aeroelastic codes, OpenFAST and HAWC2, based on an underlying common ontology. However, these toolchains result in slightly different structural parameters, and the two codes utilise different structural models. Thus, to increase the utility of the model, it is necessary to compare the aeroelastic responses. This paper compares aeroelastic loads calculated using different fidelities of the blade model in OpenFAST (ElastoDyn and BeamDyn) and HAWC2 (prismatic Timoshenko without torsion and Timoshenko with fully populated stiffness matrix), where both codes use the DTU Basic controller and the same turbulence boxes to reduce discrepancies. The aeroelastic responses to steady wind, step wind and turbulent wind (per IEC 61400-1 wind class IB) are considered. The results indicate a generally good agreement between the loads dominated by aerodynamic thrust and force, especially for the no-torsion blade models. Discrepancies were observed in other load channels, partially due to differences in the asymmetric loading of the rotor and partially due to differing closed-loop dynamics, and they will be the subject of future investigations.

17 WIND ENERGY↗
DOE OSTI2018

Evaluation of the Inertial Response of Variable-Speed Wind Turbines Using Advanced Simulation

In this paper, we focus on the temporary frequency support effect provided by wind turbine generators (WTGs) through the inertial response. With the implemented inertial control methods, the WTG is capable of increasing its active power output by releasing parts of the stored kinetic energy when the frequency excursion occurs. The active power can be boosted temporarily above the maximum power points, but the rotor speed deceleration follows and an active power output deficiency occurs during the restoration of rotor kinetic energy. We evaluate and compare the inertial response induced by two distinct inertial control methods using advanced simulation. In the first stage, the proposed inertial control methods are analyzed in offline simulation. Using an advanced wind turbine simulation program, FAST with TurbSim, the response of the researched wind turbine is comprehensively evaluated under turbulent wind conditions, and the impact on the turbine mechanical components are assessed. In the second stage, the inertial control is deployed on a real 600kW wind turbine - Controls Advanced Research Turbine, 3-bladed (CART3), which further verifies the inertial control through a hardware-in-the-loop (HIL) simulation. Various inertial control methods can be effectively evaluated based on the proposed two-stage simulation platform, which combines the offline simulation and real-time HIL simulation. The simulation results also provide insights in designing inertial control for WTGs.

17 WIND ENERGY↗
DOE OSTI2024

A Quantum-Classical Collaborative Training Architecture Based on Quantum State Fidelity

Recent advancements have highlighted the limitations of current quantum systems, particularly the restricted number of qubits available on near-term quantum devices. This constraint greatly inhibits the range of applications that can leverage quantum computers. Moreover, as the available qubits increase, the computational complexity grows exponentially, posing additional challenges. Consequently, there is an urgent need to use qubits efficiently and mitigate both present limitations and future complexities. To address this, existing quantum applications attempt to integrate classical and quantum systems in a hybrid framework. In this study, we concentrate on quantum deep learning and introduce a collaborative classical-quantum architecture called co-TenQu. The classical component employs a tensor network for compression and feature extraction, enabling higher-dimensional data to be encoded onto logical quantum circuits with limited qubits. On the quantum side, we propose a quantum-state-fidelity-based evaluation function to iteratively train the network through a feedback loop between the two sides. co-TenQu has been implemented and evaluated with both simulators and the IBM-Q platform. Compared to state-of-the-art approaches, co-TenQu enhances a classical deep neural network by up to 41.72% in a fair setting. Additionally, it outperforms other quantum-based methods by up to 1.9 times and achieves similar accuracy while utilizing 70.59% fewer qubits.

42 ENGINEERING↗
DOE OSTI2017

Refactoring the Genetic Code for Increased Evolvability

ABSTRACT The standard genetic code is robust to mutations during transcription and translation. Point mutations are likely to be synonymous or to preserve the chemical properties of the original amino acid. Saturation mutagenesis experiments suggest that in some cases the best-performing mutant requires replacement of more than a single nucleotide within a codon. These replacements are essentially inaccessible to common error-based laboratory engineering techniques that alter a single nucleotide per mutation event, due to the extreme rarity of adjacent mutations. In this theoretical study, we suggest a radical reordering of the genetic code that maximizes the mutagenic potential of single nucleotide replacements. We explore several possible genetic codes that allow a greater degree of accessibility to the mutational landscape and may result in a hyperevolvable organism that could serve as an ideal platform for directed evolution experiments. We then conclude by evaluating the challenges of constructing such recoded organisms and their potential applications within the field of synthetic biology. IMPORTANCE The conservative nature of the genetic code prevents bioengineers from efficiently accessing the full mutational landscape of a gene via common error-prone methods. Here, we present two computational approaches to generate alternative genetic codes with increased accessibility. These new codes allow mutational transitions to a larger pool of amino acids and with a greater extent of chemical differences, based on a single nucleotide replacement within the codon, thus increasing evolvability both at the single-gene and at the genome levels. Given the widespread use of these techniques for strain and protein improvement, along with more fundamental evolutionary biology questions, the use of recoded organisms that maximize evolvability should significantly improve the efficiency of directed evolution, library generation, and fitness maximization.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Field Testing of a Mixed Potential IoT Sensor Platform for Methane Quantification

Emissions of CH 4 from natural gas infrastructure must urgently be addressed to mitigate its effect on global climate. With hundreds of thousands of miles of pipeline in the US used to transport natural gas, current methods of surveying for leaks are inadequate. Mixed potential sensors are a low cost, field deployable technology for remote and continuous monitoring of natural gas infrastructure. We demonstrate for the first time a field trial of a mixed potential sensor device coupled with machine learning and internet-of-things platform at Colorado State University’s Methane Emissions Technology Evaluation Center (METEC). Emissions were detected from a simulated buried underground pipeline source. Sensor data was acquired and transmitted from the field test site to a remote cloud server. Quantification of concentration as a function of vertical distance is consistent with previously reported transport modelling efforts and experimental surveys of methane emissions by more sophisticated CH 4 analyzers.

03 NATURAL GAS↗
DOE OSTI2025

ACTIVE

The Automated Control Testbed for Integration, Verification, and Emulation (ACTIVE) framework is a software platform designed to support the optimized operation and management of a wide range of building types. It enables the development, testing, and validation of diverse control strategies, including AI-based, rule-based, and model-based approaches. The platform facilitates a seamless transition from simulation-based evaluation of control strategies to real-world field validation and deployment. ACTIVE supports the full building management lifecycle, encompassing data acquisition and management, system monitoring, optimized control, adaptive learning services, device dispatch and coordination, as well as advanced analytics and visualization. Together, these capabilities provide an integrated environment for improving building performance, operational efficiency, reducing energy cost, and reliability.

Smith, Robert [Oak Ridge National Laboratory (ORNL↗
DOE OSTI2024

Offshore Advanced Infrastructure Integrity Model (AIIM) Dashboard

The Advanced Infrastructure Integrity Model (AIIM) is a multivariate, multi-machine learning modeling technology applied to evaluate the integrity of offshore energy infrastructure (e.g., pipelines, platforms) in the U.S Gulf Region. Offshore energy infrastructure plays an essential role in ensuring access to safe and secure energy for the United States. According to the U.S. Energy Information Administration (EIA), production in the U.S. Gulf Region accounts for 15% of total crude and 5% of total natural gas from the United States. Many of these structures have been operating for close to or past their design life, while others have the chance of attrition before return on investment. To better understand the potential for reuse or life extension opportunities, an assessment of the infrastructure integrity is critical to inform safe decision making. Assessing structural integrity, AIIM provides key insights that inform infrastructure use and reuse, as well as hazard prevention planning, in support of stakeholders including researchers and industry.

Advanced Infrastructure Integrity Model↗
DOE OSTI2022

Accomplishments of Thermal Neutron Scattering Research at North Carolina State University [Slides]

Thermal neutron scattering law (TSL) data evaluations have been completed and contributed to ENDF. New evaluations are underway. FLASSH is developing as a modern platform for thermal neutron data analysis featuring an enhanced user experience and low learning overhead. Advanced TSL techniques in combination with Doppler analysis have been developed, which were incorporated into FLASSH. ML/DL NeTS method development has been initiated. Experimental capabilities for validation have been developed at the PULSTAR reactor.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRS1974

Exploration for fossil and nuclear fuels from orbital altitudes

Results from the ERTS program pertinent to exploration for oil, gas, and uranium are discussed. A review of achievements in relevant geological studies from ERTS, and a survey of accomplishments oriented towards exploration for energy sources are presented along with an evaluation of the prospects and limitations of the space platform approach to fuel exploration, and an examination of continuing programs designed to prove out the use of ERTS and other space system in exploring for fuel resources.

Short, N. M.↗
NASA NTRS1975

Water-management models in Florida from ERTS-1 data

The author has identified the following significant results. The usefullness of ERTS 1 to improving the overall effectiveness of collecting and disseminating data was evaluated. ERTS MSS imagery and in situ monitoring by DCS were used to evaluate their separate and combined capabilities. Twenty data collection platforms were established in southern Florida. Water level and rainfall measurements were collected and disseminated to users in less than 2 hours, a significant improvement over conventional techniques requiring 2 months. ERTS imagery was found to significantly enhance the utility of ground measurements. Water stage was correlated with water surface areas from imagery in order to obtain water stage-volume relations. Imagery provided an economical basis for extrapolating water parameters from the point samples to unsampled data and provided a synoptic view of water mass boundaries that no amount of ground sampling or monitoring could provide.

Higer, A. L.↗
NASA NTRS2004

Robust Timing Synchronization in Aeronautical Mobile Communication Systems

This work details a study of robust synchronization schemes suitable for satellite to mobile aeronautical applications. A new scheme, the Modified Sliding Window Synchronizer (MSWS), is devised and compared with existing schemes, including the traditional Early-Late Gate Synchronizer (ELGS), the Gardner Zero-Crossing Detector (GZCD), and the Sliding Window Synchronizer (SWS). Performance of the synchronization schemes is evaluated by a set of metrics that indicate performance in digital communications systems. The metrics are convergence time, mean square phase error (or root mean-square phase error), lowest SNR for locking, initial frequency offset performance, midstream frequency offset performance, and system complexity. The performance of the synchronizers is evaluated by means of Matlab simulation models. A simulation platform is devised to model the satellite to mobile aeronautical channel, consisting of a Quadrature Phase Shift Keying modulator, an additive white Gaussian noise channel, and a demodulator front end. Simulation results show that the MSWS provides the most robust performance at the cost of system complexity. The GZCD provides a good tradeoff between robustness and system complexity for communication systems that require high symbol rates or low overall system costs. The ELGS has a high system complexity despite its average performance. Overall, the SWS, originally designed for multi-carrier systems, performs very poorly in single-carrier communications systems. Table 5.1 in Section 5 provides a ranking of each of the synchronization schemes in terms of the metrics set forth in Section 4.1. Details of comparison are given in Section 5. Based on the results presented in Table 5, it is safe to say that the most robust synchronization scheme examined in this work is the high-sample-rate Modified Sliding Window Synchronizer. A close second is its low-sample-rate cousin. The tradeoff between complexity and lowest mean-square phase error determines the rankings of the Gardner Zero-Crossing Detector and both versions of the Early-Late Gate Synchronizer. The least robust models are the high and low-sample-rate Sliding Window Synchronizers. Consequently, the recommended replacement synchronizer for NASA's Advanced Air Transportation Technologies mobile aeronautical communications system is the high-sample-rate Modified Sliding Window Synchronizer. By incorporating this synchronizer into their system, NASA can be assured that their system will be operational in extremely adverse conditions. The quick convergence time of the MSWS should allow the use of high-level protocols. However, if NASA feels that reduced system complexity is the most important aspect of their replacement synchronizer, the Gardner Zero-Crossing Detector would be the best choice.

Xiong, Fu-Qin↗
NASA NTRS2014

Multi-Mission System Analysis for Planetary Entry (M-SAPE) Version 1

This report describes an integrated system for Multi-mission System Analysis for Planetary Entry (M-SAPE). The system in its current form is capable of performing system analysis and design for an Earth entry vehicle suitable for sample return missions. The system includes geometry, mass sizing, impact analysis, structural analysis, flight mechanics, TPS, and a web portal for user access. The report includes details of M-SAPE modules and provides sample results. Current M-SAPE vehicle design concept is based on Mars sample return (MSR) Earth entry vehicle design, which is driven by minimizing risk associated with sample containment (no parachute and passive aerodynamic stability). By M-SAPE exploiting a common design concept, any sample return mission, particularly MSR, will benefit from significant risk and development cost reductions. The design provides a platform by which technologies and design elements can be evaluated rapidly prior to any costly investment commitment.

Samareh, Jamshid↗
NASA NTRS2018

Mapping Pine Plantations in the Southeastern U.S. Using Structural, Spectral, and Temporal Remote Sensing Data

The southeastern U.S. produces the most industrial roundwood in the U.S. each year, largely from commercial pine plantations. The extent of plantation forests and management dynamics can be difficult to ascertain from periodic forest inventories, yet short-rotation tree plantations also present challenges for remote sensing. Here, we integrated spectral, temporal, and structural information from airborne and satellite platforms to distinguish pine plantations from natural forests and evaluate the contribution from planted forests to regional forest coverin the southeastern U.S. Within flight lines from NASA Goddard's Lidar, Hyperspectral, and Thermal (G-LiHT) Airborne Imager, lidar metrics of forest structure had the highest overall accuracy for pine plantations among single-source classifications (90%), but the combination of spectral and temporal metrics from Landsat generated comparable accuracy (91%). Combined structural, temporal, and spectral information from G-LiHT and Landsat had the highest accuracy for plantations (92%) and natural forests (88%). At a regional scale, classifications using Landsat spectral and temporal metrics had between 74 and 82% mean class accuracy for plantations.Regionally, plantations accounted for 28% of forest cover in the southeastern U.S., a result similar to plot-based estimates, albeit with greater spatial detail. Regional maps of plantation forests differed from existing map products, including the National Land Cover Database. Combining plantation extent in 2011 with Landsat based forest change data identified strong regional gradients in plantation dynamics since 1985, with distinct spatial patterns of rotation age (east-west) and plantation expansion (interior). Our analysis demonstrates the potential to improve the characterization of dynamic land cover classes, including economically important timber plantations, by integrating diverse remote sensing datasets. Critically, multi-source remote sensing provides an approach to leverage periodic forest inventory data for annual monitoring of managed forest landscapes.

Fagan, M. E.↗
NASA NTRS2019

Radiation Tolerance of Nanopore Sequencing Technology for Life Detection on Mars and Europa

The search for life beyond Earth is a key motivator in space exploration. Informational polymers, like DNA and RNA, are key biosignatures for life as we know it. The MinION is a miniature DNA sequencer based on versatile nanopore technology that could be implemented on future planetary missions. A critical unanswered question is whether the MinION and its protein-based nanopores can withstand increased radiation exposure outside Earth’s shielding magnetic field. We evaluated the effects of ionizing radiation on the MinION platform – including flow cells, reagents, and hardware – and discovered limited performance loss when exposed to ionizing doses comparable to a mission to Mars. Targets with harsher radiation environments, like Europa, would require improved radiation resistance via additional shielding or design refinements.

Mark A. Sutton↗