Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation platform”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,063 records · Page 59

Performance and Reliability Assessment of the U.S. Department of Energy Atmospheric Radiation Measurement (ARM) Data Advisor (ADA)

The Atmospheric Radiation Measurement (ARM) User Facility provides one of the world's largest openly accessible repositories of atmospheric observations through the ARM Data Discovery platform. Although the repository contains more than three decades of measurements collected from permanent observatories, mobile facilities, aircraft campaigns, and field experiments, identifying appropriate datasets can be challenging, particularly for new users unfamiliar with ARM instrumentation and datastream organization. To improve data accessibility, the ARM Data Center developed the ARM Data Advisor (ADA), an artificial intelligence-powered assistant designed to facilitate scientific data discovery, dataset interpretation, and user guidance. This report evaluates ADA's performance as a domain-specific scientific assistant using realistic atmospheric science workflows. The evaluation examines five key capabilities: data retrieval and curation efficiency, hallucination resistance, scientific reasoning, response to ambiguous queries, and content retention and session continuity. Representative prompts were developed to simulate typical interactions between researchers and the ARM Data Discovery platform, and ADA's responses were assessed for retrieval completeness, scientific accuracy, consistency, and practical usefulness. In these representative tests, ADA reduced the complexity of discovering and accessing ARM datasets by recommending appropriate datastreams, explaining instrumentation, interpreting metadata, and assisting with data processing workflows. ADA also exhibits strong domain knowledge of atmospheric science terminology and generally resists hallucination by acknowledging unavailable datasets and requesting clarification when appropriate. Overall, the results indicate that ADA represents a promising advancement in scientific data discovery within the ARM User Facility and has considerable potential to improve researcher productivity, particularly for new users and interdisciplinary scientists seeking efficient access to ARM observations.

Salvador, Christian [ORNL] (ORCID:0000000283287777↗

Rapid Assessment of In Situ Wheat Straw Residue Via Remote Sensing Platforms

Crop residues influence near surface soil organic carbon content (SOC), impact our ability to remotely assess soil properties, and play a role in global carbon budgets. Methods that measure crop residues are laborious, and largely inappropriate for regional estimates. The objective of this study was to evaluate remote sensing (RS) data for rapid quantification of residue cover. In March 2000 and April 2001, residue plots (15 m x 15 m) were established in the Coastal Plain and Appalachian Plateau physiographic regions of Alabama. Treatments consisted of five wheat (Triticum aestivum L.) straw cover rates (0, 10, 20, 50, and 80%) replicated 3 times. Soil water content and residue decomposition were monitored. Spectral measurements were acquired via spectroradiometer (350 - 1050 nm), Airborne Terrestrial Applications Sensor (ATLAS) (400 - 12,500 nm), airborne color photography (400 - 600 nm), and IKONOS satellite (450 - 900 nm). Spectroradiometer data were acquired monthly, aircraft images yearly, and satellite per availability. Results showed all platforms successfully estimated residue cover variability using red, near infrared (NIR) and thermal infrared (TIR) regions of the spectrum. Airborne ATLAS imagery was best explaining as much as 98% of the variability in wheat straw cover. Spectroradiometer, color infrared photography, and IKONOS imagery accounted for 84, 56, and 24% of the variability, respectively.

Sullivan, D. G.↗

Cyber-Power Co-Simulation for End-to-End Synchrophasor Network Analysis and Applications

The resiliency, reliability and security of the next generation cyber-power smart grid depend upon efficiently leveraging advanced communication and computing technologies. Also, developing real-time data-driven applications is critical to enable wide-area monitoring and control of the cyber-power grid given high-resolution data from Phasor Measurement Units (PMUs). North American Synchrophasor Initiative Network (NASPlnet) provides guidance for PMU data exchanges. With the advancement in networking and grid operation, it is necessary to evaluate the performance of different data flow architectures suggested by NASPInet and analyze the impact on applications. Therefore, we need a cyber-power co-simulation framework that supports very large-scale co-simulation capable of running in parallel, high-performance computing platforms and capturing real-life network behavior. This work presents an end-to-end automated and user-driven cyber-power co-simulation using NS3 to model communication networks, GridPACK to model the power grid, and HELICS as a co-simulation engine. Comparative analysis of latency in synchrophasor networks and a performance evaluation of a power system stabilizer application utilizing PMU data in an IEEE 39 bus test system is presented using this cosimulation testbed.

Mustafa, Hussain M.↗

A Comprehensive eVTOL Performance Evaluation Framework in Urban Air Mobility

In this paper, we developed an open-source simulation framework for the evaluation of electric vertical takeoff and landing vehicles (eVTOLs) in the context of Unmanned Traffic Management (UTM) and under the concept of Urban Air Mobility (UAM). Unlike most existing studies, the proposed framework combines the utilization of UTM and eVTOLs to develop a realistic UAM testing platform. For this purpose, we first develop an UTM simulator to simulate the real-world UAM environment. Then, instead of using a simplified eVOTL model, a high-fidelity eVTOL design tool, namely SUAVE, is employed and an dilation sub-module is introduced to bridge the gap between the UTM simulator and SUAVE eVTOL performance evaluation tool to elaborate the complete mission profile. Based on the developed simulation framework, experiments are conducted and the results are presented to analyze the performance of eVTOLs in the UAM environment.

Mrinmoy Sarkar↗

Experimental study of trajectory planning and control of a high precision robot manipulator

The kinematic and trajectory planning is presented for a 6 DOF end-effector whose design was based on the Stewart Platform mechanism. The end-effector was used as a testbed for studying robotic assembly of NASA hardware with passive compliance. Vector analysis was employed to derive a closed-form solution for the end-effector inverse kinematic transformation. A computationally efficient numerical solution was obtained for the end-effector forward kinematic transformation using Newton-Raphson method. Three trajectory planning schemes, two for fine motion and one for gross motion, were developed for the end-effector. Experiments conducted to evaluate the performance of the trajectory planning schemes showed excellent tracking quality with minimal errors. Current activities focus on implementing the developed trajectory planning schemes on mating and demating space-rated connectors and using the compliant platform to acquire forces/torques applied on the end-effector during the assembly task.

Nguyen, Charles C.↗

New Orthophoto Generation Strategies from UAV and Ground Remote Sensing Platforms for High-Throughput Phenotyping

Remote sensing platforms have become an effective data acquisition tool for digital agriculture. Imaging sensors onboard unmanned aerial vehicles (UAVs) and tractors are providing unprecedented high-geometric-resolution data for several crop phenotyping activities (e.g., canopy cover estimation, plant localization, and flowering date identification). Among potential products, orthophotos play an important role in agricultural management. Traditional orthophoto generation strategies suffer from several artifacts (e.g., double mapping, excessive pixilation, and seamline distortions). The above problems are more pronounced when dealing with mid- to late-season imagery, which is often used for establishing flowering date (e.g., tassel and panicle detection for maize and sorghum crops, respectively). In response to these challenges, this paper introduces new strategies for generating orthophotos that are conducive to the straightforward detection of tassels and panicles. The orthophoto generation strategies are valid for both frame and push-broom imaging systems. The target function of these strategies is striking a balance between the improved visual appearance of tassels/panicles and their geolocation accuracy. The new strategies are based on generating a smooth digital surface model (DSM) that maintains the geolocation quality along the plant rows while reducing double mapping and pixilation artifacts. Moreover, seamline control strategies are applied to avoid having seamline distortions at locations where the tassels and panicles are expected. The quality of generated orthophotos is evaluated through visual inspection as well as quantitative assessment of the degree of similarity between the generated orthophotos and original images. Several experimental results from both UAV and ground platforms show that the proposed strategies do improve the visual quality of derived orthophotos while maintaining the geolocation accuracy at tassel/panicle locations.

54 ENVIRONMENTAL SCIENCES↗

Progress Towards a Common CERES Cloud Mask Algorithm for MODIS and VIIRS: Evaluation using CALIOP Data

For over two decades The Clouds and the Earth’s Radiant Energy System (CERES) project has endeavored to produce a long-term global climate data record for detecting changes in the Earth’s radiation budget and to improve understanding of how clouds contribute to those changes. CERES incorporates cloud information derived from passive narrowband satellite imaging radiometers, and over the course of the project different instruments have contributed to this effort, namely the Moderate Resolution Imaging Spectroradiometer (MODIS) and the Visible Infrared Imaging Radiometer Suite (VIIRS).Cloud properties have been derived from MODIS on the Aqua satellite for CERES since 2002,and VIIRS on the NOAA-20 satellite launched in 2017 will continue the cloud record once Aqua-MODIS reaches the end of its operational lifetime. However, MODIS and VIIRS have different spectral capabilities and characteristics which complicates our ability to seamlessly transition the record from MODIS to VIIRS. This study evaluates some of the recent algorithm modifications incorporated by the CERES Cloud Working Group towards developing a unified cloud mask algorithm for MODIS and VIIRS that utilizes a set of spectral bands common to both instruments. Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP) data products are used to evaluate MODIS and VIIRS regional cloud fraction estimates and identify areas where improvements can be made. The cloud mask algorithm relies on computed estimates of cloud-free top-of-atmosphere radiances to differentiate cloudy and cloud-free imager pixels. The unified cloud mask algorithm currently under development uses a reduced number of spectral bands common to both MODIS and VIIRS and so relies on the accuracy of these simulated cloud-free radiances more heavily than predecessor algorithms, i.e., the CERES Edition 4 cloud mask, which use as much spectral information as available on each imager with less consideration for cross-platform consistency. Our validation strategy using CALIOP data is also described. The CALIOP observations are critical for assessing cloud detection accuracies and for independently confirming cloud-free conditions which enables a more robust evaluation of the simulated cloud-free radiances for biases due to factors such as view angle and the spectral dependence of water vapor absorption. These effects are known to differ for the two satellite instruments. Comparisons of MODIS and VIIRS cloud fractions are presented in context with estimates from CALIOP and from the CERES Edition 4 cloud mask algorithm to gauge current progress in developing accurate and consistent MODIS and VIIRS cloud properties for CERES.

CERES↗

Registration and Fusion of Multiple Source Remotely Sensed Image Data

Earth and Space Science often involve the comparison, fusion, and integration of multiple types of remotely sensed data at various temporal, radiometric, and spatial resolutions. Results of this integration may be utilized for global change analysis, global coverage of an area at multiple resolutions, map updating or validation of new instruments, as well as integration of data provided by multiple instruments carried on multiple platforms, e.g. in spacecraft constellations or fleets of planetary rovers. Our focus is on developing methods to perform fast, accurate and automatic image registration and fusion. General methods for automatic image registration are being reviewed and evaluated. Various choices for feature extraction, feature matching and similarity measurements are being compared, including wavelet-based algorithms, mutual information and statistically robust techniques. Our work also involves studies related to image fusion and investigates dimension reduction and co-kriging for application-dependent fusion. All methods are being tested using several multi-sensor datasets, acquired at EOS Core Sites, and including multiple sensors such as IKONOS, Landsat-7/ETM+, EO1/ALI and Hyperion, MODIS, and SeaWIFS instruments. Issues related to the coregistration of data from the same platform (i.e., AIRS and MODIS from Aqua) or from several platforms of the A-train (i.e., MLS, HIRDLS, OMI from Aura with AIRS and MODIS from Terra and Aqua) will also be considered.

LeMoigne, Jacqueline↗

Coastal-Fog Microphysics Using In-Situ Observations and GOES-R Retrievals

Here, the objective of this work is to evaluate GOES-R based fog conditions occurred during the C-FOG (Toward Improving Coastal Fog Prediction) field campaign. C-FOG is designed to advance understanding of fog formation, development, and dissipation over coastal environments to improve its predictability. The project took place along coastlines and open water environments of Eastern Canada (Nova Scotia, NS and the Island of Newfoundland, NL) during August-October of 2018 where environmental conditions play an important role for late season’s fog formation. During the C-FOG field campaign, instruments were located at the Ferryland Supersite, NL, with 2 main sites, and five satellite sites, as well as on the Research Vessel (R/V) Hugh R. Sharp. Key measurement instruments included a Gondola carrying a CDP (cloud droplet probe) and a BCP (backscatter cloud probe) was used for measuring droplet spectra from 1-75 µm on the R/V. A LPM (laser precipitation monitor) with 100 µm-1 cm size range and an OPC (optical particle counter) with 0.3-17 µm at 16 spectral channels provided information for fog and drizzle discrimination. Remote sensing platforms (e.g. profiling microwave radiometer, PMWR), Ceilometer, Lidar), meteorological towers, tethered balloons, and GOES-R products (e.g. fog coverage and droplet size and liquid water path) were used to evaluate fog over horizontal and vertical dimensions. Results suggest that effective radius, phase, liquid water path, and liquid water content values obtained from GOES-R and PMWR were comparable to ground based in-situ observations. It is concluded that integration of observations and nowcasting products may help improve short term local fog predictions.

54 ENVIRONMENTAL SCIENCES↗

A Composite View of Ozone Evolution in the 1995-1996 Northern Winter Polar Vortex Developed from Airborne Lidar and Satellite Observations

The processes which contribute to the ozone evolution in the high latitude northern lower stratosphere are evaluated using a three dimensional model simulation and ozone observations. The model uses winds and temperatures from the Goddard Earth Observing System Data Assimilation System. The simulation results are compared with ozone observations from three platforms: the differential absorption lidar (DIAL) which was flown on the NASA DC-8 as part of the Vortex Ozone Transport Experiment; the Microwave Limb Sounder (MLS); the Polar Ozone and Aerosol Measurement (POAM II) solar occultation instrument. Time series for the different data sets are consistent with each other, and diverge from model time series during December and January. The model ozone in December and January is shown to be much less sensitive to the model photochemistry than to the model vertical transport, which depends on the model vertical motion as well as the model vertical gradient. We evaluate the dependence of model ozone evolution on the model ozone gradient by comparing simulations with different initial conditions for ozone. The modeled ozone throughout December and January most closely resembles observed ozone when the vertical profiles between 12 and 20 km within the polar vortex closely match December DIAL observations. We make a quantitative estimate of the uncertainty in the vertical advection using diabatic trajectory calculations. The net transport uncertainty is significant, and should be accounted for when comparing observations with model ozone. The observed and modeled ozone time series during December and January are consistent when these transport uncertainties are taken into account.

Douglass, A. R.↗

Evaluating Northern Hemisphere Growing Season Net Carbon Flux in Climate Models Using Aircraft Observations

Understanding terrestrial ecosystems and their response to anthropogenic climate change requires quantification of land-atmosphere carbon exchange. However, top-down and bottom-up estimates of large-scale land-atmosphere fluxes, including the northern extratropical growing season net flux (GSNF), show significant discrepancies. We developed a data-driven metric for the GSNF using atmospheric carbon dioxide concentration observations collected during the High-Performance Instrumented Airborne Platform for Environmental Research Pole-to-Pole Observations and Atmospheric Tomography Mission flight campaigns. This aircraft-derived metric is bias-corrected using three independent atmospheric inversion systems. We estimate the northern extratropical GSNF to be 5.7 ± 0.3 Pg C and use it to evaluate net biosphere productivity from the Coupled Model Intercomparison Project phase 5 and 6 (CMIP5 and CMIP6) models. While the model-to-model spread in the GSNF has decreased in the CMIP6 models relative to that of the CMIP5 models, there is still disagreement on the magnitude and timing of seasonal carbon uptake with most models underestimating the GSNF and overestimating the length of the growing season relative to the observations. We also use an emergent constraint approach to estimate annual northern extratropical gross primary productivity to be 56 ± 17 Pg C, heterotrophic respiration to be 25 ± 13 Pg C, and net primary productivity to be 28 ± 12 Pg C. The flux inferred from these aircraft observations provides an additional constraint on large-scale gross fluxes in prognostic Earth system models that may ultimately improve our ability to accurately predict carbon-climate feedbacks.

54 ENVIRONMENTAL SCIENCES↗

HIPPO – A Software Platform for Electricity Market Research and Development

The goal of this project is to provide Regional transmission organizations (RTOs) and independent system operators (ISOs) a market design and prototyping software, High-Performance Power-Grid Optimization (HIPPO), that they can evaluate electricity market design options, calculate market planning strategies and operational performance. With the high standards and strict reliability requirements for operating power systems, impacts of new technologies need to be fully investigated prior to any consideration for adoption. A market design and prototyping software tool which can be used to prototype electricity market design options, to calculate market planning strategies and operational performance with high precision, and to investigate the impacts for integrating future power grid technologies will be valuable to RTOs/ISOs who operate power systems, to vendors like GE and ABB who provide the market solvers, and to market participants and researchers who are actively doing market research. HIPPO is a such tool that can be used to improve the current market operations and provide capabilities for rigorous forward-looking design and prototyping of next-generation energy markets. HIPPO has a high-resolution model for the day-ahead SCUC, which was validated with MISO and GE-Grid Solutions. HIPPO is built with parallel and distributed computing capabilities and can be executed in both multi-thread and high-performance computing (HPC) settings. This capability provides fast solution speed necessary to handle the larger and more complex SCUC problems of real-world cases and the potentially growing size and complexity of future scenarios. In addition, HIPPO has a concurrent optimizer (CO) which manages multiple algorithm executions simultaneously and leverages the advantages from different algorithms. This structure provides flexibility to better benchmark competing approaches. Highly accurate market model, fast solution technologies and flexible model and algorithm control are the features which will make HIPPO an extensible platform for developing and testing multiple approaches to meet a wide range of future market needs.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Market optimization and technoeconomic analysis of hydrogen-electricity coproduction systems

Decarbonization efforts across North America, Europe, and beyond rely on variable renewable energy sources such as wind and solar, as well as alternative fuels, such as hydrogen, to support the sustainable energy transition. These advancements have prompted a need for more flexibility in the electric grid to complement non-dispatchable energy sources and increased demand from electrification. Integrated energy systems are well suited to provide this flexibility, but conventional technoeconomic modeling paradigms neglect the time-varying dynamic nature of the grid and thus undervalue resource flexibility. In this work, we develop a computational optimization framework for dynamic market-based technoeconomic comparison of integrated energy systems that coproduce low-carbon electricity and hydrogen (e.g., solid oxide fuel cells, solid oxide electrolysis) against technologies that only produce electricity (e.g., natural gas combined cycle with carbon capture) or only produce hydrogen. Our framework starts with rigorous physics-based process models, built in the open-source Institute for the Design of Advanced Energy Systems (IDAES) modeling and optimization platform, for six energy process concepts. Using these rigorous models and a workflow to optimally design each technology, the framework is shown to be capable of evaluating new and emerging technologies in varying energy markets under a plethora of future scenarios (i.e., renewables penetration, carbon tax, etc.). Ultimately, our framework finds that solid oxide fuel cell-based coproduction systems achieve positive profits for 85% of the analyzed market scenarios. From these market optimization results, we use multivariate linear regression (R 2 values up to 0.99) to determine which electricity price statistics are most significant to predict the optimized annual profit of each system. The proposed framework provides a powerful tool for directly comparing flexible, multi-product energy process concepts to help discern optimal technology and integration options.

08 HYDROGEN↗

Performance Evaluation of Distributed Energy Resource Management Algorithm in Large Distribution Networks

This paper presents performance evaluation of hierarchical optimization and control for distributed energy resource management system (DERMS) in large distribution networks via an advanced hardware-in-the-loop (HIL) platform. The HIL platform provides realistic testing in a laboratory environment, including the accurate modeling of a full-scale distribution system of 11,000 nodes, the DERMS software controller, and 90 power hardware photovoltaics (PVs) and battery inverters. The applied DERMS algorithm is designed based on a realtime optimal power flow algorithm and implemented with acceleration design that performs fast dispatch of simulated PVs and real physical hardware DER devices every 4 seconds.

DERMS↗

D2U: Data Driven User Emulation for the Enhancement of Cyber Testing, Training, and Data Set Generation

Whether testing intrusion detection systems, conducting training exercises, or creating data sets to be used by the broader cybersecurity community, realistic user behavior is a critical component of a cyber range. Existing methods either rely on network level data or replay recorded user actions to approximate real users in a network. Our work is the first to produce generative models trained on actual user data (sequences of application usage) collected on endpoints. Once trained to the user's behavioral data, these models can generate novel sequences of actions %that appear to come from the same distribution as the training data. These sequences of actions are then fed to our custom software via configuration files, which replicate those behaviors on end devices. Notably, our models are platform agnostic and could generate behavior data for any emulation software package. In this paper we present our model generation process, software architecture, and an initial evaluation of the fidelity of our models. Our software is currently deployed in a cyber range to help evaluate the efficacy of defensive cyber technologies. We suggest additional ways that the cyber community as a whole can benefit from more realistic user behavior emulation. The data used to train our model, as well as sample configuration files produced by the model, are available at [redacted].

Oesch, T↗

Heart of the Hearth: Making the Popular Clean, Not the Clean Popular - Technology Research, Development, and Tools for Clean Biomass Cookstoves

This technical report summarizes the work completed by BioLite in fulfilment of the US DOE EERE award. The work plan focused on three key objectives: developing an optimized combustion system that demonstrates high combustion efficiency and low PM 2.5 and CO emissions, integrate the system into popular stove phenotypes – side-fed rocket stove architecture like the BioLite HomeStove, and the Patsari chimney stove in Mexico such that they maintain their important phenotypical characteristics, independently evaluate quantitative fuel and emissions performance of the integrated ‘Turbo-Patsari’ in Mexican households. The project activities were organized into six major tasks: A. Develop, fabricate, and test proof-of-concept prototypes B. Develop field prototypes, assess user feedback and field performance C. Define revised stove design for pre-production model, Identify manufacturing requirements and estimated cost to build, Conduct reliability, emissions, and performance testing of pre-production Turbo-Patsari D. Build pre-production Turbo-Patsari stove combustion cores E. Conduct pre-production field trials F. Summarize field trial results and evaluate Turbo-Patsari for potential volume production. A two-pronged approach was adopted for the above tasks. The first involved building a modular test platform that allowed parametric variation of multiple stove design parameters that directly affect its performance – heat output, thermal efficiency, and emissions. The second part of the approach comprised of building a surrogate Patsari based on GIRA’s specifications that could then be modified or retrofitted for optimum performance based on the learnings from the modular test platform. The following sections of the report will describe the findings of tests on these platform, the subsequent development, design, and installation of the Turbo-Patsari, and finally the in-home field trial.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Results from the Balloon Ozone Intercomparison Campaign (BOIC)

Data from the BOIC which consisted of three balloon missions conducted in Palestine, Texas from June 1983 to March 1984 are presented. The BOIC was to assess the ability to perform ozone measurements from balloon platforms. The accuracy and precision of the various ozone measurement systems, which were composed of a photometer, a mass spectrometer, and solar UV absorption sensors, are evaluated. The ozone observations obtained with the instruments on the three flight missions are analyzed and intercompared. The flight in situ data are also compared to the National Bureau of Standards reference photometer, satellite measurements, and under simulated stratospheric pressure and ozone concentrations.

Hilsenrath, E.↗

Results of the Stable Microgravity Vibration Isolation Flight Experiment

This paper presents an overview of the STABLE microgravity isolation system developed and successfully flight tested in October 1995. A description of the hardware design and operational principles is given. A sample of the measured flight data is presented, including an evaluation of attenuation performance provided by the actively controlled electromagnetic isolation system. Preliminary analyses of flight data show that the acceleration environment aboard STABLE's isolated platform was attenuated by a factor of more than 25 between 0.1 and 100 Hz. STABLE was developed under a cooperative agreement between National Aeronautics and Space Administration, Marshall Space Flight Center, and McDonnell Douglas Aerospace. The flight hardware was designed, fabricated, integrated, tested, and delivered to the Cape during a five month period.

Edberg, Donald↗