Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation datasets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,639 records · Page 91
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Visualization and Decision Making Design Under Uncertainty

Uncertainty is an important aspect to data understanding. Without awareness of the variability, error, or reliability of a dataset, the ability to make decisions on that data is limited. However, practices around uncertainty visualization remain domain-specific, rooted in convention, and in many instances, absent entirely. Part of the reason for this may be a lack of established guidelines for navigating difficult choices of when uncertainty should be added, how to visualize uncertainty, and how to evaluate its effectiveness. Unsurprisingly, the inclusion of uncertainty into visualizations is a major challenge to visualization. As work concerned with uncertainty visualization grows, it has become clear that simple visual additions of uncertainty information to traditional visualization methods do not appropriately convey the meaning of the uncertainty, pose many perceptual challenges, and, in the worst case, can lead a viewer to a completely wrong understanding of the data. These challenges are the driving motivator for this special issue.

data models↗
DOE OSTI2026

Exploring Sustainability in Scientific Software through Code Quality & Test Coverage Metrics

Context: Scientific open-source software (SciOSS) plays a foundational role in research and engineering, yet its long-term sustainability has often been overlooked and remains a significant concern. Objective: This study investigates the long-term sustainability of SciOSS through code and test quality metrics. Method: We analyze CASS Software Portfolio projects, classifying them by sustainability and comparing their code structure, test coverage, and links between code quality and testing across the dataset. Results: Sustainable projects show higher, more consistent test coverage and clearer code-test correlations, while unsustainable ones show weaker patterns. Overall, test coverage is low in scientific software, and high complexity and coupling reduce testability. Conclusion: In this study, we present a practical, data-driven approach for assessing sustainability in scientific software, offering a foundation for evaluating long-term software health and supporting future efforts in quality assurance and sustainability monitoring.

Md mushfiqur rahman, Sheikh [University of Tenness↗
DOE OSTI2021

Omics-Lethal Human Viruses, Influenza A Experiment ICL103

The purpose of this experiment was to evaluate the human host response to Influenza A wild-type (H5N1) virus and mutant viruses. Sample data was obtained for human lung adenocarcinoma cell line (Calu-3) infected with WT Influenza A/Vietnam/1203/2004 (H5N1, VN1203) and mutant viruses PB2-K627E and NS1-trunc124 for mRNA, miRNA, proteomics, lipidomics, and metabolomics data analysis. Secondary host-associated viral dataset downloads contain one or more statistically processed (normalization data transformation) quantitative dataset collections resulting in qualitative expression analyses of primary host-pathogen experimental study designs. Leveraging unique high-resolution Omics capabilities for proteomics, metabolomics, lipidomics, and transcriptomics dataset download each have a direct relationship to a primary sample submission corresponding to a specific Influenza A virus infection.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Omics-Lethal Human Viruses, Interferon-Stimulated Response Experiment IFNaHUH001

The purpose of this experiment was to evaluate the human host cellular response to treatment with and without interferon alpha/beta (IFNα/β) treatment. Sample time course data was obtained from human hepatoma carcinoma cells (HUH-7) expressing transcriptional activation protein VP30, stably transfected with the Ebola VP30 gene for enabling replication of VP30-deficient Ebola virus for transcriptome expression analysis. Secondary host-associated viral dataset downloads contain one or more statistically processed (normalization data transformation) quantitative dataset collections resulting in qualitative expression analyses of primary host-pathogen experimental study designs. Transcriptomics dataset download have a direct relationship to a primary sample submission corresponding to a specific interferon response to viral infection.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Omics-Lethal Human Viruses, West Nile Experiment WLN002

The purpose of this experiment was to evaluate the host response to wild-type West Nile virus infectious clone (WNV-NY99 clone 382) and mutant WNV-E218A (WNV-NY99 382 E218A 2 nt) virus infection. Sample data was obtained from mouse popliteal draining lymph nodes for mRNA and miRNA expression analysis. See Experiment WLN003 for corresponding omics analysis. Secondary host-associated viral dataset downloads contain one or more statistically processed (normalization data transformation) quantitative dataset collections resulting in qualitative expression analyses of primary host-pathogen experimental study designs. Transcriptomics dataset downloads have a direct relationship to a primary sample submission corresponding to a specific West Nile virus infection.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS2014

Examining the Link Between Food Prices and Food Insecurity: a Multi-Level Analysis of Maize Price and Birthweight in Kenya

In developing countries where many poor people rely on rainfed, locally produced food for the majority of their caloric intake, shifts in climate and weather patterns can dramatically reduce agricultural productivity. The reduction in agricultural productivity reduces overall food availability and ultimately impacts food accessibility, putting millions of people at risk for malnutrition. In this project we focus on Kenya where roughly a third of households are food insecure. We examine the relationship of the price of maize and low birth weight to help quantify the impact of local food prices on one outcome of household food insecurity. Using spatially referenced data from recent Kenyan Demographic and Health Survey datasets, price data, livelihood information, and a remotely sensed-based measure of local growing season productivity, we develop a dataset linking pregnancies occurring from 2001 to 2008 to the spatially and temporally relevant maize price data. We construct several regression models to examine the impact of local maize prices and remotely sensed based estimates of crop production on infant birth weight - specifically low birth weight. The results of the models highlight the importance of including community crop production to evaluate maize price impacts on low birth weight outcomes. Also, because of the positive correlation between pre-pregnancy maize prices and birth weight, the results suggest that some households may benefit from high prices or that high prices may impact the number of conceptions. More generally, our work demonstrates that multilevel models that account for community-level variation are important for disentangling these complex relationships and can contribute to the discussion of how to design more effective food policies.

Low birth weight↗
NASA NTRS2017

AMSR2 Soil Moisture Product Validation

The Advanced Microwave Scanning Radiometer 2 (AMSR2) is part of the Global Change Observation Mission-Water (GCOM-W) mission. AMSR2 fills the void left by the loss of the Advanced Microwave Scanning Radiometer Earth Observing System (AMSR-E) after almost 10 years. Both missions provide brightness temperature observations that are used to retrieve soil moisture. Merging AMSR-E and AMSR2 will help build a consistent long-term dataset. Before tackling the integration of AMSR-E and AMSR2 it is necessary to conduct a thorough validation and assessment of the AMSR2 soil moisture products. This study focuses on validation of the AMSR2 soil moisture products by comparison with in situ reference data from a set of core validation sites. Three products that rely on different algorithms were evaluated; the JAXA Soil Moisture Algorithm (JAXA), the Land Parameter Retrieval Model (LPRM), and the Single Channel Algorithm (SCA). Results indicate that overall the SCA has the best performance based upon the metrics considered.

microwave↗
NASA NTRS2022

Scientist-Stakeholder Relationships Drive Carbon Data Product Transfer Effectiveness within NASA Program

Carbon cycle science is at the heart of research on global climate change and its long-term impacts, as it examines the exchange of carbon between the atmosphere, oceans, land, and the impact of fossil fuel emissions on this cycling. Given the urgency of the climate challenge, NASA’s Carbon Monitoring System (CMS) requires all funded investigators to identify and work with stakeholder organizations at project inception to accelerate the transfer of the products developed by funded research into decision making systems. In this study, we contribute to the literature through the implementation of a quantitative analysis of 908 unique survey responses from funded investigators to explore the maturity of the scientist-stakeholder engagement. The paper employs multiple correspondence analysis to provide evidence to support policy options to increase stakeholder integration into research programs. Despite limitations of the dataset used, we demonstrated that multiple funding rounds, long-standing relationships between the stakeholder and scientist, and the scientific productivity of the PI, including the ability to produce datasets and research papers on these datasets, all contribute to carbon products moving from research to operational use. The maturity of relationships between scientists and stakeholders was shown to result improved stakeholder engagement. The use of carbon products should be identified in every stage of the program, and that capacity building is needed to support both existing and newly identified stakeholders better understand and use CMS products. As Federal, State, and local policy on climate adaptation and mitigation matures, the need for information on carbon will expand. Building of stakeholder-scientist relationships in CMS results in an effective generation and use of datasets to support this need and prototype ways that improved information needed for decision making can be created.

Monitoring↗
NASA NTRS2023

Impact of Design Factors for ESA CCI Satellite Soil Moisture Data Assimilation over Europe

In this study, soil moisture retrievals of the combined active–passive ESA Climate Change Initiative (CCI) soil moisture product are assimilated into the Noah-MP land surface model over Europe using a one-dimensional ensemble Kalman filter and an 18-yr study period. The performance of the data assimilation (DA) system is evaluated by comparing it with a model-only experiment (at in situ sites) and by assessing statistics of innovations and increments as DA diagnostics (over the entire domain). For both assessments, we explore the impact of three design choices, resulting in the following insights. 1) The magnitude of the assumed observation errors strongly affects the skill improvements evaluated against in situ stations and internal diagnostics. 2) Choosing between climatological or monthly cumulative distribution function matching as the observation bias correction method only has a marginal effect on the in situ skill of the DA system. However, the internal diagnostics suggest a more robust system parameterization if the observations are rescaled monthly. 3) The choice of atmospheric reanalysis dataset to force the land surface model affects the model-only skill and the DA skill improvements. The model-only skill is higher with input from the MERRA-2 than with input from the ERA5 reanalysis, resulting in larger DA skill improvements for the latter. Additionally, we show that the added value of the DA strongly depends on the quality of the satellite retrievals and land cover, with the most substantial soil moisture skill improvements occurring over croplands and skill degradation occurring over densely forested areas.

Soil moisture↗
NASA NTRS2024

Evaluation of CMIP6 Model Simulations of PM 2.5 and its Components Over China

Earth system models (ESMs) participating in the latest Coupled Model Intercomparison Project Phase 6 (CMIP6) simulate various components of fine particulate matter (PM 2.5 ) as major climate forcers. Yet the model performance for PM 2.5 components remains little evaluated due in part to a lack of observational data. Here, we evaluate near-surface concentrations of PM 2.5 and its five main components over China as simulated by 14 CMIP6 models, including organic carbon (OC; available in 14 models), black carbon (BC; 14 models), sulfate (14 models), nitrate (4 models), and ammonium (5 models). For this purpose, we collect observational data between 2000 and 2014 from a satellite-based dataset for total PM2.5 and from 2469 measurement records in the literature for PM 2.5 components. Seven models output total PM 2.5 concentrations, and they all underestimate the observed total PM 2.5 over eastern China, with GFDL-ESM4 (−1.5 %) and MPI-ESM-1-2-HAM (−1.1 %) exhibiting the smallest biases averaged over the whole country. The other seven models, for which we recalculate total PM 2.5 from the available component output, underestimate the total PM 2.5 concentrations partly because of the missing model representations of nitrate and ammonium. Concentrations of the five individual components are underestimated in almost all models, except that sulfate is overestimated in MPI-ESM-1-2-HAM by 12.6 % and in MRI-ESM2-0 by 24.5 %. The underestimation is the largest for OC (by −71.2 % to −37.8 % across the 14 models) and the smallest for BC (−47.9 % to −12.1 %). The multi-model mean (MMM) reproduces the observed spatial pattern for OC (R = 0.51), sulfate (R = 0.57), nitrate (R = 0.70) and ammonium (R = 0.74) fairly well, yet the agreement is poorer for BC (R = 0.39). The varying performances of ESMs on total PM 2.5 and its components have important implications for the modeled magnitude and spatial pattern of aerosol radiative forcing.

CMIP6↗
DOE OSTI2024

Efficient data-driven models for prediction and optimization of geothermal power plant operations

Increasing the capacity of geothermal energy as a renewable resource calls for development and deployment of efficient control and optimization technologies for geothermal power plants. A data-driven prediction and optimization model is presented as a cost-effective and efficient alternative to physics-based approach. The model predicts power output and operational cost by propagating the influence of control and disturbance variables within an artificial neural network (ANN). Numerical experiments with simulated and field data from a real geothermal power plant are first used to demonstrate the prediction performance of the ANN model. The model is then adopted to maximize the net predicted power production by automatically adjusting the working fluid circulation rate. The optimization performance of the model in evaluated using a thermodynamic flowsheet simulation model. The workflow is applied to model and control the effect of ambient temperature on an air-cooled binary cycle power plant, which is complex and costly to perform using a physics-based predictive model. As a result, the performance of the method is demonstrated by applying it to both simulated and field datasets from a binary cycle geothermal power plant.

15 GEOTHERMAL ENERGY↗
DOE OSTI2022

Overcoming the disconnect between energy system and climate modeling

Energy system models underpin decisions by energy system planners and operators. Energy system modeling faces a transformation: accounting for changing meteorological conditions imposed by climate change. To enable that transformation, a community of practice in energy-climate modeling has started to form that aims to better integrate energy system models with weather and climate models. In this work, we evaluate the disconnects between the energy system and climate modeling communities, then lay out a research agenda to bridge those disconnects. In the near-term, we propose interdisciplinary activities for expediting uptake of future climate data in energy system modeling. In the long-term, we propose a transdisciplinary approach to enable development of (1) energy-system-tailored climate datasets for historical and future meteorological conditions and (2) energy system models that can effectively leverage those datasets. This agenda increases the odds of meeting ambitious climate mitigation goals by systematically capturing and mitigating climate risk in energy sector decision-making.

17 WIND ENERGY↗
DOE OSTI2020

Analysis of the Frequency of Extreme Precipitation Events at Los Alamos National Laboratory

The Environmental Protection and Compliance (EPC) Storm Water Permitting and Compliance Program is currently updating its stormwater compliance standards for the Los Alamos National Laboratory (LANL) Engineering Standards Manual (2015) and is addressing the required current meteorological data needed for storm water applications. Information on the frequency of extreme precipitation events at LANL is needed. In response to this request, LANL Meteorology & Air Quality (MAQ) was tasked to estimate the frequency of extreme precipitation events. An earlier study by Foley (2012) which estimated extreme precipitation rates at LANL for a set of duration periods and average recurrence intervals (return periods) was evaluated. However, it was determined that this study would not be helpful since its technical support documentation was unavailable and the meteorological data and the methodology employed were not well understood. This led to the need to develop a new peer-reviewed methodology. This report documents the development of the new methodology and the application of a temporally representative precipitation dataset from February 1990 through December 2018, monitored at the official LANL meteorological station, Technical Area (TA)-6, to develop the frequency of extreme precipitation events.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Omics-Lethal Human Viruses, West Nile Experiment WLN003

The purpose of this experiment was to evaluate the host response to wild-type West Nile virus infectious clone (WNV-NY99 clone 382) and mutant WNV-E218A (WNV-NY99 382 E218A 2 nt) virus infection. Sample data was obtained from mouse popliteal draining lymph nodes for proteomics, metabolomics, and lipidomics expression analysis. See Experiment WLN002 for corresponding transcriptome analysis. Secondary host-associated viral dataset downloads contain one or more statistically processed (normalization data transformation) quantitative dataset collections resulting in qualitative expression analyses of primary host-pathogen experimental study designs. Leveraging unique high-resolution Omics capabilities for proteomics, metabolomics, and lipidomics dataset downloads each have a direct relationship to a primary sample submission corresponding to a specific West Nile virus infection.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS2013

Experimental Database with Baseline CFD Solutions: 2-D and Axisymmetric Hypersonic Shock-Wave/Turbulent-Boundary-Layer Interactions

A database compilation of hypersonic shock-wave/turbulent boundary layer experiments is provided. The experiments selected for the database are either 2D or axisymmetric, and include both compression corner and impinging type SWTBL interactions. The strength of the interactions range from attached to incipient separation to fully separated flows. The experiments were chosen based on criterion to ensure quality of the datasets, to be relevant to NASA's missions and to be useful for validation and uncertainty assessment of CFD Navier-Stokes predictive methods, both now and in the future. An emphasis on datasets selected was on surface pressures and surface heating throughout the interaction, but include some wall shear stress distributions and flowfield profiles. Included, for selected cases, are example CFD grids and setup information, along with surface pressure and wall heating results from simulations using current NASA real-gas Navier-Stokes codes by which future CFD investigators can compare and evaluate physics modeling improvements and validation and uncertainty assessments of future CFD code developments. The experimental database is presented tabulated in the Appendices describing each experiment. The database is also provided in computer-readable ASCII files located on a companion DVD.

Database↗
NASA NTRS2015

An Integrated 0-1 Hour First-Flash Lightning Nowcasting, Lightning Amount and Lightning Jump Warning Capability

Lightning one of the most dangerous weather-related phenomena, especially as many jobs and activities occur outdoors, presenting risk from a lightning strike. Cloud-to-ground (CG) lightning represents a considerable safety threat to people at airfields, marinas, and outdoor facilities-from airfield personnel, to people attending outdoor stadium events, on beaches and golf courses, to mariners, as well as emergency personnel. Holle et al. (2005) show that 90% of lightning deaths occurred outdoors, while 10% occurred indoors despite the perception of safety when inside buildings. Curran et al. (2000) found that nearly half of fatalities due to weather were related to convective weather in the 1992-1994 timeframe, with lightning causing a large component of the fatalities, in addition to tornadoes and flash flooding. Related to the aviation industry, CG lightning represents a considerable hazard to baggage-handlers, aircraft refuelers, food caterers, and emergency personnel, who all become exposed to the risk of being struck within short time periods while convective storm clouds develop. Airport safety protocols require that ramp operations be modified or discontinued when lightning is in the vicinity (typically 16 km), which becomes very costly and disruptive to flight operations. Therefore, much focus has been paid to nowcasting the first-time initiation and extent of lightning, both of CG and of any lightning (e.g, in-cloud, cloud-to-cloud). For this project three lightning nowcasting methodologies will be combined: (1) a GOESbased 0-1 hour lightning initiation (LI) product (Harris et al. 2010; Iskenderian et al. 2012), (2) a High Resolution Rapid Refresh (HRRR) lightning probability and forecasted lightning flash density product, such that a quantitative amount of lightning (QL) can be assigned to a location of expected LI, and (3) an algorithm that relates Pseudo-GLM data (Stano et al. 2012, 2014) to the so-called "lightning jump" (LJ) methodology (Shultz et al. 2011) to monitor lightning trends and to anticipate/forecast severe weather (hail > or =2.5 cm, winds > or =25 m/s, tornadoes). The result will be a time-continuous algorithm that uses GOES satellite, radar fields, and HRRR model fields to nowcast first-flash LI and QL, and subsequently monitors lightning trends on a perstorm basis within the LJ algorithm for possible severe weather occurrence out to > or =3 hours. The LI-QL-LJ product will also help prepare the operational forecast community for Geostationary Lightning Mapper (GLM) data expected in late 2015, as these data are monitored for ongoing convective storms. The LI-QL-LJ product will first predict where new lightning is highly probable using GOES imagery of developing cumulus clouds, followed by n analysis of NWS (dual-polarization) radar indicators (reflectivity at the -10 C altitude) of lightning occurrence, to increase confidence that LI is immanent. Once lightning is observed, time-continuous lightning mapping array and Pseudo-GLM observations will be analyzed to assess trends and the severe weather threat as identified by trends in lightning (i.e. LJs). Additionally, 5- and 15-min GOES imagery will then be evaluated on a per-storm basis for overshooting and other cloud-top features known to be associated with severe storms. For the processing framework, the GOES-R 0-1 hour convective initiation algorithm's output will be developed within the Warning Decision Support System - Integrated Information (WDSS-II) tracking tool, and merged with radar and lightning (LMA/Psuedo-GLM) datasets for active storms. The initial focus of system development will be over North Alabama for select lightning-active days in summer 2014, yet will be formed in an expandable manner. The lightning alert tool will also be developed in concert with National Weather Service (NWS) forecasters to meet their needs for real-time, accurate first-flash LI and timing, as well as anticipated lightning trends, amounts, continuation and cessation, so to provide key situational awareness and decision support information. The NASA Short-term Prediction Research and Transition (SPoRT) Center will provide important logistical and collaborative support and training, involving interactions with the NWS and broader user community.

Mecikalski, John↗
DOE OSTI2024

FEW questions, many answers: using machine learning to assess how students connect food–energy–water (FEW) concepts

There is growing support and interest in postsecondary interdisciplinary environmental education which integrate concepts and disciplines in addition to providing varied perspectives. There is a need to assess student learning in these programs as well as rigorous evaluation of educational practices, especially of complex synthesis concepts. This work tests a text classification machine learning model as a tool to assess student systems thinking capabilities using two questions anchored by the Food-Energy-Water (FEW) Nexus phenomena by answering two questions (1) Can machine learning models be used to identify instructor-determined important concepts in student responses? (2) What do college students know about the interconnections between food, energy and water, and how have students assimilated systems thinking into their constructed responses about FEW? Reported here are a broad range of model performances across 26 text classification models associated with two different assessment items, with model accuracy ranging from 0.755 to 0.992. Expert-like responses were infrequent in our dataset compared to responses providing simpler, incomplete explanations of the systems presented in the question. For those students moving from describing individual effects to multiple effects, their reasoning about the mechanism behind the system indicates advanced systems thinking ability. Specifically, students exhibit higher expertise for explaining changing water usage than discussing tradeoffs for such changing usage. This research represents one of the first attempts to assess the links between foundational, discipline-specific concepts and systems thinking ability. These text classification approaches to scoring student FEW Nexus Constructed Responses (CR) indicate how these approaches can be used, in addition to several future research priorities for interdisciplinary, practice-based education research. Development of further complex question items using machine learning would allow evaluation of the relationship between foundational concept understanding and integration of those concepts as well as more nuanced understanding of student comprehension of complex interdisciplinary concepts.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2022

Dimensionless parameters for ballistic performance evaluation of ceramic-faced bicomponent targets against sharp-nosed projectiles

Two dimensionless parameters are proposed to give first-order approximations for the ballistic performance of ceramic-faced bicomponent armor plates impacted by conical-nosed steel projectiles. The current work collates expansive experimental data from Wilkins and Mayseless covering a broad range of material and mechanical properties, target construction, and projectile dimensions, the data is collapsed using the Hugoniot elastic limit of the ceramic strike face as a strength metric. We find that within datasets where experimental conditions are kept constant, a singular cubic curve can be generated, but variations in experimental conditions for the ballistic limit test between datasets can result in differences in the predictive curve coefficients.

36 MATERIALS SCIENCE↗