Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 865 records · Page 48

Automating Anomaly Detection for Target systems at Spallation Neutron Source

The Spallation Neutron Source (SNS) at Oak Ridge National Laboratory, produces the world’s most intense pulse neutrons beams. An accelerated proton beam is directed into a mercury target to generate neutrons via spallation. The target system accounted for over 40% of the overall downtime of the facility in 2022. Thus, early detection in anomalies in the target systems can enable taking corrective actions to avoid failures and reduce downtime. Fault prognostics and anomaly detection in accelerators, both at SNS and outside, has largely focused on the beam side. This paper presents one the first studies exploring leveraging machine learning to automate the detection of anomalies in the target system. The target system consists of over 30 different interconnected subsystems, and the present work focuses on the mercury process system as a use case. Analyzing data from 28 process variables from 2022 and 2023, tree-based and reconstruction-based algorithms are employed to detect anomalies in archived data. The algorithms detected previously unreported anomalies, several of which were deemed alert worthy by human experts, particularly those found by reconstruction-based algorithms. Using data from each production run in the accelerator increased the generalizability of the models in time. Efforts are now underway to implement a workflow for incorporating human feedback to update the models and evaluating performance on unseen data. The models will eventually be integrated into the existing System Tracking and Reliability system with a web interface for automated anomaly detection and reporting along with a pathway for incorporating human feedback for model updates.

Raj, Anant [ORNL] (ORCID:0000000306711244)↗

Technical, Economic, Energetic, and Environmental Evaluation of Pretreatment Strategies for Scaling Control in Brackish Water Desalination Brine Treatment

Effective pretreatment is essential for achieving long-term stable operation and high water recovery during the desalination of alternative waters. This study developed a process modeling approach for technical, economic, energetic, and environmental assessments of pretreatment technologies to identify the impacts of each technology treating brackish water desalination brine with high scaling propensity. The model simulations evaluated individual pretreatment technologies, including chemical softening (CS), chemical coagulation (CC), electrocoagulation (EC), and ion exchange (IX). In addition, combinations of these pretreatment technologies aiming at the effective reduction of key scaling constituents such as hardness and silica were investigated. The three evaluation parameters in this assessment consist of levelized cost of water (LCOW, $/m 3 ), specific energy consumption and cumulative energy demand (SEC|CED, kWh/m 3 ), and carbon dioxide emissions (CO 2 , kg CO 2-eq /m 3 ). The case study evaluated in this work was the desalination brine from the Kay Bailey Hutchison Desalination Plant (KBHDP) with a total dissolved solids (TDS) concentration of 11,000 mg/L and rich in hardness and silica. The evaluation of individual pretreatment units from the highest to lowest LCOW, SEC|CED, and CO 2 emissions in the KBHDP brine was IX > CS > EC > CC, CS > IX > EC > CC, and CC > CS > EC > IX, respectively. In the case of pretreatment combinations for the KBHDP, the EC + IX treatment combination was shown to be the best in terms of the LCOW and CO 2 emissions. The modeling and evaluation of these pretreatment units provide valuable guidance on the selection of cost-effective, energy-efficient, and environmentally sustainable pretreatment technologies tailored to desalination brine applications for minimal- or zero-liquid discharge.

14 SOLAR ENERGY↗

Evaluation of a distributed catchment scale water balance model

The validity of some of the simplifying assumptions in a conceptual water balance model is investigated by comparing simulation results from the conceptual model with simulation results from a three-dimensional physically based numerical model and with field observations. We examine, in particular, assumptions and simplifications related to water table dynamics, vertical soil moisture and pressure head distributions, and subsurface flow contributions to stream discharge. The conceptual model relies on a topographic index to predict saturation excess runoff and on Philip's infiltration equation to predict infiltration excess runoff. The numerical model solves the three-dimensional Richards equation describing flow in variably saturated porous media, and handles seepage face boundaries, infiltration excess and saturation excess runoff production, and soil driven and atmosphere driven surface fluxes. The study catchments (a 7.2 sq km catchment and a 0.64 sq km subcatchment) are located in the North Appalachian ridge and valley region of eastern Pennsylvania. Hydrologic data collected during the MACHYDRO 90 field experiment are used to calibrate the models and to evaluate simulation results. It is found that water table dynamics as predicted by the conceptual model are close to the observations in a shallow water well and therefore, that a linear relationship between a topographic index and the local water table depth is found to be a reasonable assumption for catchment scale modeling. However, the hydraulic equilibrium assumption is not valid for the upper 100 cm layer of the unsaturated zone and a conceptual model that incorporates a root zone is suggested. Furthermore, theoretical subsurface flow characteristics from the conceptual model are found to be different from field observations, numerical simulation results, and theoretical baseflow recession characteristics based on Boussinesq's groundwater equation.

Troch, Peter A.↗

AgMIP Training in Multiple Crop Models and Tools

The Agricultural Model Intercomparison and Improvement Project (AgMIP) has the goal of using multiple crop models to evaluate climate impacts on agricultural production and food security in developed and developing countries. There are several major limitations that must be overcome to achieve this goal, including the need to train AgMIP regional research team (RRT) crop modelers to use models other than the ones they are currently familiar with, plus the need to harmonize and interconvert the disparate input file formats used for the various models. Two activities were followed to address these shortcomings among AgMIP RRTs to enable them to use multiple models to evaluate climate impacts on crop production and food security. We designed and conducted courses in which participants trained on two different sets of crop models, with emphasis on the model of least experience. In a second activity, the AgMIP IT group created templates for inputting data on soils, management, weather, and crops into AgMIP harmonized databases, and developed translation tools for converting the harmonized data into files that are ready for multiple crop model simulations. The strategies for creating and conducting the multi-model course and developing entry and translation tools are reviewed in this chapter.

farm crops↗

Numerical Model Studies of the Martian Mesoscale Circulations

The study objectives were to evaluate by numerical modeling various possible mesoscale circulation on Mars and related atmospheric boundary layer processes. The study was in collaboration with J. Tillman of the University of Washington (who supported the study observationally). Interaction has been made with J. Prusa of Iowa State University in numerical modeling investigation of dynamical effects of topographically-influenced flow. Modeling simulations included evaluations of surface physical characteristics on: (i) the Martian atmospheric boundary layer and (ii) their impact on thermally and dynamically forced mesoscale flows. Special model evaluations were made in support of selection of the Pathfinder landing sites. J. Tillman's finding of VL-2 inter-annual temperature difference was followed by model simulations attempting to point out the forcing for this feature. Publication of the results in the reviewed literature in pending upon completion of the manuscripts in preparation as indicated later.

Segal, Moti↗

Exploring Afro-Asian water fluxes in CMIP5 and CMIP6 models: Present-day evaluation and future projections

Accurate representation and projection of water fluxes are vital, particularly in monsoon regions where seasonal variability and changes significantly impact water resources, agriculture, hydroelectric power generation, and the economy. This study uses both CMIP5 and CMIP6 models to investigate the present-day representation of key water flux components (including precipitation, evaporation, water vapor, and moisture advection) over the Afro-Asian region during the summer monsoon (JJAS). We also examine future changes under two emission scenarios and assess the underlying physical mechanisms driving these changes while identifying sources of projection uncertainty. Our results show that both models reasonably capture the present-day characteristics of water flux components, although with noticeable biases. Across most regions, we find that CMIP6 models demonstrate slight improvements over CMIP5 in the representation of these components. In a warmer future, a robust intensification of JJAS precipitation (exceeding 0.25 mm/day) is projected across the Afro-Asian region. This increase is largely driven by the vertical thermodynamic term associated with increasing temperature. We find that model uncertainty is the primary source of uncertainty in water flux projections, accounting for over 50 % of the total variance.

Climate change↗

Test evaluation of the Sperry laser gyro model ASLG 15

Various parameters were evaluated such as bias, scale factor, scale factor sensitivity to supply voltage and external temperature, and turn-on trends. Photographs and descriptions of test equipment are given, and test procedures are outlined. A systems description (electronic equipment, block diagrams), performance characteristics, and equipment specifications of the laser gyro model are given. Also considered are the laser beam optics (laser mode locking). Results are reported for the various parameters examined, and recommendations given.

Source record↗

Predictions of transonic separated flow with an eddy-viscosity/Reynolds-shear-stress closure model

In previous work, a new turbulence-closure model was specifically developed for two-dimensional turbulent boundary layers subjected to strong, adverse-pressure gradients and the attendant separation. This closure model was shown to perform well, but the inverse, boundary-layer calculations used in evaluating the model were not truly predictive since the mass-flux parameter distribution obtained from the experimental data had to be specified. The objective of this study was to evaluate this closure model for a series of strong, transonic, inviscid-viscous interactions with varying degrees of separation using a fully predictive calculation method based on the Reynolds-averaged, Navier-Stokes equations. Calculated results are compared with experimental results and are shown to be in excellent agreement, even for the interactions with massive separation. This closure model has the very favorable property of requiring little more computational effort than equilibrium, algebraic models.

Johnson, D. A.↗

Evaluation of GLAS Demonstration Model Loop Heat Pipe Thermal Vacuum Performance with Various Fluid Charges

Two loop heat pipes (LHPs) are to be used for tight thermal control of the Geoscience Laser Altimeter System (GLAS) instrument, planned for flight in late 2001. The LHPs are charged with Propylene as a working fluid. One LHP will be used to transport 110 W from a laser a radiator, the other will transport 190 W from electronic boxes to a separate radiator. The application includes a large amount of thermal mass in each LHP system and low initial startup powers. This along with some non-ideal flight design compromises, such as a less than ideal charge level for this design concept with a symmetrical secondary wick, lead to inadequate performance of the flight LHPs during the flight thermal vacuum test in October of 2000. This presentation focuses on identifying; the sources of the flight test difficulties by modifying the charge and test setup of the successfully tested Development Model Loop Heat Pipe (DM LHP). While very similar to the flight design, the DM L14P did have several significant difference in design and method of testing. These differences were evaluated for affect on performance by conforming the DM LHP to look more like the flight units. The major difference that was evaluated was the relative fill level of the working fluid within the concentrically design LHP compensation chamber. Other differences were also assessed through performance testing including starter heater size and "hot biasing" of major interior components. Performance was assessed with respect to startup, low power operation, conductance, and control heater power. The results of the testing showed that performance improves as initial charge increases, and when the starter heater is made smaller. The "hot biasing" of the major components did not appear to have a detrimental effect. As a result of test results of the DM LHP, modifications are being made to the flight units to increase the fluid charge and increase the watt-density of the starter heater.

Baker, Charles↗

Evaluation of an efficient statistical transport model for turbulent droplet dispersion in dilute combusting sprays

Evaluation of an efficient statistical transport model for turbulent droplet dispersion is made for a dilute spray of methanol droplets injected into a turbulent, axisymmnetric methane-fuelled diffusion flame burning in stagnant air. In the dispersion model, a computational parcel representing a group of physical particles (droplets) is considered to have a normal probability density function (pdf) in space. The mean is determined by Lagrangian tracking through a sequence of stochastically generated turbulent eddies and the variance is evaluated from a statistical formulation based on the linearized particle equations of motion. The basic validity of this model is established through comparison with available experimental data and with theoretical predictions using a conventional stochastic direct modeling approach. The conclusion of the evaluation is that the proposed dispersion model compares favorably with experimental data and provides a valid technique for simulating turbulent combusting sprays with significant computational savings over conventional methods.

Litchford, Ron J.↗

Development of biomechanical models for human factors evaluations

Computer aided design (CAD) techniques are now well established and have become the norm in many aspects of aerospace engineering. They enable analytical studies, such as finite element analysis, to be performed to measure performance characteristics of the aircraft or spacecraft long before a physical model is built. However, because of the complexity of human performance, CAD systems for human factors are not in widespread use. The purpose of such a program would be to analyze the performance capability of a crew member given a particular environment and task. This requires the design capabilities to describe the environment's geometry and to describe the task's requirements, which may involve motion and strength. This in turn requires extensive data on human physical performance which can be generalized to many different physical configurations. PLAID is developing into such a program. Begun at Johnson Space Center in 1977, it was started to model only the geometry of the environment. The physical appearance of a human body was generated, and the tool took on a new meaning as fit, access, and reach could be checked. Specification of fields-of-view soon followed. This allowed PLAID to be used to predict what the Space Shuttle cameras or crew could see from a given point.

Woolford, Barbara↗

Multi‐Model Ensembles in Ecosystem Modeling: Challenges and Best Practices for Decision‐Making

Ecosystem models are increasingly central to the decision-making for environmental policy, conservation planning, and climate-related investments. Yet, the growing reliance on Multi-Model Ensembles (MMEs) of ecosystem models by practitioners and policymakers, sometimes under tight timelines and imperfect information, has frequently outpaced the scientific rigor required to ensure ensemble reliability. Here, MMEs refer to approaches that combine targeted predictions from multiple models with the expectation of improving robustness and quantifying predictive uncertainty. Poorly designed MMEs may create a false sense of confidence and lead to suboptimal policy and market decisions. This perspective argues that robust decision-making-relevant MMEs must be grounded on two pillars: (1) rigorous Model Intercomparison Projects (MIPs), which identify inter-model agreement and disagreement, characterize model uncertainties, and evaluate robustness with observationally based benchmarks—MIPs' diagnostic evaluation is so critical that it must be needed to drive MME's decision in model selection and weighting, especially when only a limited number of models available; and (2) co-design by both stakeholders and scientists to ensure that scenarios, metrics and uncertainty requirements provide decision-relevant information. Building upon the past success and lessons from the existing MIPs-MMEs efforts (e.g., climate/Earth system/crop), we derived the theoretical basis for MMEs, addressed their specific challenges in ecosystem modeling, and highlighted proper consideration of model numbers and diversity, risk of model inter-dependence, effective calibration of model parameters, possible overdue of some ecosystem model development, critical roles of open benchmark data across a wide range of conditions, and suggested use of Artificial Intelligence to support MIPs-MMEs. We highlighted the under-recognized opportunity for MIPs and MMEs to drive scientific progress and innovation through identifying better performing models, systematic benchmarking, feedback loops, and targeted model improvement. By following actionable best practice guidelines, MMEs can evolve from ad hoc aggregation of models into a trusted backbone of environmental policy and decision-making.

ecosystem modeling↗

Energy Efficient High-Pressure Turbine Leakage Technology Report

The leakage test program was one of such supporting technology programs structured to provide guidance to the Energy Efficient Engine High Pressure Turbine Component Design Effort. Leakage reduction techniques were identified and evaluated. Test models were used to simulate component leak paths and to evaluate leakage reduction techniques. These models simulated the blade/disk attachment, the vane inner platform attachment, and the vane outer platform attachment combined with the blade outer airseal. Disk blade attachment testing indicated that leakage in this area could be reduced to very low levels by paying careful attention to the tolerances along the contact surface between the blade vibration damper and the blade platform contact surface. The aim of feather seal testing was to achieve a goal for an effective leakage gap of one mil (.001 inch) per inch of feather seal length. Results indicated that effective gaps even below the goal level were achievable by (1) maintaining close tolerances between feather seals and their slots to minimize end gaps and limit seal rotation, (2) avoiding feather seal overlap, and (3) minimizing feather seal intersections. W seals were shown to be effective leakage control devices. Wire rope, in its present state of development, was shown not to be an effective sealing concept for application to the component design.

Gardner, W. B.↗

Preliminary evaluation of spectral, normal and meteorological crop stage estimation approaches

Several of the projects in the AgRISTARS program require crop phenology information, including classification, acreage and yield estimation, and detection of episodal events. This study evaluates several crop calendar estimation techniques for their potential use in the program. The techniques, although generic in approach, were developed and tested on spring wheat data collected in 1978. There are three basic approaches to crop stage estimation: historical averages for an area (normal crop calendars), agrometeorological modeling of known crop-weather relationships agrometeorological (agromet) crop calendars, and interpretation of spectral signatures (spectral crop calendars). In all, 10 combinations of planting and biostage estimation models were evaluated. Dates of stage occurrence are estimated with biases between -4 and +4 days while root mean square errors range from 10 to 15 days. Results are inconclusive as to the superiority of any of the models and further evaluation of the models with the 1979 data set is recommended.

Cate, R. B.↗

Investigation of remote sensing techniques of measuring soil moisture

Major activities described include development and evaluation of theoretical models that describe both active and passive microwave sensing of soil moisture, the evaluation of these models for their applicability, the execution of a controlled field experiment during which passive microwave measurements were acquired to validate these models, and evaluation of previously acquired aircraft microwave measurements. The development of a root zone soil water and soil temperature profile model and the calibration and evaluation of gamma ray attenuation probes for measuring soil moisture profiles are considered. The analysis of spatial variability of soil information as related to remote sensing is discussed as well as the implementation of an instrumented field site for acquisition of soil moisture and meteorologic information for use in validating the soil water profile and soil temperature profile models.

Newton, R. W.↗

Visual detection of spatial contrast patterns: evaluation of five simple models

The ModelFest Phase One dataset is a collection of luminance contrast thresholds for 43 two-dimensional monochromatic spatial patterns confined to an area of approximately two by two degrees. These data were collected by a collaboration among twelve laboratories, and were designed to provide a common database for calibration and testing of spatial vision models. Here I report fits of the ModelFest data with five models: Peak Contrast, Contrast Energy, Generalized Energy, a Gabor Channels model, and a Discrete Cosine Transform model. The Gabor Channels model provides the best fit, though the other, simpler models, with the exception of Peak Contrast, provide remarkably good fits as well. Though there are clear individual differences, regularities in the data suggest the possibility of constructing a standard observer for spatial vision. c2000 Optical Society of America.

NASA Discipline Space Human Factors↗

Structural model optimization using statistical evaluation

The results of research in applying statistical methods to the problem of structural dynamic system identification are presented. The study is in three parts: a review of previous approaches by other researchers, a development of various linear estimators which might find application, and the design and development of a computer program which uses a Bayesian estimator. The method is tried on two models and is successful where the predicted stiffness matrix is a proper model, e.g., a bending beam is represented by a bending model. Difficulties are encountered when the model concept varies. There is also evidence that nonlinearity must be handled properly to speed the convergence.

Collins, J. D.↗

An Evaluation of Recent Gravity Models wrt. Altimeter Satellite Missions

With the launch of CHAMP and GRACE, we have entered a new phase in the history of satellite geodesy. For the first time, geopotential models are now available based almost exclusively on satellite-satellite tracking either with GPS in the case of the CHAMP-based geopotential models, or co-orbital intersatellite ultra-precise ranging in the case of GRACE. Different groups have analyzed these data, and produced a series of geopotential models (e.g., EIGENlS, EIGEN2, GGM0lS, GGMOlC) that incorporate the new data. We will compare the performance of these "newer" geopotential models with the standard models now used for computations, (e.g., JGM-3, BGM-96, PGS7727, and GRIMS-C1) for TOPEX, JASON, Geosat-Follow-On (GFO), and Envisat using standard metrics such as SLR RMS of fit, altimeter crossovers, and orbit overlaps. Where covariances are available we can evaluate the predicted geographically correlated orbit error. These predicted results can be compared with the Earth-fixed differences between dynamic and reduced-dynamic orbits to test the predictive accuracy of the covariances, as well as to calibrate the error of the solutions.

Lemoine, Frank G.↗