A performance study of the lunar module's landing radar system.
Lunar landing module Doppler radar system in guidance navigation and control system, studying mathematical model performance
Eichler, J.↗
SEARCH · Engineering Papers
Results for “Performance Modeling”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Gaining Perspective on Unconventional Well Design Choices through Play-level Application of Machine Learning Modeling
The recent development of unconventional oil and gas (O&G) reservoirs has led to an abundant hydrocarbon supply, both domestically and globally. However, there is a continued push to develop new and innovative approaches to improve exploration and extraction efficiencies and overall well productivity moving forward. Substantial improvements in unconventional O&G development are expected through optimized well completion and stimulation strategies aimed at maximizing well productivity. Optimizing well designs will require tailoring to the distinctive geologic conditions present for any newly placed well. To better evaluate the impact of well design attributes and their associated interactions on productivity in a major unconventional play, multivariate machine learning-based models that use empirical datasets were developed. A gradient boosted regression tree (GBRT) algorithm was applied. GBRT has been narrowly investigated for O&G applications but enables straightforward parametric importance and influence evaluation, as well as assessment of parameter interaction effects. Models were trained on well design and locational parameters that serve as a proxy for variable geologic conditions to estimate two types of productivity indicator response variables strongly correlated to estimated ultimate recovery (EUR). The dataset utilized consists of over 7,000 well observations that cover the majority of the productive region of the Marcellus Shale. Model performance was evaluated and algorithm parameters tuned by analyzing the goodness-of-fit for simulated results against observed data in a cross-validation approach. Models were found capable of 73–79 percent prediction accuracy on held out testing data of gas equivalent production and can be used to inform future well design and placement decisions for increasing EUR per well and improving overall field-level recovery. Study results indicate that Marcellus well performance improves most with upscaling perforated interval lengths and water and proppant volumes per foot; but relative productivity improvements are spatially dependent across the play. Finally, optimal combinations of water and proppant on well performance were found to vary depending on well location, emphasizing the utility of data-driven models capable of broad application across a play of interest for informing tailored well design approaches prior to their field deployment.
04 OIL SHALES AND TAR SANDS↗
Approximation of ice phenology of Maine lakes using Aqua MODIS surface temperature data
Studies of lake ice phenology have historically relied on limited in situ data. Relatively few observations exist for ice out and fewer still for ice in, both of which are necessary to determine the temporal extent of ice cover. Satellite data provide an opportunity to better document patterns of ice phenology across landscapes and relate them to the climatological drivers behind changing ice phenology. We developed a model, the Cumulative Sum Method (CSM), that uses daytime and nighttime surface temperature observations from the Moderate Resolution Imaging Spectroradiometer (MODIS) sensor on board the Earth-observing Aqua satellite to approximate ice in (the onset of ice cover) and ice out from training datasets of 13 and 58 Maine lakes, respectively, during the 2002/2003 through 2017/2018 ice seasons. Ice in was signaled by reaching a threshold of cumulative negative degrees following the first day of the season below 0°C. Ice out was signaled by reaching a threshold of cumulative positive degrees following the first day of the year above 0°C. The comparison of observed and remotely sensed ice-in dates showed relative agreement with a correlation coefficient of 0.71 and a mean absolute error (MAE) of 9.8 days. Ice-out approximations had a correlation coefficient of 0.67 and an MAE of 8.8 days. Lakes smaller in surface area and nearer the Atlantic coast had the greatest error in approximation. Application of the CSM to 20 additional lakes in Maine produced a comparable ice-out MAE of 8.9 days. Ice-out model performance was weaker for the warmest years; there was a larger MAE of 12.0 days when the model was applied to the years 2019–2023 for the original 58 lakes. The development of this model, which utilizes daily satellite data, demonstrates the promise of remote sensing for quantifying ice phenology over short, temporal scales, and wider geographic regions than can be observed in situ, and allows exploration of the influence of surface temperature patterns on the process and timing of ice in and ice out.
54 ENVIRONMENTAL SCIENCES↗
Complementing Dynamical Downscaling With Super‐Resolution Convolutional Neural Networks
Despite advancements in Artificial Intelligence (AI) methods for climate downscaling, significant challenges remain for their practicality in climate research. Current AI-methods exhibit notable limitations, such as limited application in downscaling Global Climate Models (GCMs), and accurately representing extremes. To address these challenges, we implement an AI-based methodology using super-resolution convolutional neural networks (SRCNN), trained and evaluated on 40 years of daily precipitation data from a reanalysis and a high-resolution dynamically downscaled counterpart. The dynamical downscaled simulations, constrained using spectral nudging, enable the replication of historical events at a higher resolution. This allows the SRCNN to emulate dynamical downscaling effectively. Modifications, such as incorporating elevation data and data pre-processing enhances overall model performance, while using exponential and quantile loss functions improve the simulation of extremes. Our findings show SRCNN models efficiently and skillfully downscale precipitation from GCMs. Future work will expand this methodology to downscale additional variables for future climate projections.
54 ENVIRONMENTAL SCIENCES↗
An in silico method to assess antibody fragment polyreactivity
Antibodies are essential biological research tools and important therapeutic agents, but some exhibit non-specific binding to off-target proteins and other biomolecules. Such polyreactive antibodies compromise screening pipelines, lead to incorrect and irreproducible experimental results, and are generally intractable for clinical development. Here, we design a set of experiments using a diverse naïve synthetic camelid antibody fragment (nanobody) library to enable machine learning models to accurately assess polyreactivity from protein sequence (AUC > 0.8). Moreover, our models provide quantitative scoring metrics that predict the effect of amino acid substitutions on polyreactivity. We experimentally test our models’ performance on three independent nanobody scaffolds, where over 90% of predicted substitutions successfully reduced polyreactivity. Importantly, the models allow us to diminish the polyreactivity of an angiotensin II type I receptor antagonist nanobody, without compromising its functional properties. We provide a companion web-server that offers a straightforward means of predicting polyreactivity and polyreactivity-reducing mutations for any given nanobody sequence.
60 APPLIED LIFE SCIENCES↗
The effect of relative humidity and temperature on the response of stomatal conductance to vapor pressure deficit in tropical trees
Understanding how leaf gas exchange responds to changes in vapor pressure deficit (VPD) is key to predicting tropical forest resilience to climate change. Stomata regulate leaf water and CO2 diffusion, and respond to changes in temperature and relative humidity (RH), two drivers of VPD. At high temperatures, the cuticular pathway may also become significant and participate in the overall leaf conductance. Here, we measured gas exchange under light and dark conditions to investigate the stomatal and cuticular responses to temperature and RH on detached branches in five tropical tree species. Leaf conductance in the dark, when stomata are essentially closed, was not markedly impacted by temperature and RH, suggesting a minimal response of the cuticular pathway to these conditions. We compared six steady-state conductance models incorporating different effects of photosynthesis and evaporative demand on stomatal control. All models performed well (residual standard deviation, σ, < 0.025 mol m-2 s-1), but the best-fitting model (σ = 0.017 mol m-2 s-1) used a nonlinear relationship between photosynthesis and stomatal conductance and incorporated RH rather than vapor pressure difference. All models overestimated the steady-state conductance at high RH. Furthermore, leaf conductance immediately increased after a decrease in RH (wrong-way response), but not after an increase in leaf temperature. This suggests that the mechanisms underlying stomatal response to VPD need further investigation. The non-linear coupling between photosynthetic rate and stomatal conductance indicates a sharper physiological response than previously acknowledged.
Lamour, Julien↗
Automatic Waveform Quality Control for Surface Waves Using Machine Learning
Surface-wave seismograms are widely used by researchers to study Earth’s interior and earthquakes. To extract information reliably and robustly from a suite of surface waveforms, the signals require quality control screening to reduce artifacts from signal complexity and noise. This process has usually been completed by human experts labeling each waveform visually, which is time consuming and tedious for large data sets. We explore automated approaches to improve the efficiency of waveform quality control processing by investigating logistic regression, support vector machines, K-nearest neighbors, random forests (RF), and artificial neural networks (ANN) algorithms. To speed up signal quality assessment, we trained these five machine learning (ML) methods using nearly 400,000 human-labeled waveforms. The ANN and RF models outperformed other algorithms and achieved a test accuracy of 92%. We evaluated these two best-performing models using seismic events from geographic regions not used for training. The results show that the two trained models agree with labels from human analysts but required only 0.4% of the time. Although the original (human) quality assignments assessed general waveform signal-to-noise, the ANN or RF labels can help facilitate detailed waveform analysis. Our investigations demonstrate the capability of the automated processing using these two ML models to reduce outliers in surface-wave-related measurements without human quality control screening.
58 GEOSCIENCES↗
Meeting Global Health Needs via Infectious Disease Forecasting: Development of a Reliable Data-Driven Framework
Infectious diseases (IDs) have a significant detrimental impact on global health. Timely and accurate ID forecasting can result in more informed implementation of control measures and prevention policies. To meet the operational decision-making needs of real-world circumstances, we aimed to build a standardized, reliable, and trustworthy ID forecasting pipeline and visualization dashboard that is generalizable across a wide range of modeling techniques, IDs, and global locations. We forecasted 6 diverse, zoonotic diseases (brucellosis, campylobacteriosis, Middle East respiratory syndrome, Q fever, tick-borne encephalitis, and tularemia) across 4 continents and 8 countries. We included a wide range of statistical, machine learning, and deep learning models (n=9) and trained them on a multitude of features (average n=2326) within the One Health landscape, including demography, landscape, climate, and socioeconomic factors. The pipeline and dashboard were created in consideration of crucial operational metrics—prediction accuracy, computational efficiency, spatiotemporal generalizability, uncertainty quantification, and interpretability—which are essential to strategic data-driven decisions. While no single best model was suitable for all disease, region, and country combinations, our ensemble technique selects the best-performing model for each given scenario to achieve the closest prediction. For new or emerging diseases in a region, the ensemble model can predict how the disease may behave in the new region using a pretrained model from a similar region with a history of that disease. The data visualization dashboard provides a clean interface of important analytical metrics, such as ID temporal patterns, forecasts, prediction uncertainties, and model feature importance across all geographic locations and disease combinations. As the need for real-time, operational ID forecasting capabilities increases, this standardized and automated platform for data collection, analysis, and reporting is a major step forward in enabling evidence-based public health decisions and policies for the prevention and mitigation of future ID outbreaks.
60 APPLIED LIFE SCIENCES↗
Methods for Incorporating Model Uncertainty into Exoplanet Atmospheric Analysis
A key goal of exoplanet spectroscopy is to measure atmospheric properties, such as abundances of chemical species, in order to connect them to our understanding of atmospheric physics and planet formation. In this new era of high-quality JWST data, it is paramount that these measurement methods are robust. When comparing atmospheric models to observations, multiple candidate models may produce reasonable fits to the data. Typically, conclusions are reached by selecting the best-performing model according to some metric. This ignores model uncertainty in favor of specific model assumptions, potentially leading to measured atmospheric properties that are overconfident and/or incorrect. In this paper, we compare three ensemble methods for addressing model uncertainty by combining posterior distributions from multiple analyses: Bayesian model averaging, a variant of Bayesian model averaging using leave-one-out predictive densities, and stacking of predictive distributions. We demonstrate these methods by fitting the Hubble Space Telescope (HST) + Spitzer transmission spectrum of the hot Jupiter HD 209458b using models with different cloud and haze prescriptions. All of our ensemble methods lead to uncertainties on retrieved parameters that are larger but more realistic and consistent with physical and chemical expectations. Since they have not typically accounted for model uncertainty, uncertainties of retrieved parameters from HST spectra have likely been underreported. We recommend stacking as the most robust model combination method. Our methods can be used to combine results from independent retrieval codes and from different models within one code. They are also widely applicable to other exoplanet analysis processes, such as combining results from different data reductions.
79 ASTRONOMY AND ASTROPHYSICS↗
Ultrasonic Transducer Irradiation Test Results
Ultrasonic technologies offer the potential for high accuracy and resolution in-pile measurement of a range of parameters, including geometry changes, temperature, crack initiation and growth, gas pressure and composition, and microstructural changes. Many Department of Energy-Office of Nuclear Energy (DOE-NE) programs are exploring the use of ultrasonic technologies to provide enhanced sensors for in-pile instrumentation during irradiation testing. For example, the ability of small diameter ultrasonic thermometers (UTs) to provide a temperature profile in candidate metallic and oxide fuel would provide much needed data for validating new fuel performance models. These efforts are limited by the lack of identified ultrasonic transducer materials capable of long term performance under irradiation test conditions. To address this need, the Pennsylvania State University (PSU) was awarded an Advanced Test Reactor National Scientific User Facility (ATR NSUF) project to evaluate the performance of promising magnetostrictive and piezoelectric transducers in the Massachusetts Institute of Technology Research Reactor (MITR) up to a fast fluence of at least 1021 n/cm2 . A multi-National Laboratory collaboration funded by the Nuclear Energy Enabling Technologies Advanced Sensors and Instrumentation (NEET ASI) program also provided initial support for this effort. This irradiation, which started in February 2014, is an instrumented lead test and real-time transducer performance data are collected along with temperature and neutron and gamma flux data. The irradiation is ongoing and will continue to approximately mid-2015. To date, very encouraging results have been attained as several transducers continue to operate under irradiation.
Daw, Joshua↗
Display/control requirements for automated VTOL aircraft
A systematic design methodology for pilot displays in advanced commercial VTOL aircraft was developed and refined. The analyst is provided with a step-by-step procedure for conducting conceptual display/control configurations evaluations for simultaneous monitoring and control pilot tasks. The approach consists of three phases: formulation of information requirements, configuration evaluation, and system selection. Both the monitoring and control performance models are based upon the optimal control model of the human operator. Extensions to the conventional optimal control model required in the display design methodology include explicit optimization of control/monitoring attention; simultaneous monitoring and control performance predictions; and indifference threshold effects. The methodology was applied to NASA's experimental CH-47 helicopter in support of the VALT program. The CH-47 application examined the system performance of six flight conditions. Four candidate configurations are suggested for evaluation in pilot-in-the-loop simulations and eventual flight tests.
Hoffman, W. C.↗
Validation for Global Solar Wind Prediction Using Ulysses Comparison: Multiple Coronal and Heliospheric Models Installed at the Community Coordinated Modeling Center
The prediction of the background global solar wind is a necessary part of space weather forecasting. Several coronal and heliospheric models have been installed and/or recently upgraded at the Community Coordinated Modeling Center (CCMC), including the Wang-Sheely-Arge (WSA)-Enlil model, MHD-Around-a-Sphere (MAS)-Enlil model, Space Weather Modeling Framework (SWMF), and Heliospheric tomography using interplanetary scintillation data. Ulysses recorded the last fast latitudinal scan from southern to northern poles in 2007. By comparing the modeling results with Ulysses observations over seven Carrington rotations, we have extended our third-party validation from the previous near-Earth solar wind to middle to high latitudes, in the same late declining phase of solar cycle 23. Besides visual comparison, wehave quantitatively assessed the models capabilities in reproducing the time series, statistics, and latitudinal variations of solar wind parameters for a specific range of model parameter settings, inputs, and grid configurations available at CCMC. The WSA-Enlil model results vary with three different magnetogram inputs.The MAS-Enlil model captures the solar wind parameters well, despite its underestimation of the speed at middle to high latitudes. The new version of SWMF misses many solar wind variations probably because it uses lower grid resolution than other models. The interplanetary scintillation-tomography cannot capture the latitudinal variations of solar wind well yet. Because the model performance varies with parameter settings which are optimized for different epochs or flow states, the performance metric study provided here can serve as a template that researchers can use to validate the models for the time periods and conditions of interest to them.
Jian, L. K.↗
Climate Model Diagnostic Analyzer
The comprehensive and innovative evaluation of climate models with newly available global observations is critically needed for the improvement of climate model current-state representation and future-state predictability. A climate model diagnostic evaluation process requires physics-based multi-variable analyses that typically involve large-volume and heterogeneous datasets, making them both computation- and data-intensive. With an exploratory nature of climate data analyses and an explosive growth of datasets and service tools, scientists are struggling to keep track of their datasets, tools, and execution/study history, let alone sharing them with others. In response, we have developed a cloud-enabled, provenance-supported, web-service system called Climate Model Diagnostic Analyzer (CMDA). CMDA enables the physics-based, multivariable model performance evaluations and diagnoses through the comprehensive and synergistic use of multiple observational data, reanalysis data, and model outputs. At the same time, CMDA provides a crowd-sourcing space where scientists can organize their work efficiently and share their work with others. CMDA is empowered by many current state-of-the-art software packages in web service, provenance, and semantic search.
cloud computing↗
Modeling Quiet Solar Luminosity Variability from TSI Satellite Measurements and Proxy Models During 1980–2018
A continuous record of direct total solar irradiance (TSI) observations began with a series of satellite experiments in 1978. This record requires comparisons of overlapping satellite observations with adequate relative precisions to provide useful long term TSI trend information. Herein we briefly review the active cavity radiometer irradiance monitor physikalisch-meteorologisches observatorium davos (ACRIM-PMOD) TSI composite controversy regarding how the total solar irradiance (TSI) has evolved since 1978 and about whether TSI significantly increased or slightly decreased from 1980 to 2000. The main question is whether TSI increased or decreased during the so-called ACRIM-gap period from 1989 to 1992. There is significant discrepancy between TSI proxy models and observations before and after the gap, which requires a careful revisit of the data analysis and modeling performed during the ACRIM-gap period. In this study, we use three recently proposed TSI proxy models that do not present any TSI increase during the ACRIM-gap, and show that they agree with the TSI data only from 1996 to 2016. However, these same models significantly diverge from the observations from 1981 and 1996. Thus, the scaling errors must be different between the two periods, which suggests errors in these models. By adjusting the TSI proxy models to agree with the data patterns before and after the ACRIM-gap, we found that these models miss a slowly varying TSI component. The adjusted models suggest that the quiet solar luminosity increased from the 1986 to the 1996 TSI minimum by about 0.45 W/sq.m reaching a peak near 2000 and decreased by about 0.15 W/sq.m from the 1996 to the 2008 TSI cycle minimum. This pattern is found to be compatible with the ACRIM TSI composite and confirms the ACRIM TSI increasing trend from 1980 to 2000, followed by a long-term decreasing trend since.
Scafetta, Nicola↗
Modeling Quiet Solar Luminosity Variability from TSI Satellite Measurements and Proxy Models during 1980-2018
A continuous record of direct total solar irradiance (TSI) observations began with a series of satellite experiments in 1978. This record requires comparisons of overlapping satellite observations with adequate relative precisions to provide useful long term TSI trend information. Herein we briefly review the active cavity radiometer irradiance monitor physikalisch-meteorologisches observatorium davos (ACRIM-PMOD) TSI composite controversy regarding how the total solar irradiance (TSI) has evolved since 1978 and about whether TSI significantly increased or slightly decreased from 1980 to 2000. The main question is whether TSI increased or decreased during the so-called ACRIM-gap period from 1989 to 1992. There is significant discrepancy between TSI proxy models and observations before and after the gap, which requires a careful revisit of the data analysis and modeling performed during the ACRIM-gap period. In this study, we use three recently proposed TSI proxy models that do not present any TSI increase during the ACRIM-gap, and show that they agree with the TSI data only from 1996 to 2016. However, these same models significantly diverge from the observations from 1981 and 1996. Thus, the scaling errors must be different between the two periods, which suggests errors in these models. By adjusting the TSI proxy models to agree with the data patterns before and after the ACRIM-gap, we found that these models miss a slowly varying TSI component. The adjusted models suggest that the quiet solar luminosity increased from the 1986 to the 1996 TSI minimum by about 0.45 W/m2 reaching a peak near 2000 and decreased by about 0.15 W/m2 from the 1996 to the 2008 TSI cycle minimum. This pattern is found to be compatible with the ACRIM TSI composite and confirms the ACRIM TSI increasing trend from 1980 to 2000, followed by a long-term decreasing trend since.
total solar irradiance↗
Using Ultrasound Image Augmentation and Ensemble Predictions to Prevent Machine-Learning Model Overfitting
Deep learning predictive models have the potential to simplify and automate medical imaging diagnostics by lowering the skill threshold for image interpretation. However, this requires predictive models that are generalized to handle subject variability as seen clinically. Here, we highlight methods to improve test accuracy of an image classifier model for shrapnel identification using tissue phantom image sets. Using a previously developed image classifier neural network—termed ShrapML—blind test accuracy was less than 70% and was variable depending on the training/test data setup, as determined by a leave one subject out (LOSO) holdout methodology. Introduction of affine transformations for image augmentation or MixUp methodologies to generate additional training sets improved model performance and overall accuracy improved to 75%. Further improvements were made by aggregating predictions across five LOSO holdouts. This was done by bagging confidences or predictions from all LOSOs or the top-3 LOSO confidence models for each image prediction. Top-3 LOSO confidence bagging performed best, with test accuracy improved to greater than 85% accuracy for two different blind tissue phantoms. This was confirmed by gradient-weighted class activation mapping to highlight that the image classifier was tracking shrapnel in the image sets. Overall, data augmentation and ensemble prediction approaches were suitable for creating more generalized predictive models for ultrasound image analysis, a critical step for real-time diagnostic deployment.
60 APPLIED LIFE SCIENCES↗
A performance and reliability model for thermal barrier coatings
A modeling technique for predicting the performance and reliability of TBC's is being developed at Solar Turbines Incorporated. The concept combines experimental coating property data with finite element analyses to predict the thermal and mechanical behavior of coating systems in service. A key feature of Solar's approach is the use of a four point flexure test to estimate coating strength distributions and to predict coating failure probability. This model was used to evaluate the effect of physical variations on coating performance in high heat flux rocket engine applications for NASA. Current work, promoted by Caterpillar Tractor Company for diesel engine applications, is being conducted to measure coating strength as a function of temperature, and future work will document strength degradation with time at temperature. Solar's interest lies in the application of TBCs to gas turbine engine components.
Batakis, A. P.↗
Tokamak divertor plasma emulation with machine learning
Abstract Future tokamak devices that aim to create conditions relevant to power plant operations must consider strategies for mitigating damage to plasma facing components in the divertor. One of the goals of MAST-U tokamak operations is to inform these considerations by researching advanced divertor configurations that aid stable plasma detachment. Machine design, scenario planning and detachment control would all greatly benefit from tools that enable rapid calculation of scenario-relevant quantities given some input parameters. This paper presents a method for generating large, simulated scrape-off layer data sets, which was applied to generate a data set of steady-state Hermes-3 simulations of the MAST-U tokamak. A machine learning model was constructed using a Bayesian approach to hyperparameter optimisation to predict diagnosable output quantities given control-relevant input features. The resulting best-performing model, which is based on a feedforward neural network, achieves high accuracy when predicting electron temperature at the divertor target and carbon impurity radiation front position and runs in around 1 ms in inference mode. Techniques for interpreting the predictions made by the model were applied, and a high-resolution parameter scan of upstream conditions was performed to demonstrate the utility of rapidly generating accurate predictions using the emulator. This work represents a step forward in the design of machine learning-driven emulators of tokamak exhaust simulation codes in operational modes relevant to divertor detachment control and plasma scenario design.
70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗