Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “SCORE”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40

Effects of Resolution and Spectral Nudging in Simulation the Effects of Wintertime Atmospheric River Landfalls in the Western US

Landfalling atmospheric rivers (ARs) play a crucial role in the climate of the US Pacific coast region as they are frequently related with heavy precipitation and flash flooding events. Thus, the capability of climate models to accurately simulate AR landfalls and their key hydrologic effects is an important practical concern for WUS, from flood forecasting to future water resources projections. In order to examine the effects of model configuration, including the resolution and spectral nudging, in simulating the climatology of key weather events in the conterminous US, a NASA team has performed a hindcast experiment using the GEOS5 global and the NU-WRF regional models for Nov 1999 - Oct 2010. This study examines the skill of these hindcasts, with different models and their configurations, in simulating key footprints of landfalling ARs in the WUS region. Using an AR-landfall chronology based on the vertically-integrated water vapor flux calculated from the MERRA2 reanalysis, we have analyzed the observed and simulated precipitation and temperature anomalies associated with wintertime AR landfalls along the US Pacific coast. Model skill is measured using metrics including regional means, a skill score based on correlations and mean-square errors, and Taylor diagrams in four WUS Bukovsky regions. Results show that the AR-related anomalies of precipitation is more reliable than of surface temperatures. Model skill also varies according to regions. The AR temperature anomalies are well simulated in most of the WUS region except PNW. For precipitation, simulations with finer spatial resolution tend to generate larger spatial variability and agree better with the PRISM data in most regions. Such a resolution dependence of spatial variability is not found for temperatures; e.g., the MERRA2 reanalysis often outperforms, with similar spatial variability and higher pattern correlations with the PRISM data, finer-resolution NU-WRF runs in simulating temperature variations within subregions. Results from this study will be summarized to assist future (regional) climate experiments for climate change impact assessments and developing adaptationmitigation strategies, the key elements of the National Climate Assessment.

Simulation↗

Impact of GMI All-Sky Radiance Assimilation in the NASA GEOS Forecast System

The assimilation of cloud- and precipitation-affected ("all-sky") radiances has become an important focus of development at most numerical weather prediction centers. Efforts at the Global Modeling and Assimilation Office (GMAO) have focused on all-sky assimilation of GPM Microwave Imager (GMI) radiances, which became operational in the GEOS real-time production system in July 2018. Implementation of the all-sky capability required several upgrades to the GEOS hybrid 4D-EnVar assimilation infrastructure including the addition of control variables for cloud liquid, cloud ice, rain and snow, enhancements to the radiative transfer model, new hybrid background and observational error models, and modified quality control and bias correction procedures. This talk describes the impact of GMI all-sky radiance assimilation on GEOS analyses and forecasts as determined from examination of various metrics including statistics of background departures and analysis increments, forecast skill scores, and forecast sensitivity observation impact (FSOI) calculations. It is shown that in addition to the hydrometeors themselves, the initial wind, temperature and pressure fields all undergo significant dynamic adjustment in response to the analyzed cloud and precipitation features. Assimilation of GMI radiances leads to improved forecasts of lower tropospheric wind, temperature and humidity, especially in the tropics. The largest forecast improvements occur during the first 48 hours, with diminishing impact thereafter. However, combining GMI all-sky assimilation with improvements to the GEOS model physics as in the recent implementation of the real-time production system, extends these forecast improvements well in to the medium range. FSOI results based on a 24-hr moist global energy norm show that GMI radiances provide nearly uniform beneficial impact throughout the tropics, with more mixed impacts in the subtropics. While the overall impact of GMI is smaller than that of other, much more numerous microwave and hyperspectral infrared radiance types, its impact is among the largest of all radiance types on a per-observation basis.

Gelaro, Ron↗

Bringing Climate Scientist's Tools into Classrooms to Improve Conceptual Understandings

Efforts to address anthropogenic global climate change (AGCC) require public understanding of Earth and climate science. To meet this need, educational reforms and prominent scientists have called for instructional approaches that teach students how climate scientists examine AGCC. Yet, only a few educational studies have reported clear empirical results on what instructional approaches and climate education technologies best accomplish this goal. This manuscript presents detailed analysis and statistically significant results on the educational impact pre to post of students learning to use a National Aeronautics and Space Administration (NASA) global climate model (GCM). This series of case studies demonstrates that differing instructional approaches and climate education technologies result in differing levels of understanding of AGCC and ability to engage with policies addressing it. Students who learned the scientific process of climate modeling scored significantly higher pre to post on exams (quantitatively) and gained more complete conceptual understandings of the issue (qualitatively). Yet, teaching students to conduct research with complex technology can be difficult. This study also found lecture-based learning better improved recall of facts about GCMs tested by multiple-choice questions. Our findings indicate what educational systems and related technologies might provide the public with the conceptual understandings necessary to engage in the political debate over AGCC.

Public understanding↗

NOAA-20 ATMS Status: ATMS SDR Team

Data quality looks better than Suomi-NPP (Suomi National Polar-orbiting Partnership): similar biases. Smaller standard deviation of first guess departures and diagnosed observation errors. Weaker striping signal than Suomi-NPP ATMS (Advanced Technology Microwave Sounder). Improved first guess fits to: temperature observations (AMSU-A (Advanced Microwave Sounding Unit-A), CrIS (Cross-track Infrared Sounder), GPSRO (Global Positioning System Radio Occultation)); Humidity observations (MHS (Microwave Humidity Sounder), GEO CSRs (Geostationary Orbit Clear Sky Radiances)). Indicates improved accuracy of short range temperature and humidity forecasts. Neutral to slightly positive forecast scores.

Sensor Data Record (SDR)↗

Prediction of Solar Energetic Particle Event Peak Proton Intensity Using a Simple Algorithm Based on CME Speed and Direction and Observations of Associated Solar Phenomena

We assess whether a formula obtained by Richardson et al. (2014,https://doi.org/10.1007/s11207-014-0524-8) relating the peak intensity of 14- to 24-MeV protons in a solar energetic particle (SEP) event at 1 AU to the solar event location and the speed of the associated coronal mass ejection (CME) may be used in a scheme to predict the intensity of an SEP event at any location at this heliocentric distance. Starting with all 334 CMEs in the CCMC/SWRC DONKI database in October 2011 to July 2012, we use the CME speed and direction to predict the proton intensity at Earth and the two Solar Terrestrial Relations Observatory spacecraft using this formula. Since most (85%)of these CMEs were not in fact associated with SEP events, many SEP events are predicted that are not actually observed. Such cases may be reduced by considering whether type II or type III radio emissions accompany the CMEs, or by selecting faster, wider CMEs. This method is also applied to predict the SEP intensities associated with 1,100 CMEs observed by the Solar and Heliospheric Observatory Large Angle and Spectrometric Coronagraph during 1997-2006 in solar cycle 23. Various skill scores are calculated, which assess different aspects of the skill of the SEP predictions. We conclude that the Richardson et al. (2014) formula has potential as a simple empirical SEP intensity prediction tool.

coronal mass ejections↗

Sensor Analysis, Modeling, and Test for Robust Propulsion System Autonomy

An approach is presented supporting analysis, modeling, and test validation of operational flight instrumentation (OFI) that facilitates critical functions for the Space Launch System (SLS) main propulsion system (MPS). Certain types of OFI sensors were shown to exhibit highly nonlinear and non-gaussian noise characteristics during acceptance testing, motivating the development of advanced modeling and simulation (M&S) capability to support algorithm verification and flight certification. Hardware model and algorithm simulation fidelity was informed by a risk scoring metric; redesign of high-risk algorithms using test-validated sensor models significantly improved their expected performance as evaluated using Monte Carlo acceptance sampling methods. Autonomous functions include closed-loop ullage pressure regulation, pressurant leak detection, and fault isolation for automated safing and crew caution and warning (C&W).

Orr, Jeb S.↗

The Interaction Between Boundary Layer and Convection Schemes in a WRF Simulation of Post‐Cold‐Frontal Clouds over the ARM East North Atlantic Site

The correct representation of lowlevel midlatitude clouds found in the wake of cold fronts strongly relies on the representation of planetary boundary layer (PBL) and convection processes, which are typically parameterized separately in numerical models. Using the Weather Research and Forecasting Model (WRF), this study investigates how distinct pairs of PBL and convection parameterization schemes represent cloud fraction in the postcoldfrontal region. The simulations focus on the region of the DOEARM Eastern North Atlantic observation site in the Azores Islands in the wake of a cold front that passed on December 25, 2015. Different PBL and convection schemes are combined to create 12 distinct configurations. The main differences between the selected physical parameterizations are the strength of vertical mixing and the entrainment. The simulations produce a wide range of cloud fractions, where some configurations significantly underestimate while others clearly overestimate satellite and surfacebased estimates of cloud fraction. A skill score is used to quantitatively assess the performance of each configuration with respect to groundbased radar data. The key processes that are found to significantly impact the cloud fraction distribution are the strength of the PBL decoupling, the vertical wind shear, entrainment and detrainment rates in shallow convection and the occurrence of drizzle. This indicates that to successfully simulate postcoldfrontal clouds, modeled physics must balance strong internal vertical mixing and weak exchange with the free troposphere. For this case study, cloud fraction was more sensitive to the choice of convection scheme than PBL scheme.

moist convection interaction between parameterizat↗

Representativeness of CO and O3 Along ATom Transects Derived from GEOS-5 and GMI-CTM Simulations

One major goal for the NASA Atmospheric Tomography Mission (ATom) is producing an observation-based chemical climatology to represent the atmospheric heterogeneity. In this study, we use CO and O3 observations and global atmospheric model simulations to examine the spatial representativeness of the ATom-1 and -2 transects within a 4D framework provided by the NASA GEOS-5 and GMI-CTM models. Based on the probability density functions, we find that the variability of CO and O3 along the flight tracks is well hindcast by the model when sampled per ATom flights. The CO variations along the ATom-transect are likely representative of the typical CO variations over the whole Pacific basin during both the ATom-1 and -2 periods, the northern Atlantic during the ATom-1 period, and the tropical Atlantic in the ATom-2 period. Over southern Atlantic, CO along the ATom-1 transects is likely less well mixed than that of the broader region, but is still representative of the median CO concentration. CO along the ATom-2 transect is likely higher than the median CO concentration over this region. For O3, the agreements between PDFs of O3 sampled along the ATom transects and over the broader regions are fair to good over all six regions (Scores > 0.65) with notable discrepancies over some regions. For example, in ATom-1 over the northern Pacific and Atlantic, the transect samples air masses with higher O3 levels. During ATom-2, the transect over-represents the occurrence of O3 plumes over tropical Pacific. Over the southern Pacific and Atlantic for both ATom-1 and -2, the transects have a less uniform distribution compared to the surrounding basins, but still represent the median O3 abundance. Overall, we conclude in most cases that ATom measurements represent the statistical variations of these two species over the ocean basins at the time of measurement. Higher-order statistics, including covariance of species, has not been tested in this study.

ozone↗

Mitigation of Attentional Tunneling in the Flight Deck Using a Spatial Auditory Display

The role of attentional bias to a specific form of information, e.g., visual versus aural instructions, was evaluated to address the issue of attentional fixation (i.e., "cognitive tunneling") in the flight deck. A method of mitigating attentional tunneling using a spatial auditory display was evaluated in the presence and absence of a biasing factor. Data were gathered for participant recognition, accuracy and response times to aural and visual instructions under different conditions of distractor stimuli. Results showed a significant main effect for target acquisition with the use of spatial audio techniques. No significant main effects or interactions were found for target acquisition timing. Target acquisition was not affected by a "gaming score" biasing factor associated with the distractor tasks.

readback errors↗

San Francisco Bar Pilot Fatigue Study

The purpose of this study was to evaluate the extent of fatigue among San Francisco Bar Pilots (Maritime Pilots) and its potential impact on safety, and to make recommendations concerning how the risk of fatigue could be managed. Information was gathered via a literature review, observations of Bar Pilots at work, surveys, a task analysis, and an analysis of dispatch records.The work of San Francisco Bar Pilots involves an unusual mix of activities and job demands. Their work calls for situational awareness, reasoning, communication, and perceptual abilities comparable to those required by airline pilots and air traffic controllers. Errors can have severe consequences for public safety and the environment, as well as significant financial costs. Fatigue is increasingly recognized as a hazard that must be managed by the transportation industry. The reduced sleep quality and quantity experienced by personnel who work at night, in conjunction with human circadian rhythms can lead to an operationally significant level of cognitive impairment. The cognitive impact of fatigue includes functions that are critical to safe maritime piloting, such as vigilance, judgment, reaction time and communication. The surveys distributed to Bar Pilots did not uncover evidence of widespread fatigue. The survey results also suggested that fatigue was not a major concern of Bar Pilots. Bar Pilots had overall low scores on the subjective fatigue measures used in the survey, and generally assessed the safety risk due to fatigue as low. Compared to air traffic controllers, Bar Pilots gave significantly lower ratings on questions concerning the prevalence and impact of fatigue. The application of fatigue modeling software to Bar Pilot dispatch records identified that in most cases, pilot's cognitive effectiveness was predicted to be acceptable during their duty periods. However, these results could not be verified with objective data.The study identified a number of fatigue issues that deserve attention. These include Bar Pilot work periods that frequently infringe on the circadian low, consecutive work periods without a significant break, consecutive periods of night work, unpredictable work schedules, start time variability, the potential for sleep inertia, and the number of pilots on the board at any given time.

fatigue↗

FAIRness and Usability for Open-access Omics Data Systems

Omics data sharing is crucial to the biological research community, and the last decade or two has seen a huge rise in collaborative analysis systems, databases, and knowledge bases for omics and other systems biology data. We assessed the "FAIRness" of NASA's GeneLab Data Systems (GLDS) along with four similar kinds of systems in the research omics data domain, using 14 FAIRness metrics. The range of overall FAIRness scores was 6-12 (out of 14), average 10.1, and standard deviation 2.4. The range of Pass ratings for the metrics was 29-79%, Partial Pass 0-21%, and Fail 7-50%. The systems we evaluated performed the best in the areas of data findability and accessibility, and worst in the area of data interoperability. Reusability of metadata, in particular, was frequently not well supported. We relate our experiences implementing semantic integration of omics data from some of the assessed systems for federated querying and retrieval functions, given their shortcomings in data interoperability. Finally, we propose two new principles that Big Data system developers, in particular, should consider for maximizing data accessibility.

Berrios, Daniel C.↗

Evaluation of Multiple Flow Constrained Area Capacity Setting Methods for Collaborative Trajectory Options Program

The purpose of this study was to compare flow constrained area (FCA) capacity setting methods for Collaborative Trajectory Options Program (CTOP) as they pertain to the Integrated Demand Management (IDM) concept. IDM uses flow balancing to manage air traffic across multiple FCAs with a common downstream constraint, as well as constraints at the respective FCA locations. FCA capacity rates can be set manually, but generating capacities for multiple, interdependent FCAs could potentially over-burden a user. A new enhancement to CTOP called the FCA Balance Algorithm (FBA) was developed at NASA Ames Research Center to improve the process of allocating capacity across multiple flow constrained segments in the airspace. The FBA evaluates the predicted demand and capacity across multiple FCAs and dynamically generates capacity settings for the FCAs that best meet capacity limits for all identified constraints. In a human-in-the-loop simulation study, both manual and automated capacity setting methods were evaluated in terms of their overall feasibility using measures of system performance, human performance, and qualitative feedback. Subject matter experts were asked to use three different methods to allocate capacity to three FCAs, either (1) by manually setting capacity for every 60-minute time window, (2) by manually setting capacity for every 15-minute time window, or (3) by using the FBA capability to automatically generate capacity settings. Results showed no significant differences in terms of overall system performance, indicated by similar ground delay and airport throughput numbers between methods. However, differences in individual strategies afforded by the manual methods allowed some participants to achieve system-wide delay that was much lower than the average. The FBA was the fastest method of capacity setting, and it received the lowest subjective rating scores on physical task load, mental task load, task difficulty and task complexity out of the three methods. Finally, participants explained through qualitative feedback that there were many benefits to using the FBA, such as ease of use, accuracy, and low risk of human input error. Participants did not experience the same limitations with the FBA that they did with the manual methods, such as reduced accuracy in the 60-minute manual condition, or high complexity in the 15-minute/manual condition. These results suggest that the FBA automation enhancement to CTOP maintains system performance while improving human performance. Therefore, the FBA could be introduced as a way to mitigate operator workload while planning a CTOP.

NextGen↗

The Fine Motor Skills and Cognition Test Batteries: Normative Data and Interdependencies

Fine motor skills and cognitive abilities are major contributors to crew performance on essentially all extravehicular and intra-vehicular activities during spaceflight. It is critical for the crew’s safety, and for mission productivity, to know if, and when, motor skills or cognitive abilities are compromised so that countermeasures may be introduced. NASA has developed two test batteries to measure and monitor astronaut cognitive and fine motor skills. The Cognition Test Battery contains 10 sub-tests that assess cognitive behaviors ranging from low level visual perception to high level decision-making. The Fine Motor Skills Test Battery contains 4 sub-tests that assess finger dexterity, manual dexterity and wrist-finger speed. This study sought to determine acceptable norms for both batteries in an astronaut-like population and to identify the extent to which fine motor skills contribute to cognitive test scores.

Normative Data↗

Exploring Beyond Earth's Atmosphere with Human-Machine Teams

NASA's highly successful Kepler Mission has revolutionized our understanding of the Galaxy. We now know that planets, even Earth-size planets in the habitable zone, are common. With the end of the Kepler Mission we now look to the future with the Transiting Exoplanet Survey Satellite (TESS) which will discover thousands of exoplanets in orbit around the brightest stars in the sky. In a two-year survey, TESS will perform an all-sky search of more than 200,000 stars for temporary drops in brightness caused by planetary transits. With Kepler and TESS, humanity is finally at the verge of studying the masses, sizes, densities, orbits, and atmospheres of a large cohort of small planets, including a sample of rocky worlds in the habitable zones of their host stars which may prove to host life. The massive data sets generated by Kepler and TESS must be meticulously combed for the weakest planetary signals every month. While a daunting and error-prone task for humans, this is an exciting opportunity for the breakthroughs recently seen in machine learning. Specifically, traditional methods for identifying planet transits require extensive data processing pipelines followed by extensive human vetting. This manual process risks loss of information due to the data processing and to inconsistency and biases due to individual human vetters. The latest advancements in machine learning will allow an objective classifier to minimize the losses of information and greatly lessen the burden on the human vetters, in addition to providing assessment of quality and score to each planet candidate, freeing the humans to concentrate on border cases and other more interesting investigations.

Smith, Jeffrey C.↗

Predicting the Operational Acceptance of Airborne Flight Reroute Requests Using Data Mining

For tools that generate more efficient flight routes or reroute advisories, it is important to ensure compatibility of automation and autonomy decisions with human objectives so as to ensure acceptability by the human operators. In this paper, the authors developed a proof of concept predictor of operational acceptability for route changes during a flight. Such a capability could have applications in automation tools that identify more efficient routes around airspace impacted by weather or congestion and that better meet airline preferences. The predictor is based on applying data mining techniques, including logistic regression, a decision tree, a support vector machine, a random forest and Adaptive Boost, to historical flight plan amendment data reported during operations and field experiments. Cross validation was used for model development, while nested cross validation was used to validate the models. The model found to have the best performance in predicting air traffic controller acceptance or rejection of a route change, using the available data from Fort Worth Air Traffic Control Center and its adjacent Centers, was the random forest, with an F-score of 0.77. This result indicates that the operational acceptance of reroute requests does indeed have some level of predictability, and that, with suitable data, models can be trained to predict the operational acceptability of reroute requests. Such models may ultimately be used to inform route selection by decision support tools, contributing to the development of increasingly autonomous systems that are capable of routing aircraft with less human input than is currently the case.

Operational Acceptability↗

Benchmarking CME Arrival Time and Impact: Progress on Metadata, Metrics, and Events

Accurate forecasting of the arrival time and subsequent geomagnetic impacts of coronal mass ejections (CMEs) at Earth is an important objective for space weather forecasting agencies. Recently, the CME Arrival and Impact working team has made significant progress toward defining communit yagreed metrics and validation methods to assess the current state of CME modeling capabilities. This will allow the community to quantify our current capabilities and track progress in models over time. First, it is crucial that the community focuses on the collection of the necessary metadata for transparency and reproducibility of results. Concerning CME arrival and impact we have identified six different metadata types: 3D CME measurement, model description, model input, CME (non)arrival observation, model output data, and metrics and validation methods. Second, the working team has also identified a validation time period, where all events within the following two periods will be considered: 1 January 2011 to 31 December 2012 and January 2015 to 31 December 2015. Those two periods amount to a total of about 100 hit events at Earth and a large amount of misses. Considering a time period will remove any bias in selecting events and the event set will represent a sample set that will not be biased by user selection. Lastly, we have defined the basic metrics and skill scores that the CME Arrival and Impact working team will focus on.

Verbeke, C.↗

Automated Cardiovascular Pathology Assessment using Semantic Segmentation and Ensemble Learning

Cardiac magnetic resonance imaging provides high spatial resolution, enabling improved extraction of important functional and morphological features for cardiovascular disease staging. Segmentation of ventricular cavities and myocardium in cardiac cine sequencing provides a basis to quantify cardiac measures such as ejection fraction. A method is presented that curtails the expense and observer bias of manual cardiac evaluation by combining semantic segmentation and disease classification into a fully automatic processing pipeline. The initial processing element consists of a robust dilated convolutional neural network architecture for voxel-wise segmentation of the myocardium and ventricular cavities. The resulting comprehensive volumetric feature matrix captures diagnostic clinical procedure data and is utilized by the final processing element to model a cardiac pathology classifier. Our approach evaluated anonymized cardiac images from a training data set of 100 patients (4 pathology groups, 1 healthy group, 20 patients per group) examined at the University Hospital of Dijon. The top average Dice index scores achieved were 0.940, 0.886, 0.849 for structure segmentation of the left ventricle (LV), myocardium and right ventricle (RV) respectively. A 5-ary pathology classification accuracy of 90% was recorded on an independent test set using the trained model. Performance results demonstrate potential for advanced machine learning methods to deliver accurate, efficient and reproducible cardiac pathological assessment.

Semantic Segmentation↗

Orbital Debris Quarterly News

Inside - NASA Technical Standard Process for Limiting Orbital Debris Revision Ratified - Testing and Modeling the Demisability of Fiber-Reinforced Plastics - An Extended Parametric Study of the Effects of Large Constellations on the Future Debris Environment - Meeting Reports - Abstracts from the NASA HVIT - Abstracts from the NASA ODPO - ODQN Vol. 23, Issue 1&2 Errata - Orbital Debris Analyst - Space Missions/Satellite Box Score

Phillip Anz-Meador↗