Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “loss function regularization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

Surrogate-based Analysis and Optimization

A major challenge to the successful full-scale development of modem aerospace systems is to address competing objectives such as improved performance, reduced costs, and enhanced safety. Accurate, high-fidelity models are typically time consuming and computationally expensive. Furthermore, informed decisions should be made with an understanding of the impact (global sensitivity) of the design variables on the different objectives. In this context, the so-called surrogate-based approach for analysis and optimization can play a very valuable role. The surrogates are constructed using data drawn from high-fidelity models, and provide fast approximations of the objectives and constraints at new design points, thereby making sensitivity and optimization studies feasible. This paper provides a comprehensive discussion of the fundamental issues that arise in surrogate-based analysis and optimization (SBAO), highlighting concepts, methods, techniques, as well as practical implications. The issues addressed include the selection of the loss function and regularization criteria for constructing the surrogates, design of experiments, surrogate selection and construction, sensitivity analysis, convergence, and optimization. The multi-objective optimal design of a liquid rocket injector is presented to highlight the state of the art and to help guide future efforts.

Queipo, Nestor V.↗

Keeping a Beat on the Heart

Feel the relief of a patient suffering from heart arrhythmia, who is able to return home while having her heart monitored by health professionals 24 hours a day, without the fear that she will miss an important indicator and suffer a fatal heart attack - using technology originally developed to conduct experiments on the Space Shuttle. Approximately 400,000 Americans die every year from sudden heart attacks . Medical research revealed that patterns of electrical activity in the heart can act as predictors of these lethal cardiac events known as arrhythmias. Fortunately, certain arrhythmias such as ventricular fibrillation (loss of regular heartbeat and subsequent loss of function) and ventricular tachycardia (rapid heartbeats), can be detected and appropriately treated. Today, patients at moderate risk of arrhythmias can benefit from technology that would permit long- term continuous monitoring of electrical cardiac rhythms outside the hospital environment in the comfort of their own homes. Medical telemetry systems, also known as telemedicine, are evolving rapidly as wireless communication technology advances, evidenced by the commercial products and research prototypes for remote health monitoring that have appeared in recent years. Wireless systems allow patients to move freely in their home and work environment while being monitored remotely by health care professionals.

Liszka, Kathy J.↗

Short term hearing loss in general aviation operations, phase 1, part 1

The effects of light aircraft noise on six subjects during flight operations were investigated. The noise environment in the Piper Apache light aircraft was found to be capable of producing hearing threshold shifts. The following are the principal findings and conclusions: (1) Through most of the frequency range for which measurements were taken (500 to 6000 Hz), there was a regular progression showing increased loss of auditory acuity as a function of increased exposure time. (2) Extensive variability was found in the results among subjects, and in the measured loss at discrete frequencies for each subject. (3) The principal loss of hearing occurred at the low frequencies, around 500 Hz.

Parker, J. F., Jr.↗

Predictive Modeling for Differential Diagnosis and Mortality Risk Assessment

The prevalence of electronic health record (EHR) systems has brought prodigious biomedical informatics opportunity. Automated machine learning methods can effectively utilize such data and have become common tools for healthcare predictive modeling. Researches in medical informatics have explored the potential of deep learning and classical models in emergent care scenarios. In particular, predicting differential diagnoses for admissions have proven useful in decreasing unnecessary lab tests and improving inpatient triage decision-making. Moreover, identification of high-risk patients for in-hospital mortality is vitally important to maximize allocation of medical resources.The Medical Information Mart for Intensive Care (MIMIC-III) database, containing de-identified critical care inpatient was used in our study. This data set captures hospital patient laboratory measurements, pharmacologic prescriptions, diagnostic data and procedure event recordings. When considering adult patients and discounting admissions with ICU length of stay less than 24 hours, there were 37,787 unique admissions and 30,414 total patients. We examined the top 25 most prevalent ICD-9 group-level disease specificities in MIMIC-III using a multi-label classification model. In-hospital mortality was modeled as binary classification with 4,155 (13%) adult patients that expired, of which 3,138 (75.5%) were in the ICU setting. The metrics AUC, F1 score, sensitivity and specificity values calculated for each disease label measured prediction performance.The usage of ICD-9 group codes reduced feature dimension from 14,567 to 942 and greatly improved distribution of patient diagnostic categories. Disease temporal patterns were captured by considering the most frequently sampled 6 vital signs and 13 laboratory values. Missing data were imputed at each time-stamp. Time-series raw hourly average values were converted into 5 summary features (mean, standard deviation, number of observations, min & max values). Patient demographic variables such as age, gender, marital status and ethnicity were also factored into the modeling. Choi et al showed that contextual embedding of medical data, diagnostic and procedural codes alone can predict future diagnoses with sensitivity as high as 0.79. We utilized an embedding technique called word2vec which allowed sparse representations of medical history to be transformed into dense word vectors. The mappings captured contextual information by treating each admission as a sentence and learning the most likely neighboring words in a sliding window fashion. Binary and multi-label classification was achieved via collapse models, which do not consider temporal information, as well as recurrent neural networks with regularization, Softmax output layer activation together with categorical cross-entropy as the loss function.

US Army collaboration↗

Evolutionary Design of Controlled Structures

Basic physical concepts of structural delay and transmissibility are provided for simple rod and beam structures. Investigations show the sensitivity of these concepts to differing controlled-structures variables, and to rational system modeling effects. An evolutionary controls/structures design method is developed. The basis of the method is an accurate model formulation for dynamic compensator optimization and Genetic Algorithm based updating of sensor/actuator placement and structural attributes. One and three dimensional examples from the literature are used to validate the method. Frequency domain interpretation of these controlled structure systems provide physical insight as to how the objective is optimized and consequently what is important in the objective. Several disturbance rejection type controls-structures systems are optimized for a stellar interferometer spacecraft application. The interferometric designs include closed loop tracking optics. Designs are generated for differing structural aspect ratios, differing disturbance attributes, and differing sensor selections. Physical limitations in achieving performance are given in terms of average system transfer function gains and system phase loss. A spacecraft-like optical interferometry system is investigated experimentally over several different optimized controlled structures configurations. Configurations represent common and not-so-common approaches to mitigating pathlength errors induced by disturbances of two different spectra. Results show that an optimized controlled structure for low frequency broadband disturbances achieves modest performance gains over a mass equivalent regular structure, while an optimized structure for high frequency narrow band disturbances is four times better in terms of root-mean-square pathlength. These results are predictable given the nature of the physical system and the optimization design variables. Fundamental limits on controlled performance are discussed based on the measured and fit average system transfer function gains and system phase loss.

Masters, Brett P.↗

A comparison between bright points in a coronal hole and a quiet-sun region

A comparison is made of the morphological structure and temporal behavior of the emission from coronal bright points in a coronal hole and a quiet region, using data from the Harvard EUV experiment on Skylab. It is found that, in both regions, coronal bright points are located at network boundaries and cover a range of sizes from 10 to 40 in in linear extent. In a given bright pint, the peaks of emission in the six different lines, measured simultaneously through the same instrument slit, are not always cospatial, implying that bright points consist of a complex of small-scale loops at different temperatures. The intensity of bright points in both regions is also characterized by a significant temporal variability in all the wavelengths measured. This variability exhibits no regular periodicity. Yet the ratio of the varying (ac) to the constant (dc) components of the emission, in all the bright points studied, has a local maximum at 1-2 x 10 to the 5th k which coincides with the peak of the radiative loss function, and another local maximum at Mg x (1.4 x 10 to the 6th K). It is found that coronal bright points in a coronal hole or a quiet region are indistinguishable structures, and, therefore, conclude that they are independent of the overlying background corona.

Habbal, Shadia Rifai↗

Long nonlinear waves in stratified shear flows

The propagation of finite-amplitude internal waves in a shear flow is considered for wavelengths that are long compared to the shear-layer thickness. Both singular and regular modes are investigated, and the equation governing the amplitude evolution is derived. The theory is generalized to allow for a radiation condition when the region outside the stratified shear layer is unbounded and weakly stratified. In this case, the evolution equation contains a damping term describing energy loss by radiation which can be used to estimate the persistence of solitary waves or nonlinear wave packets in realistic environments. A continuous three-layer model is studied in detail and closed-form expressions are obtained for the phase speed and the coefficients of the nonlinear and dispersive terms in the amplitude equation as a function of Richardson number.

Maslowe, S. A.↗

High sustained +Gz acceleration: physiological adaptation to high-G tolerance

Since the early 1940s, a significant volume of research has been conducted in an effort to describe the impact of acute exposures to high-G acceleration on cardiovascular mechanisms responsible to maintaining cerebral perfusion and conscious in high performance aircraft pilots during aerial combat maneuvers. The value of understanding hemodynamic characteristics that underlie G-induced loss of consciousness has been instrumental in the evolution of optimal technology development (e.g., G-suits, positive pressure breathing, COMBAT EDGE, etc.) and pilot training (e.g., anti-G straining maneuvers). Although the emphasis of research has been placed on the development of protection against acute high +Gz acceleration effects, recent observations suggest that adaptation of cardiovascular mechanism associated with blood pressure regulation may contribute to a protective 'G-training' effect. Regular training at high G enhances G tolerance in humans, rats, guinea pigs, and dogs while prolonged layoff from exposure in high G profiles (G-layoff) can result in reduced G endurance. It seems probable that adaptations in physiological functions following chronically-repeated high G exposure (G training) or G-layoff could have significant impacts on performance during sustained high-G acceleration since protective technology such as G-suits and anit-G straining maneuvers are applied consistently during these periods of training. The purpose of this paper is to present a review of new data from three experiments that support the notion that repeated exposure on a regular basis to high sustained +Gz acceleration induces significant physiological adaptations which are associated with improved blood pressure regulation and subsequent protection of cerebral perfusion during orthostatic challenges.

Review, Tutorial↗

Universal Responses of Cyclic-Oxidation Models Studied

Oxidation is an important degradation process for materials operating in the high-temperature air or oxygen environments typical of jet turbine or rocket engines. Reaction of the combustion gases with the component material forms surface layer scales during these oxidative exposures. Typically, the instantaneous rate of reaction is inversely proportional to the existing scale thickness, giving rise to parabolic kinetics. However, more realistic applications entail periodic startup and shutdown. Some scale spallation may occur upon cooling, resulting in loss of the protective diffusion barrier provided by a fully intact scale. Upon reheating, the component will experience accelerated oxidation due to this spallation. Cyclic-oxidation testing has, therefore, been a mainstay of characterization and performance ranking for high-temperature materials. Models simulate this process by calculating how a scale spalls upon cooling and regrows upon heating (refs. 1 to 3). Recently released NASA software (COSP for Windows) allows researchers to specify a uniform layer or discrete segments of spallation (ref. 4). Families of model curves exhibit consistent regularity and trends with input parameters, and characteristic features have been empirically described in terms of these parameters. Although much insight has been gained from experimental and model curves, no equation has been derived that can describe this behavior explicitly as functions of the key oxidation parameters.

Smialek, James L.↗

Comparison of Spares Logistics Analysis Techniques for Long Duration Human Spaceflight

As the durations and distances involved in human exploration missions increase, the logistics associated with the repair and maintenance becomes more challenging. Whereas the operation of the International Space Station (ISS) depends upon regular resupply from the Earth, this paradigm may not be feasible for future missions. Longer mission durations result in higher probabilities of component failures as well as higher uncertainty regarding which components may fail, and longer distances from Earth increase the cost of resupply as well as the speed at which the crew can abort to Earth in the event of an emergency. As such, mission development efforts must take into account the logistics requirements associated with maintenance and spares. Accurate prediction of the spare parts demand for a given mission plan and how that demand changes as a result of changes to the system architecture enables full consideration of the lifecycle cost associated with different options. In this paper, we utilize a range of analysis techniques - Monte Carlo, semi-Markov, binomial, and heuristic - to examine the relationship between the mass of spares and probability of loss of function related to the Carbon Dioxide Removal System (CRS) for a notional, simplified mission profile. The Exploration Maintainability Analysis Tool (EMAT), developed at NASA Langley Research Center, is utilized for the Monte Carlo analysis. We discuss the implications of these results and the features and drawbacks of each method. In particular, we identify the limitations of heuristic methods for logistics analysis, and the additional insights provided by more in-depth techniques. We discuss the potential impact of system complexity on each technique, as well as their respective abilities to examine dynamic events. This work is the first step in an effort that will quantitatively examine how well these techniques handle increasingly more complex systems by gradually expanding the system boundary.

Owens, Andrew↗

Developing A Continuous Ozone Record Through the SAGE and Aura Missions With NASA Reanalysis Products

During the last quarter of the 20th century, the Stratospheric Aerosol and Gas Experiment (SAGE) missions were crucial in monitoring the loss and subsequent recovery of the stratospheric ozone layer. Due to the employed solar occultation and self-calibration method, the SAGE monitors have produced stable data throughout the lifetime of each instrument. However, over ten years passed between the end of the SAGE II and SAGE III/M3M missions in 2005 and the launch of SAGE III/ISS instrument in 2017, leaving a gap in the data that must be bridged in order to assess trends in the ozone record. The Modern-Era Retrospective analysis for Research and Applications, version 2 (MERRA-2) reanalysis product, with output available starting in 1980, is an attractive candidate for trend analysis due to the statistically optimized combination of multiple observing systems and the regular temporal and spatial coverage. However, changes in the assimilated observation systems can introduce discontinuities within the MERRA-2 ozone record, such as in 2004 when the MERRA-2 system shifted from assimilating ozone retrievals collected by SBUV instruments to those collected by instruments onboard the Aura satellite. In this study, we explore using the SAGE II record as a transfer function to develop a stable reanalysis data product, suitable for trend analysis, from the start of the SAGE II record in 1984 through the present. We follow the procedure outlined by Wargan et al. (2018) to address discontinuities in the MERRA-2 ozone dataset at the 2004 transition and during the Aura record. SAGE II ozone profiles are used to correct discontinuities in upper stratospheric ozone associated with changes in the MERRA-2 meteorological observing system in 1998 and 1995. We will then assess the relative performance of the data from different SAGE sensors using the resulting bias-corrected MERRA-2 ozone fields.

Pamela Wales↗

Multiresolution With Super-Compact Wavelets

The solution data computed from large scale simulations are sometimes too big for main memory, for local disks, and possibly even for a remote storage disk, creating tremendous processing time as well as technical difficulties in analyzing the data. The excessive storage demands a corresponding huge penalty in I/O time, rendering time and transmission time between different computer systems. In this paper, a multiresolution scheme is proposed to compress field simulation or experimental data without much loss of important information in the representation. Originally, the wavelet based multiresolution scheme was introduced in image processing, for the purposes of data compression and feature extraction. Unlike photographic image data which has rather simple settings, computational field simulation data needs more careful treatment in applying the multiresolution technique. While the image data sits on a regular spaced grid, the simulation data usually resides on a structured curvilinear grid or unstructured grid. In addition to the irregularity in grid spacing, the other difficulty is that the solutions consist of vectors instead of scalar values. The data characteristics demand more restrictive conditions. In general, the photographic images have very little inherent smoothness with discontinuities almost everywhere. On the other hand, the numerical solutions have smoothness almost everywhere and discontinuities in local areas (shock, vortices, and shear layers). The wavelet bases should be amenable to the solution of the problem at hand and applicable to constraints such as numerical accuracy and boundary conditions. In choosing a suitable wavelet basis for simulation data among a variety of wavelet families, the supercompact wavelets designed by Beam and Warming provide one of the most effective multiresolution schemes. Supercompact multi-wavelets retain the compactness of Haar wavelets, are piecewise polynomial and orthogonal, and can have arbitrary order of approximation. The advantages of the multiresolution algorithm are that no special treatment is required at the boundaries of the interval, and that the application to functions which are only piecewise continuous (internal boundaries) can be efficiently implemented. In this presentation, Beam's supercompact wavelets are generalized to higher dimensions using multidimensional scaling and wavelet functions rather than alternating the directions as in the 1D version. As a demonstration of actual 3D data compression, supercompact wavelet transforms are applied to a 3D data set for wing tip vortex flow solutions (2.5 million grid points). It is shown that high data compression ratio can be achieved (around 50:1 ratio) in both vector and scalar data set.

Lee, Dohyung↗

Molecular Mechanisms of Circadian Regulation During Spaceflight

Disruption of the regular environmental circadian cues in addition to stringent and demanding operational schedules are two main factors that undoubtedly impact sleep patterns and vigilant performance in the astronaut crews during spaceflight. Most research is focused on the behavioral aspects of the risk of circadian desynchronization, characterized by fatigue and health and performance decrement. A common countermeasure for circadian re-entrainment utilizes blue-green light to entrain the circadian clock and mitigate this risk. However, an effective countermeasure targeting the photoreceptor system requires that the basic circadian molecular machinery remains intact during spaceflight. The molecular clock consists of sets of proteins that perform different functions within the clock machinery: circadian oscillators (genes whose expression levels cycle during the day, keep the pass of cellular time and regulate downstream effector genes), the effector or output genes (those which impact the physiology of the tissue or organism), and the input genes (responsible for sensing the environmental cues that allow circadian entrainment). The main environmental cue is light. As opposed to the known photoreceptors (rods and cones), the non-visual light stimulus is received by a subset of the population of retinal ganglion cells called intrinsically photosensitive retinal ganglion cells (ipRGC) that express melanopsin (opsin 4 -Opn4-) as the photoreceptor. We hypothesize that spaceflight may affect ipRGC and melanopsin expression, which may be a contributing cause of circadian disruption during spaceflight. To answer this question, eyes from albino Balb/cJ mice aboard STS-133 were collected for histological analysis and gene expression profiling of the retina at 1 and 7 days after landing. Both vivarium and AEM (animal enclosure module) mice were used as ground controls. Opn4 expression was analyzed by real time RT/qPCR and retinal sections were stained for Opn4 immunofluorescence. Opn4 was decreased (abrogated in one case) in retinas that concurrently showed higher evidence of oxidative stress. We propose that oxidative stress can lead to a decrease in melanopsin expression, likely via ipRGC loss or impairment, and thus, it can be a contributing factor to circadian disruption during spaceflight. Countermeasures contemplating the use of light should therefore be complemented with melanopsin expression maintenance and/or reduction in oxidative stress.

Zanello, Susana↗