Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Comparative framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Emergence of Relations and the Essence of Learning: A Review of Sidman's Equivalence Relations and Behavior: A Research Story

Sidman addresses two very important questions in Equivalence Relations and Behavior: A Research Story: What are the bases of behavioral competence? And how do units of learning become related? The book recounts the story of how an understanding of emergent relations and competencies was achieved through studies in his teaching-research program with mentally retarded subjects. Although children normally accrue vast networks of relations between stimuli and events, those with mental retardation typically do not. Consequently, by learning how to establish those networks, Sidman and his students contribute richly both to the cultivation of competencies by their subjects and, more generally, to an understanding of real-world human behavior. The basic equivalence paradigm affords the subject feedback and reinforcement for very specific choices during training, but the test is not for those choices! Rather, tests for equivalence look for new choices, ones seemingly quite foreign to the training regimen. The tests for equivalence relations entail presentations of stimuli that were the options for conditional choice during reinforced training. In tests of equivalence, correct choices are novel; hence, they have never been reinforced during training. The study of equivalence relations can encourage the emergence of new perspectives that are more symbiotic than competitive. In full acknowledgment of the important role and contributions made by those who identify themselves as experimental analysts of behavior, it is timely that rapprochements be worked toward, as indeed they are, to meld that perspective with others of our time. Both our research methods and our expectations about the nature of the learning process and the abilities of our subjects can delimit what they might learn and what we, in turn, learn about their learning. The text will be of great value for instruction at the upper-division and graduate levels. Its impact will be substantial, for it defines an important advance in our efforts to understand the richness of behavior in both humans and nonhuman animals. Although not presented to that end, the book might also serve to bridge communications with other groups of animal researchers whose interests lie more in a comparative or ethological framework.

Rumbaugh, Duane M.↗

Network Theory: A Primer and Questions for Air Transportation Systems Applications

A new understanding (with potential applications to air transportation systems) has emerged in the past five years in the scientific field of networks. This development emerges in large part because we now have a new laboratory for developing theories about complex networks: The Internet. The premise of this new understanding is that most complex networks of interest, both of nature and of human contrivance, exhibit a fundamentally different behavior than thought for over two hundred years under classical graph theory. Classical theory held that networks exhibited random behavior, characterized by normal, (e.g., Gaussian or Poisson) degree distributions of the connectivity between nodes by links. The new understanding turns this idea on its head: networks of interest exhibit scale-free (or small world) degree distributions of connectivity, characterized by power law distributions. The implications of scale-free behavior for air transportation systems include the potential that some behaviors of complex system architectures might be analyzed through relatively simple approximations of local elements of the system. For air transportation applications, this presentation proposes a framework for constructing topologies (architectures) that represent the relationships between mobility, flight operations, aircraft requirements, and airspace capacity, and the related externalities in airspace procedures and architectures. The proposed architectures or topologies may serve as a framework for posing comparative and combinative analyses of performance, cost, security, environmental, and related metrics.

Holmes, Bruce J.↗

A Standard Platform for Testing and Comparison of MDAO Architectures

The Multidisciplinary Design Analysis and Optimization (MDAO) community has developed a multitude of algorithms and techniques, called architectures, for performing optimizations on complex engineering systems which involve coupling between multiple discipline analyses. These architectures seek to efficiently handle optimizations with computationally expensive analyses including multiple disciplines. We propose a new testing procedure that can provide a quantitative and qualitative means of comparison among architectures. The proposed test procedure is implemented within the open source framework, OpenMDAO, and comparative results are presented for five well-known architectures: MDF, IDF, CO, BLISS, and BLISS-2000. We also demonstrate how using open source soft- ware development methods can allow the MDAO community to submit new problems and architectures to keep the test suite relevant.

Gray, Justin S.↗

ACCEPT: Introduction of the Adverse Condition and Critical Event Prediction Toolbox

The prediction of anomalies or adverse events is a challenging task, and there are a variety of methods which can be used to address the problem. In this paper, we introduce a generic framework developed in MATLAB (sup registered mark) called ACCEPT (Adverse Condition and Critical Event Prediction Toolbox). ACCEPT is an architectural framework designed to compare and contrast the performance of a variety of machine learning and early warning algorithms, and tests the capability of these algorithms to robustly predict the onset of adverse events in any time-series data generating systems or processes.

machine learning↗

Evaluating Precipitation Features and Rainfall Characteristics in a Multi-scale Modeling Framework

Cloud and precipitation systems over the tropics and subtropics are simulated with a multi-scale modeling framework (MMF) and compared against the TRMM radar precipitation features (RPFs) product. A methodology, in close analogy to the TRMM RPFs, is developed to analyze simulated cloud precipitating structures from the embedded two-dimensional cloud-resolving models (CRMs) within an MMF. Despite the two-dimensionality of the CRMs, the simulated RPFs population distribution, and horizontal and vertical structure are in good agreement with TRMM observations. However, some deficits are also found in the model simulations. The model tends to overestimate mean convective precipitation rates for RPFs with a size less than 100 km, contributing to the excessive precipitation biases in the warm pool and western Pacific, western and northern India Ocean, and eastern Pacific commonly found in most MMFs. For large features with a size greater than 150 km, both convective and stratiform rain rates are underestimated. The distribution of maximum radar echo top heights as a function of RPF size is well simulated except the model tends to underestimate the occurrence frequency of maximum heights greater than 15 km. The maximum echo top heights for convective cells embedded within large RPFs with a size greater than 150 km are also underestimated. The cyclic lateral boundary with a limited model domain generates artificial occurrences for RPFs with a size close to the model domain size, producing a significant contribution to the total rainfall due to their sizes. This cyclic lateral boundary effect can be easily identified and quantified in both probability and cumulative distribution functions of RPFs. The geophysical distribution of the population of the largest RPFs in the control experiment shows they are mainly located in the Subtropics but also partially contribute to the common MMF biases of excessive precipitation in the Tropics. Sensitivity experiments using CRMs with different domain sizes and different grid spacings show larger domains (higher resolution) tend to shift the RPFs distribution to large (small) sizes. The cyclic lateral boundary biases increase as CRM domain size decreases. The impacts of model horizontal and vertical resolution on simulated convective systems are also investigated.

Chern, Jiun-Dar↗

Evaluating Precipitation Features and Rainfall Characteristics in a Multi‐Scale Modeling Framework

Cloud and precipitation systems are simulated with a multi‐scale modeling framework (MMF) and compared over the Tropics and Subtropics against the Tropical Rainfall Measuring Mission (TRMM) Radar‐defined Precipitation Features (RPFs) product. A methodology, in close analogy to the TRMM RPFs, is developed to produce simulated precipitation features (PFs) from the output of the embedded two‐dimensional (2D) cloud‐resolving models (CRMs) within an MMF. Despite the limitations of 2D CRMs, the simulated population distribution, horizontal and vertical structure of PFs, and the geographical location and local rainfall contribution of mesoscale convective systems (MCSs) are in good agreement with the TRMM observations. However, some model discrepancies are found and can be identified and quantified within the PF distributions. Using model biases in relative population and rainfall contributions, PFs can be characterized into four size categories: small, medium to large, very large, and extremely large. Four different major mechanisms might account for the model biases in each different category: (1) the two‐dimensionality of the CRMs, (2) a positive convection‐wind‐evaporation feedback loop, (3) an artificial dynamic constraint in a bounded CRM domain with cyclic boundaries, and (4) the limited CRM domain size. The second and fourth mechanisms tend to contribute to the excessive tropical precipitation biases commonly found in most MMFs, whereas the other mechanisms reduce rainfall contributions from small and very large PFs. MMF sensitivity experiments with various CRM domain sizes and grid spacings showed that larger domains (higher resolutions) tend to shift PF populations toward larger (smaller) sizes.

Jiun-Dar Chern↗

AMORE-Isoprene v1.0: A New Reduced Mechanism for Gas-Phase Isoprene Oxidation

Gas-phase oxidation of isoprene by ozone (O 3 ) and the hydroxyl (OH) and nitrate (NO 3 ) radicals significantly impacts tropospheric oxidant levels and secondary organic aerosol formation. The most comprehensive and up-to-date chemical mechanism for isoprene oxidation consists of several hundred species and over 800 reactions. Therefore, the computational expense of including the entire mechanism in large-scale atmospheric chemical transport models is usually prohibitive, and most models employ reduced isoprene mechanisms ranging in size from ∼ 10 to ∼ 200 species. We have developed a new reduced isoprene oxidation mechanism using a directed-graph path-based automated model reduction approach, with minimal manual adjustment of the output mechanism. The approach takes as inputs a full isoprene oxidation mechanism, the environmental parameter space, and a list of priority species which are protected from elimination during the reduction process. Our reduced mechanism, AMORE-Isoprene (where AMORE stands for Automated Model Reduction), consists of 12 species which are unique to the isoprene mechanism as well as 22 reactions. We demonstrate its performance in a box model in comparison with experimental data from the literature and other current isoprene oxidation mechanisms. AMORE-Isoprene's performance with respect to predicting the time evolution of isoprene oxidation products, including isoprene epoxydiols (IEPOX) and formaldehyde, is favorable compared with other similarly sized mechanisms. When AMORE-Isoprene is included in the Community Regional Atmospheric Chemistry Multiphase Mechanism 1.0 (CRACMM1AMORE) in the Community Multiscale Air Quality Model (CMAQ, v5.3.3), O 3 and formaldehyde agreement with Environmental Protection Agency (EPA) Air Quality System observations is improved. O 3 bias is reduced by 3.4 ppb under daytime conditions for O 3 concentrations over 50 ppb. Formaldehyde bias is reduced by 0.26 ppb on average for all formaldehyde measurements compared with the base CRACMM1. There was no significant change in computation time between CRACMM1AMORE and the base CRACMM. AMORE-Isoprene shows a 35 % improvement in agreement between simulated IEPOX concentrations and chamber data over the base CRACMM1 mechanism when compared in the Framework for 0-D Atmospheric Modeling (F0AM) box model framework. This work demonstrates a new highly reduced isoprene mechanism and shows the potential value of automated model reduction for complex reaction systems.

Automated Model Reduction↗

LISA Framework for Enhancing Gravitational Wave Signal Extraction Techniques

This paper describes the development of a Framework for benchmarking and comparing signal-extraction and noise-interference-removal methods that are applicable to interferometric Gravitational Wave detector systems. The primary use is towards comparing signal and noise extraction techniques at LISA frequencies from multiple (possibly confused) ,gravitational wave sources. The Framework includes extensive hybrid learning/classification algorithms, as well as post-processing regularization methods, and is based on a unique plug-and-play (component) architecture. Published methods for signal extraction and interference removal at LISA Frequencies are being encoded, as well as multiple source noise models, so that the stiffness of GW Sensitivity Space can be explored under each combination of methods. Furthermore, synthetic datasets and source models can be created and imported into the Framework, and specific degraded numerical experiments can be run to test the flexibility of the analysis methods. The Framework also supports use of full current LISA Testbeds, Synthetic data systems, and Simulators already in existence through plug-ins and wrappers, thus preserving those legacy codes and systems in tact. Because of the component-based architecture, all selected procedures can be registered or de-registered at run-time, and are completely reusable, reconfigurable, and modular.

Thompson, David E.↗

Image Segmentation, Registration, Compression, and Matching

A novel computational framework was developed of a 2D affine invariant matching exploiting a parameter space. Named as affine invariant parameter space (AIPS), the technique can be applied to many image-processing and computer-vision problems, including image registration, template matching, and object tracking from image sequence. The AIPS is formed by the parameters in an affine combination of a set of feature points in the image plane. In cases where the entire image can be assumed to have undergone a single affine transformation, the new AIPS match metric and matching framework becomes very effective (compared with the state-of-the-art methods at the time of this reporting). No knowledge about scaling or any other transformation parameters need to be known a priori to apply the AIPS framework. An automated suite of software tools has been created to provide accurate image segmentation (for data cleaning) and high-quality 2D image and 3D surface registration (for fusing multi-resolution terrain, image, and map data). These tools are capable of supporting existing GIS toolkits already in the marketplace, and will also be usable in a stand-alone fashion. The toolkit applies novel algorithmic approaches for image segmentation, feature extraction, and registration of 2D imagery and 3D surface data, which supports first-pass, batched, fully automatic feature extraction (for segmentation), and registration. A hierarchical and adaptive approach is taken for achieving automatic feature extraction, segmentation, and registration. Surface registration is the process of aligning two (or more) data sets to a common coordinate system, during which the transformation between their different coordinate systems is determined. Also developed here are a novel, volumetric surface modeling and compression technique that provide both quality-guaranteed mesh surface approximations and compaction of the model sizes by efficiently coding the geometry and connectivity/topology components of the generated models. The highly efficient triangular mesh compression compacts the connectivity information at the rate of 1.5-4 bits per vertex (on average for triangle meshes), while reducing the 3D geometry by 40-50 percent. Finally, taking into consideration the characteristics of 3D terrain data, and using the innovative, regularized binary decomposition mesh modeling, a multistage, pattern-drive modeling, and compression technique has been developed to provide an effective framework for compressing digital elevation model (DEM) surfaces, high-resolution aerial imagery, and other types of NASA data.

Yadegar, Jacob↗

Advances in Landslide Hazard Forecasting: Evaluation of Global and Regional Modeling Approach

A prototype global satellite-based landslide hazard algorithm has been developed to identify areas that exhibit a high potential for landslide activity by combining a calculation of landslide susceptibility with satellite-derived rainfall estimates. A recent evaluation of this algorithm framework found that while this tool represents an important first step in larger-scale landslide forecasting efforts, it requires several modifications before it can be fully realized as an operational tool. The evaluation finds that the landslide forecasting may be more feasible at a regional scale. This study draws upon a prior work's recommendations to develop a new approach for considering landslide susceptibility and forecasting at the regional scale. This case study uses a database of landslides triggered by Hurricane Mitch in 1998 over four countries in Central America: Guatemala, Honduras, EI Salvador and Nicaragua. A regional susceptibility map is calculated from satellite and surface datasets using a statistical methodology. The susceptibility map is tested with a regional rainfall intensity-duration triggering relationship and results are compared to global algorithm framework for the Hurricane Mitch event. The statistical results suggest that this regional investigation provides one plausible way to approach some of the data and resolution issues identified in the global assessment, providing more realistic landslide forecasts for this case study. Evaluation of landslide hazards for this extreme event helps to identify several potential improvements of the algorithm framework, but also highlights several remaining challenges for the algorithm assessment, transferability and performance accuracy. Evaluation challenges include representation errors from comparing susceptibility maps of different spatial resolutions, biases in event-based landslide inventory data, and limited nonlandslide event data for more comprehensive evaluation. Additional factors that may improve algorithm performance accuracy include incorporating additional triggering factors such as tectonic activity, anthropogenic impacts and soil moisture into the algorithm calculation. Despite these limitations, the methodology presented in this regional evaluation is both straightforward to calculate and easy to interpret, making results transferable between regions and allowing findings to be placed within an inter-comparison framework. The regional algorithm scenario represents an important step in advancing regional and global-scale landslide hazard assessment and forecasting.

Kirschbaum, Dalia B.↗

Evaluating the Trustworthiness of Deep Neural Networks in Deployment – A Comparative Study (Replicability Study)

As deep neural networks (DNNs) are increasingly used in safety critical applications, there is a growing concern for their trustworthiness. Even highly trained, high-performant networks are not 100% accurate. However, it is very difficult to predict their behaviour during deployment without ground truth. In this paper, we provide a comparative and replicability study on recent approaches that have been proposed to evaluate the trustworthiness of DNNs. We find that it is very difficult to run and reproduce the results for these approaches on their replication packages, and it is even more difficult to run the tools on artifacts other than their own. Further, it is difficult to compare the effectiveness of the tools, due to lack of clearly defined evaluation metrics. Our results indicate that more effort is needed in our research community to obtain sound techniques for evaluating the trustworthiness of neural networks in safety-critical domains. To this end, we contribute an evaluation framework that incorporates the considered approaches and enables evaluation on common benchmarks, using common metrics. Using this framework, we run a comparative study of the three approaches.

Trustworthy AI↗

Robustness of Observing System Simulation Experiments

Observing System Simulation Experiments (OSSEs) are used to investigate the potential performance of proposed new instruments on numerical weather prediction (NWP). As OSSEs involve a framework in which the atmosphere and observations are all completely simulated, it is necessary to perform validation of the OSSE to ensure that it is sufficiently realistic to provide useful experimental results. A common issue that affects the forecast skill and observation impacts is the tendency of OSSEs to have insufficient model error compared to NWP in the real world. In this work, two versions of the National Aeronautics and Space Administration Global Modeling and Assimilation Office (NASA/GMAO) NWP OSSE framework are compared, with the newer framework having more simulated forecast model error than the older framework due to changes to the NWP system. The performance of the updated OSSE is validated against corresponding behavior of the same NWP system in the real world in terms of the simulated observations, the analysis increments, forecast error, and observation impacts. OSSE results of analysis and forecast impacts for three proposed new observation systems are also compared between the older and newer frameworks to evaluate the robustness of the OSSE experiments and the role of model error in observation impacts. These three new instruments are the Geostationary eXtended Observations (GeoXO) hyperspectral infrared sounder (GXS), the Midwave Infrared Sounding of Temperature and humidity in a Constellation for Winds (MISTiC Winds) atmospheric motion vectors, and additional Global Navigation Satellite System Radio Occultations (GNSS-RO).

Observing System Simulation Experiments↗

Radar-Based Bayesian Estimation of Ice Crystal Growth Parameters within a Microphysical Model

The potential for polarimetric Doppler radar measurements to improve predictions of ice microphysical processes within an idealized model–observational framework is examined. In an effort to more rigorously constrain ice growth processes (e.g., vapor deposition) with observations of natural clouds, a novel framework is developed to compare simulated and observed radar measurements, coupling a bulk adaptive-habit model of vapor growth to a polarimetric radar forward model. Bayesian inference on key microphysical model parameters is then used, via a Markov chain Monte Carlo sampler, to estimate the probability distribution of the model parameters. The statistical formalism of this method allows for robust estimates of the optimal parameter values, along with (non-Gaussian) estimates of their uncertainty. To demonstrate this framework, observations from Department of Energy radars in the Arctic during a case of pristine ice precipitation are used to constrain vapor deposition parameters in the adaptive habit model. The resulting parameter probability distributions provide physically plausible changes in ice particle density and aspect ratio during growth. A lack of direct constraint on the number concentration produces a range of possible mean particle sizes, with the mean size inversely correlated to number concentration. Consistency is found between the estimated inherent growth ratio and independent laboratory measurements, increasing confidence in the parameter PDFs and demonstrating the effectiveness of the radar measurements in constraining the parameters. The combined Doppler and polarimetric observations produce the highest-confidence estimates of the parameter PDFs, with the Doppler measurements providing a stronger constraint for this case.

Robert S. Schrom↗

Flight-Determined Subsonic Lift and Drag Characteristics of Seven Lifting-Body and Wing-Body Reentry Vehicle Configurations With Truncated Bases

This paper examines flight-measured subsonic lift and drag characteristics of seven lifting-body and wing-body reentry vehicle configurations with truncated bases. The seven vehicles are the full-scale M2-F1, M2-F2, HL-10, X-24A, X-24B, and X-15 vehicles and the Space Shuttle prototype. Lift and drag data of the various vehicles are assembled under aerodynamic performance parameters and presented in several analytical and graphical formats. These formats unify the data and allow a greater understanding than studying the vehicles individually allows. Lift-curve slope data are studied with respect to aspect ratio and related to generic wind-tunnel model data and to theory for low-aspect-ratio planforms. The proper definition of reference area was critical for understanding and comparing the lift data. The drag components studied include minimum drag coefficient, lift-related drag, maximum lift-to-drag ratio, and, where available, base pressure coefficients. The effects of fineness ratio on forebody drag were also considered. The influence of forebody drag on afterbody (base) drag at low lift is shown to be related to Hoerner's compilation for body, airfoil, nacelle, and canopy drag. These analyses are intended to provide a useful analytical framework with which to compare and evaluate new vehicle configurations of the same generic family.

Saltzman, Edwin J.↗

Aerodynamic Assessment of Flight-Determined Subsonic Lift and Drag Characteristics of Seven Lifting-Body and Wing-Body Reentry Vehicle Configurations

This report examines subsonic flight-measured lift and drag characteristics of seven lifting-body and wing-body reentry vehicle configurations with truncated bases. The seven vehicles are the full-scale M2-F1, M2-F2, HL-10, X-24A, X-24B, and X-15 vehicles and the Space Shuttle Enterprise. Subsonic flight lift and drag data of the various vehicles are assembled under aerodynamic performance parameters and presented in several analytical and graphical formats. These formats are intended to unify the data and allow a greater understanding than individually studying the vehicles allows. Lift-curve slope data are studied with respect to aspect ratio and related to generic wind-tunnel model data and to theory for low-aspect-ratio platforms. The definition of reference area is critical for understanding and comparing the lift data. The drag components studied include minimum drag coefficient, lift-related drag, maximum lift-to drag ratio, and, where available, base pressure coefficients. The influence of forebody drag on afterbody and base drag at low lift is shown to be related to Hoerner's compilation for body, airfoil, nacelle, and canopy drag. This feature may result in a reduced need of surface smoothness for vehicles with a large ratio of base area to wetted area. These analyses are intended to provide a useful analytical framework with which to compare and evaluate new vehicle configurations of the same generic family.

Saltzman, Edwin J.↗

Experience with a software engineering environment framework

Experience with a software engineering environment framework tool called the Automated Product Control Environment (APCE) is described. The goals of the framework design, an overview of the major functions and features of the framework, and implementation and use of the framework are presented. Aspects of the framework discussed include automation and control; portability, distributability, and interoperability; cost/benefit analysis; and productivity. Results of using the framework are discussed and the framework approach is briefly compared to other software development environment approaches.

Blumberg, R.↗

A reference architecture for the component factory

Software reuse can be achieved through an organization that focuses on utilization of life cycle products from previous developments. The component factory is both an example of the more general concepts of experience and domain factory and an organizational unit worth being considered independently. The critical features of such an organization are flexibility and continuous improvement. In order to achieve these features we can represent the architecture of the factory at different levels of abstraction and define a reference architecture from which specific architectures can be derived by instantiation. A reference architecture is an implementation and organization independent representation of the component factory and its environment. The paper outlines this reference architecture, discusses the instantiation process, and presents some examples of specific architectures by comparing them in the framework of the reference model.

Basili, Victor R.↗