Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 865 records · Page 48

Bridging the Gap Between Requirements and Model Analysis : Evaluation on Ten Cyber-Physical Challenge Problems

Formal verfication and simulation are powerful tools to validate requirements against complex systems. [Problem] Requirements are developed in early stages of the software lifecycle and are typically written in ambiguous natural language. There is a gap between such requirements and formal notations that can be used by verification tools, and lack of support for proper association of requirements with software artifacts for verification. [Principal idea] We propose to write requirements in an intuitive, structured natural language with formal semantics, and to support formalization and model/code verification as a smooth, well-integrated process. [Contribution] We have developed an end-to-end, open source requirements analysis framework that checks Simulink models against requirements written in structured natural language. Our framework is built in the Formal Requirements Elicitation Tool (fret); we use fret's requirements language named fretish, and formalization of fretish requirements in temporal logics. Our proposed framework contributes the following features: 1) automatic extraction of Simulink model information and association of fretish requirements with target model signals and components; 2) translation of temporal logic formulas into synchronous dataflow cocospec specifications as well as Simulink monitors, to be used by verification tools; we establish correctness of our translation through extensive automated testing; 3) interpretation of counterexamples produced by verification tools back at requirements level. These features support a tight integration and feedback loop between high level requirements and their analysis. We demonstrate our approach on a major case study: the Ten Lockheed Martin Cyber-Physical, aerospace-inspired challenge problems.

Mavridou, Anastasia↗

Tree-manipulating systems and Church-Rosser theorems.

Study of a broad class of tree-manipulating systems called subtree replacement systems. The use of this framework is illustrated by general theorems analogous to the Church-Rosser theorem and by applications of these theorems. Sufficient conditions are derived for the Church-Rosser property, and their applications to recursive definitions, the lambda calculus, and parallel programming are discussed. McCarthy's (1963) recursive calculus is extended by allowing a choice between call-by-value and call-by-name. It is shown that recursively defined functions are single-valued despite the nondeterminism of the evaluation algorithm. It is also shown that these functions solve their defining equations in a 'canonical' manner.

Rosen, B. K.↗

Imaging radar observations of Askja Caldera, Iceland

A 'blind' test involving interpretation of computer-enhanced like- and cross-polarized radar images is used to evaluate the surface roughness of Askja Caldera, a large volcanic complex in central Iceland. The 'blind' test differs from earlier analyses of radar observations in that computer-processes images and both qualitative and quantitative analyses are used. Attention is given to photogeologic examination and subsequent survey-type field observations, along with aerial photography during the field trip. The results indicate that the 'blind' test of radar interpretation of the Askja volcanic area can be considered suitable within the framework of limitations of radar data considered explicitly from the onset. The limitations of the radar techniques can be eliminated by using oblique-viewing conditions to remove geometric distortions and slope effects.

Malin, M. C.↗

Dynamic Load Balancing For Grid Partitioning on a SP-2 Multiprocessor: A Framework

Computational requirements of full scale computational fluid dynamics change as computation progresses on a parallel machine. The change in computational intensity causes workload imbalance of processors, which in turn requires a large amount of data movement at runtime. If parallel CFD is to be successful on a parallel or massively parallel machine, balancing of the runtime load is indispensable. Here a framework is presented for dynamic load balancing for CFD applications, called Jove. One processor is designated as a decision maker Jove while others are assigned to computational fluid dynamics. Processors running CFD send flags to Jove in a predetermined number of iterations to initiate load balancing. Jove starts working on load balancing while other processors continue working with the current data and load distribution. Jove goes through several steps to decide if the new data should be taken, including preliminary evaluate, partition, processor reassignment, cost evaluation, and decision. Jove running on a single IBM SP2 node has been completely implemented. Preliminary experimental results show that the Jove approach to dynamic load balancing can be effective for full scale grid partitioning on the target machine IBM SP2.

Sohn, Andrew↗

Dynamic Load Balancing for Grid Partitioning on a SP-2 Multiprocessor: A Framework

Computational requirements of full scale computational fluid dynamics change as computation progresses on a parallel machine. The change in computational intensity causes workload imbalance of processors, which in turn requires a large amount of data movement at runtime. If parallel CFD is to be successful on a parallel or massively parallel machine, balancing of the runtime load is indispensable. Here a framework is presented for dynamic load balancing for CFD applications, called Jove. One processor is designated as a decision maker Jove while others are assigned to computational fluid dynamics. Processors running CFD send flags to Jove in a predetermined number of iterations to initiate load balancing. Jove starts working on load balancing while other processors continue working with the current data and load distribution. Jove goes through several steps to decide if the new data should be taken, including preliminary evaluate, partition, processor reassignment, cost evaluation, and decision. Jove running on a single EBM SP2 node has been completely implemented. Preliminary experimental results show that the Jove approach to dynamic load balancing can be effective for full scale grid partitioning on the target machine IBM SP2.

Sohn, Andrew↗

Parallel Aircraft Trajectory Optimization with Analytic Derivatives

Trajectory optimization is an integral component for the design of aerospace vehicles, but emerging aircraft technologies have introduced new demands on trajectory analysis that current tools are not well suited to address. Designing aircraft with technologies such as hybrid electric propulsion and morphing wings requires consideration of the operational behavior as well as the physical design characteristics of the aircraft. The addition of operational variables can dramatically increase the number of design variables which motivates the use of gradient based optimization with analytic derivatives to solve the larger optimization problems. In this work we develop an aircraft trajectory analysis tool using a Legendre-Gauss-Lobatto based collocation scheme, providing analytic derivatives via the OpenMDAO multidisciplinary optimization framework. This collocation method uses an implicit time integration scheme that provides a high degree of sparsity and thus several potential options for parallelization. The performance of the new implementation was investigated via a series of single and multi-trajectory optimizations using a combination of parallel computing and constraint aggregation. The computational performance results show that in order to take full advantage of the sparsity in the problem it is vital to parallelize both the non-linear analysis evaluations and the derivative computations themselves. The constraint aggregation results showed a significant numerical challenge due to difficulty in achieving tight convergence tolerances. Overall, the results demonstrate the value of applying analytic derivatives to trajectory optimization problems and lay the foundation for future application of this collocation based method to the design of aircraft with where operational scheduling of technologies is key to achieving good performance.

aircraft↗

Environmental Barrier Coating Fracture, Fatigue and High-Heat-Flux Durability Modeling and Stochastic Progressive Damage Simulation

Advanced environmental barrier coatings will play an increasingly important role in future gas turbine engines because of their ability to protect emerging light-weight SiC/SiC ceramic matrix composite (CMC) engine components, further raising engine operating temperatures and performance. Because the environmental barrier coating systems are critical to the performance, reliability and durability of these hot-section ceramic engine components, a prime-reliant coating system along with established life design methodology are required for the hot-section ceramic component insertion into engine service. In this paper, we have first summarized some observations of high temperature, high-heat-flux environmental degradation and failure mechanisms of environmental barrier coating systems in laboratory simulated engine environment tests. In particular, the coating surface cracking morphologies and associated subsequent delamination mechanisms under the engine level high-heat-flux, combustion steam, and mechanical creep and fatigue loading conditions will be discussed. The EBC compostion and archtechture improvements based on advanced high heat flux environmental testing, and the modeling advances based on the integrated Finite Element Analysis Micromechanics Analysis Code/Ceramics Analysis and Reliability Evaluation of Structures (FEAMAC/CARES) program will also be highlighted. The stochastic progressive damage simulation successfully predicts mud flat damage pattern in EBCs on coated 3-D specimens, and a 2-D model of through-the-thickness cross-section. A 2-parameter Weibull distribution was assumed in characterizing the coating layer stochastic strength response and the formation of damage was therefore modeled. The damage initiation and coalescence into progressively smaller mudflat crack cells was demonstrated. A coating life prediction framework may be realized by examining the surface crack initiation and delamination propagation in conjunction with environmental degradation under high-heat-flux and environment load test conditions.

Mechanical creep and fatigue loading condition↗

Microphysical Retrievals from Simultaneous Measurements by Airborne and Ground Radars during OLYMPEX

The OLYMPEX field campaign took place over the Olympic Peninsula of Washington during winter 2015-2016. During the intensive observing period, several aircraft flights obtained multi-frequency airborne radar measurements at X-, Ku-, Ka, and W-band from radars aboard the ER-2 and DC-8 aircraft. In addition, ground radars at S- and X-band performed RHI scans under the aircraft ground tracks. These coincident datasets provide a wealth of complementary information about the hydrometeor particle sizes, shapes, and orientations.In order to synthesize these measurements and test the robustness of scattering models, an optimal estimation retrieval based upon a Hitschfeld-Bordan profiling algorithm has been developed. This algorithm retrieves profiles of the particle size distribution parameters Nw and Dm, and, in the ice phase, relative proportions of aggregate, pristine, and rimed particles, using scattering models with different size-density and size-aspect ratio relationships. Under this formulation, only the pristine particles are horizontally aligned and capable of producing non-zero ZDR and KDP.From the nadir-looking airborne multifrequency radars, we find that aggregates may be readily distinguished from rimed and pristine particles owing to their uniqueness in triple-frequency space. However, rimed and pristine particles occupy a similar region in this space and thus polarimetric measurements greatly enhance their identification in our retrieval framework. With these capabilities we will present analyses of three-dimensional hydrometeor mapping obtained during various OLYMPEX cases. Some features retrieved in these cases include a layer of enhanced aggregation about 2km above the melting layer, hypothesized to be maintained by orographic uplift. This layer is often situated above a layer of denser, aligned particles. Regions of riming and supercooled liquid water beneath generating cells are also identified by our retrieval algorithm. Comparisons to in-situ observations and evaluation of scattering models will be presented.

Munchak, S. Joseph↗

In-Situ Resource Utilization Modeling of a Lunar Water Processing System

A key element of achieving a sustained surface presence, such as defined in NASA’s Artemis plan, is In-Situ Resource Utilization (ISRU). ISRU is the practice of using local resources to provide mission consumables that reduce system launch mass requirements, and regenerate resources (chiefly, water and oxygen) for propulsion and life support supporting both Lunar and Martian missions. ISRU systems require multiple complex processes, such as excavation, chemical reactors, and electrolysis subsystems that must operate in harmony to optimize the overall system process from beginning to end. The Mission Analysis and Integration Tool (MAIT) was previously developed with MATLAB in FY22 to connect individual subsystem models into a customized, flexible framework for the purpose of technology downselect, optimization, and end-to-end process planning. Beginning in FY24, MAIT was updated and became the capital program in the Systems Engineering and Integration (SE&I) ISRU Modeling and Analysis (SIMA) project. Prior work was leveraged and evolved using MATLAB/Simulink due to its ability to communicate with a vast number of other programming languages and makes up the backbone of data flow between inputs and outputs to the subsystem models. MAIT initially evaluated a suite of ISRU-related technologies, including the water processing Lunar Auger Dryer for ISRU (LADI) system with integrated upstream excavation and downstream electrolysis subsystems. With individual models consolidated, the MAIT tool generated over 5,000 cases during its first round of parametric sweeps on the water processing architecture at multiple production targets; the system analysis produced valuable insight into the optimal LADI geometry that minimized energy demands, estimated effects to cold trap size and radiator requirements, and calculated the power dynamics of the electrolysis unit and liquid oxygen storage volume. Additional efforts are being made to demonstrate the ability to scale ISRU technologies supporting the Space Technology Mission Directorate’s (STMD) commercialization strategy and increase the MAIT software capability. Work is ongoing to handle a wide array of ISRU system models beyond the Lunar environment, e.g. production of propellant for a Martian lander.

Avery Carlson↗

In-Situ Resource Utilization Modeling of a Lunar Water Processing System

A key element of achieving a sustained surface presence, such as defined in NASA’s Artemis plan, is In-Situ Resource Utilization (ISRU). ISRU is the practice of using local resources to provide mission consumables that reduce system launch mass requirements, and regenerate resources (chiefly, water and oxygen) for propulsion and life support supporting both Lunar and Martian missions. ISRU systems require multiple complex processes, such as excavation, chemical reactors, and electrolysis subsystems that must operate in harmony to optimize the overall system process from beginning to end. The Mission Analysis and Integration Tool (MAIT) was previously developed with MATLAB in FY22 to connect individual subsystem models into a customized, flexible framework for the purpose of technology downselect, optimization, and end-to-end process planning. Beginning in FY24, MAIT was updated and became the capital program in the Systems Engineering and Integration (SE&I) ISRU Modeling and Analysis (SIMA) project. Prior work was leveraged and evolved using MATLAB/Simulink due to its ability to communicate with a vast number of other programming languages and makes up the backbone of data flow between inputs and outputs to the subsystem models. MAIT initially evaluated a suite of ISRU-related technologies, including the water processing Lunar Auger Dryer for ISRU (LADI) system with integrated upstream excavation and downstream electrolysis subsystems. With individual models consolidated, the MAIT tool generated over 5,000 cases during its first round of parametric sweeps on the water processing architecture at multiple production targets; the system analysis produced valuable insight into the optimal LADI geometry that minimized energy demands, estimated effects to cold trap size and radiator requirements, and calculated the power dynamics of the electrolysis unit and liquid oxygen storage volume. Additional efforts are being made to demonstrate the ability to scale ISRU technologies supporting the Space Technology Mission Directorate’s (STMD) commercialization strategy and increase the MAIT software capability. Work is ongoing to handle a wide array of ISRU system models beyond the Lunar environment, e.g. production of propellant for a Martian lander.

Avery Carlson↗

Reaction control system/remote manipulator system automation

The objectives of this project is to evaluate the capability of the Procedural Reasoning System (PRS) in a typical real-time space shuttle application and to assess its potential for use in the Space Station Freedom. PRS, developed by SRI International, is a result of research in automating the monitoring and control of spacecraft systems. The particular application selected for the present work is the automation of malfunction handling procedures for the Shuttle Remote Manipulator System (SRMS). The SRMS malfunction procedures will be encoded within the PRS framework, a crew interface appropriate to the RMS application will be developed, and the real-time data interface software developed. The resulting PRS will then be integrated with the high-fidelity On-orbit Simulation of the NASA Johnson Space Center's System Engineering Simulator, and tests under various SRMS fault scenarios will be conducted.

Hiers, Harry K.↗

A Further Look at X-33 Entry Guidance and Beyond

An entry guidance design developed at Iowa State University (ISU) for the X-33 advanced technology demonstrator is outlined and compared with the X-33 entry guidance algorithms developed at NASA Marshall. Both designs are based on the Space Shuttle entry guidance concept, but significant improvements have been made to enhance the performance and reduce the complexity. The ISU design was incorporated into MAVERIC, a high fidelity vehicle simulation software for the X-33, and evaluated in Monte Carlo simulations against random dispersions in propulsion system, wind and atmospheric properties, aerodynamic coefficients, interaction between propulsion and aerodynamics, and navigation data. The simulations clearly demonstrated the capability and precision of the ISU entry guidance design in successfully guiding the X-33 in some rather difficult flight scenarios. As the entry guidance development for the X-33 is completing, this report also offers some review of the strength and limitations of the current Shuttle-based entry guidance framework, and finally some potential candidates for next generation of more capable and cost-effective entry guidance designs are discussed.

Lu, Ping↗

Constraint-Based Off-Nominal Behavior Modeling for Europa Clipper

The risk analysis for the Europa Clipper mission evaluates the probability of mission failure based on the failure rates of individual components and dependencies among them. The probabilities are calculated by integrating over the intervals of time within which a fault occurs, accounting for an infinite number of cases. The response of the spacecraft to different faults can result in different schedules of activities, changing the intervals of integration. Europa currently uses models of spacecraft systems and components to simulate individual flight scenarios. The goal is to develop a framework for integrating, automating, and improving this modeling process. We describe an approach to generating the schedules for the different fault cases and determining the intervals for faults. It is not enough to just simulate individual cases because we are working with continuous variables that generate an infinite number of possible futures. Instead, we determine time windows within which certain faults can occur and use these time windows as bounds for integration. We found that determining these time windows is a constraint optimization problem. In order to represent these problems, we employ a language based on ontologies of behavior and scenarios. The language enables us to specify constraints in a simple, declarative syntax. A constraint-based analysis engine uses the declarative specification to identify bounds on system parameters and fill in details of behavior. For example, we created a detailed model of power generation, power use, and the corresponding effects on the battery in order to determine when an undervoltage fault can occur. An undervoltage during a trajectory correction maneuver requires that thrusting be interrupted for just enough time to recharge the battery such that the maneuver can be completed within battery limits. This behavior is generated based on the model to minimize the interruption time. For certain scenarios the constraint optimization problems were simple enough to be solved by hand, but the framework made the process substantially faster. It also produced solutions to other problems that we could not solve by hand or with existing tools and allowed us to generate and run many scenarios at once. The scenario language and engine greatly simplified the process of identifying time bounds and separating cases.

Everline, Chester J.↗

Strategies for Determining the Cascade Rate in MHD Turbulence: Isotropy, Anisotropy, and Spacecraft Sampling

Exact laws for evaluating cascade rates, tracing back to the Kolmogorov "4/5" law, have been extended to many systems of interest including magnetohydrodynamics (MHD), and compressible flows of the magnetofluid and ordinary fluid types. It is understood that implementations may be limited by the quantity of available data and by the lack of turbulence symmetry. Assessment of the accuracy and feasibility of such third-order (or Yaglom) relations is most effectively accomplished by examining the von Kármán–Howarth equation in increment form, a framework from which the third-order laws are derived as asymptotic approximations. Using this approach, we examine the context of third-order laws for incompressible MHD in some detail. The simplest versions rely on the assumption of isotropy and the presence of a well-defined inertial range, while related procedures generalize the same idea to arbitrary rotational symmetries. Conditions for obtaining correct and accurate values of the dissipation rate from these laws based on several sampling and fitting strategies are investigated using results from simulations. The questions we address are of particular relevance to sampling of solar wind turbulence by one or more spacecraft.

Yanwen Wang↗

Probabilistic Forecasting of Ground Magnetic Perturbation Spikes at Mid-Latitude Stations

The prediction of large fluctuations in the ground magnetic field (dB/dt) is essential for preventing damage from Geomagnetically Induced Currents. Directly forecasting these fluctuations has proven difficult, but accurately determining the risk of extreme events can allow for the worst of the damage to be prevented. Here we trained Convolutional Neural Network models for eight mid-latitude magnetometers to predict the probability that dB/dt will exceed the 99th percentile threshold 30–60 min in the future. Two model frameworks were compared, a model trained using solar wind data from the Advanced Composition Explorer (ACE) satellite, and another model trained on both ACE and SuperMAG ground magnetometer data. The models were compared to examine if the addition of current ground magnetometer data significantly improved the forecasts of dB/dt in the future prediction window. A bootstrapping method was employed using a random split of the training and validation data to provide a measure of uncertainty in model predictions. The models were evaluated on the ground truth data during eight geomagnetic storms and a suite of evaluation metrics are presented. The models were also compared to a persistence model to ensure that the model using both datasets did not over-rely on dB/dt values in making its predictions. Overall, we find that the models using both the solar wind and ground magnetometer data had better metric scores than the solar wind only and persistence models, and was able to capture more spatially localized variations in the dB/dt threshold crossings.

Michael Coughlan↗

Simulating boundary layer transition with low-Reynolds-number k-epsilon turbulence models. I - An evaluation of prediction characteristics. II - An approach to improving the predictions

The capability of two k-epsilon low-Reynolds number (LRN) turbulence models, those of Jones and Launder (1972) and Lam and Bremhorst (1981), to predict transition in external boundary-layer flows subject to free-stream turbulence is analyzed. Both models correctly predict the basic qualitative aspects of boundary-layer transition with free stream turbulence, but for calculations started at low values of certain defined Reynolds numbers, the transition is generally predicted at unrealistically early locations. Also, the methods predict transition lengths significantly shorter than those found experimentally. An approach to overcoming these deficiencies without abandoning the basic LRN k-epsilon framework is developed. This approach limits the production term in the turbulent kinetic energy equation and is based on a simple stability criterion. It is correlated to the free-stream turbulence value. The modification is shown to improve the qualitative and quantitative characteristics of the transition predictions.

Schmidt, R. C.↗

On the generation of field-aligned plasma flow at the boundary of the plasma sheet

A possible cause of the large plasma flow velocities parallel to the magnetic field (which were observed in spacecraft experiments) near the boundary of the plasma sheet in the earth's magnetotail is considered in the framework of a magnetohydrodynamic model. It is shown for steady-state configurations that high parallel flow velocities can be expected to exist on field lines connecting to a region of weak magnetic field. The physical mechanism causing large values of the parallel velocity component can be visualized as a strong imbalance of perpendicular mass flux into and out of magnetic flux tubes passing through regions where the magnetic field is weak and inhomogeneous. The value of the parallel velocity component is evaluated, and it is found that it can substantially exceed the perpendicular velocity (by as much as a factor of 40). The results are applied to the earth's magnetotail; it is found that this mechanism is able to explain the parallel flow velocities near the boundary of the plasma sheet in the range of several hundreds of km/s.

Schindler, K.↗

Global Assimilation of Multi-Sensor Snow Observations for Improved Characterization of Snow Processes

Snow conditions on the land surface are recognized to be key components of the global hydrological cycle as they play a critical role in the determination of local and regional climate. In many mid-latitude and high-latitude regions, the seasonal water storage and associated spring snowmelt dominate the local hydrology. The contribution to the runoff and moisture conditions from snow is vital in supporting agriculture and in determining water resources management practices. Consequently, accurate characterization of snow properties becomes important for both end-use applications and weather and climate research. Recently a joint effort between the u.S. Air Force and NASA has enabled a blended, multi-sensor snow product known as the AFWA NASA Snow Algorithm (ANSA). This global snow dataset has been generated by utilizing the Earth Observation System (EOS) Moderate Resolution Imaging Spectroradiometer (MODIS) and Advanced Microwave Scanning Radiometer for EOS (AMSR-E) datasets. ANSA product includes estimates of snow cover extent, snow water equivalent (SWE) and SWE-derived snow depth fields. The MODIS-based products enable snow cover mappings under cloud-free conditions whereas the passive microwave data from AMSR-E provides measurements under cloudy conditions. These remotely-sensed snow observations are further augmented with the information from ground-based snow measurements through data fusion techniques. The resulting ANSA products are employed in the NASA Land Information System (LIS) data assimilation framework, which provides a comprehensive environment for integrating community land surface models, ground and satellite-based observations, and ensemble-based data assimilation tools. LIS incorporates the multisensor ANSA snow retrievals with the land surface model estimates to generate spatially and temporally continuous estimates of snow states, through data assimilation. A suite of experiments to assimilate ANSA snow cover, SWE and snow depth estimates with different land surface models in LIS are conducted and the resulting estimates of snow conditions are evaluated against a number of in-situ observational datasets, over several regions of the world. These evaluations are used to compare and contrast the advantages and disadvantages of these multi-sensor snow observations.

Kumar, Sujay↗