Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data modeling.”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,495 records · Page 83

Kronecker-structured covariance models for multiway data

Many applications produce multiway data of exceedingly high dimension. Modeling such multi-way data is important in multichannel signal and video processing where sensors produce multi-indexed data, e.g. over spatial, frequency, and temporal dimensions. We will address the challenges of covariance representation of multiway data and review some of the progress in statistical modeling of multiway covariance over the past two decades, focusing on tensor-valued covariance models and their inference. We will illustrate through a space weather application: predicting the evolution of solar active regions over time.

97 MATHEMATICS AND COMPUTING↗

Hybrid methods for cybersecurity analysis :

Early 2010 saw a signi cant change in adversarial techniques aimed at network intrusion: a shift from malware delivered via email attachments toward the use of hidden, embedded hyperlinks to initiate sequences of downloads and interactions with web sites and network servers containing malicious software. Enterprise security groups were well poised and experienced in defending the former attacks, but the new types of attacks were larger in number, more challenging to detect, dynamic in nature, and required the development of new technologies and analytic capabilities. The Hybrid LDRD project was aimed at delivering new capabilities in large-scale data modeling and analysis to enterprise security operators and analysts and understanding the challenges of detection and prevention of emerging cybersecurity threats. Leveraging previous LDRD research e orts and capabilities in large-scale relational data analysis, large-scale discrete data analysis and visualization, and streaming data analysis, new modeling and analysis capabilities were quickly brought to bear on the problems in email phishing and spear phishing attacks in the Sandia enterprise security operational groups at the onset of the Hybrid project. As part of this project, a software development and deployment framework was created within the security analyst work ow tool sets to facilitate the delivery and testing of new capabilities as they became available, and machine learning algorithms were developed to address the challenge of dynamic threats. Furthermore, researchers from the Hybrid project were embedded in the security analyst groups for almost a full year, engaged in daily operational activities and routines, creating an atmosphere of trust and collaboration between the researchers and security personnel. The Hybrid project has altered the way that research ideas can be incorporated into the production environments of Sandias enterprise security groups, reducing time to deployment from months and years to hours and days for the application of new modeling and analysis capabilities to emerging threats. The development and deployment framework has been generalized into the Hybrid Framework and incor- porated into several LDRD, WFO, and DOE/CSL projects and proposals. And most importantly, the Hybrid project has provided Sandia security analysts with new, scalable, extensible analytic capabilities that have resulted in alerts not detectable using their previous work ow tool sets.

Dunlavy, Daniel M.↗

Validation and Verification of Operational Land Analysis Activities at the Air Force Weather Agency

The NASA developed Land Information System (LIS) is the Air Force Weather Agency's (AFWA) operational Land Data Assimilation System (LDAS) combining real time precipitation observations and analyses, global forecast model data, vegetation, terrain, and soil parameters with the community Noah land surface model, along with other hydrology module options, to generate profile analyses of global soil moisture, soil temperature, and other important land surface characteristics. (1) A range of satellite data products and surface observations used to generate the land analysis products (2) Global, 1/4 deg spatial resolution (3) Model analysis generated at 3 hours

Shaw, Michael↗

Validation and Verification of Operational Land Analysis Activities at the Air Force Weather Agency

The NASA developed Land Information System (LIS) is the Air Force Weather Agency's (AFWA) operational Land Data Assimilation System (LDAS) combining real time precipitation observations and analyses, global forecast model data, vegetation, terrain, and soil parameters with the community Noah land surface model, along with other hydrology module options, to generate profile analyses of global soil moisture, soil temperature, and other important land surface characteristics. (1) A range of satellite data products and surface observations used to generate the land analysis products (2) Global, 1/4 deg spatial resolution (3) Model analysis generated at 3 hours. AFWA recognizes the importance of operational benchmarking and uncertainty characterization for land surface modeling and is developing standard methods, software, and metrics to verify and/or validate LIS output products. To facilitate this and other needs for land analysis activities at AFWA, the Model Evaluation Toolkit (MET) -- a joint product of the National Center for Atmospheric Research Developmental Testbed Center (NCAR DTC), AFWA, and the user community -- and the Land surface Verification Toolkit (LVT), developed at the Goddard Space Flight Center (GSFC), have been adapted to operational benchmarking needs of AFWA's land characterization activities.

Shaw, Michael↗

Modeling Transient Soil Moisture Limitations on Microbial Carbon Respiration

Soil microorganisms are known to survive periods of aridity and to recover rapidly after wetting events, with the ability to transition between a dormant state in dry conditions and an active state in wet conditions. While this dynamic behavior has been previously incorporated into soil carbon respiration modeling frameworks, a direct comparison between this active-dormant transition mechanism and a more simplified first-order model has yet to be made. Here, we demonstrate the necessary extent of model complexity needed to reproduce transient carbon respiration rates obtained from a set of soil incubation experiments implemented over a range of soil depths and time intervals. Two approaches are tested, one uses simplified first-order kinetics, whereas the other employs a transition between active and dormant biomass. The performance of each model is evaluated using an Akaike Information Criterion (AIC) based on the accuracy with which they reproduce an experimental dataset consisting of two sets of time series soil incubations collected across a range of time and depth resolutions. Based on the AIC evaluation and model-data comparison, we conclude that a dormancy-enabled model featuring two distinct microbial strategists performs best for the majority of the soil profile (above 108 cm) for both high and low depth resolution and sampling frequency, despite the added parameters required. In contrast, the first-order model achieves better AIC scores when simulating our deepest soils (112–165 cm), where moisture fluctuations are expected to be less prevalent. These findings guide how and where we choose to apply more cost intensive models.

58 GEOSCIENCES↗

Canopus: A Paradigm Shift Towards Elastic Extreme-Scale Data Analytics on HPC

Scientific simulations on high performance computing (HPC) platforms generate large quantities of data. To bridge the widening gap between compute and I/O, and enable data to be more efficiently stored and analyzed, simulation outputs need to be refactored, reduced, and appropriately mapped to storage tiers. However, a systematic solution to support these steps has been lacking on the current HPC software ecosystem. To that end, this paper develops Canopus, a progressive JPEGlike data management scheme for storing and analyzing big scientific data. It co-designs the data decimation, compression and data storage, taking the hardware characteristics of each storage tier into considerations. With reasonably low overhead, our approach refactors simulation data into a much smaller, reduced-accuracy base dataset, and a series of deltas that is used to augment the accuracy if needed. The base dataset and deltas are compressed and written to multiple storage tiers. Data saved on different tiers can then be selectively retrieved to restore the level of accuracy that satisfies data analytics. Thus, Canopus provides a paradigm shift towards elastic data analytics and enables end users to make trade-offs between analysis speed and accuracy on-the-fly. We evaluate the impact of Canopus on unstructured triangular meshes, a pervasive data model used by scientific modeling and simulations. In particular, we demonstrate the progressive data exploration of Canopus using the “blob detection” use case on the fusion simulation data.

Lu, Tao↗

Integrated Evaluation of Power Sector Decarbonization

MARKAL-PROMOD Integration presentation for USAEE conference on November 4, 2024. The presentation shows the construction of the MAGIIC translation tool to convert MARKAL capacity expansion to PROMOD model data, and PROMOD unit dispatch results to MARKAL technology availability data to allow a more robust analysis leveraging both modeling tools.

Sharma, Smriti↗

A Parallel Graph Environment for Real-World Data Analytics Workflows

Economic competitiveness and national security depend increasingly on the insightful analysis of large data sets. The diversity of real-world data sources and analytic workflows impose challenging hardware and software requirements for parallel graph platforms. The irregular nature of graph methods is not supported well by the deep memory hierarchies of conventional distributed systems, requiring new processor and runtime system designs to tolerate memory and synchronization latencies. Moreover, the efficiency of relational table operations and matrix computations are not attainable when data is stored in common graph data structures. In this paper, we present HAGGLE, a high-performance, scalable data analytics platform. The platform’s hybrid data model supports a variety of distributed, thread-safe data structures, parallel programming constructs, and persistent and streaming data. An abstract runtime layer enables us to map the stack to conventional, distributed computer systems with accelerators. The runtime uses multithreading, active messages, and data aggregation to hide memory and synchronization latencies on large-scale systems.

Graph Analytics↗

A framework for benchmarking land models

Land models, which have been developed by the modeling community in the past few decades to predict future states of ecosystems and climate, have to be critically evaluated for their performance skills of simulating ecosystem responses and feedback to climate change. Benchmarking is an emerging procedure to measure performance of models against a set of defined standards. This paper proposes a benchmarking framework for evaluation of land model performances and, meanwhile, highlights major challenges at this infant stage of benchmark analysis. The framework includes (1) targeted aspects of model performance to be evaluated, (2) a set of benchmarks as defined references to test model performance, (3) metrics to measure and compare performance skills among models so as to identify model strengths and deficiencies, and (4) model improvement. Land models are required to simulate exchange of water, energy, carbon and sometimes other trace gases between the atmosphere and land surface, and should be evaluated for their simulations of biophysical processes, biogeochemical cycles, and vegetation dynamics in response to climate change across broad temporal and spatial scales. Thus, one major challenge is to select and define a limited number of benchmarks to effectively evaluate land model performance. The second challenge is to develop metrics of measuring mismatches between models and benchmarks. The metrics may include (1) a priori thresholds of acceptable model performance and (2) a scoring system to combine data–model mismatches for various processes at different temporal and spatial scales. The benchmark analyses should identify clues of weak model performance to guide future development, thus enabling improved predictions of future states of ecosystems and climate. The near-future research effort should be on development of a set of widely acceptable benchmarks that can be used to objectively, effectively, and reliably evaluate fundamental properties of land models to improve their prediction performance skills.

Biophysical Processes↗

MLP-NN vs Gauss-Newton files

-Input files for randomly selected subset data (30 instances) from primary dipole-dipole forward modeling data.-Inversion results in surfer grid format as well as in .DAT format.-Scatterplots for MLP-NN vs Gauss-Newton present in the excel sheet.

58 GEOSCIENCES↗

An Engineering Data Management System for Ipad

An overview of the capabilities and software architecture of the IPAD information processor (IPIP) is presented. IPIP is a state-of-the-art data base management system that satisfies engineering requirements not addressed by present day commercial systems. It also significantly advances a number of capabilities that are offered commercially. IPIP capabilities range from support for multiple schemas and data models to support for distributed processing, configuration control, and data inventory management. IPIP exploits semantic commonality in features offered in various forms at different user interfaces in today's commercial systems. An integrated software architecture supports all user interfaces: programming languages, interactive data manipulation, and schema languages. This approach promotes simplicity and compactness in software and permits features to be offered symmetrically across all appropriate user interfaces.

H R Johnson↗

Measurements of the Buffeting Loads on the Wing and Horizontal Tail of a 1/4-scale Model of the X-1E Airplane

The buffeting loads acting on the wing and horizontal tail of a 1/4-scale model of the X-1E airplane have been measured in the Langley 16-foot transonic tunnel in the Mach number range from 0.40 to 0.90. When the buffeting loads were reduced to a nondimensional aerodynamic coefficient of buffeting intensity, it was found that the maximum buffeting intensity of the horizontal tail was about twice as large as that of the wing. Comparison of power spectra of buffeting loads acting on the horizontal tail of the airplaneand of the model indicated that the model horizontal tail, which was of conventional force-test-model design, responded in an entirely different mode than did the airplane.This result implied that if quantitative extrapolation of model data to flight conditions were desired a dynamically scaled model of the rearward portion of the fuselage and empennage would be required. A study of the sources of horizontal-tail buffeting of the model indicated that the wing wake contributed a large part of the total buffeting load. At one condition it was found that removal of the wing wake would reduce the buffeting loads on the horizontal tail to about one-third of the original value.

Rainey, A Gerald↗

Development of a Mars Airplane Entry, Descent, and Flight Trajectory

An entry, descent, and flight (EDF) trajectory profile for a Mars airplane mission is defined as consisting of the following elements: ballistic entry of an aeroshell; supersonic deployment of a decelerator parachute; subsonic release of a heat shield; release, unfolding, and orientation of an airplane to flight attitude; and execution of a pull up maneuver to achieve trimmed, horizontal flight. Using the Program to Optimize Simulated Trajectories (POST) a trajectory optimization problem was formulated. Model data representative of a specific Mars airplane configuration, current models of the Mars surface topography and atmosphere, and current estimates of the interplanetary trajectory, were incorporated into the analysis. The goal is to develop an EDF trajectory to maximize the surface-relative altitude of the airplane at the end of a pull up maneuver, while subject to the mission design constraints. The trajectory performance was evaluated for three potential mission sites and was found to be site-sensitive. The trajectory performance, examined for sensitivity to a number of design and constraint variables, was found to be most sensitive to airplane mass, aerodynamic performance characteristics, and the pull up Mach constraint. Based on the results of this sensitivity study, an airplane-drag optimized trajectory was developed that showed a significant performance improvement.

Murray, James E.↗

Land-Use and Land-Cover Change around Mobile Bay, Alabama from 1974-2008

This document summarizes the major findings of a Gulf of Mexico Application Pilot project led by NASA Stennis Space Center (SSC) in conjunction with a regional collaboration network of the Gulf of Mexico Alliance (GOMA). NASA researchers processed and analyzed multi-temporal Landsat data to assess land-use and land-cover (LULC) changes in the coastal counties of Mobile and Baldwin, AL between 1974 and 2008. Our goal was to create satellite-based LULC data products using methods that could be transferable to other coastal areas of concern within the Gulf of Mexico. The Mobile Bay National Estuary Program (MBNEP) is the primary end-user, however, several other state and local groups may benefit from the project s data products that will be available through NOAA-NCDDC s Regional Ecosystem Data Management program. Mobile Bay is a critical ecologic and economic region in the Gulf of Mexico and to the entire country. Mobile Bay was designated as an estuary of national significance in 1996. This estuary receives the fourth largest freshwater inflow in the United States. It provides vital nursery habitat for commercially and recreationally important fish species. It has exceptional aquatic and terrestrial bio-diversity, however, its estuary health is influenced by changing LULC patterns, such as urbanization. Mobile and Baldwin counties have experienced a population growth of 1.1% and 20.5% from 2000-2006. Urban expansion and population growth are likely to accelerate with the construction and operation of the ThyssenKrupp steel mill in the northeast portion of Mobile County. Land-use and land-cover change can negatively impact Gulf coast water quality and ecological resources. The conversion of forest to urban cover types impacts the carbon cycle and increases the freshwater and sediment in coastal waters. Increased freshwater runoff decreases salinity and increases the turbidity of coastal waters, thus impacting the growth potential of submerged aquatic vegetation (SAV), which is critical nursing ground for many Gulf fish species. A survey of Mobile Bay SAV showed widespread decreases since the 1940s. Prior to our project, coastal environmental managers in Baldwin and Mobile counties needed more understanding of the historical LULC for properly assessing the impacts of urbanization. In particular, more information on the location and extent of changing urbanization LULC patterns was needed to aid LULC planning and to assess predictions of future LULC patterns. Our products will assist the coastal environmental managers and land-use planners in making better community growth planning decisions. Our project also will help to establish a historical baseline of LULC distributions, which is a fundamental need in any stewardship plan. The primary research objective of our project was to produce historic and current geospatial LULC change products across a 34-year time frame. A multi-decadal coastal LULC change product was the major project deliverable. The geographic extent and nature of change was quantified and assessed for the upland herbaceous, barren, open water, urban, upland forest, woody wetland, and non-woody wetlanddominated land cover types. We focused on regional analyses of decadal-scale urban expansion and watershed-scaled analyses of LULC change for multiple areas of concern to the Mobile Bay NEP (Figure A). We used the following dates to derive LULC classification products from Landsat data: 1974, 1979, 1984, 1988, 1991, 1996, 2001, 2005, and 2008. We assessed the accuracy of our products using randomly sampled locations and digital geospatial reference data including field survey data, high resolution orthorectified aerial photography, high resolution multispectral and panchromatic satellite data displays (from QuickBird and Corona sensors), digital elevation model data, and National Wetlands Inventory wetland cover type data. NOAA s Coastal Change Assessment Program s (C-CAP) and National Land Cover Database (NLCD) procts were used for qualitative comparison in assessing map accuracy. We calculated an average overall classification accuracy of 87% with similar overall accuracies for the older (MSS) and newer (TM and ETM) Landsat LULC products.

Ellis, Jean↗

Interactive Computing and Processing of NASA Land Surface Observations Using Google Earth Engine

Google's Earth Engine offers a "big data" approach to processing large volumes of NASA and other remote sensing products. h\ps://earthengine.google.com/ Interfaces include a Javascript or Python-based API, useful for accessing and processing over large periods of record for Landsat and MODIS observations. Other data sets are frequently added, including weather and climate model data sets, etc. Demonstrations here focus on exploratory efforts to perform land surface change detection related to severe weather, and other disaster events.

earth engine↗