Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Scientific Data Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38

CGRO Cycle6

This is the final report covering the contract that supported several interrelated task. The first was the calibration of the BATSE SPECtroscopy detectors by comparison with known spectra. The second project was the installation and support of software to enable routine analysis of BATSE data. The third project was the support of several scientific investigations utilizing BATSE flare data.

Schwartz, Richard A.↗

TERRA/MOPITT Measurements of Tropospheric Carbon Monoxide Distributions in Support of INTEX

Interaction with the ongoing satellite measurements programs was an important goal of INTEX- A. The Terra/MOPITT instrument had been making global measurements of the tropospheric carbon monoxide (CO) distribution for 4 years, and was in a unique position to provide valuable support during the field campaign. Remote sensing of CO directly addressed the scientific questions motivating the IXTEX-A strategy and deployment, and measurement of this gas was rated as being mission critical. CO is an important trace gas in tropospheric chemistry due to its role in determining the atmospheric oxidizing capacity, as an ozone precursor, and as an indicator and tracer of both natural and anthropogenic pollution arising from incomplete combustion. The satellite perspective provided the more general temporal and spatial context to the aircraft and ground-based measurements during the subsequent scientific analysis. We proposed to build on the experience of supplying MOPITT data to previous field campaigns, such as TRACE-P. We provided expedited MOPITT data processing in near real-time, along with basic analysis of the measurements to indicate, where possible, the origin of the CO plumes that impacted the regions of flight operations and other in situ measurement activities. To ensure maximum exploitation of the satellite information, we will also had a scientist in the field to present and interpret the MOPITT data for the INTEX team, and to help ensure its utility in flight planning.

Edwards, D. P.↗

Deployable sensor system using mesh networking and satellite communication

A sensor system may be configured for continuous operation in a low resource environment and/or in extreme environmental conditions. The sensor system may have sufficient processing capabilities to provide scientific computing for pre-processing, quality control, statistical analysis, event classification, data compression and corrections (e.g., spikes in the data), autonomous decisions and actions, triggering other nodes, and information assurance functions that provide data confidentiality, data integrity, authentication, and non-repudiation. The hardware may have both mesh networking and satellite and cellular communication capability, and may be available for relatively low cost. Such a network provides the flexibility to have potentially any number of nodes be completely independent from one another. Thus, the network may scale across a diverse terrain.

97 MATHEMATICS AND COMPUTING↗

Deployable sensor system using mesh networking and satellite communication

A sensor system may be configured for continuous operation in a low resource environment and/or in extreme environmental conditions. The sensor system may have sufficient processing capabilities to provide scientific computing for pre-processing, quality control, statistical analysis, event classification, data compression and corrections (e.g., spikes in the data), autonomous decisions and actions, triggering other nodes, and information assurance functions that provide data confidentiality, data integrity, authentication, and non-repudiation. The hardware may have both mesh networking and satellite and cellular communication capability, and may be available for relatively low cost. Such a network provides the flexibility to have potentially any number of nodes be completely independent from one another. Thus, the network may scale across a diverse terrain.

Frigo, Janette↗

EXPERIMENTAL STUDIES OF NONLINEAR INTEGRABLE OPTICS

State-of-the-art accelerators at energy and intensity frontiers require increasingly bright and powerful particle beams. In conventional linear lattices, intense beams suffer from collective instabilities, resulting in beam losses and maximum beam intensity limits. This thesis presents experimental studies of a novel lattice design concept, the nonlinear integrable optics (NIO), aimed at enhancing beam stability limits with little to no beam dynamics degradation. Single-particle beam dynamics measurements of two NIO devices, the quasi-integrable octupole system and the fully integrable Danilov-Nagaitsev system, were carried out at the purpose-built Integrable Optics Test Accelerator (IOTA) at Fermilab. Their simulation, hardware design, and commissioning process are presented. Extensive model and analysis algorithm development and benchmarking is described. Electron beam data from two scientific runs is analyzed, yielding frequency and phase space dynamics consisten t with m odels. These results demonstrate viability and advantages of the NIO design, providing the groundwork for proton studies in the strong space-charge regime and future integrable accelerators.

Kuklev, Nikita↗

Enhancing Seismic Calibration Research Through Software Automation and Scientific Information Management

The National Nuclear Security Administration (NNSA) Ground-Based Nuclear Explosion Monitoring Research and Development (GNEMRD) Program at LLNL continues to make significant progress enhancing the process of deriving seismic calibrations and performing scientific integration, analysis, and information management with software automation tools. Our tool efforts address the problematic issues of very large datasets and varied formats encountered during seismic calibration research. New information management and analysis tools have resulted in demonstrated gains in efficiency of producing scientific data products and improved accuracy of derived seismic calibrations. In contrast to previous years, software development work this past year has emphasized development of automation at the data ingestion level. This change reflects a gradually-changing emphasis in our program from processing a few large data sets that result in a single integrated delivery, to processing many different data sets from a variety of sources. The increase in the number of sources had resulted in a large increase in the amount of metadata relative to the final volume of research products. Software developed this year addresses the problems of: (1) Efficient metadata ingestion and conflict resolution; (2) Automated ingestion of bulletin information; (3) Automated ingestion of waveform information from global data centers; and (4) Site Metadata and Response transformation required for certain products. This year, we also made a significant step forward in meeting a long-standing goal of developing and using a waveform correlation framework. Our objective for such a framework is to extract additional calibration data (e.g. mining blasts) and to study the extent to which correlated seismicity can be found in global and regional scale environments.

58 GEOSCIENCES↗

Homomorphic data compression for real time photon correlation analysis

The construction of highly coherent X-ray sources, combined with next-generation detectors that are larger and faster, has enabled new research opportunities across the scientific landscape. Among the techniques that benefit most from these advancements is X-ray photon correlation spectroscopy (XPCS), where faster acquisition unlocks the ability to study faster dynamics within samples. However, faster acquisition on larger detectors also introduces unprecedented challenges for online data processing and offline data storage. Such challenges are particularly prominent for XPCS, where real time analyses require simultaneous calculation of all the previously acquired data in the time series. We present a homomorphic compression scheme to effectively reduce the computational time and memory space required for XPCS analysis. Leveraging similarities in the mathematical expression between a matrix-based compression algorithm and the correlation calculation, our approach allows direct operation on the compressed data without their decompression. The offline compression scheme extends storage capacity by a factor of 40 while preserving key features in the lossy compressed data. Meanwhile, the online compression scheme reduces the computational time to below 1 ms, enabling real time calculation of the correlation functions at kHz framerate. Our demonstration of a homomorphic compression of scientific data provides an effective solution to the big data challenge at coherent light sources. Beyond the example shown in this work, the framework can be extended to facilitate real-time operations directly on a compressed data stream for other techniques.

36 MATERIALS SCIENCE↗

An Introduction to the Benchmarking and Publications for Non-Targeted Analysis Working Group

Non-targeted analysis (NTA) encompasses a rapidly evolving set of mass spectrometry techniques aimed at characterizing the chemical composition of complex samples, identifying unknown compounds, and/or classifying samples, without prior knowledge regarding the chemical content of the samples. Recent advances in NTA are the result of improved and more accessible instrumentation for data generation, and analysis tools for data evaluation and interpretation. As researchers continue to develop NTA approaches in various scientific fields, there is a growing need to identify, disseminate, and adopt community-wide method reporting guidelines. In 2018, NTA researchers formed the Benchmarking and Publications for Non-Targeted Analysis Working Group (BP4NTA) to address this need. Consisting of participants from around the world and representing fields ranging from environmental science and food chemistry to ‘omics and toxicology, BP4NTA provides resources addressing a variety of challenges associated with NTA. Furthermore, thus far, BP4NTA group members have aimed to establish consensus on NTA-related terms and concepts, and to create consistency in reporting practices by providing resources on a public website, including consensus definitions, reference content, and lists of available tools. Moving forward, BP4NTA will provide a setting for NTA researchers to continue discussing emerging challenges and contribute to additional harmonization efforts.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Observational and numerical studies of extreme frontal scale contraction

The general objective of this effort is to increase understanding of how frontal scale contraction processes may create and sustain intense mesoscale precipitation along intensifying cold fronts. The five-part project (an expansion of the originally proposed two-part project) employed conventional meteorological data, special mesoscale data, remote sensing measurements, and various numerical models. First an idealized hydrostatic modeling study of the scale contraction effects of differential cloud cover on low-level frontal structure and dynamics was completed and published in a peer-reviewed journal. The second objective was to complete and publish the results from a three dimensional numerical model simulation of a cold front in which differential sensible heating related to cloud coverage patterns was apparently crucial in the formation of a severe frontal squall line. The third objective was to use a nonhydrostatic model to examine the nonlinear interactions between the transverse circulation arising from inhomogeneous cloud cover, the adiabatic frontal circulation related to semi-geostrophic forcing, and diabatic effects related to precipitation processes, in the development of a density current-like microstructure at the leading edge of cold fronts. Although the development of a frontal model that could be used to initialize such a primitive equation model was begun, we decided to focus our efforts instead on a project that could be successfully completed in this short time, due to the lack of prospects for continued NASA funding beyond this first year (our proposal was not accepted for future funding). Thus, a fourth task was added, which was to use the nonhydrostatic model to test tentative hypotheses developed from the most detailed observations ever obtained on a density current (primarily sodar and wind profiler data). These simulations were successfully completed, the findings were reported at a scientific conference, and the results have recently been submitted to a peer-reviewed journal. The fifth objective was to complete the analysis of data collected during the Cooperative Oklahoma Profiler Studies (COPS-91) field project, which was supported by NASA. The analysis of the mesoscale surface and sounding data, Doppler radar imagery, and other remote sensing data from multi frequency wind profiler, microwave radiometer, and the Radio Acoustic Sounding System has been completed. This study is a unique investigation of processes that caused the contraction of a cold front to a microscale zone exhibiting an undular bore-like structure. Results were reported at a scientific conference and are being prepared for publication. In summary, considerable progress has been achieved under NASA funding in furthering our understanding of frontal scale contraction and density current - gravity wave interaction processes, and in utilizing models and remotely sensed data in such studies.

Koch, Steven E.↗

NASA Lunar Base Wireless System Propagation Analysis

There have been many radio wave propagation studies using both experimental and theoretical techniques over the recent years. However, most of studies have been in support of commercial cellular phone wireless applications. The signal frequencies are mostly at the commercial cellular and Personal Communications Service bands. The antenna configurations are mostly one on a high tower and one near the ground to simulate communications between a cellular base station and a mobile unit. There are great interests in wireless communication and sensor systems for NASA lunar missions because of the emerging importance of establishing permanent lunar human exploration bases. Because of the specific lunar terrain geometries and RF frequencies of interest to the NASA missions, much of the published literature for the commercial cellular and PCS bands of 900 and 1800 MHz may not be directly applicable to the lunar base wireless system and environment. There are various communication and sensor configurations required to support all elements of a lunar base. For example, the communications between astronauts, between astronauts and the lunar vehicles, between lunar vehicles and satellites on the lunar orbits. There are also various wireless sensor systems among scientific, experimental sensors and data collection ground stations. This presentation illustrates the propagation analysis of the lunar wireless communication and sensor systems taking into account the three dimensional terrain multipath effects. It is observed that the propagation characteristics are significantly affected by the presence of the lunar terrain. The obtained results indicate the lunar surface material, terrain geometry and antenna location are the important factors affecting the propagation characteristics of the lunar wireless systems. The path loss can be much more severe than the free space propagation and is greatly affected by the antenna height, surface material and operating frequency. The results from this paper are important for the lunar wireless system link margin analysis in order to determine the limits on the reliable communication range, achievable data rate and RF coverage performance at planned lunar base work sites.

Hwu, Shian U.↗

Randomized Algorithms for Scientific Computing (RASC)

Randomized algorithms have propelled advances in artificial intelligence (AI) and represent a foundational research area in advancing AI for Science. Future advancements in DOE Office of Science priority areas such as climate science, astrophysics, fusion, advanced materials, combustion, and quantum computing all require randomized algorithms for surmounting challenges of complexity, robustness, and scalability. Advances in data collection and numerical simulation have changed the dynamics of scientific research and motivate the need for randomized algorithms. For instance, advances in imaging technologies such as X-ray ptychography, electron microscopy, electron energy loss spectroscopy, or adaptive optics lattice light-sheet microscopy collect hyperspectral imaging and scattering data in terabytes, at breakneck speed enabled by state-of-the-art detectors. The data collection is exceptionally fast compared with its analysis. Likewise, advances in high-performance architectures have made exascale computing a reality and changed the economies of scientific computing in the process. Floating-point operations that create data are essentially free in comparison with data movement. Thus far, most approaches have focused on creating faster hardware. Ironically, this faster hardware has exacerbated the problem by making data still easier to create. Under such an onslaught, scientists often resort to heuristic deterministic sampling schemes (e.g., low-precision arithmetic, sampling every nth element) and sacrifice potentially valuable accuracy. Dramatically better results can be achieved via randomized algorithms, reducing the data size as much as or more than naive deterministic subsampling can achieve, while retaining the high accuracy of computing on the full data set. By randomized algorithms we mean those algorithms that employ some form of randomness in internal algorithmic decisions to accelerate time to solution, increase scalability, or improve reliability. Examples include matrix sketching for solving large-scale least-squares problems (see Figure 1) and stochastic gradient descent for training machine learning models. We are not recommending heuristic methods but rather randomized algorithms that have certificates of correctness and probabilistic guarantees of optimality and near-optimality. Such approaches can be useful beyond acceleration, for example, in understanding how to avoid measure zero worst-case scenarios that plague methods such as QR matrix factorization.

97 MATHEMATICS AND COMPUTING↗

New Rover Conops with High-Performance Onboard Computing: Give Up Raw Data to Reduce Ops Cost and Do More Science

A major portion of time during the tactical operation of Mars rovers is spent for selecting, prioritizing, and coordinating sciences and engineering activities such that they fit within resource constraints, including the downlink data volume, energy, and time. In particular, the downlink data volume constraint is getting particularly tighter in recent missions because modern instruments produce increasingly high data volume while the communication bandwidth is essentially bounded by the law of physics. Tactical operation would be substantially simplified, hence the operation cost could be reduced, if the data volume constraint is relaxed or even removed. In this abstract, we propose a new operation paradigm for achieving this goal. The key observation is that, both in science and engineering applications, the bit size of raw data is typically much greater than the volume of processed information that is needed for scientific or engineering analysis. For example, a full-resolution image from Mastcam-Z, the main science camera on Perseverance, is about 700 kB in volume and we downlinked 29,685 images up to Sol 243, totaling ~20 GB of data. But of course, scientists do not use every pixel of these images; what they really look for in the images are geological features, typically represented by specific geometric configurations or textures. An end product after processing hundreds of Mascam-Z images could be a single geological map summarizing the spatial distribution of the features. For another example, a 100-meter drive of Perseverance produces 7-12 MB of drive telemetry, which records every detail of the rover's motion at 8 Hz, including position, attitude, steering angles, encoder readings, motor currents and many other information. But what the ground engineers eventually pay attention to is the signs of anomaly, such as excessive motor currents or high slip; if a drive is nominal, the vast majority of this data is unused. What if, then, we process the raw data onboard and only downlink the processed data that is relevant to scientific or engineering analyses, such as a list of detected science features (with cropped images) or a list of potential signs of anomaly while driving? A major roadblock for such onboard, high-level information processing has been the onboard computational resource. RAD750, the main onboard computer of Perseverance, is obviously not sufficient for performing complex image or signal processing such as object detection, semantic segmentation, or anomaly detection. Interestingly, RAD750 is not the best processor that Perseverance has; Qualcomm's Snapdragon 801, a modern mobile processor, is on her Heli Base Station, a device for communicating with Mars Helicopter Ingenuity; also, Intel's Atom E3845 processors are on engineering cameras. In the reminder of this paper, we will introduce two particular uses cases of these high-performance co-processors (meaning auxiliary CPU, GPU, or other types of processors that are separate from the main processor that runs the main flight software) for lowering operation cost and accommodating more science activities for a given communication constraint.

Didier, A.↗

Envision: An interactive system for the management and visualization of large geophysical data sets

Envision is a software project at the University of Illinois and Texas A&M, funded by NASA's Applied Information Systems Research Project. It provides researchers in the geophysical sciences convenient ways to manage, browse, and visualize large observed or model data sets. Envision integrates data management, analysis, and visualization of geophysical data in an interactive environment. It employs commonly used standards in data formats, operating systems, networking, and graphics. It also attempts, wherever possible, to integrate with existing scientific visualization and analysis software. Envision has an easy-to-use graphical interface, distributed process components, and an extensible design. It is a public domain package, freely available to the scientific community.

Searight, K. R.↗

Multivariate Pointwise Information-Driven Data Sampling and Visualization

With increasing computing capabilities of modern supercomputers, the size of the data generated from the scientific simulations is growing rapidly. As a result, application scientists need effective data summarization techniques that can reduce large-scale multivariate spatiotemporal data sets while preserving the important data properties so that the reduced data can answer domain-specific queries involving multiple variables with sufficient accuracy. While analyzing complex scientific events, domain experts often analyze and visualize two or more variables together to obtain a better understanding of the characteristics of the data features. Therefore, data summarization techniques are required to analyze multi-variable relationships in detail and then perform data reduction such that the important features involving multiple variables are preserved in the reduced data. To achieve this, in this work, we propose a data sub-sampling algorithm for performing statistical data summarization that leverages pointwise information theoretic measures to quantify the statistical association of data points considering multiple variables and generates a sub-sampled data that preserves the statistical association among multi-variables. Using such reduced sampled data, we show that multivariate feature query and analysis can be done effectively. The efficacy of the proposed multivariate association driven sampling algorithm is presented by applying it on several scientific data sets.

97 MATHEMATICS AND COMPUTING↗

Uncertainty in Experimental Data Analysis [Slides]

The talk was presented virtually to the Institute of Fundamental Technological Research, Polish Academy of Sciences in Warsaw, Poland, December 21, 2020. Astronomical observations, unusual medical cases, physics experiments too costly to repeat, natural events like earthquakes, hurricanes – all of them are impossible to repeat yet produce important scientific information not achievable in other way. This data should not be treated as qualitative, anecdotal evidence only. It should be analyzed in a mathematically rigorous way to produce quantitative experimental data. Analysis method for one-of-a-kind event data differs from analysis of a repeated experiment data. For a repeated experiments the experimental error includes a range of true values generated by repetitions of the experiment, and measurement uncertainty caused by detectors. They are independent. Repetitions of any experiment, as similar as achievable, always have built-in differences resulting in a range of the true values rather than in a single true experimental value. Measurement uncertainty depends on the measurement system only. Modern digital measurements have very small uncertainty, frequently smaller than the range of true experimental values resulting from built-in differences in the experiment repetitions. When data from one-of-a-kind experiment are analyzed, only the measurement uncertainty can be reported.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

An Examination of Issues Related to a Europa Subsurface Component for the JIMO Mission

The Galileo Europa data set served to revolutionize our view of Europa. In particular the strong evidence of a large, cold, salty Ocean beneath 5-30 km of ice has profoundly altered the significance of Europa in our thinking, especially of context of habitability in the solar system. While much remains to be learned from spacecraft observations of several sorts, there are significant questions answerable only by in-situ techniques; these relate to the formation of Europa, the nature of its ocean, and the prospects for life in its ocean, sediments, and ice. We feel that wide-ranging discussion of an in-situ subsurface mission to Europa, as part of JIMO, should proceed. The science objective of the mission is to characterize the icy shell of Europa to resolve its provenance, estimate the composition of brine of the Europa ocean, and search for evidence of Earth-like life. Probably anyone would agree that an in-situ mission to Europa would be of great value, but he or she would also immediately take the position that such a mission is utterly impractical. We take the position here of defining the least complex mission that can nonetheless justify its cost and to argue that such a mission is realistic enough that it should be seriously considered. Our mission thinking has been: 1) Soft landing. A soft lander is required on a site sufficiently flat to offer a stable platform; no further site selectivity is required. 2) Subsurface exploration. The Europa subsurface must be examined. Surficial processes on Europa arguably have exposed the upper 200 m of shell to chemical effects from the Jovian radiation belts as well as cometary infall, etc; to examine native ice we must descend below that point to, for discussion, 300 m. At that depth we argue that the ice is characteristic of ice at depth and possibly is effectively sea ice. 3) Science data. A few simple measurements at various depths and at 300 m constitute a scientifically successful mission. Measurements would include analysis of meltwater for a few inorganic ions and amino acids and an optical examination of the borehole wall. 4) Communication. Transmission of data to an orbiter is essential, but we will constrain the landed mission to a daily communication over a few days. 5) Subsurface access. Drilling to 300 m is a significant challenge; it can be addressed by several means: Thermal Probe (Cryobot) which permits water to refreeze above the vehicle. This is our tentative choice with plutonium as the fuel to generate thermal energy for drilling and electrical power for operations. Open Hole Drill, a thermal system in which the meltwater is removed for greater thermal efficiency. Meltwater removal on Europa is both a complexity and a risk, but analysis is improved. Mechanical Drilling in which cutting or grinding generates ice chips which are removed. This is too complex at Europa temperatures. The measurement objectives for the mission will be: Obj. 1: Determine the concentration of simple inorganic salts in the Europa Ice Shell and, by extrapolation, of the ocean. These data will also validate spaceborne sensors. Obj. 2: Determine the nature and abundance of amino acids in the ice such that cometary infall material in the upper ice can be compared to material at depth. Obj. 3: Optically examine the ice to resolve inclusion structure, particulate content, and stratification. Access to 300 m depth is a significant if not audacious plan; we are aware that this has not been done on any planetary body. Our approach is the use of a plutonium heat source; to overcome Europa's surface temperature and to melt ice a significant amount of plutonium is needed, and significant shielding and other protective steps will be required. The quantity of plutonium is a key concern. The mission will require subsurface collection and processing of samples for in situ analysis, calling for a miniature, high pressure micro-sampling system designed to meet needs of instruments that require low presses for operation. The inlet system itself collects a micro-sample in the external high pressure environment, then transfers it into a protected low pressure environment for analysis.

Carsey, F. D.↗

HPDR: High-Performance Portable Scientific Data Reduction Framework

The rapid growth in scientific data generation is outpacing advancements in computing systems necessary for efficient storage, transfer, and analysis, particularly in the context of exascale computing. With the deployment of first-generation exascale computing systems and next-generation experimental facilities, this gap is widening and necessitates effective data reduction techniques to manage enormous data volumes. Over the past decade, various data reduction methods, including lossless compression, error-controlled lossy compression, and data refactoring, have been developed to accelerate I/O in scientific workflows. Despite significant reductions in data volume, these methods introduce considerable computational overhead, which can become the new bottleneck in data processing. To mitigate this, GPU-accelerated data reduction algorithms have been introduced. However, challenges remain in their integration into exascale workflows, including limited portability across different GPU architectures, substantial memory transfer overhead, and reduced scalability on dense multi-GPU systems. To address these challenges, we propose HPDR, a high-performance and portable data reduction framework. HPDR is designed to enable the execution of state-of-the-art reduction algorithms across diverse processor architectures while reducing memory transfer overhead to 2.3 % of the original, resulting in up to 3.5× faster throughput compared to existing solutions. It also achieves up to 96% of the theoretical speedup in multi-GPU settings. In addition, evaluations on accelerating I/O operations at scale up to 1,024 nodes of the Frontier supercomputer demonstrate that HPDR can achieve up to 103 TB/s reduction throughput, providing up to 4× acceleration in parallel I/O performance compared to existing data reduction routines. This work highlights the potential of HPDR to significantly enhance data reduction efficiency in exascale computing environments.

Chen, Jieyang [University of Oregon]↗

Scientific & Intelligence Exascale Visualization Analysis System

SIEVAS provides an immersive visualization framework for connecting multiple systems in real time for data science. SIEVAS provides the ability to connect multiple COTS and GOTS products in a seamless fashion for data fusion, data analysis, and viewing. It provides this capability by using a combination of micro services, real time messaging, and web service compliant back-end system.

Money, JamesH.↗