Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data processing and standardization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37

Space Applications of Industrial Laser Systems (SAILS)

A program is under way to develop a YAG laser based materials processing workstation to fly in the cargo bay of the Space Shuttle. The system will be capable of cutting and welding steel, aluminum, and Inconel alloys of the type planned for use on Space Station Freedom. As well as demonstrating the ability of a YAG laser to perform remote (fiber-optic delivered) repair and fabrication operations in space, fundamental data will be collected on these interactions for comparison with terrestrial data and models. The flight system, scheduled to fly in 1995, will be constructed as two modules to fit into the standard Get Away Special (GAS) canisters. The first can holds the laser and its power supply, to be constructed by our industrial partner, Lumonics Industrial Processing Division. The second canister has the materials processing workstation and the command and data acquisition subsystems. These components will be provided by groups at the University of Tennessee Space Institute (UTSI) and the University of Waterloo. The cans are linked by a fiber-optic cable which transmits the beam from the laser head to the workstation.

Mueller, Robert E.↗

Surface Crystallization of Supercooled Water in Clouds

The process by which liquid cloud droplets homogeneously crystallize into ice is still not well-understood. The ice nucleation process based on the standard and classical theory of homogeneous freezing, initiates within the interior volume of a cloud droplet. Current experimental data on homogeneous freezing rates of ice in droplets of supercooled water, both in air and emulsion oil samples, show considerable scatter. For example, at -33 C, the reported volume-based freezing rates of ice in supercooled water vary by as much as 5 orders of magnitude, which is well outside the range of measurement uncertainties. Here, we show that the process of ice nucleus formation at the air (or oil)-liquid water interface may help to explain why experimental results on ice nucleation rates yield different results in different ambient phases. Our results also suggest that surface crystallization of ice in cloud droplets can explain why low amounts of supercooled water have been observed in the atmosphere near -40 C.

Tabazadeh, Azadeh↗

On A Higher Order Method for Anonymous Feature Processing

Some feature-driven navigation sources, such as cameras or lidars, often require measurement-to-feature associations between the collected data and an onboard feature catalog to be performed upstream of the filter. Standard navigation practice suggests the use of Kalman updates with measurements that have first passed residual editing tests, but this is often insufficient to prevent updates based upon incorrectly associated data, leading to filter degradation and divergence. Recent work has developed the anonymous feature processing (AFP) technique that eliminates reliance upon explicit feature associations outside of the filter entirely while maintaining desirable estimation performance. This paper continues by exploring the approximation employed by AFP, and a higher order approximation is presented to further improve the estimation performance of the AFP update.

James S Mccabe↗

Evolution of the JPSS Ground Project Calibration and Validation System

The Joint Polar Satellite System (JPSS) is the National Oceanic and Atmospheric Administration's (NOAA) next-generation operational Earth observation Program that acquires and distributes global environmental data from multiple polar-orbiting satellites. The JPSS Program plays a critical role to NOAA's mission to understand and predict changes in weather, climate, oceans, coasts, and space environments, which supports the Nation's economy and protection of lives and property. The National Aeronautics and Space Administration (NASA) is acquiring and implementing the JPSS, comprised of flight and ground systems, on behalf of NOAA. The JPSS satellites are planned to fly in the afternoon orbit and will provide operational continuity of satellite-based observations and products for NOAA Polar-orbiting Operational Environmental Satellites (POES) and the Suomi National Polar-orbiting Partnership (SNPP) satellite. To support the JPSS Calibration and Validation (CalVal) node Government Resource for Algorithm Verification, Independent Test, and Evaluation (GRAVITE) services facilitate: Algorithm Integration and Checkout, Algorithm and Product Operational Tuning, Instrument Calibration, Product Validation, Algorithm Investigation, and Data Quality Support and Monitoring. GRAVITE is a mature, deployed system that currently supports the SNPP Mission and has been in operations since SNPP launch. This paper discusses the major re-architecture for Block 2.0 that incorporates SNPP lessons learned, architecture of the system, and demonstrates how GRAVITE has evolved as a system with increased performance. It is now a robust, stable, reliable, maintainable, scalable, and secure system that supports development, test, and production strings, replaces proprietary and custom software, uses open source software, and is compliant with NASA and NOAA standards.

Next-Generation↗

CROCUS Urban Canyons - Space Science and Engineering Center (SPARC) Doppler lidar data

This is the netCDF format output from the Halo Photonics Streamline XR Doppler lidar that was deployed next to the Space Science and Engineering Center (SPARC) trailer at the University of Illnois-Chicago greenhouse parking lot during CROCUS Urban Canyons. The purpose of collecting this dataset is to provide vertical and horizontal wind profiles for studying the characteristics of turbulence over the urban canyon of Chicago. This data contains the radial velocity, intensity, and backscatter from the vertical profile, range height indicator, and sector scans that were performed over both Intensive Operating Period 1 and 2 of CROCUS Urban Canyons. There are four different types of files: * The Range Height Indicator (RHI) files contain scans that are along a constant azimuth, spanning the entire hemisphere of elevation values above the surface. * The Velocity Azimuth Display (VAD) files contain the raw radial velocity data from the 6-beam, 60 degree scans. * The User1 files contain stacked Plan Position Indicator scans over a 45 degree quadrant over downtown Chicago. * The Stare files contain vertically pointing scans. These are standard netCDF files that can be opened using xarray. The VAD scans can be processed from their raw radial velocities to horizontal wind speeds with the Atmospheric data Community Toolkit (https://arm-doe.github.io/ACT/).

EARTH SCIENCE > ATMOSPHERE > ATMOSPHERIC WINDS↗

Report of the subpanel on resampling functions

The state of the art and anticipated requirements for resampling in applications of remote sensing are examined. It is noted that the wide range of potential applications and expanded needs for resampling versatility in new imaging sensors leads to a concern for creating standardized test data sets and ground training sites. Several research areas are defined including the development of (1) a theory for defining an input psf of an instrument such that upon resampling of the processed data into the desired output grid the radiometric and geometric properties are a best estimate of the true upwelling radiances; (2) algorithms for estimating missing data or for ignoring missing data; (3) optimal resampling functions; (4) standard data sets; and (5) merit functions for assessing resampling techniques.

Source record↗

Digital Radar-Signal Processors Implemented in FPGAs

High-performance digital electronic circuits for onboard processing of return signals in an airborne precipitation- measuring radar system have been implemented in commercially available field-programmable gate arrays (FPGAs). Previously, it was standard practice to downlink the radar-return data to a ground station for postprocessing a costly practice that prevents the nearly-real-time use of the data for automated targeting. In principle, the onboard processing could be performed by a system of about 20 personal- computer-type microprocessors; relative to such a system, the present FPGA-based processor is much smaller and consumes much less power. Alternatively, the onboard processing could be performed by an application-specific integrated circuit (ASIC), but in comparison with an ASIC implementation, the present FPGA implementation offers the advantages of (1) greater flexibility for research applications like the present one and (2) lower cost in the small production volumes typical of research applications. The generation and processing of signals in the airborne precipitation measuring radar system in question involves the following especially notable steps: The system utilizes a total of four channels two carrier frequencies and two polarizations at each frequency. The system uses pulse compression: that is, the transmitted pulse is spread out in time and the received echo of the pulse is processed with a matched filter to despread it. The return signal is band-limited and digitally demodulated to a complex baseband signal that, for each pulse, comprises a large number of samples. Each complex pair of samples (denoted a range gate in radar terminology) is associated with a numerical index that corresponds to a specific time offset from the beginning of the radar pulse, so that each such pair represents the energy reflected from a specific range. This energy and the average echo power are computed. The phase of each range bin is compared to the previous echo by complex conjugate multiplication to obtain the mean Doppler shift (and hence the mean and variance of the velocity of precipitation) of the echo at that range.

Berkun, Andrew↗

Recovering pointwise values of discontinuous data within spectral accuracy

The pointwise values of a function, f(x), can be accurately recovered either from its spectral or pseudospectral approximations, so that the accuracy solely depends on the local smoothness of f in the neighborhood of the point x. Most notably, given the equidistant function grid values, its intermediate point values are recovered within spectral accuracy, despite the possible presence of discontinuities scattered in the domain. (Recall that the usual spectral convergence rate decelerates otherwise to first order, throughout). To this end, a highly oscillatory smoothing kernel is employed in contrast to the more standard positive unit-mass mollifiers. In particular, post-processing of a stable Fourier method applied to hyperbolic equations with discontinuous data, recovers the exact solution modulo a spectrally small error. Numerical examples are presented.

Gottlieb, D.↗

Recovering pointwise values of discontinuous data within spectral accuracy

The pointwise values of a function, f(x), can be accurately recovered either from its spectral or pseudospectral approximations, so that the accuracy solely depends on the local smoothness of f in the neighborhood of the point x. Most notably, given the equidistant function grid values, its intermediate point values are recovered within spectral accuracy, despite the possible presence of discontinuities scattered in the domain. (Recall that the usual spectral convergence rate decelerates otherwise to first order, throughout). To this end, a highly oscillatory smoothing kernel is employed in contrast to the more standard positive unit-mass mollifiers. In particular, post-processing of a stable Fourier method applied to hyperbolic equations with discontinuous data, recovers the exact solution modulo a spectrally small error. Numerical examples are presented.

Gottlieb, D.↗

Software Suite to Support In-Flight Characterization of Remote Sensing Systems

A characterization software suite was developed to facilitate NASA's in-flight characterization of commercial remote sensing systems. Characterization of aerial and satellite systems requires knowledge of ground characteristics, or ground truth. This information is typically obtained with instruments taking measurements prior to or during a remote sensing system overpass. Acquired ground-truth data, which can consist of hundreds of measurements with different data formats, must be processed before it can be used in the characterization. Accurate in-flight characterization of remote sensing systems relies on multiple field data acquisitions that are efficiently processed, with minimal error. To address the need for timely, reproducible ground-truth data, a characterization software suite was developed to automate the data processing methods. The characterization software suite is engineering code, requiring some prior knowledge and expertise to run. The suite consists of component scripts for each of the three main in-flight characterization types: radiometric, geometric, and spatial. The component scripts for the radiometric characterization operate primarily by reading the raw data acquired by the field instruments, combining it with other applicable information, and then reducing it to a format that is appropriate for input into MODTRAN (MODerate resolution atmospheric TRANsmission), an Air Force Research Laboratory-developed radiative transport code used to predict at-sensor measurements. The geometric scripts operate by comparing identified target locations from the remote sensing image to known target locations, producing circular error statistics defined by the Federal Geographic Data Committee Standards. The spatial scripts analyze a target edge within the image, and produce estimates of Relative Edge Response and the value of the Modulation Transfer Function at the Nyquist frequency. The software suite enables rapid, efficient, automated processing of ground truth data, which has been used to provide reproducible characterizations on a number of commercial remote sensing systems. Overall, this characterization software suite improves the reliability of ground-truth data processing techniques that are required for remote sensing system in-flight characterizations.

Stanley, Thomas↗

Functionality of the Python Packages for the HERMES Mission

The Heliophysics Environmental and Radiation Measurement Experiment Suite (HERMES) is a set of four instruments that will fly on the Lunar Gateway, an orbital outpost which will support Artemis lunar operations. HERMES will focus on understanding the causes of space-weather variability as driven by the Sun and modulated by the magnetosphere. In this talk, we will discuss the open source approach of the HERMES Science Operation Center (SOC) team being implemented in a number of Python packages which all work together. We will describe the core package which contains Python interfaces for the loading, calibrating, plotting, validating, and saving of measurement data through Common Data Format (CDF) files making use of pycdf provided by spacepy. Each instrument also has a Python package developed using a package template and will provide specific calibration and processing functionality to each instrument. The packages make extensive use of the scientific Python ecosystem and maintain compatibility with PyHC standards. The abstraction of intricate, high heritage data formats, such as CDF files, in Python enables easier analysis and opens doors for greater participation in heliophysics science.

hermes↗

Elevating the Quality of Space Omics Sequencing Data: Innovations and Methodologies from NASA GeneLab Sample Processing Laboratory

NASA’s GeneLab, part of the NASA Open Science Data Repository, is a space-related database that hosts a diverse range of transcriptomics, proteomics, epigenomics and genomics data. The NASA GeneLab Sample Processing Laboratory (SPL) generates omics data from biological experiments conducted aboard the International Space Station, Space Shuttle and space related ground experiments, this omics data then hosted on the GeneLab repository. Samples generated such experiments pose numerous technical challenges such as small experimental sample size, variance in dissection times, limited tissue preservation methods, prolonged storage time, and more. GeneLab SPL team had developed specialized expertise in nucleic acid extraction, library preparation and sequencing of such biological samples via extensive training and years of experience. In order to ensure data accuracy and consistency across experiments, SPL has developed standardized protocols for each species and tissue type. These protocols in conjunction with quality control metrics and data standards are crucial in generating of high-quality data. SPL protocols and standards have been developed in collaboration with the scientific community and had been made publicly available on the GeneLab portal, guaranteeing comparability of datasets across spaceflight experiments. To ensure reliability of data generation, SPL leverages cutting-edge innovations in laboratory automation for sample processing. By leveraging these state-of-the-art platforms, SPL achieves high levels of data reproducibility while significantly minimizing sources of bias and variability, especially across experiments with large numbers of samples. Over the past few years, the space biology investigator community has accessed SPL-generated data from the Open Science Data Repository for a myriad of data re-analysis and re-use studies. We observe a trend that in-house SPL-generated data consistently outperforms outsourced sequencing data in terms of technical standards, quality control metrics, timeliness of data delivery, and sequencing and reagent efficiency. Superior data generation has and will continue to enable discoveries in disease, diagnostic tools, and the biological effects of long duration spaceflight.

GeneLab↗

Preliminary simulations of the large-scale environment during the FIRE cirrus IFO

Large scale forcing (scales greater than 500 km) is the dominant factor in the generation, maintenance, and dissipation of cirrus cloud systems. However, the analyses of data acquired during the first Cirrus IFO have highlighted the importance of mesoscale processes (scales of 20 to 500 km) to the development of cirrus cloud systems. Unfortunately, Starr and Wylie found that the temporal and spatial resolution of the standard and supplemental rawinsonde data were insufficient to allow an explanation of all of the mesoscale cloud features that were present on the 27 to 28 Oct. 1986. It is described how dynamic initialization, or 4-D data assimilation (FDDA) can provide a method to address this problem. The first steps towards application of FDDA to FIRE are also described.

Westphal, Douglas L.↗

Commercial, industrial, and institutional discount rate estimation for efficiency standards analysis: Sector-level data 1998–2021

Underlying each of the Department of Energy’s (DOE’s) federal appliance and equipment energy conservation standards are a set of complex analyses of the projected costs and benefits of regulation. Any new or amended standard must be designed to achieve significant additional energy conservation, provided that it is technologically feasible and economically justified (42 U.S.C. 6295(o)(2)(A)). DOE determines economic justification based on whether the benefits exceed the burdens, considering a variety of factors, including the economic impact of the standard on consumers of the product and the savings in lifetime operating cost compared to any increase in price or maintenance expenses (42 U.S.C. 6295(o)(2)(B)). As part of this determination, DOE conducts a Life-Cycle Cost (LCC) analysis, which models the combined impact of appliance first cost and operating cost changes on a representative commercial building sample in order to identify the fraction of customers achieving LCC savings or incurring net cost at the considered efficiency levels. Thus, the commercial discount rate value(s) used to calculate the present value of energy cost savings within the LCC model implicitly plays a role in estimating the economic impact of potential standard levels. This report provides an in-depth discussion of the commercial discount rate estimation process. It is an update to previous reports on estimating commercial discount rates from firm-level financial data (Fujita, 2016). Major topics covered in this report include: Discount rate estimation methods and rationale; -Data sources used and data limitations; -Discount rate distributions for use in standards analysis; -Discount rate estimation methods and distributions specific to the small business subgroup analysis. Going forward, this report will be updated as data allow and analyses necessitate.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Ultrahigh performance LC/FT-MS non-targeted screening for biomass burning organic aerosol with MZmine2 and MFAssignR

In recent years, ultrahigh performance liquid chromatography Fourier transform mass spectrometry (LC/FT-MS) based non-targeted screening (NTS) methods have become increasingly popular for comprehensive analysis of complex organic mixtures. However, applying these methods for environmental complex mixture analysis is challenging due to the extreme complexity of natural samples and a lack of standard samples or surrogates for environmental complex mixtures. Furthermore, limited molecular markers in the databases and insufficient data processing software workflows make the application of these methods more challenging for environmental complex mixtures. In this work, we implement a new NTS data processing workflow to process data collected from ultrahigh performance liquid chromatography and Fourier transform Orbitrap Elite Mass Spectrometry (LC/FT-MS) by combining MZmine2 and MFAssignR, two opensource data processing tools and commercial Mesquite liquid smoke as a surrogate for biomass burning organic aerosol. MZmine2.53 data extraction followed MFAssignR molecular formula assignment offered noise free and highly accurate 1733 individual molecular formulas presented in liquid smoke with 4906 molecular species, including isomers. The results of this new approach were consistent with the results of direct infusion FT-MS analysis confirming its reliability. Over 90% of the molecular formulas presented in mesquite liquid smoke were matched with the molecular formulas of ambient biomass burning organic aerosol. This suggests the potential use of commercial liquid smoke as a surrogate for biomass burning organic aerosol research. Furthermore, the presented method significantly improves the identification of the molecular composition of biomass burning organic aerosol by successfully addressing some of the limitations related to the data analysis and giving a semi quantitative insight into the analysis.

54 ENVIRONMENTAL SCIENCES↗

ESS-DIVE Reporting Format for Amplicon Abundance Table

While standardized sequencing data is available in public repositories and efforts such as MIxS for common sample collection and processing metadata are well established, the lack of common bioinformatic processing metadata has hindered the ability to do large-scale metaanalyses and the potential for data re-use by non-experts such as ecosystem, watershed, or earth system modelers. To address this need for Department of Energy researchers, we have developed an amplicon reporting format which captures both sample preparation and bioinformatic processing metadata and stores processed amplicon data as a paired abundance table and sequencing file to maximize the potential for re-use of these data. To aid in the adoption of accessible and reproducible analysis workflows, this reporting format was developed in concert with amplicon functionality within the Department of Energy’s Systems Biology Knowledgebase (KBase) to ensure common data and metadata requirements and facilitate seamless transfer between these platforms.This dataset contains support documentation for the amplicon reporting format (README.md and instructions.md), templates for both bioinformatic and sequencing metadata (amplicon_bioinformatic_metadata_template_2021_10_03.csv and amplicon_sequencing_metadata_template_2021_10_03.csv), a crosswalk indicating how this reporting format relates to the current MIxS format (ESSDIVE-MIxS_crosswalk.csv), a list of available instrument terms (amplicon_seq_instrument_terms_2021_10_03.csv), a map between QIIME2 parameter settings and metadata fields (amplicon_qiime2_plugin_metadata_map.csv), a data dictionary (amplicon_CSV_dd.csv), and file-level metadata (amplicon_FLMD.csv).

54 ENVIRONMENTAL SCIENCES↗

Compilation and Evaluation of Data from Groundwater Impounded within the U12n and U12t Tunnels, Rainier and Aqueduct Mesas, Nevada National Security Site

The Department of Defense (DOD) Defense Threat Reduction Agency (DTRA) and the U.S. Department of Energy (DOE) Office of Environmental Management Nevada Program (EM NV) conducted routine physical and geochemical monitoring of water impounded behind impermeable structures placed within the U12n and U12t tunnels on the Nevada National Security Site (NNSS) (formerly the Nevada Test Site [NTS]). Desert Research Institute (DRI) conducted a semiquantitative evaluation of pressure data to determine the extent to which the tunnels have been inundated and a qualitative evaluation of monitored geochemical parameters to determine if trends exist that were indicative of hydrologic and/or geochemical processes operating behind the tunnel plugs. Data were also evaluated to determine if monitored radiological parameters exceeded primary standards associated with the Environmental Protection Agency’s (EPA) Safe Drinking Water Act (SDWA) (40 C.F.R. § 141.66).

54 ENVIRONMENTAL SCIENCES↗

mCDR and carbon sequestration in various macroalgae products (FY22 Seedling Report)

Marine approaches to CDR (mCDR) are gaining recognition and substantial funding in the United States. Macroalgae farming has been identified by several highly recognized organizations as a potential carbon capture strategy, and significant research investments have been made in this area. However, much of the existing literature on the potential of macroalgae cultivation and product development as an mCDR strategy has not adequately considered the permanence of carbon captured, due to the status of the industry. Pacific Northwest National Laboratory (PNNL) has been interested in exploring the potential connections between macroalgae farming, mCDR, and marine energy. In October 2021, PNNL conducted a literature review of life cycle analyses (LCAs) from macroalgae products to assess the carbon capture potential and permanence. This project leverages the previous work done based on LCA for carbon sequestration and permanence in macroalgae and expands it to include additional approaches to monitoring, reporting, and verification (MRV), and opportunities for marine energy. This report provides a collection of the findings throughout this FY22 Seedling for the U.S. Department of Energy’s Water Power Technology Office, structured by the following tasks as defined by the initial proposal: Task 1: Update rankings of macroalgae products based on expanded literature review of carbon sequestration and value of temporary storage. Task 2: Assess potential changes to net climate impacts measured in LCAs of kelp products if marine energy was integrated in processing / harvesting. Task 3: Develop recommendations for standardized assessment of carbon capture potential of biological products and define data collection requirements.

54 ENVIRONMENTAL SCIENCES↗