Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data processing and standardization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

COVID-19 Data Curation Effort: An Initial Analysis of the Data

During the COVID-19 pandemic of 2020, major case reporting outlets quickly coalesced around two or three primary vendors. Johns Hopkins University and The New York Times were among the more prominent, and all were of great value to the nation, particularly during the uncertain early stages of the pandemic. They primarily focused on three major attributes: number of new cases, deaths, and recovery. Recognizing that many states were reporting very detailed data sets (e.g., hospital beds) at a county level or finer, the ORNL Pandemic Modeling team embarked on a major data curation effort from March to June 2020 for the purpose of capturing this wealth of detailed data. The challenge of curating this data was daunting. The number of attributes reported by the states grew on almost on a weekly basis. States were routinely shifting their web tool strategies away from easily parsable HTML-based formatting to new Tableau and ArcGIS content. This growth in the sheer number of attributes, combined with the unpredictable shifts in data format, meant an aggressive and agile combination of automated scripting and manual scraping was required to capture new daily streams. Further, the team had to scale up staff and widen its approach for capture and storage. As a result, the team collected more than 11 million data points. Following the close of this data collection effort on June 30 th , 2020, the team embarked on a major effort to appraise what had been collected, including an inventory list, spatial completeness, temporal completeness, scale and geographic characteristics, and a determination. A report on this matter was submitted on September 15 th , 2020, titled “DOE COVID-19 Data Curation Effort: Overview of Data Collection Coverage”. Over 2000 unique attributes had been netted over a wide range of spatial scales, including state, county, zip codes, health regions, and census blocks. Over 11 million individual data points were collected across these attributes, and spatial coverage (in total) included all 50 states and multiple territories. What became apparent in the process is that in the absence of any data standards, many states reported a wide variety of unique attributes that were not always compatible with attributes reported in other states. As time continued, states began adding new attributes and offering finer grain detail in some older attributes. This meant that not all data streams existed for the entire time period; in fact, the number tended to increase dramatically towards the end. Often, states would begin an attribute series and then stop altogether. These highly variable and uncertain conditions illuminated the need for harmonization approaches that would reconcile and conflate changing attribute names and detail over time. For example, grouping racial data reported as either Black or African American, depending on the state, into a single harmonized attribute. These choices would make a within-state analysis possible during the time period and lead to potential between-state analytics later on. This was almost entirely a manual decision process, requiring some subjective decision-making at times, to prevent a fragmented, short-lived collection of time series fragments that would offer few insights into trends, patterns, and correlates. This report imports harmonized data for state and county into the World Spatio-Temporal Analytics and Mapping Project (WSTAMP). WSTAMP is a major space-time analysis and visualization tool developed at ORNL for the National Geospatial-Intelligence Agency specifically for this kind of exploratory analysis. WSTAMP offers a rich analytical and graphical environment consisting of a wide range of analytics. These include time series plots, statistical summaries, data mining techniques, trend and pattern detection, and hypothesis generation.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS2012

Globally Gridded Satellite (GridSat) Observations for Climate Studies

Geostationary satellites have provided routine, high temporal resolution Earth observations since the 1970s. Despite the long period of record, use of these data in climate studies has been limited for numerous reasons, among them: there is no central archive of geostationary data for all international satellites, full temporal and spatial resolution data are voluminous, and diverse calibration and navigation formats encumber the uniform processing needed for multi-satellite climate studies. The International Satellite Cloud Climatology Project set the stage for overcoming these issues by archiving a subset of the full resolution geostationary data at approx.10 km resolution at 3 hourly intervals since 1983. Recent efforts at NOAA s National Climatic Data Center to provide convenient access to these data include remapping the data to a standard map projection, recalibrating the data to optimize temporal homogeneity, extending the record of observations back to 1980, and reformatting the data for broad public distribution. The Gridded Satellite (GridSat) dataset includes observations from the visible, infrared window, and infrared water vapor channels. Data are stored in the netCDF format using standards that permit a wide variety of tools and libraries to quickly and easily process the data. A novel data layering approach, together with appropriate satellite and file metadata, allows users to access GridSat data at varying levels of complexity based on their needs. The result is a climate data record already in use by the meteorological community. Examples include reanalysis of tropical cyclones, studies of global precipitation, and detection and tracking of the intertropical convergence zone.

Knapp, Kenneth R.↗
DOE OSTI2025

National Energy Water Treatment & Speciation (NEWTS): A Water & Critical Mineral Database and Dashboard

The scarcity of water resources, the need for beneficial water reuse, and the challenges of wastewater treatment are becoming increasingly pressing in economic, social, and environmental domains. Addressing these concerns requires effective treatment strategies to manage wastewater streams and tackle environmental and economic issues. Furthermore, the recovery of critical minerals from the waste streams associated with energy production holds the promise of offsetting treatment costs and securing local sources of valuable minerals. However, relevant data on these waste streams are dispersed and challenging to locate. The process of ingesting such data into modeling software often involves multiple steps, requiring data restructuring to meet software-input requirements. The non-standardized reporting of water data makes data aggregation and reformatting a time-consuming process. Additionally, essential attributes necessary for modeling water treatment and mineral scale formation are frequently missing. Moreover, data gaps vary depending on the region of interest. Consequently, there is a pressing need for high-quality energy-water composition data that can be easily imported into water chemistry modeling software. To address this need, the National Energy Technology Laboratory has created the National Energy Water Treatment and Speciation (NEWTS) Database and Dashboard—a free online tool catering to community leaders and water researchers. NEWTS facilitates a comprehensive understanding of the composition of energy-related wastewater streams in the United States. The datasets provide detailed concentrations and speciation of major and minor aqueous compounds in energy-related wastewater streams, including power plant leachate, acid mine drainage, brackish water, and oil and gas produced water across the United States. Many of the aqueous species are critical minerals (Li, REEs) in high demand to modernize the world’s energy infrastructure. Many of the datasets also contain volumetric flow-rates needed to model the treatment and reuse scenarios in advanced aqueous chemistry software programs. The NEWTS Database and Dashboard offer public access to hitherto challenging-to-access datasets, presented in a standardized format that is tailored for easy input into aqueous chemistry modeling software. By performing the work needed to transform dispersed, disparate data sources into unified, model-ready datasets, NEWTS serves as an essential resource in advancing water treatment research and sustainable water resource management.

produced water management↗
NASA NTRS2010

Development of an Uncertainty Model for the National Transonic Facility

This paper introduces an uncertainty model being developed for the National Transonic Facility (NTF). The model uses a Monte Carlo technique to propagate standard uncertainties of measured values through the NTF data reduction equations to calculate the combined uncertainties of the key aerodynamic force and moment coefficients and freestream properties. The uncertainty propagation approach to assessing data variability is compared with ongoing data quality assessment activities at the NTF, notably check standard testing using statistical process control (SPC) techniques. It is shown that the two approaches are complementary and both are necessary tools for data quality assessment and improvement activities. The SPC approach is the final arbiter of variability in a facility. Its result encompasses variation due to people, processes, test equipment, and test article. The uncertainty propagation approach is limited mainly to the data reduction process. However, it is useful because it helps to assess the causes of variability seen in the data and consequently provides a basis for improvement. For example, it is shown that Mach number random uncertainty is dominated by static pressure variation over most of the dynamic pressure range tested. However, the random uncertainty in the drag coefficient is generally dominated by axial and normal force uncertainty with much less contribution from freestream conditions.

Walter, Joel A.↗
DOE OSTI2026

Aligning NASA Earth Science Data Stewardship with FAIR Principles: Outcomes, Recommendations, and Future Directions

The FAIR Principles—Findable, Accessible, Interoperable, and Reusable—offer a widely accepted framework for improving the sharing and reuse of digital scientific data by both human and machine users. Following these principles is critical for effective scientific data stewardship, broader scientific collaboration, and compliance with federal and agency data policies. This paper, based on the work of NASA’s Open, Free, and FAIR Working Group (O’FAIR WG) under the Earth Science Data Systems Program, presents an overview of how FAIR is being applied within NASA’s Earth science data landscape. It highlights ongoing progress and challenges, identifies FAIR-enabling resources, and offers recommendations and strategic actions to enhance the FAIRness of NASA-funded open and free Earth science data products. The FAIR-enabling resources identified underscore the vital role of NASA's existing enterprise processes, standards, tools, and infrastructures in supporting FAIR implementation. Our findings show strong performance in making NASA Earth science data more findable and accessible. However, further work is needed—especially in enhancing interoperability, so that different systems and tools can better understand and exchange data. This is especially important for enabling machine-driven discovery and analysis. We emphasize the importance of a balanced strategy that combines a centralized, top-down approach—focused on building enterprise-level capabilities and processes—with a decentralized, bottom-up approach driven by discipline-specific needs and community practices. We advocate for coordinated efforts to enhance (meta)data interoperability to facilitate seamless data and information sharing and exchange of Earth science data both within NASA and across other agencies managing Earth science data.

Data Product↗
DOE OSTI2024

A Case Study of Multimodal, Multi-institutional Data Management for the Combinatorial Materials Science Community

Although the convergence of high-performance computing, automation, and machine learning has significantly altered the materials design timeline, transformative advances in functional materials and acceleration of their design will require addressing the deficiencies that currently exist in materials informatics, particularly a lack of standardized experimental data management. The challenges associated with experimental data management are especially true for combinatorial materials science, where advancements in automation of experimental workflows have produced datasets that are often too large and too complex for human reasoning. The data management challenge is further compounded by the multimodal and multi-institutional nature of these datasets, as they tend to be distributed across multiple institutions and can vary substantially in format, size, and content. Furthermore, modern materials engineering requires the tuning of not only composition but also of phase and microstructure to elucidate processing–structure–property–performance relationships. To adequately map a materials design space from such datasets, an ideal materials data infrastructure would contain data and metadata describing (i) synthesis and processing conditions, (ii) characterization results, and (iii) property and performance measurements. In this work, we present a case study for the low-barrier development of such a dashboard that enables standardized organization, analysis, and visualization of a large data lake consisting of combinatorial datasets of synthesis and processing conditions, X-ray diffraction patterns, and materials property measurements generated at several different institutions. While this dashboard was developed specifically for data-driven thermoelectric materials discovery, we envision the adaptation of this prototype to other materials applications, and, more ambitiously, future integration into an all-encompassing materials data management infrastructure.

36 MATERIALS SCIENCE↗
DOE OSTI2020

XANES spectroscopy of sulfides stable under reducing conditions

X-ray absorption near-edge structure (XANES) spectroscopy is a powerful technique to quantitatively investigate sulfur speciation in geologically complex materials such as minerals, glasses, soils, organic compounds, industrial slags, and extraterrestrial materials. This technique allows non-destructive investigation of the coordination chemistry and oxidation state of sulfur species ranging from sulfide (2–oxidation state) to sulfate (6+ oxidation state). Each sulfur species has a unique spectral shape with a characteristic K-edge representing the s → p and d hybridization photoelectron transitions. As such, sulfur speciation is used to measure the oxidation state of samples by comparing the overall XANES spectra to that of reference compounds. Although many S XANES spectral standards exist for terrestrial applications under oxidized conditions, new sulfide standards are needed to investigate reduced (oxygen fugacity, f O 2 , below IW) silicate systems relevant for studies of extraterrestrial materials and systems. Sulfides found in certain meteorites (e.g., enstatite chondrites and aubrites) and predicted to exist on Mercury, such as CaS (oldhamite), MgS (niningerite), and FeCr 2 S 4 (daubréelite), are stable at f O 2 below IW-3 but rapidly oxidize to sulfate and/or produce sulfurous gases under terrestrial surface conditions. XANES spectra of these compounds collected to date have been of variable quality, possibly due to the unstable nature of certain sulfides under typical (e.g., oxidizing) laboratory conditions. A new set of compounds was prepared for this study and their XANES spectra are analyzed for comparison with potential extraterrestrial analogs. S K -edge XANES spectra were collected at Argonne National Lab for FeS (troilite), MnS (alabandite), CaS (oldhamite), MgS (niningerite), Ni 1–x S, NiS 2 , CaSO 4 (anhydrite), MgSO 4 , FeSO 4 , Fe 2 (SO 4 ) 3 , FeCr 2 S 4 (daubréelite), Na 2 S, Al 2 S 3 , Ni 7 S 6 , and Ni 3 S 2 ; the latter five were analyzed for the first time using XANES. These standards expand upon the existing S XANES end-member libraries at a higher spectral resolution (0.25 eV steps) near the S K -edge. Processed spectra, those that have been normalized and “flattened,” are compared to quantify uncertainties due to data processing methods. Future investigations that require well-characterized sulfide standards, such as the ones presented here, may have important implications for understanding sulfur speciation in reduced silicate glasses and minerals with applications for the early Earth, Moon, Mercury, and enstatite chondrites.

Anzures, Brendan A.↗
NASA NTRS1993

Scintillation fading on a low elevation angle satellite path: Assessing the Austin experiment at 11.2 GHz

The University of Texas at Austin is now in its fifth year of observing an 11.2 GHz INTELSAT satellite beacon with an elevation angle of only 5.8 degrees. Measurements of the rainfall rate, beacon level, the radiometric sky temperature, and of meteorological parameters are ongoing. The experiment is motivated by the fact that significant increases in coverage can be obtained from a given geostationary orbit location if acceptable performance can be achieved at elevation angles below the current standard at Ku-Band of 10 degrees. The topics covered include the following: data collection, data processing, scintillation fading vs. rain fading, diurnal and seasonal variations, power spectrum, and variability of the beacon standard deviation.

Vogel, W. J.↗
DOE OSTI2024

AEcroscopy: A Software–Hardware Framework Empowering Microscopy Toward Automated and Autonomous Experimentation

Microscopy has been pivotal in improving the understanding of structure-function relationships at the nanoscale and is by now ubiquitous in most characterization labs. However, traditional microscopy operations are still limited largely by a human-centric click-and-go paradigm utilizing vendor-provided software, which limits the scope, utility, efficiency, effectiveness, and at times reproducibility of microscopy experiments. Here, in this work, a coupled software–hardware platform is developed that consists of a software package termed AEcroscopy (short for Automated Experiments in Microscopy), along with a field-programmable-gate-array device with LabView-built customized acquisition scripts, which overcome these limitations and provide the necessary abstractions toward full automation of microscopy platforms. The platform works across multiple vendor devices on scanning probe microscopes and electron microscopes. It enables customized scan trajectories, processing functions that can be triggered locally or remotely on processing servers, user-defined excitation waveforms, standardization of data models, and completely seamless operation through simple Python commands to enable a plethora of microscopy experiments to be performed in a reproducible, automated manner. This platform can be readily coupled with existing machine-learning libraries and simulations, to provide automated decision-making and active theory-experiment optimization to turn microscopes from characterization tools to instruments capable of autonomous model refinement and physics discovery.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Search for resonant pair production of Higgs bosons in the $\textrm{b}\overline{\textrm{b}}\textrm{b}\overline{\textrm{b}}$ final state using large-area jets in proton-proton collisions at $\sqrt{s}$ = 13 TeV

A search is presented for the resonant production of a pair of standard model-like Higgs bosons using data from proton-proton collisions at a centre-of-mass energy of 13 TeV, collected by the CMS experiment at the CERN LHC in 2016–2018, corresponding to an integrated luminosity of 138 fb −1 . The final state consists of two b quark-antiquark pairs. The search is conducted in the region of phase space where at least one of the pairs is highly Lorentz-boosted and is reconstructed as a single large-area jet. The other pair may be either similarly merged or resolved, the latter reconstructed using two b-tagged jets. The data are found to be consistent with standard model processes and are interpreted as 95% confidence level upper limits on the product of the cross sections and the branching fractions of the spin-0 radion and the spin-2 bulk graviton that arise in warped extradimensional models. The limits set are in the range 9.74–0.29 fb and 4.94–0.19 fb for a narrow radion and a graviton, respectively, with masses between 1 and 3 TeV. For a radion and for a bulk graviton with widths 10% of their masses, the limits are in the range 12.5–0.35 fb and 8.23–0.23 fb, respectively, for the same masses. These limits result in the exclusion of a narrow-width graviton with a mass below 1.2 TeV, and of narrow and 10%-width radions with masses below 2.6, and 2.9 TeV, respectively.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2020

Search for direct top squark pair production in events with one lepton, jets, and missing transverse momentum at 13 TeV with the CMS experiment

A search for direct top squark pair production is presented. The search is based on proton-proton collision data at a center-of-mass energy of 13 TeV recorded by the CMS experiment at the LHC during 2016, 2017, and 2018, corresponding to an integrated luminosity of 137 fb$^{−1}$. The search is carried out using events with a single isolated electron or muon, multiple jets, and large transverse momentum imbalance. The observed data are consistent with the expectations from standard model processes. Exclusions are set in the context of simplified top squark pair production models. Depending on the model, exclusion limits at 95% confidence level for top squark masses up to 1.2 TeV are set for a massless lightest supersymmetric particle, assumed to be the neutralino. For models with top squark masses of 1 TeV, neutralino masses up to 600 GeV are excluded.[graphic not available: see fulltext]

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

Data-driven key performance indicators and datasets for building energy flexibility: A review and perspectives

Energy flexibility, through short-term demand-side management (DSM) and energy storage technologies, is now seen as a major key to balancing the fluctuating supply in different energy grids with the energy demand of buildings. This is especially important when considering the intermittent nature of ever-growing renewable energy production, as well as the increasing dynamics of electricity demand in buildings. This paper provides a holistic review of (1) data-driven energy flexibility key performance indicators (KPIs) for buildings in the operational phase and (2) open datasets that can be used for testing energy flexibility KPIs. The review identifies a total of 48 data-driven energy flexibility KPIs from 87 recent and relevant publications. These KPIs were categorized and analyzed according to their type, complexity, scope, key stakeholders, data requirement, baseline requirement, resolution, and popularity. Moreover, 330 building datasets were collected and evaluated. Of those, 16 were deemed adequate to feature building performing demand response or building-to-grid (B2G) services. The DSM strategy, building scope, grid type, control strategy, needed data features, and usability of these selected 16 datasets were analyzed. This review reveals future opportunities to address limitations in the existing literature: (1) developing new data-driven methodologies to specifically evaluate different energy flexibility strategies and B2G services of existing buildings; (2) developing baseline-free KPIs that could be calculated from easily accessible building sensors and meter data; (3) devoting non-engineering efforts to promote building energy flexibility, standardizing data-driven energy flexibility quantification and verification processes; and (4) curating and analyzing datasets with proper description for energy flexibility assessm.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Energy efficiency for the growing South Carolina manufacturing industries. Final Report

The overall goals of the proposed project were to establish a DOE Industrial Assessment Center with Clemson University as the main center and to cement the Clemson IAC as the "go to" resource for energy efficiency expertise and assistance to manufacturing businesses in the state of South Carolina. The Clemson IAC included a satellite support center through partnership with the SCE&G Energy Innovation Center at the Clemson University Restoration Institute (CURI) in North Charleston, SC. The Clemson IAC was the first IAC based in the state with the goal to serve the entire state. The Clemson IAC provided SMEs with no-cost energy assessments, trained the next generation of energy-savvy engineers, and provided outreach to non-participating SMEs. Project objectives were structured into five 12-month Budget Periods. In the first Budget Period, the primary objective was to establish methods and materials for Clemson IAC assessments, training, and outreach. In the remaining Budget Periods, the primary objectives were to perform assessments, train students, and pursue outreach to hard-to-reach SMEs that did not participate in energy assessments. Expected outcomes in the first Budget Period included the development of standard procedures for performing energy assessments, including data acquisition, processing, and communication both within the team and in assessment reports prepared for SMEs. Outcomes related to student training in the first Budget Period included detailed curriculum and internship plans for students pursuing the DOE IAC Certificate and energy-related Clemson University certificates. Outcomes in the first Budget Period also included the development of outreach materials and plans for outreach events. In Budget Periods 2 through 5, major expected outcomes are trained students and completed energy assessments and reports for SMEs. Decision points and Go-No Go criteria for the end of each Budget Period, presented in more detail below, are based on the number of students in training and the number of energy assessments performed.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
NASA NTRS1980

Program for integrating multizonal photographs of the Earth, taken by MKF-6 camera, in a computer

An algorithm and program are described, for integrating up to 6 simultaneously exposed photographs in different spectral ranges of the surface of the Earth, taken by MKF-6 cameras aboard Soyuz-22. Three of the reference marks are identified on 1 photograph and then are used to integrate the other photographs with the first. The program was compiled for the ES-1040 computer, as a standard subprogram in a system for computer processing of data of study of the Earth from space.

Agapov, A. V.↗
NASA NTRS1989

Knowledge-based control of an adaptive interface

The analysis, development strategy, and preliminary design for an intelligent, adaptive interface is reported. The design philosophy couples knowledge-based system technology with standard human factors approaches to interface development for computer workstations. An expert system has been designed to drive the interface for application software. The intelligent interface will be linked to application packages, one at a time, that are planned for multiple-application workstations aboard Space Station Freedom. Current requirements call for most Space Station activities to be conducted at the workstation consoles. One set of activities will consist of standard data management services (DMS). DMS software includes text processing, spreadsheets, data base management, etc. Text processing was selected for the first intelligent interface prototype because text-processing software can be developed initially as fully functional but limited with a small set of commands. The program's complexity then can be increased incrementally. The intelligent interface includes the operator's behavior and three types of instructions to the underlying application software are included in the rule base. A conventional expert-system inference engine searches the data base for antecedents to rules and sends the consequents of fired rules as commands to the underlying software. Plans for putting the expert system on top of a second application, a database management system, will be carried out following behavioral research on the first application. The intelligent interface design is suitable for use with ground-based workstations now common in government, industrial, and educational organizations.

Lachman, Roy↗
NASA NTRS1990

Rocket engine failure detection using system identification techiques

The theoretical foundation and application of two univariate failure detection algorithms to Space Shuttle Main Engine (SSME) test firing data is presented. Both algorithms were applied to data collected during steady state operation of the engine. One algorithm, the time series algorithm, is based on time series techniques and involves the computation of autoregressive models. Times series techniques have been previously applied to SSME data. The second algorithm is based on standard signal processing techniques. It consists of tracking the variations in the average signal power with time. The average signal power algorithm is a newly proposed SSME failure detection algorithm. Seven nominal test firings were used to develop failure indication thresholds for each algorithm. These thresholds were tested using four anomalous firings and one additional nominal firing. Both algorithms provided significantly earlier failure indication times than did the current redline limit system. Neither algorithm gave false failure indications for the nominal firing. The strengths and weaknesses of the two algorithms are discussed and compared. The average signal algorithm was found to have several advantages over the time series algorithm.

Meyer, Claudia M.↗