Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “categorical data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Cost benefit analysis of the transfer of NASA remote sensing technology to the state of Georgia

The author has identified the following significant results. First order benefits can generally be quantified, thus allowing quantitative comparisons of candidate land cover data systems. A meaningful dollar evaluation of LANDSAT can be made by a cost comparison with equally effective data systems. Users of LANDSAT data can be usefully categorized as performing three general functions: planning, permitting, and enforcing. The value of LANDSAT data to the State of Georgia is most sensitive to the parameters: discount rate, digitization cost, and photo acquisition cost. Under a constrained budget, LANDSAT could provide digitized land cover information roughly seven times more frequently than could otherwise be obtained. Thus on one hand, while the services derived from LANDSAT data in comparison to the baseline system has a positive net present value, on the other hand if the budget were constrained, more frequent information could be provided using the LANDSAT system than otherwise be obtained.

Zimmer, R. P.↗

Operational Analytics Studies for ATLAS Distributed Computing: Data Popularity Forecast and Utilization of the WLCG Centers

Operational analytics is the direction of research related to the analysis of the current state of computing processes and the prediction of future states in order to anticipate imbalances and take timely measures to stabilize a complex system. There are two relevant areas in ATLAS Distributed Computing that are currently the focus of studies: user physics analysis including the forecast of popularity of data samples among users, and evaluating WLCG centers for their readiness to process user analysis payloads. Studying these areas is challenging due to the complexity involved, as it requires a comprehensive understanding of numerous boundary conditions typically found in large-scale distributed computing infrastructures. Forecasts of data popularity are problematic without the categorization of user tasks by their types (data transformation or physics analysis), which do not always appear on the surface but may induce noise, which introduces significant distortions for predictive analysis. Evaluating the WLCG resources by their analysis workloads is also a challenging task as it is necessary to find a balance between the workload of the resource, its performance, the waiting time for jobs on it, as well as the volume of jobs that it processes. This is especially difficult in a heterogeneous computing environment, where legacy resources are used along with modern high-performance machines. We will look at these areas of research in detail and discuss what tools and methods are used in our work, demonstrating results already obtained.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Inventory of China's Energy-Related CO2 Emissions in 2008

Although China became the world's largest emitter of energy-related CO{sub 2} emissions in 2007, China does not publish annual estimates of CO{sub 2} emissions and most published estimates of China's emissions have been done by other international organizations. Undertaken at the request of the Energy Information Administration (EIA) of the US Department of Energy, this study examines the feasibility of applying the EIA emissions inventory methodology to estimate China's emissions from published Chinese data. Besides serving as a proof of concept, this study also helps develop a consistent and transparent method for estimating China's CO{sub 2} emissions using an Excel model and identified China-specific data issues and areas for improvement. This study takes a core set of data from the energy balances published in the China Energy Statistical Yearbook 2009 and China Petrochemical Corporation Yearbook 2009 and applies the EIA's eight-step methodology to estimate China's 2008 CO{sub 2} emissions. First, China's primary and secondary fuel types and consumption by end use are determined with slight discrepancies identified between the two data sources and inconsistencies in product categorization with the EIA. Second, energy consumption data are adjusted to eliminate double counting in the four potential areas identified by EIA; consumption data from China's Special Administrative Regions are not included. Physical fuel units are then converted to energy equivalents using China's standard energy measure of coal equivalent (1 kilogram = 29.27 MJ) and IPCC carbon emissions coefficients are used to calculate each fuel's carbon content. Next, carbon sequestration is estimated following EIA conventions for other petroleum products and non-energy use of secondary fuels. Emissions from international bunker fuels are also subtracted under the 'reference' calculation of estimating apparent energy consumption by fuel type and the 'sectoral' calculation of summing emissions across end-use sectors. Adjustments for the China-specific conventions of reporting foreign bunkers and domestic bunkers fueling abroad are made following IPCC definitions of international bunkers and EIA reporting conventions, while the sequestration of carbon in carbon steel is included as an additional adjustment. Under the sectoral approach, fuel consumption of bunkers and other transformation losses as well as gasoline consumption are reallocated to conform to EIA sectoral reporting conventions. To the extent possible, this study relies on official energy data from primary sources. A limited number of secondary sources were consulted to provide insight into the nature of consumption of some products and to guide the analysis of carbon sequestered in steel. Beyond these, however, the study avoided trying to estimate figures where directly unavailable, such as natural gas flaring. As a result, the basic calculations should be repeatable for other years with the core set of data from National Bureau of Statistics and Sinopec (or a similarly authoritative source of oil product data). This study estimates China's total energy-related CO{sub 2} emissions in 2008 to be 6666 Mt CO{sub 2}, including 234.6 Mt of non-fuel CO{sub 2} emissions and 154 Mt of sequestered CO{sub 2}. Bunker fuel emissions in 2008 totaled 15.9 Mt CO{sub 2}, but this figure is underestimated because fuel use by Chinese ship and planes for international transportation and military bunkers are not included. Of emissions related to energy consumption, 82% is from coal consumption, 15% from petroleum and 3% from natural gas. From the sectoral approach, industry had the largest share of China's energy-related CO{sub 2} emissions with 72%, followed by residential at 11%, transport and telecommunications at 8%, and the other four (commerce, agriculture, construction and other public) sectors having a combined share of 9%. Thermal electricity and (purchased) heat (to a lesser degree) are major sources of fuel consumption behind sectoral emissions, responsible for 2533 Mt CO2 and 321 Mt CO{sub 2}, respectively. The 2008 emissions estimated for China in this study falls within the range of other international estimates, and suggests that the EIA methodology can be adopted to estimate China's emissions if the proper adjustments are made. While these results are helpful in understanding China's annual emissions, several key areas of data challenges affect the accuracy of this estimate. Industrial process-based emissions - an important source of emissions given China's industry-intensive economy and size of its cement sector - have not been included in this calculation and could be the focus of further model refinement. The accuracy of the Chinese emissions estimate can be further improved by addressing two unreported international bunker categories and developing China-specific carbon sequestration coefficients for non-fuel use energy products.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Nuclear Power Fault Diagnostics and Preventative Maintenance Optimization

Operation and maintenance costs for nuclear power plants are very large. Reactors are starting to shut down even after their operating licenses have been extended, because they are not price competitive compared to other energy sources. The nuclear industry is witnessing early closure of nuclear power plants due to economic reasons despite excellent safety records. Therefore, it is imperative to reduce costs to prevent these early closures. This paper showcases recent research into advanced fault diagnostics techniques and preventative maintenance optimization to reduce these maintenance costs. This report focuses on the condensate and feedwater system for both pressurized and boiling water reactor systems. The computerized maintenance management system, which contains the plant’s digital record of all the corrective- and preventative-maintenance work orders, was used as a ground truth to locate potential faults and label the process data as healthy or faulty. Various feature extraction techniques were utilized to further differentiate the faults from the healthy data. Support vectors machines were used to categorize other test sets of process data as healthy or faulty through a cross validation procedure. Similar faults were not found within this system leading to preventative maintenance optimization. Unnecessary amounts of preventative maintenance lead to inflated maintenance costs. This paper summarizes the steps for preventative maintenance optimization from component health determination to recommendation for action. This optimization was completed for condensate pumps, condensate booster pumps, and the respective motors that drive them.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Assessment of NDE reliability data

Twenty sets of relevant nondestructive test (NDT) reliability data were identified, collected, compiled, and categorized. A criterion for the selection of data for statistical analysis considerations was formulated, and a model to grade the quality and validity of the data sets was developed. Data input formats, which record the pertinent parameters of the defect/specimen and inspection procedures, were formulated for each NDE method. A comprehensive computer program was written and debugged to calculate the probability of flaw detection at several confidence limits by the binomial distribution. This program also selects the desired data sets for pooling and tests the statistical pooling criteria before calculating the composite detection reliability. An example of the calculated reliability of crack detection in bolt holes by an automatic eddy current method is presented.

Yee, B. G. W.↗

Automated Detection of Anomalous Shipping Manifests to Identify Illicit Trade

We describe an approach to analyzing trade data which uses clustering to detect similarities across shipping manifest records, classification to evaluate clustering results and categorize new unseen shipping data records, and visual analytics to provide to support situation awareness in dynamic decision making to monitor and warn against the movement of radiological threat materials through search, analysis and forecasting capabilities. The evaluation of clustering results through classification and systematic inspection of the clusters show the clusters have strong semantic cohesion and offer novel ways to detect transactions related to nuclear smuggling.

classification↗

Evaluating the Effects of Missing Values and Mixed Data Types on Social Sequence Clustering Using t-SNE Visualization

© 2019 Association for Computing Machinery. The goal of this work is to investigate the impact of missing values in clustering joint categorical social sequences. Identifying patterns in sociodemographic longitudinal data is important in a number of social science settings. However, performing analytical operations, such as clustering on life course trajectories, is challenging due to the categorical and multidimensional nature of the data, their mixed data types, and corruption by missing and inconsistent values. Data quality issues were investigated previously on single variable sequences. To understand their effects on multivariate sequence analysis, we employ a dataset of mixed data types and missing values, a dissimilarity measure designed for joint categorical sequence data, together with dimensionality reduction methodologies in a systematic design of sequence clustering experiments. Given the categorical nature of our data, we employ an “edit” distance using optimal matching. Because each data record has multiple variables of different types, we investigate the impact of mixing these variables in a single dissimilarity measure. Between variables with binary values and those with multiple nominal values, we find that the ability to overcome missing data problems is more difficult in the nominal domain than in the binary domain. Additionally, alignment of leading missing values can result in systematic biases in dissimilarity matrices and subsequently introduce both artificial clusters and unrealistic interpretations of associated data domains. We demonstrate the usage of t-distributed stochastic neighborhood embedding to visually guide mitigation of such biases by tuning the missing value substitution cost parameter or determining an optimal sequence span.

Lazar, Alina↗

Systems cost/performance analysis (study 2.3). Volume 2, appendix A: Data base

Data are presented on selected payload equipments (components) which were collected for the purpose of exercising the systems cost/performance model. Although most of the data is accurate, approximations based on engineering judgment and experience are used wherever actual data was unavailable. The equipments are organized according to the following subsystems which use the specific components: stabilization and control, auxiliary propulsion, data processing, communication, and electrical power. The data sheet for each component states which subsystem utilizes the component, which configurations require the component, which equipment type the component is categorized as, and the data base identifier or code number assigned to the component. The data describing the component consist of the following four types: performance, safety, cost, and schedule.

Campbell, B. H.↗

Using Fuzzy Clustering for Real-time Space Flight Safety

To ensure space flight safety, it is necessary to monitor myriad sensor readings on the ground and in flight. Since a space shuttle has many sensors, monitoring data and drawing conclusions from information contained within the data in real time is challenging. The nature of the information can be critical to the success of the mission and safety of the crew and therefore, must be processed with minimal data-processing time. Data analysis algorithms could be used to synthesize sensor readings and compare data associated with normal operation with the data obtained that contain fault patterns to draw conclusions. Detecting abnormal operation during early stages in the transition from safe to unsafe operation requires a large amount of historical data that can be categorized into different classes (non-risk, risk). Even though the 40 years of shuttle flight program has accumulated volumes of historical data, these data don t comprehensively represent all possible fault patterns since fault patterns are usually unknown before the fault occurs. This paper presents a method that uses a similarity measure between fuzzy clusters to detect possible faults in real time. A clustering technique based on a fuzzy equivalence relation is used to characterize temporal data. Data collected during an initial time period are separated into clusters. These clusters are characterized by their centroids. Clusters formed during subsequent time periods are either merged with an existing cluster or added to the cluster list. The resulting list of cluster centroids, called a cluster group, characterizes the behavior of a particular set of temporal data. The degree to which new clusters formed in a subsequent time period are similar to the cluster group is characterized by a similarity measure, q. This method is applied to downlink data from Columbia flights. The results show that this technique can detect an unexpected fault that has not been present in the training data set.

Lee, Charles↗

The Application of Imaging to Very High Energy Gamma-ray Astronomy (Final Technical Report: VERITAS Site Operations 2013-2018)

VERITAS is the most-sensitive very-high-energy (VHE; E > 100 GeV) gamma-ray observatory in the world. This award partially supported its experimental operations, via the VERITAS Project Office, from 2013-18. Project operations were based at the Smithsonian’s F.L. Whipple Observatory (FLWO) near Tucson, AZ. During this time VERITAS completed its seventh through eleventh seasons of operations with its full four-telescope array. These were the second through the sixth seasons since the completion of a major detector upgrade which lowered the observatory’s energy threshold by 40% and enables it to detect objects twice as fast as when it began full-scale operations. The VERITAS Project Office operated within its budget throughout this period, as it has done throughout its history. Similarly the observatory met, and often exceeded, all of its performance metrics during the five-year period. In all, ~6600 h of data were acquired, of which nearly 5700 h are of publishable weather quality, and 93% contain the full four-telescope array. All categorical breakdowns of the data taking (e.g. hours devoted to dark matter research) match those envisioned in the funded operations proposal. As of April 2019, the VERITAS collaboration of ~80 scientists had reported the detection of 63 astrophysical sources of very high energy (VHE; E>100 GeV) gamma rays, belonging to ~8 different source classes. This marks an increase of 21 sources since the funding of this award. A total of 55 journal articles and 33 PhD theses were published by the VERITAS collaboration during the period covered by the award. The collaboration publication totals are now 108 articles and 63 theses, since project inception, and these publications have been cited ~3200 times. In addition, the collaboration released 22 Astronomer’s Telegrams between 2013-18 alerting the community to important phenomena in a timely manner. VERITAS remains fully operational and its most recent season (2017-18) was, in many respects, the best in VERITAS’s history in terms of technical performance. If funding is secured from various partners the collaboration desires to operate the instrument until at least 2023. Regardless of the future of VERITAS site-operations, the VERITAS data archive contains all previous observations and will remain accessible online for data mining efforts until at least 2024 (i.e. at least 5 years after the close of operations). This will enable the production of publications from all data taken during the period of performance of this award.

79 ASTRONOMY AND ASTROPHYSICS↗

Do we have globally representative data to understand soil processes?

Understanding and modeling soils and soil organic matter (SOM) are central to a variety of human needs, from food production to ecosystem management. Soil data have been collected for over a century, but the global spatial and process representativeness of soil data remains unclear. We assessed the representativeness of currently available soil data that could be used to understand a variety of SOM processes. We used 16 open-source soil databases and data from over 281,000 unique locations globally, categorizing the databases into three main data types necessary to understand SOM processes: soil carbon stocks and fluxes, mechanistic drivers of these stocks and fluxes, and soil carbon gain or loss potential. We found that stock and driver data have extensive global coverage. However, data on soil carbon gain or loss potential, particularly data describing change in soils over time such as time series data, are severely limited in their global coverage. We conclude that while significant strides have been made in measuring soil carbon stocks and fluxes, and their drivers, we are limited in global data related to changes in soils over time. Our recommendations for soil data generators are to ensure precise metadata reporting and prioritizing sampling in underrepresented areas like tropical, arctic, mountainous, wetland and arid regions. We also encourage designing revisit schemes that explicitly support change detection and reporting multi-modal datasets that can aid in model development. Targeted measurement of low coverage soil data types and regions is necessary for a range of applications including current and future biogeochemical predictions, and their management and policy implications.

carbon fluxes↗

Distance Metrics and Clustering Methods for Mixed-type Data

In spite of the abundance of clustering techniques and algorithms, clustering mixed interval (continuous) and categorical (nominal and/or ordinal) scale data remain a challenging problem. In order to identify the most effective approaches for clustering mixed–type data, we use both theoretical and empirical analyses to present a critical review of the strengths and weaknesses of the methods identified in the literature. Here, the guidelines on approaches to use under different scenarios are provided, along with potential directions for future research.

97 MATHEMATICS AND COMPUTING↗

Creating the First Interactive Mobility Data Landscape

As the world continues to be driven increasingly driven by data, the ways this data is sorted and collected is critical for researchers and specification creators. In the world of mobility data, there are few if any de jure standards connecting data, and there is little knowledge on the gaps that exist in the data. In this project we have created an interactive landscape where mobility data and data specifications can be categorized and organized in an easy-to-use living document.

ADVANCED PROPULSION SYSTEMS↗

IEA Wind Task 49: Reference Site Conditions for Floating Wind Arrays

The commercial-scale deployment of floating offshore wind (FOW) projects is expected to take place in a diverse range of sites that may differ significantly from existing fixed-bottom projects. FOW farms are particularly sensitive to the water depth and the meteorological and oceanographic (metocean) and geotechnical conditions at the project site due to the wave-induced system motions and loads as well as the anchoring system constraints imposed by the seafloor conditions. Uncertainty around the site conditions will permeate through all aspects of project design, leading to suboptimal and overly conservative designs, increased costs, and adversely affected performance. As FOW expands into a global industry, metocean and geotechnical conditions will increasingly vary for projects located in different geographic regions or in far-from-shore, deep-water sites. This study represents the outputs of work package 1 of International Energy Agency Wind Task 49, which focuses on the integrated design of floating wind arrays. The primary goal of this study is to establish the type of parameters and constraints required to characterize FOW array reference sites; provide a realistic and publicly available set of reference site conditions to the FOW community as a baseline set of data for individual research projects; identify and categorize any critical gaps in the existing data or methodologies required to define reference site characteristics; and inform and support the design of reference FOW arrays. A building block concept was developed for synthesizing reference sites for the design of FOW arrays. The building blocks include three classes of site conditions focusing on the techno-economic design of FOW projects: metocean conditions, seabed conditions, and coastal infrastructure. All reference site data produced and collected in this study are publicly available.

17 WIND ENERGY↗

A cross-sectional study of the temporal evolution of electricity consumption of six commercial buildings

Current approaches to building efficiency diagnoses include conventional energy audit techniques that can be expensive and time consuming. In contrast, virtual energy audits of readily available 15-minute-interval building electricity consumption are being explored to provide quick, inexpensive, and useful insights into building operation characteristics. A cross sectional analysis of six buildings in two different climate zones provides methods for data cleaning, population-based building comparisons, and relationships (correlations) of weather and electricity consumption. Data cleaning methods have been developed to categorize and appropriately filter or correct anomalous data including outliers, missing data, and erroneous values (resulting in < 0.5% anomalies). The utility of a cross-sectional analysis of a sample set of building's electricity consumption is found through comparisons of baseload, daily consumption variance, and energy use intensity. Correlations of weather and electricity consumption 15-minute interval datasets show important relationships for the heating and cooling seasons using computed correlations of a Time-Specific-Averaged- Ordered Variable (exterior temperature) and corresponding averaged variables (electricity consumption)(TSAOV method). The TSAOV method is unique as it introduces time of day as a third variable while also minimizing randomness in both correlated variables through averaging. This study found that many of the pair-wise linear correlation analyses lacked strong relationships, prompting the development of the new TSAOV method to uncover the causal relationship between electricity and weather. We conclude that a combination of varied HVAC system operations, building thermal mass, plug load use, and building set point temperatures are likely responsible for the poor correlations in the prior studies, while the correlation of time-specific-averaged-ordered temperature and corresponding averaged variables method developed herein adequately accounts for these issues and enables discovery of strong linear pair-wise correlation R values. TSAOV correlations lay the foundation for a new approach to building studies, that mitigates plug load interferences and identifies more accurate insights into weather-energy relationship for all building types. Over all six buildings analyzed the TSAOV method reported very significant average correlations per building of 0.94 to 0.82 in magnitude. Our rigorous statistics-based methods applied to 15- minute-interval electricity data further enables virtual energy audits of buildings to quickly and inexpensively inform energy savings measures.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Assessment of NDE Reliability Data

Twenty sets of relevant Nondestructive Evaluation (NDE) reliability data have been identified, collected, compiled, and categorized. A criterion for the selection of data for statistical analysis considerations has been formulated. A model to grade the quality and validity of the data sets has been developed. Data input formats, which record the pertinent parameters of the defect/specimen and inspection procedures, have been formulated for each NDE method. A comprehensive computer program has been written to calculate the probability of flaw detection at several confidence levels by the binomial distribution. This program also selects the desired data sets for pooling and tests the statistical pooling criteria before calculating the composite detection reliability. Probability of detection curves at 95 and 50 percent confidence levels have been plotted for individual sets of relevant data as well as for several sets of merged data with common sets of NDE parameters.

Yee, B. G. W.↗

The payload connection - Approaches to onboard data processing for scientific systems on the Space Shuttle

The integration of payload instruments into the Command and Data Management Subsystem (CDMS) of the Space Shuttle Spacelab is discussed. Specific emphasis is on the distributed (self-contained processor) vs centralized (Spacelab Computer) approach to science payload utilization of these control and data handling capabilities. An overview of the Spacelab CDMS is first given. A synopsis of the integration process for Spacelab Missions 1, 2, and 3 is discussed. Three different hardware approaches to payload command and data handling are then categorized from which Spacelab implementations to date are derived. The different types of Spacelab Mission 3 payload CDMS hardware and software being used are discussed, including examples of microprocessors and data acquisition systems. Preliminary costs for Spacelab application software vs other flight software approaches are compared. A standard RAU interface that would permit a range of ECOS services to be provided, yet be implemented as a mass-produceable unit for incorporation into payloads, is proposed, in keeping with the trend toward simplifying the integration effort, standardizing CDMS interfaces, and ultimately lowering cost.

Konkel, C. R.↗

Analyst Tools and Quality Control Software for the ARM Data System

Mission Research develops analyst tools and automated quality control software in order to assist the Atmospheric Radiation Measurement (ARM) Data Quality Office with their data inspection tasks. We have developed web-based data analysis and visualization tools such as the interactive plotting program NCVweb, various diagnostic plot browsers, and a datastream processing status application. These tools allow even novice ARM researchers to be productive with ARM data with only minimal effort. We also contribute to the ARM Data Quality Office by analyzing ARM data streams, developing new quality control metrics, new diagnostic plots, and integrating this information into DQ HandS - the Data Quality Health and Status web-based explorer. We have developed several ways to detect outliers in ARM data streams and have written software to run in an automated fashion to flag these outliers. We have also embarked on a system to comprehensively generate long time-series plots, frequency distributions, and other relevant statistics for scientific and engineering data in most high-level, publicly available ARM data streams. Furthermore, frequency distributions categorized by month or by season are made available to help define valid data ranges specific to those time domains. These statistics can be used to set limits that when checked, will improve upon the reporting of suspicious data and the early detection of instrument malfunction. The statistics and proposed limits are stored in a database for easy reporting, refining, and for use by other processes. Web-based applications to view the results are also available.

54 ENVIRONMENTAL SCIENCES↗