Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data analytics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 757 records · Page 42
All sourcesNASA NTRSDOE OSTI
DOE OSTI2018

Exploring the Optimal Platform Configuration for Power-Constrained HPC Workflows

In high-performance computing (HPC) workflows, data analytics is typically utilized to gain insights from scientific simulations. Approaching the era of exascale, online analysis is gaining popularity due to the savings of I/O to persistent storage. As computing capability keeps growing, power consumption is becoming critical to HPC facilities. Enforcing power limits is emerging as a practical trend for power-constrained HPC facilities. However, it remains unclear how to choose the appropriate power limits for various HPC workflows and how to distribute the power limit of a workflow between simulation and analysis. In addition, given a power limit, it is unclear what the optimal scales and power capping levels are for various workflows, especially when taking reliability into account. In order to resolve these issues in power-constrained HPC, in this paper, we propose a reliability-aware model to determine the aforementioned platform configurations for HPC workflows. We also validate our model and present model-driven studies for a wide range of real-system scenarios. Our study reveals interesting insights about how platform configuration affects the performance and energy efficiency of HPC workflows under power constraints.

Tang, Kun↗
DOE OSTI2022

Strategies for Integrating Deep Learning Surrogate Models with HPC Simulation Applications

The emerging trend of the convergence of high performance computing (HPC), machine learning/deep learning (ML/DL), and big data analytics presents a host of challenges for large-scale computing campaigns that seek best practices to interleave traditional scientific simulation-based workloads with ML/DL models. A portfolio of systematic approaches to incorporate deep learning into modeling and simulation serves a vital need when we support AI for science at a computing facility. In this paper, we evaluate several strategies for deploying deep learning surrogate models in a representative physics application on supercomputers at the Oak Ridge Leadership Computing Facility (OLCF). We discuss a set of recommended deployment architectures and implementation approaches. We analyze and evaluate these alternatives and show their performance and scalability up to 1000 GPUs on two mainstream platforms equipped with different deep learning hardware and software stacks.

Yin, Junqi↗
DOE OSTI2022

Proactive Posturing of Large Power Grid for Mitigating Hurricane Impacts

In the past decade, natural disasters such as hurricanes have challenged the operation and control of U.S. power grid more. It is crucial to develop proactive strategies to assist grid operators for better emergency response and minimized electricity service interruptions. In this paper, we propose a proactive posturing methodology of power system elements, and formulated a Security-Constrained Optimal Power Flow (SCOPF) that informed by cross-domain hurricane modeling and its potential impacts on the grid elements. Simulation results based on real-world power grid and historical hurricane event validated the applicability of the proposed optimization formulation, and show potential to enable grid operators and planners with interactive cross-domain data analytics in mitigating hurricane impacts.

power system emergency response, security constrai↗
DOE OSTI2017

Social energy: mining energy from the society

The inherent nature of energy, i.e., physicality, sociality and informatization, implies the inevitable and intensive interaction between energy systems and social systems. From this perspective, we define 'social energy' as a complex sociotechnical system of energy systems, social systems and the derived artificial virtual systems which characterize the intense intersystem and intra-system interactions. The recent advancement in intelligent technology, including artificial intelligence and machine learning technologies, sensing and communication in Internet of Things technologies, and massive high performance computing and extreme-scale data analytics technologies, enables the possibility of substantial advancement in socio-technical system optimization, scheduling, control and management. In this paper, we provide a discussion on the nature of energy, and then propose the concept and intention of social energy systems for electrical power. A general methodology of establishing and investigating social energy is proposed, which is based on the ACP approach, i.e., 'artificial systems' (A), 'computational experiments' (C) and 'parallel execution' (P), and parallel system methodology. A case study on the University of Denver (DU) campus grid is provided and studied to demonstrate the social energy concept. In the concluding remarks, we discuss the technical pathway, in both social and nature sciences, to social energy, and our vision on its future.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2017

Chemical Sensing Strategies for Real-Time Monitoring of Transformer Oil: A Review

Power transformers are a central component in the field of energy distribution and transmission. The early recognition of incipient faults in operating transformers is substantially cost effective by lessening impromptu blackouts. A standout amongst the most responsive and dependable strategies utilized for assessing the health of oil filled electrical equipment is dissolved gas analysis (DGA). Nowadays, there is an expanding requirement for better nonintrusive diagnostic and online monitoring tools to survey the internal state of the transformers. Chemical sensors are viewed as a key innovation for condition monitoring of transformer health, coordinating the non-invasiveness with typical sensor features, such as cost, usability, portability, and the integration with the data networks. Low-cost chemical sensors-based DGA techniques are expected to drastically augment the diagnostic abilities empowering the deployment on a broader range of oil filled power assets. The recent development involves both specific sensors designed to detect individual dissolved gas in transformer oil and non-specific sensors, operated in near ambient conditions, with the potential to be applied in a DGA system. In this paper, general background and operating guidelines of DGA are presented to address the origin of the gas formation, methods for their detection and the interpretation of the results by data analytics. The recent significant interest and advancements in chemical sensors to DGA applications are reviewed. Lastly, future research perspectives and challenges for the development of novel DGA chemical sensors are also discussed.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Distributed-Memory Parallel Symmetric Nonnegative Matrix Factorization

We develop the first distributed-memory parallel implementation of Symmetric Nonnegative Matrix Factorization (SymNMF), a key data analytics kernel for clustering and dimensionality reduction. Our implementation includes two different algorithms for SymNMF, which give comparable results in terms of time and accuracy. The first algorithm is a parallelization of an existing sequential approach that uses solvers for non symmetric NMF. The second algorithm is a novel approach based on the Gauss-Newton method. It exploits second-order information without incurring large computational and memory costs. We evaluate the scalability of our algorithms on the Summit system at Oak Ridge National Laboratory, scaling up to 128 nodes (4,096 cores) with 70% efficiency. Additionally, we demonstrate our software on an image segmentation task.

Eswar, Srinivas↗
DOE OSTI2024

Enabling HPC Scientific Workflows for Serverless

The convergence of edge computing, big data analytics, and AI with traditional scientific calculations is increasingly being adopted in HPC workflows. Workflow management systems are crucial for managing and orchestrating these complex computational tasks. However, it is difficult to identify patterns within the growing population of HPC workflows. Serverless has emerged as a novel computing paradigm, offering dynamic resource allocation, quick response time, fine-grained resource management and auto-scaling. In this paper, we propose a framework to enable HPC scientific workflows on serverless. Our approach integrates a widely used traditional HPC workflow generator with an HPC serverless workflow management system to create benchmark suites of scientific workflows with diverse characteristics. These workflows can be executed on different serverless platforms. We comprehensively compare executing workflows on traditional local containers and serverless computing platforms. Our results show that serverless can reduce CPU and memory usage respectively by 78.11% and 73.92% without compromising performance.

Andrei da silva, Anderson↗
DOE OSTI2021

ARENA: Asynchronous Reconfigurable Accelerator Ring to Enable Data-Centric Parallel Computing

The next generation HPC and data centers are likely to be reconfigurable and data-centric due to the trend of hardware specialization and the emergence of data-driven applications. In this work, we propose ARENA – an asynchronous reconfigurable accelerator ring architecture as a potential scenario on how the future HPC and data centers will be like. Despite using the coarse-grained reconfigurable arrays (CGRAs) as the substrate platform, our key contribution is not only the CGRA-cluster design itself, but also the ensemble of a new architecture and programming model that enables asynchronous tasking across a cluster of reconfigurable nodes, so as to bring specialized computation to the data rather than the reverse. We presume distributed data storage without asserting any prior knowledge on the data distribution. Hardware specialization occurs at runtime when a task finds the majority of data it requires are available at the present node. In other words, we dynamically generate specialized CGRA accelerators where the data reside. The asynchronous tasking for bringing computation to data is achieved by circulating the task token, which describes the dataflow graphs to be executed for a task, among the CGRA cluster connected by a fast ring network. Evaluations on a set of HPC and data-driven applications across different domains show that ARENA can provide better parallel scalability with reduced data movement (53.9 percent). Compared with contemporary compute-centric parallel models, ARENA can bring on average 4.37× speedup. The synthesized CGRAs and their task-dispatchers only occupy 2.93mm 2 chip area under 45nm process technology and can run at 800MHz with on average 759.8mW power consumption. ARENA also supports the concurrent execution of multi-applications, offering ideal architectural support for future high-performance parallel computing and data analytics systems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Perspectives on Machine Learning-assisted Plasma Medicine: Towards Automated Plasma Treatment

Cold atmospheric plasmas (CAPs) have shown great promise for medical applications through their synergistic chemical, electrical, and thermal effects, which can induce therapeutic outcomes. However, safe and reproducible plasma treatment of complex biological surfaces poses a major hurdle to the widespread adoption of CAPs for medical applications. Predictive modeling of the mutual interactions between the plasma and biological surfaces and, thus, systematic approaches to quantify and predict plasma treatment outcomes remain largely elusive due to the lack of mechanistic understanding of plasma-surface interactions that can span across vastly different length-and time-scales. In addition, real-time sensing capabilities in biomedical CAP devices are often limited, which can be detrimental to plasma treatment due to the intrinsic plasma and surface variability during the treatment, as well as sensitivity to external perturbations. All of these challenges can make reproducible and effective plasma treatment of biological surfaces difficult to realize, which is further compounded by errors due to human operation of hand-held CAP devices. Machine learning and data-driven approaches can be particularly useful in addressing these challenges in three major ways: (i) data-driven modeling of hard-to-model plasma-surface interactions and plasma treatment outcomes; (ii) learning data analytics for plasma and surface diagnostics in real-time; and (iii) developing predictive controllers that enable reliable and effective CAP treatments. Furthermore, this paper discusses the promise of machine learning to accelerate plasma medicine research in these areas, toward machine learning-assisted and automated CAP treatment of complex biological surfaces.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

Feed the fish: A review of aquaculture feeders and their strategic implementation

Automatic feeders are revolutionizing aquaculture by enabling precise and controlled feeding regimens that optimize growth, reduce feed waste, and enhance the overall efficiency of farming operations. Demand feeders provide some similar benefits but with feeding tailored to fish appetites and, in some cases, feed dispersal without electricity. This review explores the evolution, technological advancements, and applications of these feeders with a survey of recent research. It looks at common feeder designs and compares the pros and cons of five automatic feeder configurations in commercial use today. The article contrasts feeders and feed sizes for farmed species in different life stages and facilities, from hatcheries to ponds and offshore cages. It discusses the importance of species-tailored feeding strategies as well as impacts on fish behavior and health, nutrient delivery, and environmental sustainability. Incorporating sensors and on-site computing enables optimization in feeding algorithms that feeders then implement precisely and reliably. The review compiles results from multiple studies comparing growth rate, weight, and feed conversion ratio (FCR) outcomes from automatic feeders and demand feeders versus traditional hand-feeding regimens. The integration of feeders with real-time monitoring and data analytics is also discussed, highlighting future directions for research and adoption across the industry.

42 ENGINEERING↗
DOE OSTI2019

A Prognostics and Health Management Framework for Wind

Operation and maintenance costs are a major driver for levelized cost of energy of wind power plants and can be reduced through optimized operation and maintenance practices accomplishable by various prognostics and health management (PHM) technologies. In recent years, the wind industry has become more open to adopting PHM solutions, especially those focusing on diagnostics. However, prognostics activities are, in general, still at the research and development stage. On the other hand, the industry has a request to estimate a component's remaining useful life (RUL) when it has faulted, and this is a key output of prognostics. Systematically presenting PHM technologies to the wind industry by highlighting the RUL prediction need potentially helps speed up its acceptance and provides more benefits from PHM to the industry. In this paper, we introduce a PHM for wind framework. It highlights specifics unique to wind turbines and features integration of data and physics domain information and models. The output of the framework focuses on RUL prediction. To demonstrate its application, a data domain method for wind turbine gearbox fault diagnostics is presented. It uses supervisory control and data acquisition system time series data, normalizes gearbox temperature measurements with reference to environmental temperature and turbine power, and leverages big data analytics and machine-learning techniques to make the model scalable and the diagnostics process automatic. Another physics-domain modeling method for RUL prediction of wind turbine gearbox high-speed-stage bearings failed by axial cracks is also discussed. Bearing axial cracking has been shown to be the prevalent wind turbine gearbox failure mode experienced in the field and is different from rolling contact fatigue, which is targeted during the bearing design stage. The method uses probability of failure as a component reliability assessment and RUL prediction metric, which can be expanded to other drivetrain components or failure modes. The presented PHM for wind framework is generic and applicable to both land-based and offshore wind turbines.

17 WIND ENERGY↗
DOE OSTI2018

Factor analysis in automated face detection: gender, occlusion, eyewear, brightness, contrast, and focus measure

Computer-based facial recognition algorithms exploit the unique characteristics of faces in images. However, in non-cooperative situations these unique characteristics are often disturbed. In this study, we examine the effect of six different factors on face detection in an unconstrained imaging environment: image brightness, image contrast, focus measure, eyewear, gender, and occlusion. The aim of this study is twofold: first, to quantify detection rates of conventional Haar cascade algorithms across these six factors; and second, to propose methods for automatically labeling datasets whose size prohibits manual labeling. First, we manually classify a uniquely challenging dataset comprising 9,688 images of passengers in vehicles acquired from a roadside camera system. Next, we quantify how each of the aforementioned factors affect face detection on this dataset. Of the six factors studied, occlusion had the most significant impact, resulting in a 54% decrease in detection rate between unoccluded and severely occluded faces in our unique dataset. Finally, we provide a methodology for data analytics of large datasets where manual labeling of the whole dataset is not possible.

Jafek, Benjamin↗
DOE OSTI2021

A Survey of Thermal Sensing Application in Additive Manufacturing

Industry 4.0 represents a significant change in manufacturing with the inclusion of such technologies as additive manufacturing and data analytics. In support of these changes, infrared thermal imaging (IR) and very-near infrared (VNIR) have proven invaluable in numerous applications related to additive manufacturing. In this review, these applications will be presented as they relate to polymer and metal-based additive manufacturing processes. Applications including in-situ characterization, post-build analysis, experimental setups, modeling, and machine learning will be covered. With a general overview complete, the review will conclude with a discussion of challenges identified throughout the literature and thoughts on future trends.

Borish, Michael↗
DOE OSTI2019

New tolerance factor to predict the stability of perovskite oxides and halides

Predicting the stability of the perovskite structure remains a long-standing challenge for the discovery of new functional materials for many applications including photovoltaics and electrocatalysts. We developed an accurate, physically interpretable, and one-dimensional tolerance factor, τ, that correctly predicts 92% of compounds as perovskite or nonperovskite for an experimental dataset of 576 ABX 3 materials (X = O 2– , F – , Cl – , Br – , I – ) using a novel data analytics approach based on SISSO (sure independence screening and sparsifying operator). τ is shown to generalize outside the training set for 1034 experimentally realized single and double perovskites (91% accuracy) and is applied to identify 23,314 new double perovskites ( A 2 BB'X 6 ) ranked by their probability of being stable as perovskite. Furthermore, this work guides experimentalists and theorists toward which perovskites are most likely to be successfully synthesized and demonstrates an approach to descriptor identification that can be extended to arbitrary applications beyond perovskite stability predictions.

36 MATERIALS SCIENCE↗
DOE OSTI2016

Verifying quantitative reliability for programs that execute on unreliable hardware

Emerging high-performance architectures are expected to contain unreliable components that may exhibit soft errors, which silently corrupt the results of computations. Full detection and masking of soft errors is challenging, expensive, and, for some applications, unnecessary. For example, approximate computing applications (such as multimedia processing, machine learning, and big data analytics) can often naturally tolerate soft errors. We introduce Rely, a programming language that enables developers to reason about the quantitative reliability of an application—namely, the probability that it produces the correct result when executed on unreliable hardware. Rely allows developers to specify the reliability requirements for each value that a function produces. We perform a static quantitative reliability analysis that verifies quantitative requirements on the reliability of an application, enabling a developer to perform sound and verified reliability engineering. The analysis takes a Rely program with a reliability specification and a hardware specification that characterizes the reliability of the underlying hardware components and verifies that the program satisfies its reliability specification when executed on the underlying unreliable hardware platform. We demonstrate the application of quantitative reliability analysis on six computations implemented in Rely.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2017

A Pattern Language for High-Performance Computing Resilience

High-performance computing systems (HPC) provide powerful capabilities for modeling, simulation, and data analytics for a broad class of computational problems. They enable extreme performance of the order of quadrillion floating-point arithmetic calculations per second by aggregating the power of millions of compute, memory, networking and storage components. With the rapidly growing scale and complexity of HPC systems for achieving even greater performance, ensuring their reliable operation in the face of system degradations and failures is a critical challenge. System fault events often lead the scientific applications to produce incorrect results, or may even cause their untimely termination. The sheer number of components in modern extreme-scale HPC systems and the complex interactions and dependencies among the hardware and software components, the applications, and the physical environment makes the design of practical solutions that support fault resilience a complex undertaking. To manage this complexity, we developed a methodology for designing HPC resilience solutions using design patterns. We codified the well-known techniques for handling faults, errors and failures that have been devised, applied and improved upon over the past three decades in the form of design patterns. In this paper, we present a pattern language to enable a structured approach to the development of HPC resilience solutions. The pattern language reveals the relations among the resilience patterns and provides the means to explore alternative techniques for handling a specific fault model that may have different efficiency and complexity characteristics. Using the pattern language enables the design and implementation of comprehensive resilience solutions as a set of interconnected resilience patterns that can be instantiated across layers of the system stack.

Hukerikar, Saurabh↗
DOE OSTI2022

Results From Invoking Artificial Neural Networks to Measure Insider Threat Detection & Mitigation

Advances on differentiating between malicious intent and natural “organizational evolution” to explain observed anomalies in operational workplace patterns suggest benefit from evaluating collective behaviors observed in the facilities to improve insider threat detection and mitigation (ITDM). Advances in artificial neural networks (ANN) provide more robust pathways for capturing, analyzing, and collating disparate data signals into quantitative descriptions of operational workplace patterns. In response, a joint study by Sandia National Laboratories and the University of Texas at Austin explored the effectiveness of commercial artificial neural network (ANN) software to improve ITDM. Overall, this research demonstrates the benefit of learning patterns of organizational behaviors, detecting off-normal (or anomalous) deviations from these patterns, and alerting when certain types, frequencies, or quantities of deviations emerge for improving ITDM. Evaluating nearly 33,000 access control data points and over 1,600 intrusion sensor data points collected over a nearly twelve-month period, this study's results demonstrated the ANN could recognize operational patterns at the Nuclear Engineering Teaching Laboratory (NETL) and detect off-normal behaviors—suggesting that ANNs can be used to support a data-analytic approach to ITDM. Several representative experiments were conducted to further evaluate these conclusions, with the resultant insights supporting collective behavior-based analytical approaches to quantitatively describe insider threat detection and mitigation.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗