Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data driven”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,783 records · Page 99
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Solving Inverse Stochastic Problems from Discrete Particle Observations Using the Fokker--Planck Equation and Physics-Informed Neural Networks

The Fokker--Planck (FP) equation governing the evolution of the probability density function (PDF) is applicable to many disciplines, but it requires specification of the coefficients for each case, which can be functions of space-time and not just constants and hence require the development of a data-driven modeling approach. When the data available is directly on the PDF, there exist methods for inverse problems that can be employed to infer the coefficients and thus determine the FP equation and subsequently obtain its solution. Herein, we address a more realistic scenario, where only sparse data are given on the particles' positions at a few time instants, which are not sufficient to accurately construct directly the PDF even at those times from existing methods, e.g., kernel estimation algorithms. To this end, we develop a general framework based on physics-informed neural networks (PINNs) that introduces a new loss function using the Kullback--Leibler divergence to connect the stochastic samples with the FP equation to simultaneously learn the equation and infer the multidimensional PDF at all times. In particular, we consider two types of inverse problems, type I, where the FP equation is known but the initial PDF is unknown, and type II, in which, in addition to the unknown initial PDF, the drift and diffusion terms are also unknown. In both cases, we investigate problems with either Brownian or Lévy noise or a combination of both. Here, we demonstrate the new PINN framework in detail in the one-dimensional (1D) case, but we also provide results for up to five dimensions demonstrating that we can infer both the FP equation and dynamics simultaneously at all times with high accuracy using only very few discrete observations of the particles.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2019

PMT Gain Calibration In MicroBooNE

Liquid argon (LAr) is an ideal scintillating detector medium: it is very bright, releasing O(10, 000) photons per MeV of deposited energy, and is also transparent to its own scintillation. Light data in liquid argon time projection chamber (LArTPC) experiments in general and MicroBooNE in particular has many important uses. In MicroBooNE, light collected over all photosensors is used as a first and second level trigger. At the data acquisition stage ~ 5PE is required for triggering. An additional software trigger of ≈ 20PE helps reject a large portion of cosmic ray background in events with no neutrino interaction occurring during the beam spill. Scintillation can also be used for the determination of absolute drift coordinate of non-beam related events. Additionally, matching reconstructed light to reconstructed TPC charge is a powerful tool for cosmic ray rejection. Finally due to the specific properties of LAr scintillation, light information can be used for particle identification. For many of these tasks good modeling of the light response of the detector is crucial. Applying data-driven corrections to optical detector data and simulation (prediction) allows to obtain a well calibrated energy scale from the PMTs. This reduces discrepancies between data and simulation, and calibrates out non-uniformities of data over the full data taking period. Thus it is expected to factor in improving systematic uncertainties on MicroBooNE’s flagship analyses - the low energy excess (LEE) search and LAr-ν cross-section measurements.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2021

Development of Renewable Energy Data for Facilitating the Clean Energy Transition in Vietnam

Vietnam is transforming its power system with an increasing share of variable renewable energy (VRE) in the generation mix and plans to achieve 27% VRE by capacity in 2030 and 42% by capacity in 2045, as indicated by the draft Eighth Power Development Plan for 2020–-2045 (PDP8). Further increase in VRE penetration is possible with data-driven analysis where availability of data, specifically VRE data, becomes critical. NREL has worked with various stakeholders in Vietnam to create high-resolution multi-year VRE data publicly available to all. This paper reviews this new VRE data for Vietnam and how different stakeholders can use this data to inform VRE deployment decisions.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

UQ4QM: Uncertainty Quantification for Quantum Materials (Chemical Dynamics Initiative Final Report)

The Uncertainty Quantification for Quantum Materials (UQ4QM) LDRD project focused on developing solutions for strategic two project areas the Chemical Dynamics Initiative (CDi) Use Case 3. This included data-driven approaches toward understanding heterogeneous data, such as multi-fidelity data or data with unknown spatial or temporal perturbations. The applications were varied but the project aims pursued solutions which were amenable to common UQ approaches in order to maximize impact.

36 MATERIALS SCIENCE↗
NASA NTRS1986

A formal definition of data flow graph models

In this paper, a new model for parallel computations and parallel computer systems that is based on data flow principles is presented. Uninterpreted data flow graphs can be used to model computer systems including data driven and parallel processors. A data flow graph is defined to be a bipartite graph with actors and links as the two vertex classes. Actors can be considered similar to transitions in Petri nets, and links similar to places. The nondeterministic nature of uninterpreted data flow graphs necessitates the derivation of liveness conditions.

Kavi, Krishna M.↗
NASA NTRS1994

Graph-Based Dynamic Assignment Of Multiple Processors

Algorithm-to-architecture mapping model (ATAMM) is strategy minimizing time needed to periodically execute graphically described, data-driven application algorithm on multiple data processors. Implemented as operating system managing flow of data and dynamically assigns nodes of graph to processors. Predicts throughput versus number of processors available to execute given application algorithm. Includes rules ensuring application algorithm represented by graph executed periodically without deadlock and in shortest possible repetition time. ATAMM proves useful in maximizing effectiveness of parallel computing systems.

Hayes, Paul J.↗
NASA NTRSDate not supplied

The Future of NASA Earth Science in the Commercial Cloud: Challenges and Opportunities

NASA produces a large volume and variety of data products that are used every day to support research, decision making, and education. The widespread use of NASA’s Earth Science data is enabled by NASA’s Earth Science Data System (ESDS) program, which oversees the archiving and distribution of these data and invests in the development of new data systems and tools. However, NASA’s current approach to Earth Science data distribution — based on distributed institutional archives with individual on-premises high-performance computing capabilities — faces some significant challenges, including massive increases in data volume from upcoming missions, a greater need for transdisciplinary science that synthesizes many different kinds of observations, and a push to make science more open, inclusive, and accessible. To address these challenges, NASA is aggressively migrating its Earth Science data and related tools and services into the commercial cloud. Migration of data into the commercial cloud can significantly improve NASA’s existing data system capabilities by (1) providing more flexible options for storage and compute (including rapid, as-needed access to state-of-the-art capabilities); (2) by centralizing and standardizing data access, which gives all of NASA’s institutional data centers access to all of each other’s datasets; and (3) by facilitating “analysis-in-place”, whereby users can bring their own computational workflows and tools to the data rather than having to maintain their own copies of NASA datasets. However, migration to the commercial cloud also poses some significant challenges, including (1) managing costs under a “pay-as-you-go” model; (2) incompatibility with existing tools and data formats with object-based storage and network access; (3) vendor lock-in; (4) challenges with data access for workflows that mix on-premise and cloud computing; and (5) standardization for highly diverse data as is present in NASA’s data archive. I conclude with two examples of recent NASA activities showcasing capabilities enabled by the commercial cloud: An interactive analysis and development platform for analyzing airborne imaging spectroscopy data, and a new collection of tools and services for data discovery, analysis, publication, and data-driven storytelling (Visualization, Exploration, and Data Analysis, VEDA).

Alexey N Shiklomanov↗
DOE OSTI2023

WeakIdent: Weak formulation for identifying differential equation using narrow-fit and trimming

Data-driven identification of differential equations is an interesting but challenging problem, especially when the given data are corrupted by noise. When the governing differential equation is a linear combination of various differential terms, the identification problem can be formulated as solving a linear system, with the feature matrix consisting of linear and nonlinear terms multiplied by a coefficient vector. This product is equal to the time derivative term, and thus generates dynamical behaviors. The goal is to identify the correct terms that form the equation to capture the dynamics of the given data. We propose a general and robust framework to recover differential equations using a weak formulation with two new mechanisms, narrow-fit and trimming, for both ordinary and partial differential equations (ODEs and PDEs). The weak formulation facilitates an efficient and robust way to handle noise, and two new mechanisms, narrow-fit and trimming, improve the coefficient support and value recoveries respectively. For each sparsity level, Subspace Pursuit is utilized to find an initial set of support from the large dictionary. Then, we focus on highly dynamic regions (rows of the feature matrix), and error normalize the feature matrix in the narrow-fit step. The support is further updated via trimming the terms that contribute the least. Finally, the support set of features with the smallest Cross-Validation error is chosen as the result. A comprehensive set of numerical experiments are presented for both systems of ODEs and PDEs with various noise levels. The proposed method gives a robust recovery of the coefficients, and a significant denoising effect which can handle up to 100% noise-to-signal ratio for some equations. We compare the proposed method with several state-of-the-art algorithms for the recovery of differential equations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Platform for Remote Deployment and Training for Enhanced Building Operation Practices (Building Re-Tuning and On-going Commissioning)

While a building’s energy usage is driven largely by its design and use, building operator behavior has a strong influence on its energy consumption. This project developed and piloted a specific, data-driven coaching methodology to help operators understand how they can adjust operations and/or affect no/low-cost repairs or upgrades to their specific building HVAC systems to reduce energy consumption. Named BuildingCoach, the operational optimization method used is based on the Building Re-tuning approach developed by the Pacific Northwest National Laboratory. A building operations analytics market has matured over the past decade, though its potential to affect energy-saving changes has not been fully realized. Training operators to understand the methods for operational optimization with the explicit approach of using building-system performance data is hypothesized to create a more effective, longer lasting result in building energy efficiency, and this strategy is the fundamental premise of this project. With the support of an Industry Advisory Board, the project succeeded in developing materials and recruiting for and delivering three pilot cohorts. Deliverables included twenty-two self-paced training modules (accessed via a Learning Management System) and a web-based platform that includes access to real-time building system data and a repository for building system documentation. The project set out to have 100 participants from 50 buildings in three pilot cohorts. In the end, there were 28 participants from 17 buildings, i.e., a significant shortfall. The first two pilot cohorts had only two buildings in each, and this was partially due to difficulties in deploying the Building Operator Coaching Solution (“the BOCS”), which is technology that extracts the data from the controls network and presents it as prescribed for coaching. In the third cohort, the project team deployed the BOCS successfully to 13 buildings, the methodology was piloted as intended, and numerous opportunities for optimization were identified. The BuildingCoach business plan charts a path to an economically sustainable effort. However, even with a licensing model captured in the final version of the business plan, the scalability is still limited to keeping less than 1,000 buildings affected by 2033. Even so, there are unexplored paths to greater scalability that are being considered. CUNY BPL is working to perpetuate and grow the use of BuildingCoach. As of this writing, about twenty buildings have either been connected or will be connected with operators coached / to be coached in the NYC municipal portfolio, twelve buildings across four campuses in NY State will use BuildingCoach, a NY upstate county wishes for six or seven buildings to participate with the support of funding from NYSERDA, and others have also expressed interest. In the decades to come, there will be an increasing percentage of large and mid-sized buildings that incorporate automated system optimization (ASO), and the building operators’ role will shift to spend more time on maintenance and monitoring. Meanwhile, programs such as BuildingCoach will play a critical role in optimizing operations. And, regardless of the emergence of ASO, operators will still need to understand how their systems operate so that they can monitor them properly. Within that context, BuildingCoach is an important step towards operators’ understanding of efficient building system operations.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Data-Efficient Dimensionality Reduction and Surrogate Modeling of High-Dimensional Stress Fields

Tensor datatypes representing field variables like stress, displacement, velocity, etc., have increasingly become a common occurrence in data-driven modeling and analysis of simulations. Numerous methods [such as convolutional neural networks (CNNs)] exist to address the meta-modeling of field data from simulations. As the complexity of the simulation increases, so does the cost of acquisition, leading to limited data scenarios. Modeling of tensor datatypes under limited data scenarios remains a hindrance for engineering applications. Here, in this article, we introduce a direct image-to-image modeling framework of convolutional autoencoders enhanced by information bottleneck loss function to tackle the tensor data types with limited data. The information bottleneck method penalizes the nuisance information in the latent space while maximizing relevant information making it robust for limited data scenarios. The entire neural network framework is further combined with robust hyperparameter optimization. We perform numerical studies to compare the predictive performance of the proposed method with a dimensionality reduction-based surrogate modeling framework on a representative linear elastic ellipsoidal void problem with uniaxial loading. The data structure focuses on the low-data regime (fewer than 100 data points) and includes the parameterized geometry of the ellipsoidal void as the input and the predicted stress field as the output. The results of the numerical studies show that the information bottleneck approach yields improved overall accuracy and more precise prediction of the extremes of the stress field. Additionally, an in-depth analysis is carried out to elucidate the information compression behavior of the proposed framework.

artificial intelligence↗
DOE OSTI2021

Survey on stochastic distribution systems: A full probability density function control theory with potential applications

Complex systems seen either in general engineering practice or economics are subjected to ever increased uncertainties that are mostly represented as random variables or parameters, and the characteristics of random variables are represented by their probability density functions (PDFs). Controlling their PDFs means to shape their stochastic distributions and in general it would provide a full treatment for system analysis and operational control and optimization. This leads to the development of stochastic distribution control (SDC) systems theory in the past decades, where the original aim of the controller design is to realize a shape control of the distributions of certain random variables in their PDFs sense for some engineering processes. Indeed, once the PDFs of these random variables or parameters are used to describe their distribution characters, the control task is to obtain control signals so that the output PDFs of stochastic systems are made to follow their target PDFs. The subject of SDC was initially originated for non-Gaussian stochastic control systems design but has found a wide spectrum of applications in general systems in terms of data-driven modeling, analysis, signal processing (filtering), data mining via multivariable statistics, decision-making (optimization) for systems subjected to uncertainties and even in economics. In this context, SDC constitutes an effective primer tool for complex system analysis, control and operational optimizations. In this review paper, a detailed survey of the developments on the research of SDC systems will be made together with their wide spectrum applications and future perspectives.

42 ENGINEERING↗
DOE OSTI2015

Optimal carbon capture and storage contracts using historical CO 2 emissions levels

In an effort to reduce carbon dioxide (CO 2 ) emissions to the atmosphere, carbon capture and storage (CCS) technology has been developed to collect CO 2 from emissions generators and store it underground. Recent proposed legislation would limit the volume of emissions generated from power sources, effectively requiring some sources to participate in CCS. Both emissions sources and storage operators require incentives to enter into contracts to capture excess emissions at the source, and transport and store the CO 2 underground. As the level of emissions from power plants is stochastic and carryover into future time periods is expensive, we develop a newsvendor model to determine the optimal price and volume of these contracts to maximize the expected profit of the storage operator and encourage the participation of multiple emissions sources. Because the storage operator has a limit on the amount of CO 2 that can be injected each month, this limit affects the allocation of the optimal contract amounts between the emitters. Furthermore, the distribution of emissions and relative costs of transportation also influence the optimal policy. In addition to analytical solutions, we present data-driven methods for using correlated emissions data to determine the optimal price and volume of these contracts.

42 ENGINEERING↗
DOE OSTI2024

Weighted Composition Operators for Learning Nonlinear Dynamics

Operator theoretic methods in dynamical system have been dominated by the use of Koopman operators and their continuous time counterparts, such as Koopman Generators and Liouville Operators. The advantage gained from their use primarily stems from the ability to extract subspaces and eigenfunctions within a space of observables that are invariant with respect to the Koopman operator over that space. When this occurs, a dynamic mode decomposition of the systems state provides a linear model for the dynamical system. Not all Koopman operators have eigenfunctions that may be exploited in this manner. However, the framework can still be leveraged for approximations using other operators. In this setting, we present a different operator for the study of dynamical systems, the weighted composition operator. These operators are compact for a wide range of dynamics and spaces, and through their interactions with occupation kernels and vector valued kernels, they admit an estimation of the underlying dynamics. Here, this manuscript presents a new algorithm for the data driven study of dynamical systems from data, and also provides two numerical experiments where convergence is achieved as a proof of concept.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Creating an Advanced Sensor Network to calculate real-time, mass-weighted flue gas composition and air heater leakage of a coal-fired utility boiler under dynamic operating conditions

Utilization of renewable energy sources to minimize the environmental impact of energy production has changed the way utility boilers operate, requiring frequent load cycling between full load and partial loads as low as 30%. Dynamic operation of coal-fired utility boilers significantly reduces boiler efficiency when compared to steady state at full load. Data-driven plant optimization has shown success with coal-fired utility boilers under dynamic operating conditions. The purpose of this work was to create an Advanced Sensor Network (ASN) to provide more extensive real-time data to inform dynamic plant optimization of Net Unit Heat Rate (NUHR). The ASN consists of gas sampling grids in the convective pass of the boiler and downstream of the air heater. These sampling grids allow for quantification of spatial variation of flue gas within the boiler and calculation of mass-weighted composition of flue gas through the combination of composition, velocity, and temperature measurements. The comparison of O 2 between the inlet and outlet of the air heater is used to calculate air leakage in real time. Flue gas composition and air heater leakage are both important factors in boiler efficiency and NUHR. Further, the results of this work support the value of mass-weighted averages for determining flue gas composition accurately. The measurements from the ASN show increased composition stratification during dynamic operation, with an average standard deviation 38% higher than observed during steady-state operation. Air heater leakage was also observed to increase from 2.8% to 5.1% following a load change. Prior to the installation of the ASN, these data would not have been available for dynamic control. These real-time data will be leveraged to calculate and optimize for NUHR during dynamic operation in future work.

42 ENGINEERING↗
DOE OSTI2025

LCLS Big Data Handling – How I Learned to Stop Worrying and Love the Data Deluge

Advanced data and computing systems are vital to Linac Coherent Light Source (LCLS) operations, data interpretation and overall scientific productivity. The transition to MHz-era operation marks a fundamental change in scale that requires new infrastructure and architectures to link LCLS to the required scale of computing needed for scientific interpretation. The LCLS-II Data System meets big data challenges by implementing configurable data reduction that can adapt to multiple science areas, real-time analysis frameworks to provide visualization and fast feedback, and the ability to transfer data to local and remote computational facilities for near real time analysis at the appropriate scale. Feature extracted information generated in the data analysis pipeline - at the edge, local compute, or remote High-Performance Computing (HPC) resources - can be used to steer experiments and inform user decisions during beam time. Artificial Intelligence and Machine Learning (AI/ML) techniques present new opportunities to rapidly analyse large datasets and direct experiments, but create new challenges in scaling, adaptability, complexity, and trustworthiness. We describe how the LCLS-II Data System architecture addresses its data-driven challenges in the areas of data acquisition, data processing, data management, and workflow orchestration to decrease the overall time-to-science and provide a vision for future developments.

artificial intelligence↗
DOE OSTI2024

Analyzing Residential Charging Demand for Light-Duty Electric Vehicles in Colorado

The past decade has witnessed a remarkable surge in adoption of electric vehicles (EVs). The momentum is expected to continue with strong support from governments and industry. Rapid EV adoption will add significant electricity demand, making it critical to plan for and manage EV charging to avoid causing additional stress and non-negligible risks to the already-aging power grid. To help power grid operators understand the impacts of residential EV charging and identify risk factors, this study presents a data-driven charging demand analysis for light-duty vehicles. This study considers two real-world grid service regions in Colorado and merges multiple data sources and state-of-the-art tools that characterize EV adoption projections, vehicle travel patterns, seasonal variations, residential charging accessibility, ambient temperature impact, EV charging behaviors, grid utility customers, vehicle registration, and household-level EV charging demand distribution. We characterize potential residential charging demand in 2030 for two regions within the state of Colorado: Boulder and Aurora regions. We project that EVs will be 26% of the light-duty vehicle population in Boulder and 16% in Aurora areas. Charging demand is characterized for ten power grid feeders (five for each study region). Across the ten feeders, peak total EV charging powers during wintertime range from less than 1 MW to more than 4 MW.

ADVANCED PROPULSION SYSTEMS↗