Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data driven”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

A Data-Driven Methodology for Contextual Unit Commitment Using Regression Residuals

Day after day, system operators are faced with the challenge of taking unit commitment (UC) decisions under uncertain net load conditions. The standard operating procedure for taking UC decisions begins by leveraging auxiliary data on covariates (such as the day of the week or latest weather information) to generate a point prediction for net load, which is used in solving a deterministic UC problem. Such an approach, however, is known to deliver a notoriously poor out-of-sample (OOS) performance, as it completely disregards the stochastic nature of net load. While stochastic programming models explicitly represent uncertainty, they mostly do so using a generic set of scenarios that neglect covariate observations, squandering useful auxiliary data that could be harnessed to glean insights into uncertainty. In this article, we discuss a contextual stochastic optimization approach to UC, which effectively exploits covariate observations while explicitly assessing uncertainty so as to boost the OOS performance of UC decisions. The key thrust of our approach is to leverage regression models, along with their empirical residuals, to set up and solve sample average approximation problems. Not only do we prove that our approach satisfies the requisite conditions for asymptotic optimality and consistency laid out in (Kannan et al., 2022), but we also assess its performance on several case studies conducted using real-world data collected in California ISO and New York ISO grids. In conclusion, results show that the proposed approach can significantly improve OOS performance compared to alternative methods proposed in the literature under varying dataset sizes.

Yurdakul, Ogun↗
DOE OSTI2018

An Observation Data Driven Simulation and Analysis Framework for Early Stage C. elegans Embryogenesis

Recent developments in cutting-edge live microscopy and image analysis provide a unique opportunity to systematically investigate individual cell’s dynamics as well as simulation-based hypothesis testing. After a summary of data generation and analysis in the observation and modeling efforts related to C. elegans embryogenesis, we develop a systematic approach to model the basic behaviors of individual cells. Next, we present our ideas to model cell fate, division, and movement using 3D time-lapse images within an agent-based modeling framework. Then, we summarize preliminary result and discuss efforts in cell fate, division, and movement modeling. Finally, we discuss the ongoing efforts and future directions for C. elegans embryo modeling, including an inferred developmental landscape for cell fate, a quasi-equilibrium model for cell division, and multi-agent, deep reinforcement learning for cell movement.

3D live images↗
DOE OSTI2025

Data-driven modeling of dynamic occupant thermostat override behavior for demand response applications

Buildings consume nearly 40% of global energy and produce similar emissions. Whiletechnological advances address efficiency, occupant behavior causes energy use variations up to 300% between identical buildings. This gap between predicted and actual building performance impacts building design, operations, and grid demand management programs. Through analyses of smart thermostat data from 1,400 single-occupant homes, the researchdemonstrates that occupants respond to 8°F thermostat setpoint changes within a median of 15 minutes, while 2°F changes trigger responses within a median of 30 minutes. This highlights an understudied temporal relationship between thermostat setbacks and response time of occupant behaviors. Models of such behavior dynamics are required to incorporate occupant impacts into building performance simulation. A key contribution of this dissertation is the Thermal Frustration Theory (TFT), which positsthat thermal discomfort driven behaviors are caused by the time-accumulation of discomfort, not simply a temperature deviation threshold or a delay from an initiating event. Using a dataset of 634 thermostats, each with 25+ manual setpoint changes, a comparative analysis of TFT and comfort zone and a delayed response theories demonstrated that personalized TFT models better predict when manual setpoint change occur. This was measured by the area under the curve statistical measure (AUC); all three models perform similarly by a Matthews Correlation Coefficient measure. Higher AUC performance is especially important for modeling occupant behavior in demand response programs where false negatives of rare occupant interactions could adversely affect grid stability. EnergyPlus based simulations were conducted with TFT-derived occupant models, demonstrating the ability to identify parameters of known TFT models from only data observable with smart thermostats, even under the presence of noise from routine overrides. Overall, the dissertation highlights that thermostat interactions are neither static,instantaneous, nor driven solely by the environment. Instead, temporal accumulation of discomfort and routine-based behavior play important roles. The methodology and results offer a pathway towards more accurate modeling of human-building interactions for policy assessment, building design, and demand response programs.

Sharma, Kunind [Northeastern University] (ORCID:00↗
DOE OSTI2020

Data-Driven Understanding of Low-to-Moderate Income Customers’ Adoption and Financial Qualification in Community Solar (Final Technical Report)

When Solstice began working in the community solar industry, it quickly became clear that there was a wide disparity along race and class lines in terms of what kind of household traditional solar offerings benefited. Solstice is an organization that aligns itself to the principles of a Just Transition, or the concept that a transition to a green economy should benefit and prioritize historically marginalized groups of people. Given that low-income communities are disproportionately burdened by our current polluting fossil fuel economy, Solstice set out to investigate the root causes of the exclusion of low to moderate income (LMI) households in the community solar market. As we worked more and more with financiers, developers, and LMI households, we recognized that significant barriers to entry in a developer-owned project were credit threshold requirements. A FICO score of 750 and higher discriminates against LMI households that are not financially stable enough to take on multiple lines of credit (or who may not have been deemed credit worthy enough to access a line of credit) yet who may have been reliable utility customers. As Solstice began looking further into preliminary data and speaking to community-based organizations (CBOs) that serve LMI households, we found our hypothesis to be worth investigating; there was indeed a subset of LMI households with poor FICO scores (or no FICO score at all) that had perfect bill payment history. Though initially Solstice was intent on gathering a body of data to prove or disprove this hypothesis, we were also concerned that all this proof of a financially stable and reliable customer was not being incorporated into FICO, and wondered if such a score would be possible. After preliminary research into the existence of alternative scores, Solstice realized that many mission-driven lending institutions rely on alternative metrics that are formulated for their specific industry. However, we also realized that community solar did not have an alternative credit underwriting mechanism, though there was great need from solar financiers for one. We anticipated that the creation of an EnergyScore would contribute to financiers’ need to qualify more people, as these entities are desperately looking for ways to lower the cost of customer acquisition. FICO turns away nearly 50% of potential customers (according to our own acquisition experience), and much of the community solar industry is realizing that FICO is not the perfect qualifying mechanism. Additionally, with a grounding in energy justice, just transitions, and climate justice, Solstice recognizes the need for a solution that addresses a more urgent need for LMI households to access renewable energy savings and relieve energy burdens. With funding from the Department of Energy, we gathered the data necessary to build the EnergyScore, reached out to mission-driven developers willing to test the metric, and secured several demonstration projects to pilot the EnergyScore. After acquiring customers for these demo projects using the EnergyScore, we will be continuously collecting customer payment behavior data. Though it goes beyond the scope of this project, we plan to disseminate this de-identified data with the wider community solar industry, which includes not only financiers and developers, but other mission-driven nonprofits, solar cooperatives, community-based organizations, environmental justice activists, and academics. While we intend to disprove the notion that LMI households cannot be included in projects without acutely increasing the risk to project finances, we also hope the data can be used to negotiate better pricing of systems and terms of ownership for community groups seeking to build inclusive projects.

14 SOLAR ENERGY↗
DOE OSTI2023

Loose Belt Fault Detection and Virtual Flow Meter Development Using Identified Data-driven Energy Model for Fan Systems

An energy model that correlates fan airflow, head, speed, and system power input is essential to detect device faults and optimize control strategies in fan systems. Since the application of variable-frequency drives (VFDs) makes the motor-efficiency data published by manufacturers inapplicable for VFD–motor–fan systems, the fan efficiency and drive (belt–motor–VFD) efficiency must be identified for each individual system to obtain accurate energy models. The objectives of this paper are to identify an energy model of existing VFD–motor–fan systems using available experimental data and demonstrate its applications in loose belt fault detection and virtual airflow meter development for optimal control. First, an approach is developed to identify the fan head, fan efficiency, and drive-efficiency curves using available fan head, speed, and system power input as well as temporarily measured airflow rate without measuring shaft power. Then, the energy model is identified for an existing VFD–motor–fan system. Finally, the identified model is applied to detect the slipped belt faults and develop the virtual airflow meter. The experiment results reveal that the developed approach can effectively obtain the energy model of VFD–motor–fan systems and the model can be applied to effectively detect slipped belt faults and accurately calculate the fan airflow rate.

42 ENGINEERING↗
DOE OSTI2015

Residential Mobility and Lung Cancer Risk: Data-Driven Exploration Using Internet Sources

Frequent relocation has been linked to health decline, particularly with respect to emotional and psychological wellbeing. In this paper we investigate whether there is an association between frequent relocation and lung cancer risk. For the initial investigation we leverage two online data sources to collect cancer and control subjects using web crawling and tailored text mining. The two data sources share different strengths and weaknesses in terms of the amount of detail, population representation, and sample size. One data source includes online obituaries. The second data source includes augmented LinkedIn profiles. For each data source, the subjects spatiotemporal history is reconstructed from the available information provided in the obituaries and from the education and work experience provided in the LinkedIn profiles. The study shows that lung cancer subjects have higher mobility frequency than the control group. This trend is consistent for both data sources.

Yoon, Hong-Jun↗
DOE OSTI2021

Computational Data-Driven Materials Discovery

Machine learning from large materials datasets enables accelerated materials discovery. Currently, the most accessible way to generate uniform, well curated, voluminous datasets is by the application of high-throughput first principles computations. In this work, we present the guiding principles of using computational data and machine learning to drive new materials discovery.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Comparative Analysis of ML Techniques for Data-Driven Anomaly Detection, Classification and Localization in Distribution System

High penetration of Distributed Energy Resources (DERs), fundamental load behavior changes, controllable loads, and significant increase in Electrical Vehicles (EVs) lead to complex dynamic behavior of the electric distribution system. Increasing number of components also means more measurements, more data and more data anomalies. Detecting, classifying and localizing these anomalies are important for situational awareness, and at the same time, very challenging given increasing complexity of the system. Highly accurate and high-resolution analytical techniques are needed to support anomaly detection, classification and localization (AD-C-L) for monitoring, root cause analysis and decision making. This paper provides comprehensive review and analysis of the existing spatio-temporal AD-C-L techniques within the distribution system. Challenges for specific problems in AD-C- L have been also discussed in this paper. Existing AD-C- L techniques have been categorized and synthesized for specific merits and limitations of multiple Machine Learning (ML) methodologies using common developed metrics of performance. The comparative analysis is summarized and presented with the open research challenges and path forward for future research needs.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2013

Optimal SCR Control Using Data-Driven Models

We present an optimal control solution for the urea injection for a heavy-duty diesel (HDD) selective catalytic reduction (SCR). The approach taken here is useful beyond SCR and could be applied to any system where a control strategy is desired and input-output data is available. For example, the strategy could also be used for the diesel oxidation catalyst (DOC) system. In this paper, we identify and validate a one-step ahead Kalman state-space estimator for downstream NOx using the bench reactor data of an SCR core sample. The test data was acquired using a 2010 Cummins 6.7L ISB production engine with a 2010 Cummins production aftertreatment system. We used a surrogate HDD federal test procedure (FTP), developed at Michigan Technological University (MTU), which simulates the representative transients of the standard FTP cycle, but has less engine speed/load points. The identified state-space model is then used to develop a tunable cost function that simultaneously minimizes NOx emissions and urea usage. The cost function is quadratic and univariate, thus the minimum can be computed analytically. We show the performance of the closed-loop controller in using a reduced-order discrete SCR simulator developed at MTU. Our experiments with the surrogate HDD-FTP data show that the strategy developed in this paper can be used to identify performance bounds for urea dose controllers.

diesel, emmissions, control, environment, modeling↗
DOE OSTI2012

Empirical Performance Model-Driven Data Layout Optimization and Library Call Selection for Tensor Contraction Expressions

Empirical optimizers like ATLAS have been very effective in optimizing computational kernels in libraries. The best choice of parameters such as tile size and degree of loop unrolling is determined by executing different versions of the computation. In contrast, optimizing compilers use a model-driven approach to program transformation. While the model-driven approach of optimizing compilers is generally orders of magnitude faster than ATLAS-like library generators, its effectiveness can be limited by the accuracy of the performance models used. In this paper, we describe an approach where a class of computations is modeled in terms of constituent operations that are empirically measured, thereby allowing modeling of the overall execution time. The performance model with empirically determined cost components is used to perform data layout optimization together with the selection of library calls and layout transformations in the context of the Tensor Contraction Engine, a compiler for a high-level domain-specific language for expressing computational models in quantum chemistry. The effectiveness of the approach is demonstrated through experimental measurements on representative computations from quantum chemistry.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2024

New Data-Driven Constraints on the Sign of Gluon Polarization in the Proton

Recently, the possible existence of negative gluon helicity Δ g has been observed to be compatible with existing empirical constraints, including from jet production in polarized proton-proton collisions at the Relativistic Heavy Ion Collider, and lattice QCD data on polarized gluon Ioffe time distributions. We perform a new global analysis of polarized parton distributions in the proton with new constraints from the high- x region of deep-inelastic scattering (DIS). A dramatic reduction in the quality of the fit for the negative Δ g replicas compared to those with positive Δ g suggests that the negative Δ g solution cannot simultaneously account for high- x polarized DIS data along with lattice and polarized jet data. Published by the American Physical Society 2024

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Data-driven electron-diffraction approach reveals local short-range ordering in CrCoNi with ordering effects

Abstract The exceptional mechanical strength of medium/high-entropy alloys has been attributed to hardening in random solid solutions. Here, we evidence non-random chemical mixing in a CrCoNi alloy, resulting from short-range ordering. A data-mining approach of electron nanodiffraction enabled the study, which is assisted by neutron scattering, atom probe tomography, and diffraction simulation using first-principles theory models. Two samples, one homogenized and one heat-treated, are observed. In both samples, results reveal two types of short-range-order inside nanoclusters that minimize the Cr–Cr nearest neighbors (L1 2 ) or segregate Cr on alternating close-packed planes (L1 1 ). The L1 1 is predominant in the homogenized sample, while the L1 2 formation is promoted by heat-treatment, with the latter being accompanied by a dramatic change in dislocation-slip behavior. These findings uncover short-range order and the resulted chemical heterogeneities behind the mechanical strength in CrCoNi, providing general opportunities for atomistic-structure study in concentrated alloys for the design of strong and ductile materials.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Global Data-Driven Determination of Baryon Transition Form Factors

Hadronic resonances emerge from strong interactions encoding the dynamics of quarks and gluons. The structure of these resonances can be probed by virtual photons parametrized in transition form factors. Here, in this study, twelve N* and Δ transition form factors at the pole are extracted from data with the center-of-mass energy from πN threshold to 1.8 GeV, and the photon virtuality 0 ≤ Q 2 /GeV 2 ≤ 8. For the first time, these results are determined from a simultaneous analysis of more than one state, i.e., ~10 5 π⁢N, η⁢N, and K⁢Λ electroproduction data. In addition, about 5×10 4 data in the hadronic sector as well as photoproduction serve as boundary conditions. For the Δ⁡(1232) and N⁡(1440) states our results are in qualitative agreement with previous studies, while the transition form factors at the poles of some higher excited states are estimated for the first time. Realistic uncertainties are determined by further exploring the parameter space.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2019

A Game-Theoretic Data-Driven Approach for Pseudo-Measurement Generation in Distribution System State Estimation

In this paper, we present an efficient computational framework with the purpose of generating weighted pseudo-measurements to improve the quality of distribution system state estimation (DSSE) and provide observability with advanced metering infrastructure (AMI) against unobservable customers and missing data. The proposed technique is based on a game-theoretic expansion of relevance vector machines (RVMs). This platform is able to estimate the nodal power consumption and quantify its uncertainty while reducing the prohibitive computational burden of model training for large AMI datasets. To achieve this objective, the large training set is decomposed and distributed among multiple parallel learning entities. The resulting estimations from the parallel RVMs are then combined using a game-theoretic model based on the idea of repeated games with vector payoff. It is observed that through this approach and by exploiting the seasonal changes in customers’ behavior the accuracy of pseudo-measurements can be considerably improved, while introducing robustness against bad training data samples. The proposed pseudo-measurement generation model is integrated into a DSSE using a closed-loop information system, which takes advantage of a branch current state estimator (BCSE) to further improve the performance of the designed machine learning framework. This method has been tested on a practical distribution feeder model with smart meter data for verification.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Data Driven User Emulator

This software generates realistic network traffic to test intrusion detection systems. The most realistic traffic is generated when software is used to drive actual applications, thereby behaving like a real user. Tools that generate such realistic user behavior are called user emulators. However, no existing user emulators use models based on data science and real user data, and they suffer from a decrease in the fidelity of the generated traffic. We develop a user emulator that uses real user data and data science to generate higher fidelity emulation and increase the accuracy of our experimental results.

Oesch, TimothyS.↗
DOE OSTI2026

Improving Detector Systematic Uncertainties Through Data-Driven Machine Learning

Detector simulation in liquid argon time projection chambers (LArTPCs) is a constant challenge. In particular the modeling of electrons response on wires is highly nontrivial. However, new machine learning techniques exist which can be leveraged to ameliorate these concerns. We present a novel methodology to attempt to learn from cosmic muon data in the ICARUS detector how reconstructed wire signals are influenced by features of the hits such as location, particle direction, angle relative to the wire plane, etc. A model can then be generated which can apply the learned mapping to Monte Carlo events to create a more data-like simulation sample. By creating such a sample we expect to reduce the systematic uncertainties at ICARUS due to our detector modeling.

Hausner, Harry [Fermilab] (ORCID:0000000188932280)↗