SEARCH · Engineering Papers

Results for “SCORE”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,009 records · Page 56

All sources NASA NTRS DOE OSTI

DOE OSTI2020

Methods for Explainable Artificial Intelligence

We explored ways of quantifying information in a neural network. This can be used to determine the right size of a network or to infer the way in which a network is processing information. The first year and a half was somewhat exploratory while the last half of the project focused on approaches that seemed to show the most promise. The introduce a new way of computing explainable artificial intelligence (XAI) saliency maps that is several orders of magnitude faster than methods with similar fidelity We call it FastCAM. The method works be combining a Class Activation Map (CAM) method such as GradCAM with a forward activation map computed with a statistic we call SMOE Scale. The addition of the forward activation maps to CAM methods seems to always improve their fidelity. At the same time, computational overhead is not increased by very much. While Gradients with SmoothGrad scores better on some fidelity measures, it is overall not as good and requires more than 1500 times to compute. We demonstrate two completed applications of FastCAM on tasks outside of the LDRD at LLNL. The source code for FastCAM is currently being implanted into Captum, the official XAI toolkit for the popular deep learning toolkit PyTorch. The LDRD currently has 13 publications released to the public. 10 of them are journal length.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

Detection of Defects in Additively Manufactured Metallic Materials with Machine Learning of Pulsed Thermography Images

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2020

Data-Driven Understanding of Low-to-Moderate Income Customers’ Adoption and Financial Qualification in Community Solar

Through this project, we sought to gather a body of customer data that either proved or disproved our assumption that metrics other than FICO can and should be used to qualify customers for community solar. Using customer data on income, FICO scores, and utility/rent/cell phone repayment history, we developed an alternative metric in order to test in the market at a small scale whether new qualifying metrics could open the shared solar market up to millions of additional households. We demonstrate that the EnergyScore is both more accurate in qualifying customers that will not default, and more inclusive in qualifying low to moderate income households. We are now in the process of utilizing the EnergyScore in a number of pilot projects, building a robust dataset of customer churn and default, and subsequently disseminating this data to more traditional and larger scale financiers and solar developer partners to change the way potential customers are qualified.

14 SOLAR ENERGY↗

DOE OSTI2020

Pulsed Thermal Tomography Nondestructive Examination of Additively Manufactured Reactor Materials (Second Annual Progress Report)

Additive manufacturing (AM) is an emerging method for cost-efficient fabrication of nuclear reactor parts. AM of metallic structures for nuclear energy applications is currently based on laser powder bed fusion (LPBF) process, which can introduce internal material flaws, such as pores and anisotropy. Integrity of AM structures needs to be evaluated nondestructively because material flaws could lead to premature failures due to exposure to high temperature, radiation and corrosive environment in a nuclear reactor. Thermal tomography (TT) provides a capability for non-destructive evaluation of sub-surface defects in arbitrary size structures. Thermal tomography is a computational method for heat diffusion-based imaging of solids, which provides 3D visualization of data from flash thermography measurements. We investigate thermal tomography imaging and nondestructive evaluation of stainless steel and nickel super alloy metallic structures produced with laser powder bed fusion (LPBF) additive manufacturing (AM) process. Metallic structures produced with LPBF contain defects, and there are limited capabilities to evaluate these structures non-destructively. Thermal tomography reconstruction of 3D apparent spatial effusivity provides information about AM structure geometry and internal material flaws. We study performance of thermal tomography in imaging of metallic structures through COMSOL computer simulations of transient heat transfer, and through reconstruction of data obtained from experimental measurements. Reconstruction of internal defects is investigated using a stainless steel 316L specimen with flat bottom hole (FBH) indentations, and Inconel 718 plate produced with laser powder bed fusion (LPBF) method, which contains imprinted hemispherical shape low density regions containing non-sintered metallic powder. The FBH’s have the same sizes as the imprinted defects in the LPBF specimens, but offer better imaging contrast. Thermal tomography reconstructions provide visualizations of internal defects, and allow for estimation of their sizes and locations. Detection sensitivity of TT is limited by noises. We investigate separation of signal from noise in thermography images using several machine learning (ML) methods, including new spatio-temporal blind source separation (STBSS) and spatio-temporal sparse dictionary learning (STSDL) methods. Performance of the ML methods is benchmarked using thermography data obtained from imaging stainless steel 316L and Inconel 718 specimens produced LPBF method with imprinted calibrated porosity defects. The ML methods are ranked by F-score and execution runtime. Finally, we investigate TT of AM stainless steel 316L specimen with imprinted internal porosity defects using relatively low-cost, small form factor infrared (IR) camera based on uncooled micro bolometer detector. Sparse coding related K-means singular value decomposition (SVD) machine learning, image processing algorithms are developed to improve quality of TT images through removal of Additive white Gaussian noise without blurring the images. Following initial qualification of an AM component for deployment in a nuclear reactor, a compact TT can also be used for in-service nondestructive evaluation (NDE). With capability to perform in-service NDE of the AM component lifecycle, TT data can be used for development of a component digital twin.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2021

Integrated Landscape Management to Reduce Biomass Feedstock Access Costs

Using geospatial, machine learning, and optimization techniques, a field scoring and design framework known as the bioenergy Landscape Environmental Assessment and Design System (bioLEADS) was developed and used to show through modelling that it is possible to reduce biomass feedstock access costs, improve field revenue, and shift intensive row crop production away from subfield areas susceptible to erosion and low in soil organic carbon. The purpose of bioLEADS is to automate agricultural field selection and subfield allocation to perennial energy crop production while incorporating reduced biomass feedstock access costs to support attaining the U.S. Department of Energy (DOE) Bioenergy Technologies Office (BETO) cost targets.

09 BIOMASS FUELS↗

DOE OSTI2021

Coupled social and infrastructure approaches for enhancing solar energy adoption. Final Report

The goal of this project was to work with rural electric cooperatives to facilitate the diffusion of solar energy adoption in households located in the rural and semi-urban areas of Virginia by identifying social and behavioral factors that might be unique to rural regions; and develop a model to calculate the solar adoption propensity score for household based on their demographics, social and behavioral characteristics which would provide an objective metric to cooperatives that can be further used to do targeted marketing of rooftop solar panels. This was achieved through the following tasks: (1) Conducted a survey of the members of Virginia electric cooperatives to identify demographic, social, financial and behavioral attributes of individuals who are likely to adopt rooftop solar panels. (2) Developed a highly detailed, data-driven, agent-based model of the population of Virginia, focusing on the rural regions. (3) Developed diffusion models that use social, behavioral, and demographic factors, and peer effects to study their impact on solar adoption in rural areas. (4) Built a prototype tool based on the diffusion model to help study market segmentation in rural areas and made it available to National Rural Electric Cooperative Association (NRECA). (5) Results and recommendations derived from the model were provided to NRECA to be shared with participating cooperatives. (6) Results were published in peer reviewed journals, conference proceedings and book chapters, and ideas disseminated through presentations and newsletters. There were several important methodological contributions made under this project which are detailed in the published papers, including: (1) Built a decision-adjusted model for predicting adoptors with imbalanced training data; (2) designed seeding strategies to maximize adoption given a fixed budget; (3) built a methodology to compare different agent based models; (4) created models to identify important factors that influence decision to adopt solar panels; and (5) built a methodology for building household profiles of solar generation to study the duck curve phenomenon. The team included members from the University of Virginia (lead), National Rural Electric Cooperative Association (NRECA), Arizona State University, Virginia Tech and Sandia National Laboratory. Note that no individual entity or stakeholder has incentive to promote solar in rural regions. Most of the research and work focuses around urban regions where the potential for growth in solar adoption is higher due to higher population density. This puts rural areas at a disadvantage. By improving the diffusion of solar adoption in rural parts of the country, we can not only provide clean energy to rural areas but also promote job growth and improves energy independence.

14 SOLAR ENERGY↗

DOE OSTI2021

Verification of Combined VR Techniques, Derivation of Future Time Equation, and Integration of LLNL Pulsed Sphere V&V Suite [Slides]

To determine whether the combination of forced-collision and DXTRAN variance-reduction (VR) techniques is unbiased, and to gain insight into the operation of these techniques, proof that first-moment estimates from Monte Carlo simulations employing both techniques are unbiased is developed. A general background on the forced-collision and DXTRAN VR techniques and their combination is given. Proof of an unbiased simulation is outlined by showing the equivalence of the history score moment equations of simulations with these techniques in use. A report with detailed proof of this equivalence is available upon request. The derivation of the future time equation using a similar approach, as well as a summary of the addition of the LLNL Pulsed Sphere experiments to the MCNP verification and validation suite, is also briefly discussed.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Hospice Landscape Report

In July 2018, CMS requested assistance from Oak Ridge National Laboratory (ORNL) to provide expert data science support aimed at developing algorithms for data mining of medical data for operational and payment purposes. The project is intended to be exploratory: work is aimed at alleviating challenges associated with improper payments, specifically audit methodologies and targeting and changes to risk scores. Project goals include developing new, sophisticated methods for audit targeting and improved profile– payment error correlations, specifically focused on Medicare Part C, the program under which MAOs provide health care services to beneficiaries. ORNL conducted RADV analyses against RAPS and EDS data as well as a hospice landscape analysis per a January 2015 dataset that included Medicare beneficiaries who were in hospice in 2017 and 2018. Ongoing work under this project also involves development of predictive models for RADV investigations and hospice landscape.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Data Science and Machine Learning for Genome Security

This report describes research conducted to use data science and machine learning methods to distinguish targeted genome editing versus natural mutation and sequencer machine noise. Genome editing capabilities have been around for more than 20 years, and the efficiencies of these techniques has improved dramatically in the last 5+ years, notably with the rise of CRISPR-Cas technology. Whether or not a specific genome has been the target of an edit is concern for U.S. national security. The research detailed in this report provides first steps to address this concern. A large amount of data is necessary in our research, thus we invested considerable time collecting and processing it. We use an ensemble of decision tree and deep neural network machine learning methods as well as anomaly detection to detect genome edits given either whole exome or genome DNA reads. The edit detection results we obtained with our algorithms tested against samples held out during training of our methods are significantly better than random guessing, achieving high F1 and recall scores as well as with precision overall.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2021

Towards a New Supply Chain Cybersecurity Risk Analysis Technique

Supply chain cyber-attacks, such as the SolarWinds Orion attack, are occurring with greater frequency. These attacks compromise a digital device before it is sent to customers, bypassing traditional security controls to remain persistent and undetected in operational environments. While supply chain attacks are prevalent, methods for analyzing the risk of these attacks are currently unavailable. This paper proposes new supply chain cyber-attack difficulty and risk metrics to evaluate the relative risk of an attack throughout the supply chain lifecycle. Difficulty metrics for each stakeholder in a digital device’s supply chain (e.g., hardware manufacturing, firmware development, software development, storage, and distribution entities) are calculated using scores from cybersecurity maturity questionnaires in a Bayesian Network leaky Noisy-MAX model. These difficulty metrics are then used to calculate an overall supply chain cyber-attack risk. Vulnerability and recoverability metrics are also proposed to evaluate the relative stakeholder influence in the attack risk. These proposed relative risk metrics enable continuous supply chain monitoring, provide decision-makers with information necessary for improved supplier selection, and help drive improvements in the cybersecurity posture of the stakeholders in their supply chain.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2022

Cooperative Research and Development Agreement between National Energy Technology Laboratory and Gas Technology Institute (Abstract)

Hydrogen has the potential to play an important role in decarbonizing energy-intensive sectors, and credible and open-source protocols are needed to vet the environmental credibility of a specific production pathway, given the variability even among the same technologies. Stakeholders and markets lack consistent, transparent, technical tools and protocols to assess the carbon intensity of hydrogen production at the asset level. Gas Technology Institute (GTI) and S&P Global Platts have launched the Open Hydrogen Initiative (OHI), a new collaboration focused on brining industry within the hydrogen marketplace together to provide further transparency into the environmental greenhouse gas (GHG) impact of hydrogen production. As part of this initiative, GTI has invited NETL to participate in the effort because of NETL’s deep expertise and capabilities in Life Cycle Analysis. Therefore, NETL is joining forces with the Gas Technology Institute (GTI) to build a measurement tool, accompanying protocols, and confidence score of the quality of the measurement. This CRADA effort provides the technical research collaboration support with GTI that will be used in the broader Open Hydrogen Initiative that can provide stakeholders the technical tools and protocols to decarbonize energyintensive sectors.

08 HYDROGEN↗

DOE OSTI2022

Feedstock Carbon Intensity Calculator (FD-CIC): Users’ Manual and Technical Documentation

The carbon intensities (CIs) of biofuels are determined with the life cycle analysis (LCA) technique, which accounts for the energy/material uses and emissions during the complete supply chain of biofuel including feedstock production and fuel conversion stages. Regulatory agencies such as California Air Resources Board (CARB) adopts LCA to calculate biofuel CIs. The Low Carbon Fuel Standard (LCFS) program developed by CARB allows individual biofuel conversion facilities to submit their own biofuel CIs with their facility input data and incentivizes the reduction in the CI specific to that particular facility compared to a reference fuel’s CI (Liu et al 2020). Such an incentive program has driven innovations in biorefineries to reduce their greenhouse gas (GHG) emissions by linking their revenue directly to its CI score through LCFS credit trading. Besides the biofuel conversion stage, different farming practices for feedstock growth can result in significant CI variations for feedstocks, thus for biofuels. To provide evidence-based research findings, the U.S. Department of Energy’s Advanced Research Projects Agency–Energy (ARPA-E) has supported the Systems Assessment Center of the Energy Systems and Infrastructure Analysis Division at Argonne National Laboratory to examine CI variations of different farming practices to grow agricultural crops for biofuel production. Meanwhile, the ARPA-E has launched the Systems for Monitoring and Analytics for Renewable Transportation Fuels from Agricultural Resources and Management (SMARTFARM) program to develop technologies and data platforms that enable an accurate measurement of key farming parameters that can help robust accounting of the GHG benefits of sustainable, low-carbon agronomic practices at farm level.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Intelligent Energy Optimizer for Residential Buildings

Demand-side management in the buildings is essential for meeting grid flexibility needs in a highly renewable energy scenario. Appliance load monitoring helps decision making for demand-side management by providing the information on operation status/power consumption from different appliances in the buildings. Nonintrusive load monitoring (NILM) is an attractive option for appliance load monitoring using because it has lower cost for sensors and helps mitigate privacy concerns. In this study, the team used an event detection technique followed by two different methods for event classification. The results from k-means clustering showed that the events from a single appliance are often distributed in multiple clusters. Thus, the unsupervised method of NILM using k-means clustering used in this study was not very suitable for load disaggregation. The results from NILM showed that the F1 score for event classification was 0.77 for a heat pump water heater and very low for other appliances using the rule-based classification.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2022

Preliminary Results for Using Uncertainty and Out-of-distribution Detection to Identify Unreliable Predictions.

As machine learning (ML) models are deployed into an ever-diversifying set of application spaces, ranging from self-driving cars to cybersecurity to climate modeling, the need to carefully evaluate model credibility becomes increasingly important. Uncertainty quantification (UQ) provides important information about the ability of a learned model to make sound predictions, often with respect to individual test cases. However, most UQ methods for ML are themselves data-driven and therefore susceptible to the same knowledge gaps as the models themselves. Specifically, UQ helps to identify points near decision boundaries where the models fit the data poorly, yet predictions can score as certain for points that are under-represented by the training data and thus out-of-distribution (OOD). One method for evaluating the quality of both ML models and their associated uncertainty estimates is out-of-distribution detection (OODD). We combine OODD with UQ to provide insights into the reliability of the individual predictions made by an ML model.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Simulation Studies on the Interactions of Electron Beam with Wastewater

The manufactured chemical pollutants, like 1,4 dioxane and PFAS (per- and polyfluroralkyl substances), found in the underground water and/or drinking water are challenging to be removed or biodegraded. Energetic electrons are capable of mediating and removing them. This paper utilizes FLUKA code to evaluate the beam-wastewater interaction effects with different energy, space and divergence distributions of the electron beam. With 8 MeV average energy, the electron beam exits from a 0.0127 cm thick titanium window, travels through a 4.3 cm distance air and a second 0.0127 cm thick stainless water container window with 2.43 cm radius, and finally is injected into the water area, where the volume of water is around 75 cubic cm. The distribution parameters of the electron beam are from the GPT (General Particle Tracer) simulations for UITF (Upgraded Injector Test Facility) in Jefferson lab. By varying the distributions, several measurements including the dose (or energy deposition) distribution, electron fluence, photon fluence are scored and compared. Taking the comparisons into consideration, this paper is aiming to find better electron beams for the wastewater irradiation.

Li, X.↗

DOE OSTI2021

National and Regional Initiatives to Promote Energy Efficiency and Renewable Energy Through State Energy Offices

The National Association of State Energy Officials (NASEO) worked with the U.S. Department of Energy’s (DOE) Office of Energy Efficiency and Renewable Energy (EERE), Weatherization and Intergovernmental Programs Office (WIP) over a ten year period to provide technical assistance, research and analyses, and enhanced coordination between DOE and the State and Territory Energy Offices. Over the life of the agreement, NASEO worked with WIP and the states to provide statewide strategic energy plan analyses and recommendations, including customized technical assistance to the states; peer to peer financing assistance via NASEO’s Financing Committee and supporting activities; training on core energy policies and programs, including dialogues and resources to support energy-air coordination, a training for new State Energy Office Directors, peer to peer exchange via a rural energy taskforce, and support to states to enhance buildings efficiency, home energy labeling, and technology deployment opportunities; support for State Energy Program metrics; and regional coordination via regional coordinators and peer exchange opportunities both in-person and online. Over the life of the project, the position and role of State Energy Offices within state government has changed, with now 80 percent of State Energy Office Directors serving as their Governor’s energy advisor, or reporting directly to their Governor’s energy advisor. This shift in stature has made it ever more crucial for State Energy Offices to receive timely and relevant technical assistance across a range of energy issue areas. NASEO, in collaboration with WIP, was able to deliver this technical assistance, and energy efficiency and renewable energy deployment has accelerated across the country. The State Energy Office Directors and their staff continue to engage in NASEO’s Committees – many of which were supported through this agreement – and have provided formal and informal feedback on the value of the programs supported through this award (e.g., reporting via survey increased understanding of their roles and technical assistance offerings provided by WIP and NASEO following the New Director Trainings). Moreover, resources developed through this award (e.g., Comprehensive State Energy Planning Guidelines, State Energy Loan Fund Database, Rural Data Resources for State Energy Planning and Programs, The Value of Adding home Energy Score to Low-Income Energy Efficiency Programs, etc.) have been cited by states as instrumental to their understanding of specific energy issue areas and in many cases led directly to enhanced program design within a state (e.g. Iowa citing their review of NASEO’s Comprehensive State Energy Planning Guidelines as a necessary first step in their planning process, later following may of the steps outlined in the guidelines). The priorities of the states and federal government have evolved over the last decade, with an increasing focus on climate mitigation and adaptation, equity impacts and considerations, energy security and resilience, and enhanced energy efficiency and renewable energy technology deployment, but the roots of these new priorities are based in the state and federal policies and programs, and research and analyses, that were supported in part through this award and other complementary initiatives. NASEO looks forward to continuing to support the states, and collaborate and coordinate with DOE, as we build on this important foundation in the years ahead.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2023

Triage Exam, August 2006 (V.2.2)

The following questions test knowledge relevant to the DOE Radiological Triage and DHS Secondary Reachback programs. There is no time limit, and you may use any reference materials you like. Each question has only one best answer. There are 20 questions, and a score of 80% is required to pass.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2021

An Integrated Paradigm for the Management of Delivery Risk in Electricity Markets: From Batteries to Insurance and Beyond [Slides]

In wholesale electricity markets today, flexibility from a limited number of distributed energy resources (DERs) is offered daily, and the value of flexibility is not yet recognized for economic hedging of delivery risk. Under a three-year project funded by the ARPA-E PERFORM program, a collaborative team is working towards developing an integrated risk management framework that will leverage flexibility from distributed and bulk resources to cost-effectively and reliably manage delivery risk of intermittent resources. Two concepts are at the core of the proposed integrated risk management framework: (A) flexibility options, which are a novel type of options and enable wholesale electricity market participants to hedge uncertainty by buying flexibility. (B) DER flexibility scores, which provide a way for utilities or aggregators to classify assets in groups with different likelihood of delivering contracted flexibility. This report presentation will focus on the proposed ISO-product "flexibility options," which is complementary to ramp and other products being introduced by ISOs/RTOs to manage net load uncertainties. Participating resources with imbalance risk can buy flexibility options to hedge their production, whereas grid-connected resources that can provide physical flexibility can offer flexibility options. We will present basics of the formulation for a day-ahead ISO market that matches buyers and sellers of this hedge in coordination with existing capabilities to schedule energy and ancillary services, and outline how their settlements mitigate the impact of imbalance risk.

24 POWER TRANSMISSION AND DISTRIBUTION↗