Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Analyst”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Identifying Emerging Safety Threats Through Topic Modeling in the Aviation Safety Reporting System: A COVID-19 Study

The NASA Aviation Safety Reporting System (ASRS) is a voluntary, confidential aviation safety reporting system. The ASRS receives reports from pilots, air traffic controllers, flight attendants, and others involved in aviation operations. The reports are de-identified and coded by ASRS expert safety analysts, and a short descriptive synopsis is written to describe the safety issue. The de-identified reports are then disseminated to the aviation community in many ways, including via an online database, Safety Alert Bulletins, For Your Information Notices, and the CALLBACK newsletter. In this work, we consider whether we can improve the grouping, linking, and understanding of safety concerns through topic modeling. Specifically, we use topic modeling as a building block to identify emerging safety threats over time. This unsupervised approach, we argue, offers the flexibility to identify new emerging themes in this large dataset by constructing different timelines based on the content similarity of ASRS report narratives. This method's unsupervised nature improves upon related research, which is limited to pre-defined labels and therefore can not fully capture emerging safety threats. We apply our method to all ASRS reports in 2020 to assess if the generated timelines can highlight COVID-19 as it is emerging as a safety threat in incoming ASRS reports. We perform both a quantitative and qualitative evaluation of the automatically constructed timelines. The qualitative evaluation is performed by describing the evolution of top terms in the timelines, generated by our method, which we found explicitly convey the themes of COVID-19. Separately, we use a set of 1,213 COVID-19 reports from 2020 that were manually identified by ASRS analysts to quantitatively evaluate the COVID-19 reports distribution across the timelines. Our results have shown that COVID-19 emergence can be identified using the top terms that were generated by topic modeling. The top terms in topic modeling therefore can serve as a summary alternative to manually inspecting reports. Moreover, leveraging the manually identified COVID-19 reports, we found the manually identified timelines accounted for over 70% of the COVID-19 reports curated by the ASRS analysts, which demonstrates the potential of this approach for facilitating the understanding of safety concerns as they emerge and evolve. This method shows great potential to understand aerospace safety threats and other narrative- driven incident report databases.

ASRS↗
NASA NTRS2021

Automated Data Accountability for Missions in Mars Rover Data

As the Mars Curiosity Rover transmits data to the JPL Ground Data System (GDS), it frequently observes data loss and corruption, requiring re-transmits from the rover and Ground Data System Analysts (GDSA) to monitor the downlink process. As new missions are launched, the GDSA team redistributes analysts to these new missions, causing shortages in previous missions. The GDSA team can significantly benefit from the automation and optimization of the downlink process of telemetry data. In fact, there is a need for a better understanding of why the data is corrupted, so that the GDSA team can best determine the root cause of the issues in the GDS. This paper presents machine learning and deep learning based approaches to automate and optimize the detection of data loss. We first created a pipeline to automatically accumulate data from the telemetry databases (MAROS, Telemetry Data Storage, and GDS Elastic Search Database) in the downlink process. With our newly created datasets, we perform feature selection to supplement the GDSA understanding of the downlink process and provide supplemental analysis on the importance of different features. We implement various machine learning and deep learning based models, including support vector machines, ensemble methods, and deep neural networks and evaluate their accuracies in identifying whether a downlink process is complete or incomplete. We utilize fast hyperparameter optimization methods that allow our models to quickly be re-trained, allowing them to quickly be tuned and optimized on daily incoming data in real time. This hyperparameter optimization also allows our methods to be quickly integrated into other JPL missions. Our results show that our best-performing machine learning and deep learning based models outperform the existing GDSA detection software by 6 accuracy points and can aid analysts by providing insights into the data accountability problem. Since these various machine learning and deep learning approaches vary significantly in interpretability, we provide a discussion on the tradeoffs between their performance and trustworthiness in helping detect issues in data transmission.

Divsalar, Dariush↗
NASA NTRSDate not supplied

The Virginia Earth System Science Scholars (VESSS) Experience: Inspiring High School Students in Stem Through Mentorship and Collaborative Skills Development

Since 2016, the Virginia Earth System Science Scholars (VESSS) program offered by the Virginia Space Grant Consortium (VSGC) has provided an interactive science, technology, engineering, and mathematics learning experience for Virginia high school juniors and seniors. The VESSS program was created through a partnership with VSGC, NASA Langley Research Center (LaRC), and Hampton University to engage students in learning about Earth’s climate change and its global impacts. High school students from all areas of Virginia learn about Earth science and climate change in a 16 week online course focused on the Earth’s surface and interior, atmospheric composition, weather, water energy cycles, and climate variability. Students that complete the online course are invited to a no-cost seven-day residential summer academy at NASA LaRC where students are divided into teams based on four of the major spheres of study for Earth: atmosphere, biosphere, hydrosphere, and lithosphere. Each team is guided by a Master Teacher and teams of undergraduate student interns who were also previous VESSS scholars. Students interview for team positions and are given a role reflecting an actual satellite design team position such as project scientist, research scientist, budget analyst, launch and orbit analyst, contamination analyst, and education and public outreach specialist. The students spend a week mentored by NASA and industry scientists and engineers as they learn how to select science goals and objectives, select science instruments, balance a mission budget, determine the mission launch location and orbit, and communicate the importance of the mission to the public. Each team produces a mission proposal, and at the end of the week, each team presents their portion of the mission to a panel of experts, followed by a question and answer period. Through this week students learn teamwork, communication, time management, meeting management, and research skills. Project work is supplemented by team-building activities, NASA facility tours, and lectures by acclaimed guest speakers such as Dr. Christine Darden, a NASA “Hidden Figure.” Students have conveyed through course evaluations and testimonials not only the vast personal learning and growth they achieved, but also the new perspectives they gained on future STEM career fields and opportunities to explore.

Elaine Seasly↗
DOE OSTI2011

Analytic Steering: Inserting Context into the Information Dialog

An analyst’s intrinsic domain knowledge is a primary asset in almost any analysis task. Unstructured text analysis systems that apply un-supervised content analysis approaches can be more effective if they can leverage this domain knowledge in a manner that augments the information discovery process without obfuscating new or unexpected content. Current unsupervised approaches rely upon the prowess of the analyst to submit the right queries or observe generalized document and term relationships from ranked or visual results. We propose a new approach which allows the user to control or steer the analytic view within the unsupervised space. This process is controlled through the data characterization process via user supplied context in the form of a collection of key terms. We show that steering with an appropriate choice of key terms can provide better relevance to the analytic domain and still enable the analyst to uncover un-expected relationships; this paper discusses cases where various analytic steering approaches can provide enhanced analysis results and cases where analytic steering can have a negative impact on the analysis process.

Steering↗
DOE OSTI2015

Evaluation of SNS Beamline Shielding Configurations using MCNPX Accelerated by ADVANTG

Shielding analyses for the Spallation Neutron Source (SNS) at Oak Ridge National Laboratory pose significant computational challenges, including highly anisotropic high-energy sources, a combination of deep penetration shielding and an unshielded beamline, and a desire to obtain well-converged nearly global solutions for mapping of predicted radiation fields. The majority of these analyses have been performed using MCNPX with manually generated variance reduction parameters (source biasing and cell-based splitting and Russian roulette) that were largely based on the analyst's insight into the problem specifics. Development of the variance reduction parameters required extensive analyst time, and was often tailored to specific portions of the model phase space. We previously applied a developmental version of the ADVANTG code to an SNS beamline study to perform a hybrid deterministic/Monte Carlo analysis and showed that we could obtain nearly global Monte Carlo solutions with essentially uniform relative errors for mesh tallies that cover extensive portions of the model with typical voxel spacing of a few centimeters. The use of weight window maps and consistent biased sources produced using the FW-CADIS methodology in ADVANTG allowed us to obtain these solutions using substantially less computer time than the previous cell-based splitting approach. While those results were promising, the process of using the developmental version of ADVANTG was somewhat laborious, requiring user-developed Python scripts to drive much of the analysis sequence. In addition, limitations imposed by the size of weight-window files in MCNPX necessitated the use of relatively coarse spatial and energy discretization for the deterministic Denovo calculations that we used to generate the variance reduction parameters. We recently applied the production version of ADVANTG to this beamline analysis, which substantially streamlined the analysis process. We also tested importance function collapsing (in space and energy) capabilities in ADVANTG. These changes, along with the support for parallel Denovo calculations using the current version of ADVANTG, give us the capability to improve the fidelity of the deterministic portion of the hybrid analysis sequence, obtain improved weight-window maps, and reduce both the analyst and computational time required for the analysis process.

43 PARTICLE ACCELERATORS↗
DOE OSTI2015

Better Incident Response with SCOT

SCOT is an incident response management system and knowledge base designed for incident responders by incident responders. SCOT increases the effectiveness of the team without adding undue burdens. Focused on reducing the friction between analysts and their tools, SCOT enables analysts to document and share their research and response efforts in near real time. Automatically identifying indicators and correlating those indicators, SCOT helps analysts discover and respond to advanced threats.

Bruner, Todd↗
DOE OSTI2018

Forming IDEAS: Interactive Data Exploration & Analysis System

Modern cyber security operations collect an enormous amount of logging and alerting data. While analysts have the ability to query and compute simple statistics and plots from their data, current analytical tools are too simple to admit deep understanding. To detect advanced and novel attacks, analysts turn to manual investigations. While commonplace, current investigations are time-consuming, intuition-based, and proving insufficient. Our hypothesis is that arming the analyst with easy-to-use data science tools will increase their work efficiency, provide them with the ability to resolve hypotheses with scientific inquiry of their data, and support their decisions with evidence over intuition. To this end, we present our work to build IDEAS (Interactive Data Exploration and Analysis System). We present three real-world use-cases that drive the system design from the algorithmic capabilities to the user interface. Finally, a modular and scalable software architecture is discussed along with plans for our pilot deployment with a security operation command.

Bridges, Robert↗
DOE OSTI2018

Toward a Multimodal-Deep Learning Retrieval System for Monitoring Nuclear Proliferation Activities

As the amount of available data increases, the human ability to locate, process, and analyze it is strained and eventually overwhelmed. To address this challenge for nonproliferation analysts, the authors have been creating a large-scale multimodal retrieval system to help analysts triage and search open source science, technology, and news data for indicators of nuclear proliferation capabilities and activities. The system relies on a set of deep neural networks (DNNs) trained to evaluate conceptual similarities across data modalities, such as text, image, and video. These DNNs can be used to search and prioritize data, according to a nuclear fuel cycle (NFC) process template, that are conceptually closest to the seed query items regardless of data modality. The DNNs have been trained to map conceptually related words, sentences, and images to nearby points in a multimodal feature space, enabling intra- and intermodal retrieval via nearest-neighbor calculations to seed query points. The authors evaluate the system’s ability to retrieve NFC-related data that have been purposely hidden in collections of unrelated background data. They demonstrate quantitative and qualitative results for text-to-image, image-to-image, and image-to-video retrievals. This paper discusses data challenges confronting nonproliferation analysts, describes the DNNs designed to retrieve multimodal data that are proximal in the semantic space, and demonstrates their effectiveness by applying the DNNs to nonproliferation-specific multimodal data sets.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2017

Deep Learning for Unsupervised Insider Threat Detection in Structured Cybersecurity Data Streams

Situational awareness data is a prototypical example of structured heterogeneous streaming data with asynchronous timing that can quickly scale beyond the cognitive power of a human analyst. We present deep learning methods that can train in real time from unlabeled streams and provide probabilistic anomaly scores. We compare our novel deep and recurrent neural network models to three baseline systems using threat detection recall on the CERT Insider Threat Dataset v6.2. In our experiments, our deep neural network and our recurrent neural network systems outperformed all baselines, and we found that using aggregated activity count features yielded the best performance. Our best model produces on average an anomaly score of 95.53 percentile for the day, suggesting it can facilitate a great reduction in analyst workload. Our models are also interpretable, in that they break down the anomaly score into individual features of user behavior, which could further aid analysts in reviewing potential cases of insider threat.

Tuor, Aaron R.↗
DOE OSTI2018

Quantifying the Contribution of Individual Display Features on Mental Workload to Support Human-System Interface Design in Nuclear Power Plants

Abstract. The integration of new digital instrumentation and control (I&C) technologies like advanced human-system interfaces in U.S. nuclear power plant main control rooms is important for addressing long-term aging and obsolescence of existing I&C. Nonetheless, attention should be made to ensure these technologies reflect state-of-the-art human factors engineering (HFE) principles. Often, there is conflicting guidance from one guideline to another, requiring the analyst to make a judgment call on addressing these 'tradeoffs.' The objective of this research was to inform the analyst of these tradeoffs through an empirical investigation of how certain display features that characterize common HFE guidelines concerning visual clutter and saliency influence information processing in a naturalistic context. By understanding the unique contribution of each display feature using a multilevel model, the HFE analyst should have an understanding of the interrelations of each feature with its impact on cognitive processes. Results and implications are discussed in this paper.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2020

A Visual Analytics Framework for Reviewing Streaming Performance Data

Understanding and tuning the performance of extreme-scale parallel computing systems demands a streaming approach due to the computational cost of applying offline algorithms to vast amounts of performance log data. Analyzing large streaming data is challenging because the rate of receiving data and limited time to comprehend data make it difficult for the analysts to sufficiently examine the data without missing important changes or patterns. To support streaming data analysis, we introduce a visual analytic framework comprising of three modules: data management, analysis, and interactive visualization. The data management module collects various computing and communication performance metrics from the monitored system using streaming data processing techniques and feeds the data to the other two modules. The analysis module automatically identifies important changes and patterns at the required latency. In particular, we introduce a set of online and progressive analysis methods for not only controlling the computational costs but also helping analysts better follow the critical aspects of the analysis results. Finally, the interactive visualization module provides the analysts with a coherent view of the changes and patterns in the continuously captured performance data. Through a multi-faceted case study on performance analysis of parallel discrete-event simulation, we demonstrate the effectiveness of our framework for identifying bottlenecks and locating outliers.

Human-centered computing↗
DOE OSTI2025

Verification of the Uniformly-Ordered Binary Decision Algorithm in Correlated-Benchmark Whisper Calculations

Whisper is a nuclear criticality safety code package that aids analysts in validation exercises by computing upper subcritical limits (USL) for applications of interest. To obtain statistically meaningful, significant, and conservative USLs, the analyst must ensure that Whisper selects a sufficient number of benchmarks that are neutronically similar to the application. Many of the available benchmarks are correlated but are currently treated as independent, leading to an artificially small sample size, as their individual information contributions will be overestimated. To aid the analyst in obtaining a sufficient sample size, prior work [2] demonstrated application of the Uniformly-Ordered Binary Decision (UOBD) algorithm in adjusting benchmark weights to account for benchmark correlations. This work provides verification of the Whisper implementation and considers the impact of updated benchmark correlations compared to those available previously. We demonstrate that the UOBD algorithm performs as expected with an analytic example. With HEU-SOL-THERM-001 cases 1 through 10 as the applications, we compare the USLs computed with benchmark correlations available in the Whisper 1.1 release only to those computed with additional benchmark correlations from DICE 2023 and demonstrate substantive differences.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2017

Web-based visual data exploration for improved radiological source detection

Radiation detection can provide a reliable means of detecting radiological material. Such capabilities can help to prevent nuclear and/or radiological attacks, but reliable detection in uncontrolled surroundings requires algorithms that account for environmental background radiation. The Berkeley Data Cloud (BDC) facilitates the development of such methods by providing a framework to capture, store, analyze, and share data sets. In the era of big data, both the size and variety of data make it difficult to explore and find data sets of interest and manage the data. Thus, in the context of big data, visualization is critical for checking data consistency and validity, identifying gaps in data coverage, searching for data relevant to an analyst's use cases, and choosing input parameters for analysis. Downloading the data and exploring it on an analyst's desktop using traditional tools are no longer feasible due to the size of the data. This study describes the design and implementation of a visualization system that addresses the problems associated with data exploration within the context of the BDC. Finally, the visualization system is based on a JavaScript front end communicating via REST with a back end web server.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2024

In the nuclear explosion monitoring context, what is an anomaly?

Abstract In the early years of nuclear explosion monitoring, experts used downwind detections with meaningful ratios of radioactive species to identify an explosion. Today’s reality is sparse networks of radionuclide monitoring stations looking for weak signals. Analysts need to discriminate between industrial background radioactivity and nuclear explosion signals, even using the detection of one isotope. Aerosol and xenon measurements potentially related to nuclear tests in 2006 and 2013 announced by the Democratic People’s Republic of Korea and from worldwide civilian background radioactivity are considered when defining radionuclide detection anomalies to objectively guide the use of limited analyst resources and reduce the possibility of not detecting nuclear explosions.

Miley, Harry S.↗
DOE OSTI2015

Compositional analysis of biomass reference materials: Results from an interlaboratory study

Biomass compositional methods are used to compare different lignocellulosic feedstocks, to measure component balances around unit operations and to determine process yields and therefore the economic viability of biomass-to-biofuel processes. Four biomass reference materials (RMs NIST 8491–8494) were prepared and characterized, via an interlaboratory comparison exercise in the early 1990s to evaluate biomass summative compositional methods, analysts, and laboratories. Having common, uniform, and stable biomass reference materials gives the opportunity to assess compositional data compared to other analysts, to other labs, and to a known compositional value. The expiration date for the original characterization of these RMs was reached and an effort to assess their stability and recharacterize the reference values for the remaining material using more current methods of analysis was initiated. We sent samples of the four biomass RMs to 11 academic, industrial, and government laboratories, familiar with sulfuric acid compositional methods, for recharacterization of the component reference values. In this work, we have used an expanded suite of analytical methods that are more appropriate for herbaceous feedstocks, to recharacterize the RMs’ compositions. We report the median values and the expanded uncertainty values for the four RMs on a dry-mass, whole-biomass basis. The original characterization data has been recalculated using median statistics to facilitate comparisons with this data. We found improved total component closures for three out of the four RMs compared to the original characterization, and the total component closures were near 100 %, which suggests that most components were accurately measured and little double counting occurred. Here, the major components were not statistically different in the recharacterization which suggests that the biomass materials are stable during storage and that additional components, not seen in the original characterization, were quantified here.

09 BIOMASS FUELS↗
DOE OSTI2019

High-Resolution Mass Spectrometry Quantification: Impact of Differences in Data Processing of Centroid and Continuum Data

High-resolution mass spectrometry (HRMS) in full scan mode acquires all ions present in the sample of interest offering a lot of qualitative information. This, in combination with the improved performance of the new generation HRMS systems, triggers more (bio) analysts to switch from triple quad MS systems to HRMS for quantitative analysis. Quantitative processing of HRMS data is performed based on narrow mass extraction windows rather than on nominal mass product ion chromatograms (SRM or MRM). Optimal processing of HRMS data requires different considerations and software tools and can have an impact on data processing and final results. The selection of centroid versus continuum/profile data for processing, selection of the optimal narrow mass extraction window, using theoretical versus measured accurate mass for the extraction of the ion chromatograms as well as differences in calculations and data handling residing in the different vendor software packages are tackled in the presented manuscript. These differences are illustrated on HRMS data acquired for the same plasma samples on three different platforms, i.e., a Sciex QToF, a Waters QToF, and a Thermo Orbitrap system, and processed in four different software packages, i.e., Sciex Analyst® TF, Waters Masslynx, Waters Unifi, and Thermo Xcalibur. The impact of these differences on quantitative HRMS performance was evaluated on calibration curves of eight small molecule compounds in plasma using four different ways of processing. Simple guidelines are provided for the selection of an optimal mass extraction window for continuum and centroided data. .

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

Recovery of DNA from fired and unfired cartridge casings: comparison of two DNA collection methods

For over 10 years, various studies have attempted to increase the recovery of DNA from ammunition by modifying the DNA collection, extraction, purification, and amplification procedures, with varying levels of success. This study focused on the “soaking” method of Montpetit & O’Donnell [1] and the “rinse-and-swab" method of Bille et al. [2]. First, testing for the presence of exogenous DNA, 210 boxed cartridges (brass, steel, and nickel-plated) from nine manufacturers were swabbed and DNA was extracted, concentrated, and quantified. Extracts that quantified > 0 ng/µL (44 of 210) were amplified and genotyped with GlobalFiler™. Of those, only one extract yielded two alleles indicating that the manufacturing and packaging of ammunition was virtually DNA free. Next, to obtain a baseline comparison of two DNA collection methods on a non-metallic substrate and identify a suitable number of cells to spot on cartridges, different DNA input amounts of primary human adult epidermal keratinocytes (HEKa) were tested. Thereafter, 300 brass and 300 nickel-plated, cartridges were spotted with HEKa cells containing ~5 ng of DNA, fired or unfired, and processed with either method. Finally, five methods representing hybrids of the soaking and rinse-and-swab methods were tested to determine if variations of those methods could be used to increase DNA yield and recovery. The results show that the soaking method consistently yielded more DNA than the rinse-and-swab method from a non-metallic substrate. However, the comparison study demonstrated that both methods performed comparably for cartridges. On average, the soaking method recovered 0.25 ng of DNA (5.1% recovery) and the rinse-and-swab method recovered 0.28 ng (5.8% recovery). However, average recoveries were significantly different among three analysts and considerable variation in yields were observed, possibly due to storage time. Furthermore, consistent with prior reports, the DNA recovered from brass casings was only 16% of that recovered from nickel-plated casings and the average yield of DNA from fired casings was reduced to 67% of unfired casings. Moreover, DNA extracts from brass or nickel-plated casings did not appear to contain amplification inhibitors and only 30/596 appeared severely degraded. Finally, both the published rinse-and-swab and soaking methods yielded more DNA than all modifications of the two methods. Overall, both methods yielded equivalent DNA quantities. Additionally, recovery of DNA from any given cartridge casing may be dependent on storage time as well as the skill, proficiency, and experience of the analyst and may reflect stochastic effects, particularly for casings containing low copy and/or degraded DNA.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2012

Integration of facility modeling capabilities for nuclear nonproliferation analysis

Developing automated methods for data collection and analysis that can facilitate nuclear nonproliferation assessment is an important research area with significant consequences for the effective global deployment of nuclear energy. Facility modeling that can integrate and interpret observations collected from monitored facilities in order to ascertain their functional details will be a critical element of these methods. Although improvements are continually sought, existing facility modeling tools can characterize all aspects of reactor operations and the majority of nuclear fuel cycle processing steps, and include algorithms for data processing and interpretation. Assessing nonproliferation status is challenging because observations can come from many sources, including local and remote sensors that monitor facility operations, as well as open sources that provide specific business information about the monitored facilities, and can be of many different types. Although many current facility models are capable of analyzing large amounts of information, they have not been integrated in an analyst-friendly manner. This paper addresses some of these facility modeling capabilities and illustrates how they could be integrated and utilized for nonproliferation analysis. The inverse problem of inferring facility conditions based on collected observations is described, along with a proposed architecture and computer framework for utilizing facility modeling tools. After considering a representative sampling of key facility modeling capabilities, the proposed integration framework is illustrated with several examples.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗