Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “BIG SCIENCE”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

Federated Cloud Challenges in NASA's Earth Science Data Systems (Why So Difficult?)

NASA is presented with a number of opportunities and challenges in federating its Earth Science Data Systems in the burgeoning world of cloud computing. Cloud hosting of Earth Science data provides a new way of bringing data together, at least from a virtual location sense, and is one of the main motives for NASA to host data there. However, NASA is also faced with a Big Data Variety challenge, brought on by the variety of the EO datasets in its archives. This diversity requires many diverse science archives to service the different science communities. As a result, nearly every major function in the Earth Observing System Data and Information System (EOSDIS) must also be federated across its data centers. This pattern is repeated with many of the outside agencies and organizations that EOSDIS federates with, such as the Committee for Earth Observing Satellites, leading to pioneering work on "deep federation" in a joint project with the European Space Agency to develop a Multi-Mission Algorithm and Analysis Platform.

Lynnes, Christopher↗

Big data for ecologists: Highlighting the ORNL DAAC

Ecologists are increasingly confronted by questions that can be addressed only by integrating data from numerous sources, often across large geographic areas and broad time periods. The supply of ecological big data is increasing at a rapid pace as researchers are publishing their data sets and large, public science and data infrastructures (such as NEON, DataONE, LTER, & NCEAS) are producing and curating extensive volumes of complex data and metadata. While supply of, and demand for, ecological data is on the rise, many ecologists now face a new challenge in locating and synthesizing the data relevant for their particular question. Here we highlight selected popular big data products applicable to ecological research available from the NASA Distributed Active Archive Center (DAAC) located at Oak Ridge National Laboratory (ORNL).

Boyer, Alison G↗

Trace: a high-throughput tomographic reconstruction engine for large-scale datasets

Abstract Background Modern synchrotron light sources and detectors produce data at such scale and complexity that large-scale computation is required to unleash their full power. One of the widely used imaging techniques that generates data at tens of gigabytes per second is computed tomography (CT). Although CT experiments result in rapid data generation, the analysis and reconstruction of the collected data may require hours or even days of computation time with a medium-sized workstation, which hinders the scientific progress that relies on the results of analysis. Methods We present Trace, a data-intensive computing engine that we have developed to enable high-performance implementation of iterative tomographic reconstruction algorithms for parallel computers. Trace provides fine-grained reconstruction of tomography datasets using both (thread-level) shared memory and (process-level) distributed memory parallelization. Trace utilizes a special data structure called replicated reconstruction object to maximize application performance. We also present the optimizations that we apply to the replicated reconstruction objects and evaluate them using tomography datasets collected at the Advanced Photon Source. Results Our experimental evaluations show that our optimizations and parallelization techniques can provide 158× speedup using 32 compute nodes (384 cores) over a single-core configuration and decrease the end-to-end processing time of a large sinogram (with 4501 × 1 × 22,400 dimensions) from 12.5 h to <5 min per iteration. Conclusion The proposed tomographic reconstruction engine can efficiently process large-scale tomographic data using many compute nodes and minimize reconstruction times.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

ASCR@40

One page flyers on: A Revolution in Modeling and Simulation; Applying Equations to Complex Problems; Uncertainty Quantification; Moving Big Data; Grid Computing for High-Speed Collaboration; Making Sense of Big Data; Overcoming Scaling Challenges; Building Better Computers; World-Leading Computing Facilities; Supporting Science Through Open-Source Software; and Building the Computational Workforce. Content provided by Department of Energy multiprogram laboratory researchers. Prepared by the Krell Institute for the ASCAC Subcommittee on the 40-year History of ASCR.

97 MATHEMATICS AND COMPUTING↗

NASA Pilot-Engaged Expert Response Using IBM Watson Technology: Prototype Evaluation of Knowledge Retrieval System

NASA Langley Research Center and IBM have been investigating the use of IBM Watson technology in aerospace research and development. One application of Watson technology is the Pilot-Engaged Expert Response (PEER) use case. The PEER system is envisioned as an in-cockpit advisor that will act as a source of situationally-relevant information for pilots and other flight crew members to assist in decision making about real-time events and situations that arise in the course of aircraft operations. PEER will make available vast stores of knowledge and information quickly and directly, putting important informational resources where they are needed most. IBM has worked with NASA to develop an architecture and articulate a roadmap for the development of the PEER system. That vision is built around Watson Discovery Advisor (WDA) software solution, derived from IBM's Jeopardy!-winning automatic question answering system. PEER makes use of WDA's sophisticated question-answering capabilities as its core, adding important User Interface components and other customizations for the cockpit environment, including communication with flight systems and other external data sources. The development plan for PEER includes four development stages, with the current project constituting the first phase. In this project, a prototype instance of PEER was successfully adapted to the aviation domain, enabling users to ask questions about aviation topics and receive useful and accurate answers to these questions. Major tasks accomplished include the development of procedures for domain adaptation through automatic lexicon extraction from domain glossaries; generation of question-answer training data which was used to train the system; and assessment of the effectiveness of domain adaptation, which showed a dramatic improvement in the ability of the PEER system to answer domain-relevant questions. In addition, the vision for the PEER system was pushed forward by the articulation of a plan for the automatic enhancement of question-answering with contextual information. This initial phase focused on two main goals: 1) the targeted domain adaptation of the underlying WDA system to the aviation domain; and, 2) the design of the software systems needed to leverage flight-contextual data. Domain adaptation of the WDA system proceeds via three main activities: Domain data ingestion, lexical customization and model training. A textual corpus consisting of 1,147 individual documents with more than 7.5 million words of text was ingested into the system and this served as the basis of all further development. A domain lexicon of over 3,500 aviation-domain terms was semi-automatically generated from domain documents and used to train the system. In addition, a set of over 500 question-answer (QA) pairs relevant to the PEER use case was developed; these were used to train and assess the system. These important first steps established the basis for the PEER system. In addition, steps were taken towards the integration of the PEER system into the cockpit environment with the development of a functional design for the Contextual Data Augmentation (CDA) subsystem. This subsystem brings to bear contextual data to improve system responses. It has three main submodules: the Contextual Data Collection module, the Contextual Data Selection module, and the Contextual QA Augmentation module. These modules form a processing pipeline that addresses the problems associated with automatically integrating information from external resources into the knowledge-retrieval mechanism.

Machine learning↗

Big Questions: Missing Antimatter

Einstein's equation E = mc2 is often said to mean that energy can be converted into matter. More accurately, energy can be converted to matter and antimatter. During the first moments of the Big Bang, the universe was smaller, hotter and energy was everywhere. As the universe expanded and cooled, the energy converted into matter and antimatter. According to our best understanding, these two substances should have been created in equal quantities. However when we look out into the cosmos we see only matter and no antimatter. The absence of antimatter is one of the Big Mysteries of modern physics. In this video, Fermilab's Dr. Don Lincoln explains the problem, although doesn't answer it. The answer, as in all Big Mysteries, is still unknown and one of the leading research topics of contemporary science.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

New Era, New Opportunity, Is GES DISC Ready for Big Data Challenge?

The new era of Big Data has opened doors for many new opportunities, as well as new challenges, for both Earth science research/application and data communities. As one of the twelve NASA data centers - Goddard Earth Sciences Data and Information Services Center (GES DISC), one of our great challenges has been how to help research/application community efficiently (quickly and properly) accessing, visualizing and analyzing the massive and diverse data in natural hazard research, management, or even prediction. GES DISC has archived over 2000 TB data on premises and distributed over 23,000 TB of data since 2010. Our data has been widely used in every phase of natural hazard management and research, i.e. long term risk assessment and reduction, forecasting and predicting, monitoring and detection, early warning, damage assessment and response. The big data challenge is not just about data storage, but also about data discoverability and accessibility, and even more, about data migration/mirroring in the cloud. This paper is going to demonstrate GES DISC’s efforts and approaches of evolving our overall Web services and powerful Giovanni (Geospatial Interactive Online Visualization ANd aNalysis Infrastructure) tool into further improving data discoverability and accessibility. Prototype works will also be presented.

Li, A.↗

Kernels for scalable data analysis in science: Towards an architecture-portable future

In this paper, we pose and address some of the unique challenges in the analysis of scientific Big Data on supercomputing platforms. Our approach identifies, implements and scales numerical kernels that are critical to the instantiation of theory-inspired analytic workflows on modern computing architectures. We present the benefits of scalable kernels towards constructing algorithms such as principal component analysis and non-negative matrix factorization on an image-analysis use case at the Oak Ridge Leadership Computing Facility (OLCF). Based on experience with the use-case, we conclude that piecing scalable analytic kernels into user-defined analytic workflows are a flexible, modular and agile way to enable architecture-portable productivity for the data-intensive sciences.

Sukumar, Sreenivas R.↗

Big lunar data visualization and analysis

NASA's earth and planetary spacecraft return large amounts of remote sensing data, such as imagery and raw science measurements, in support of remarkable research. Not only does the data lead to new scientific discoveries about our planet and the solar system, it provides a wealth of information to educate, inspire, and engage the public at large. To leverage this rich data for mission planning, scientific research, public outreach and education, it is essential to make it accessible and understandable, analyzable, all while appealing to their interests. This presentation will highlight web-based capabilities that showcase NASA's large volume of lunar data collected from past and current Moon missions. It is particularly relevant as the new Administration has more plans for the Moon. We will illustrate big data visualization and analysis in easy-touse and interactive mediums for diverse use.

Malhotra, Shan↗

Beyond Einstein: From the Big Bang to Black Holes

How did the Universe begin? Does time have a beginning and an end? Does space have edges? The questions are clear and simple. They are as old as human curiosity. But the answers have always seemed beyond the reach of science. Until now. In their attempts to understand how space, time, and matter are connected, Einstein and his successors made three predictions. First, space is expanding from a Big Bang; second, space and time can tie themselves into contorted knots called black holes where time actually comes to a halt; third, space itself contains some kind of energy that is pull- ing the Universe apart. Each of these three predictions seemed so fantastic when it was made that everyone, including Einstein himself, regarded them as unlikely. Incredibly, all three have turned out to be true. Yet Einstein's legacy is one of deep mystery, because his theories are silent on three questions raised by his fantastic predictions: (1) What powered the Big Bang? (2) What happens to space, time, and matter at the edge of a black hole? (3) What is the mysterious dark energy pulling the Universe apart? The answers to these questions-which lie at the crux of where our current theories fail us-will lead to a profound, new understanding of the nature of time and space. To find answers, however, we must venture beyond Einstein. The answers require new theories, such as the inflationary Universe and new insights in high-energy particle theory. Like Einstein s theories, these make fantastic predictions that seem hard to believe: unseen dimensions and entire universes beyond our own. We must find facts to confront and guide these new theories. Powerful new technologies now make this possible. And NASA and its partners are developing an armada of space-based observatories to chart the path to discovery. Here is where the Beyond Einstein story begins. By exploring the three questions that are Einstein s legacy, we begin the next revolution in understanding our Universe. We plot our way forward using clues from observations and from new ideas connecting the worlds of the very small and the very large, from the atom out through the deepest reaches of the cosmos.

Source record↗

Big Data Analytics for Long-Term Meteorological Observations at Hanford Site

A growing number of physical objects with embedded sensors with typically high volume and frequently updated data sets has accentuated the need to develop methodologies to extract useful information from big data for supporting decision making. This study applies a suite of data analytics and core principles of data science to characterize near real-time meteorological data with a focus on extreme weather events. To highlight the applicability of this work and make it more accessible from a risk management perspective, a foundation for a software platform with an intuitive Graphical User Interface (GUI) was developed to access and analyze data from a decommissioned nuclear production complex operated by the U.S. Department of Energy (DOE, Richland, USA). Exploratory data analysis (EDA), involving classical non-parametric statistics, and machine learning (ML) techniques, were used to develop statistical summaries and learn characteristic features of key weather patterns and signatures. The new approach and GUI provide key insights into using big data and ML to assist site operation related to safety management strategies for extreme weather events. Specifically, this work offers a practical guide to analyzing long-term meteorological data and highlights the integration of ML and classical statistics to applied risk and decision science.

54 ENVIRONMENTAL SCIENCES↗

A Qualitative Readiness-Requirements Assessment Model for Enterprise Big-Data Infrastructure Investment

In the last three decades, there has been an exponential growth in the area of information technology providing the information processing needs of data-driven businesses in government, science, and private industry in the form of capturing, staging, integrating, conveying, analyzing, and transferring data that will help knowledge workers and decision makers make sound business decisions. Data integration across enterprise warehouses is one of the most challenging steps in the big data analytics strategy. Several levels of data integration have been identified across enterprise warehouses: data accessibility, common data platform, and consolidated data model. Each level of integration has its own set of complexities that requires a certain amount of time, budget, and resources to implement. Such levels of integration are designed to address the technical challenges inherent in consolidating the disparate data sources. In this paper, we present a methodology based on industry best practices to measure the readiness of an organization and its data sets against the different levels of data integration. We introduce a new Integration Level Model (ILM) tool, which is used for quantifying an organization and data system s readiness to share data at a certain level of data integration. It is based largely on the established and accepted framework provided in the Data Management Association (DAMA-DMBOK). It comprises several key data management functions and supporting activities, together with several environmental elements that describe and apply to each function. The proposed model scores the maturity of a system s data governance processes and provides a pragmatic methodology for evaluating integration risks. The higher the computed scores, the better managed the source data system and the greater the likelihood that the data system can be brought in at a higher level of integration.

Big data↗

Critical aspects of nano-indentation technique in application to hardened cement paste

Several open questions related to the experimental protocol and processing of data acquired by the nano-indentation (NI) technique are investigated. The volume fractions of mechanically different phases obtained from statistical NI (SNI) analysis are shown to be different from those obtained by back-scattered electron (BSE) image analysis and X-ray diffraction (XRD) method on the same paste. Judging from transmission electron microscope (TEM) images, the representative volume element of low-density calcium-silicate hydrates (C-S-H) can be considered to be around 500 nm, whereas for high-density C-S-H it is about 100 nm. This raises the question how the appropriate penetration depth for NI experiments should be selected. Changing the maximum load from 1 mN to 5 mN, the effect of penetration depth on the experimental results is studied. As an alternative to the SNI method, a 'manual' indentation method is proposed, which combines information from BSE and atomic-force microscopy (AFM), coupled to the NI machine. The AFM allows to precisely indent a high-density C-S-H rim around unhydrated clinkers in cement paste. Yet the results from that technique still show a big scatter.

36 MATERIALS SCIENCE↗

High Performance Data Analytics on a Commodity Private Cloud

Sandia is researching novel methods of analysis for large datasets. The term “Big Data” has been used frequently in recent years to describe a discipline of computer science that attempts to distil an increasing quantity of data into a result or meaningful subset that can be easily visualized and acted upon by human consumers. These data are frequently characterized by one or more of the following: high volume, velocity, variety, and veracity. Sandia scientists and researchers are no strangers to large datasets, which often typify the result of high-performance computing workloads. The challenge for Sandia data scientists, however, comes at the arrival of exascale computing, which has become mandated by executive order for national computing centers. Because of power and networking limitations, exascale computing precludes the movement of datasets at exascale from data production to data analysis. Such analysis must be done in-situ, to mitigate the time and power costs of network transport. Currently, many of Sandia’s data analytics environments exist as independent entities, often specialized for individual use cases, interconnected to other data analytics, high-performance computing, and storage systems. Sandia is procuring, installing, and researching future platforms for such data analytics. A memory footprint of 256 GB per node, fourteen data rate (FDR) InfiniBand networking, PCIe connected non-volatile memory (NVMe) data storage, and an object data store will characterize the coming institutional data analytics platforms. The combined systems will contain 300 compute nodes. A cloud-inspired software stack resulting from collaboration between the Sandia centers will allow the systems to support a flexible mix of user and system-facing workloads and use cases including code development and testing in R and Python, Apache Hadoop and Spark, distributed in-memory databases, graph analytics, emulytics, system log and predictive analytics, and data visualization for institutional and mission customers. These systems will arrive at the end of FY 2015 and production is planned by the spring of FY 2016.

97 MATHEMATICS AND COMPUTING↗

Triton Initiative: FY22 Communications, Outreach, and Engagement End-of-Year Report

The Department of Energy (DOE) Water Power Technologies Office (WPTO) Triton Initiative supports the advancement of the marine energy (ME) industry through environmental monitoring research and technology development. This report presents the results and analysis of the Triton Initiative’s communications, outreach, and engagement (TCOE) efforts in fiscal year 2022. The primary TCOE goals were to: (1) educate and raise awareness of ME and the role of Triton's environmental monitoring research in supporting the industry; (2) build trust with audiences through transparent communications and outreach; and (3) evaluate and refine TCOE tactics based on feedback and metrics. To support these goals, the TCOE team used multiple platforms and approaches. Notable achievements include: (1) 12 newsletter issues sent to 185 subscribers with an average open rate of 56.4%. (2) 10 Triton Stories, resulting in 2,871 collective views contributing to 46% of all Triton website views. (3) 78 Triton-specific social media posts, which generated a total of 81,896 impressions, 1,037 post-clicks, and 7,814 video views. (4) 6,320 Triton website views with increased search engine optimization ranking in several categories. (5) 3 Triton researchers interviewed as guests on two different podcasts, Water Women and Big Deep: An Ocean Podcast. (6) A Triton special issue of the Journal of Marine Science and Engineering (JMSE) featuring 10 peer reviewed publications. All articles ranked in the top 25%, and two in the top 5%, for digital attention of all research outputs scored by Altmetric. (7) A seven-part webinar series called Triton Talks to share and discuss research and results from the research published in the JMSE special issue. Triton leveraged unique opportunities, particularly the JMSE special issue, to disseminate research results to end users, educate stakeholders, and gain valuable feedback. These concerted communication efforts increased exposure across platforms ultimately resulting in greater reach and access across audiences. Based on audience analyses of webinar attendees and newsletter subscribers, the TCOE team was able to successfully engage with general audiences, research partners, and ME stakeholders, including subject matter experts from government agencies, research organizations, and the regulatory community. The TCOE task established channels to gather input and create opportunities for two-way communication with people engaged with Triton’s outreach efforts. The feedback received will enable the TCOE team to support its goals for ongoing evaluation of outreach and engagement tools while continuing to build trust in the ME community and educate diverse audiences about the impactful research conducted by the Triton Initiative. This report is a Triton Initiative Fiscal Year 2022 Quarter 4 Milestone Deliverable due to the DOE WPTO Sponsor on 9/30/2022. An updated version to include data through 9/30/2022 will be delivered in October 2022.

16 TIDAL AND WAVE POWER↗

Arthur C. Clarke - Prophet of the Space Age

Informally known as The Big Three, Arthur C. Clarke, Isaac Asimov, and Robert Heinlein were arguably the most famous science fiction writers of the latter half of the 20th century. Interestingly, they all knew each other, both professionally and personally; Clarke corresponded with the other two regularly for decades. He even had an informal agreement with Asimov, the Clarke-Asimov Treaty, that if asked, they agreed to say that Clarke was the better science fiction writer and Asimov the better science writer. But Clarke was much more than a science fiction writer - he was an engineer, a scientist, a futurist, a humanist, an explorer, and even an educator.

Arthur C. Clarke↗

Achieving Fast Operational Intelligence in NASA's Deep Space Network Through Complex Event Processing

NASA’s Deep Space Network (DSN) is a complex, global project, in which the expertise of human operators remain crucial for its successful operation. To find ways to save costs in operations and to improve its services, a number of modernization efforts are underway in the DSN. One such effort is a research and technology development task at the Jet Propulsion Laboratory that is investigating the use of complex event processing (CEP) for intelligent assessment of situations, trend analysis, and advanced automation. The technology leverages the significant business intelligence (BI) and data science advancements made in the enterprise industries over the last several years. The open source big data processing engine Apache SparkTM and the high-throughput, distributed messaging system Apache Kafka form the core of the DSN Complex Event Processing (DCEP) framework. This paper discusses the system engineering perspective of why achieving efficient, lower-cost operations in the DSN is a challenging problem, how the DCEP system handles the use cases that help realize intelligent operations, and how this solution fits into the overall model of the planned DSN Follow-the- Sun Operations (FtSO).

Choi, Joshua S.↗

Nanoscale Electronic Inhomogeneity in In_2Se_3 Nanoribbons Revealed by Microwave Impedance Microscopy

Driven by interactions due to the charge, spin, orbital, and lattice degrees of freedom, nanoscale inhomogeneity has emerged as a new theme for materials with novel properties near multiphase boundaries. As vividly demonstrated in complex metal oxides and chalcogenides, these microscopic phases are of great scientific and technological importance for research in hightemperature superconductors, colossal magnetoresistance effect, phase-change memories, and domain switching operations. Direct imaging on dielectric properties of these local phases,however, presents a big challenge for existing scanning probe techniques. Here, we report the observation of electronic inhomogeneity in indium selenide (In{sub 2}Se{sub 3}) nanoribbons by near-field scanning microwave impedance microscopy. Multiple phases with local resistivity spanning six orders of magnitude are identified as the coexistence of superlattice, simple hexagonal lattice and amorphous structures with {approx}100nm inhomogeneous length scale, consistent with high-resolution transmission electron microscope studies. The atomic-force-microscope-compatible microwave probe is able to perform quantitative sub-surface electronic study in a noninvasive manner. Finally, the phase change memory function in In{sub 2}Se{sub 3} nanoribbon devices can be locally recorded with big signal of opposite signs.

36 MATERIALS SCIENCE↗