Engineering Papers⌕ Search

Engineering topics

Louis, Joseph

Publications and source records attributed to Louis, Joseph.

Automated Assembly Progress Monitoring in Modular Construction Factories Using Computer Vision-Based Instance Segmentation

Modular construction has recently gained interest as a transformative construction method. In this method, a large portion of the construction is performed inside factories, where processes are fast-paced and interdependent; therefore, any deviation from the schedule can delay the production. Such deviations are frequent in modular factories due to the labor-intensive nature of the tasks. This propagation of delays can be mitigated by continuously monitoring each process; however, current manual monitoring methods are laborious, and recently proposed contact sensor-based methods are intrusive to the work. In addition, recent computer vision-based monitoring methods inside factories are limited to detection algorithms that fail to provide the pixel-level accuracy required for assembly progress monitoring in highly occluded factory scenes, and they require a large number of manual annotations. Therefore, this paper proposes a method to monitor the installation of subassemblies in modular construction factories using mask R-CNN instance segmentation and improves the data efficiency of the model using a copy-paste augmentation method. This method was validated on the CCTV videos captured from a modular construction factory in the US, resulting in a 9% mAP improvement in segmentation.

computer vision↗

Bottleneck Detection in Modular Construction Factories Using Computer Vision

The construction industry is increasingly adopting off-site and modular construction methods due to the advantages offered in terms of safety, quality, and productivity for construction projects. Despite the advantages promised by this method of construction, modular construction factories still rely on manually-intensive work, which can lead to highly variable cycle times. As a result, these factories experience bottlenecks in production that can reduce productivity and cause delays to modular integrated construction projects. To remedy this effect, computer vision-based methods have been proposed to monitor the progress of work in modular construction factories. However, these methods fail to account for changes in the appearance of the modular units during production, they are difficult to adapt to other stations and factories, and they require a significant amount of annotation effort. Due to these drawbacks, this paper proposes a computer vision-based progress monitoring method that is easy to adapt to different stations and factories and relies only on two image annotations per station. In doing so, the Scale-invariant feature transform (SIFT) method is used to identify the presence of modular units at workstations, and the Mask R-CNN deep learning-based method is used to identify active workstations. This information was synthesized using a near real-time data-driven bottleneck identification method suited for assembly lines in modular construction factories. This framework was successfully validated using 420 h of surveillance videos of a production line in a modular construction factory in the U.S., providing 96% accuracy in identifying the occupancy of the workstations and an F-1 Score of 89% in identifying the state of each station on the production line. The extracted active and inactive durations were successfully used via a data-driven bottleneck detection method to detect bottleneck stations inside a modular construction factory. The implementation of this method in factories can lead to continuous and comprehensive monitoring of the production line and prevent delays by timely identification of bottlenecks.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

The Energy in Modular (EMOD) Buildings Method: A Guide to Energy-Efficient Design for Industrialized Construction of Modular Buildings

Industrialized construction has immense potential to address the growing need globally to build and upgrade the building stock to be affordable, energy-efficient, and resilient. It can also help achieve the United States' goal of a 50% reduction in U.S. greenhouse gas (GHG) emissions by 2030. Despite this potential, and the ever-increasing push for electrification and decarbonization of households in the United States, industrialized construction has not yet been leveraged specifically to help address these challenges and accelerate the pathway to meet these goals. The National Renewable Energy Laboratory (NREL) aims to claim this missed opportunity by focusing on delivering affordable, grid-efficient net-zero energy (NZE) modular buildings for underserved communities to ensure an equitable transition to the future of clean energy, accelerate decarbonization of the built environment, and support the development of a high-productivity construction and energy efficiency workforce. The Energy in Modular (EMOD) method is our approach to designing, producing, and delivering affordable, net-zero energy, low-carbon, and healthier buildings at scale. The following energy efficiency strategies are part of the scope of this guide: envelope thermal control, envelope infiltration control, mechanical, electrical, and plumbing systems, smart controls, and solar plus storage. We draw synergies between design for manufacturing and assembly, process optimization, retrofit technologies, and digitization. Our goal is to influence the improvement and production of buildings to increase performance, enhance energy efficiency, and reduce GHG emissions. This guide documents the research and development efforts initiated by a set of design objectives to "modularize" a set of energy efficiency and low-carbon strategies into a housing unit while preserving and enhancing energy efficiency benefits and decarbonization pathways. This guide is intended to serve as a framework for housing developers, housing agencies, architects, energy experts, and process engineers or factory operator personnel who are critical to today's modular builder teams. This guide focuses on specific energy efficiency strategies, decarbonization pathways, and associated processes as part of NREL's research efforts. Stakeholders may substitute other means, methods, and technologies for the ones evaluated in this study.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Identifying Modular Construction Worker Tasks Using Computer Vision

Modular construction is increasingly being seen as an attractive method for delivering building projects due to advantages in safety, quality, and lead-time. Despite these benefits, this method still relies heavily on human labor, which causes variability in factory assembly-line performance that can erode performance benefits of modular construction. Continuous improvement methods can alleviate some of these issues, but they also require continuous monitoring of human workers' performance. Due to limitations of manual time study and automated sensor-based monitoring methods, recently computer vision-based methods have gained momentum in identifying the activities of construction workers from the videos of onsite construction. Therefore, this paper explores the use of computer vision-based human activity recognition techniques to identify and classify worker activities in modular construction videos. Computer vision-based tracking method has been used to track the human workers in each frame, and Resnet-50 network has been used to classify the activity of tracked workers. Evaluation of this framework has achieved higher than 90% accuracy and recall in testing.

computer vision↗

Tracking Volumetric Units in Modular Factories for Automated Progress Monitoring Using Computer Vision

The construction industry is increasingly adopting off-site and prefabricated methods due to advantages offered in safety, quality, and lead time. Applying industrialized methods for plant management in offsite construction factories requires the collection of large volumes of production process data, which is a tedious task when performed manually. Recent attempts to automate this process have relied on sensor-based data collection methods which are susceptible to noise, expensive, and difficult to validate. Computer vision methods, however, enable process data collection from videos without the limitations of the other sensor-based methods. This technology has not been applied for offsite construction except in very few instances and therefore, this study proposes a novel method to reliably collect the production process data using computer vision method in near real-time from widely used surveillance cameras in offsite construction. The proposed method allows the user to annotate the workstations of interest on the video as ground truths and process these areas throughout the entire video to track the units entering and leaving stations, while continuously updating a near real-time schedule of the production line. This framework was validated by implementing on the surveillance videos of the production process of modular home manufacturing in a factory. The results consistently provided 100% accuracy, after denoising, for all the videos processed including 60 h of work for a station. The developed method enables real-time tracking of station performance, which can enable continuous improvement methods for factory management and resource allocation.

computer vision↗

Development of Integrated Mechanical Pods

This presentation highlights early wins, updated progress, and upcoming developments on ‘national-scale shared development platform’ for rapid prototyping, testing and validation of various integrated Mechanical Pod solutions and form factors. Such pod solutions consist of a set of all-electric heat pump mechanical equipment that have integrated functionalities through built-in controls, with heating, cooling, hot water, ventilation (including energy recovery), electrical management, and battery storage within a single package. The presentation draws inspiration from the success of bathroom pods in the US modular construction industry, UK’s efforts with unitizing mechanical systems as ‘utility cupboards’, and VEIC’s early wins in design-build of all-electric Mechanical Pod solutions in Vermont. The presentation includes researchers and partners involved with NREL in Design for Manufacturing and Assembly (DfMA), Virtual Design and Construction (VDC), and digital twin based process optimization modeling of integrated Mechanical Pod solutions. The presentation aims to highlight early wins from such a platform and how various physical and virtual tools are currently being employed as part of NREL’s ongoing multi-year project funded by US DOE. Streamlined procurement, coordination, installation, and O&M of Mechanical Pods such that the majority of work is delegated to the off-site modular factory implies monetary savings. Such a seemingly basic shift in location of the construction process leads to great reduction in complexity, first cost, lead time, and waste, and greater opportunities for innovative compartmentalization and integration of mechanical systems appropriately sized for each apartment or hotel guest room. However, past studies on unitized combination systems show that high installation costs, maintenance issues, challenges with system integration, limitations in existing electrical infrastructure, and lack of architecturally appealing solutions are key barriers. NREL and partners aim to address key barriers through DfMA approach, rapid prototyping and testing, and digital twin process optimization modeling. The presentation is also a call for interested entities to partner with NREL as part of the national-scale development platform, help drive both product and process innovation, and encourage open source sharing of learnings. Learning objectives include (1) learn about the vision of national-scale shared development platform for process-product innovation on integrated mechanical pod solutions and how to get involved, (2) gain an understanding of the components of an all-electric, high performance home, design characteristics and equipment included in an all-electric mechanical pod, integration of mechanical systems within a modular factories’ assembly line, and the system’s commissioning, operation and maintenance. The pre-planning and coordination with the factory and sub-contractors are also highlighted, (3) gain an understanding of using process modeling tools to quantify resource-constrained performance of operations (such as integration of energy efficiency strategies) to manufacture modules of varying design, (4) gain insights on virtual design, rapid prototyping, and emulated testing of various form factors across different climatic conditions. The need for such preliminary testing with open source sharing of learnings will also be highlighted.

30 DIRECT ENERGY CONVERSION↗

Integrating Energy Efficiency Strategies with Industrialized Construction for Our Clean Energy Future: Preprint

NREL’s Industrialized Construction Innovation Team has developed an ambitious plan to accelerate the integration of energy efficiency (EE) strategies with Industrialized Construction (IC). The United States (U.S.) construction industry is beginning to use IC methods to build multifamily apartment buildings to address affordability and labor shortages. Apart from reducing cost of construction and delivery times, the IC method of permanent modular construction has the potential to facilitate the integration of a wide range of EE strategies and advanced controls into such buildings. While there may be unintended EE benefits to IC such as a tighter envelope due to higher construction quality, the process has not been leveraged specifically to enhance EE. NREL aims to claim this missed opportunity and integrate IC benefits with EE as well as advanced controls, distributed energy resources, and grid-friendly design strategies. The paper proposes an ‘IC Assessment Framework’ to achieve affordable zero-energy modular multifamily buildings. Through the selection criteria of Design for Manufacturing and Assembly, the framework aims to distill a broad range of proven EE strategies for site-built into a set of strategies that qualify as easy to integrate for off-site. The output is a Factory Information Model (FIM) that represents a process-based digital twin to enable advanced time-and-motion study, plugs into open source building energy modeling platform (EnergyPlus), and serves as a vital tool facilitating wider adoption of EE integration. Conclusively, the paper delineates next steps for upcoming pilots with NREL’s IC partners towards developing a transformational pathway for our Clean Energy Future.

30 DIRECT ENERGY CONVERSION↗