DOE OSTI · 2420484
Towards Auto-Generated Data Systems
Abstract
After decades of progress, database management systems (DBMSs) are now the backbones of many data applications that we interact with on a daily basis. Yet, with the emergence of new data types and hardware, building and optimizing new data systems remain as difficult as the heyday of relational databases. In this paper, we summarize our work towards automating the building and optimization of data systems. Drawing from our own experience, we further argue that any automation technique must address three aspects: user specification, code generation, and result validation. We conclude by discussing a case study using videos data processing, along with opportunities for future research towards designing data systems that are automatically generated.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Cheung, Alvin, Ahmad, Maaz Bin Safeer, Haynes, Brandon, Kittivorawong, Chanwut, Laddad, Shadaj, Liu, Xiaoxuan, Wang, Chenglong, Yan, Cong. 2023-08-01. Towards Auto-Generated Data Systems. https://doi.org/10.14778/3611540.3611635
Cite the original work for its findings. Save a collection to share your selection of sources.