Moore’s Law And The Future Of Big Data
Big Data LDN 2022, 22 Sept, 12:00pm, Data Engineering Theatre
Despite the reports that suggest Moore’s law is slowing down, the specification of the commodity hardware is still growing. Renting machines with hundreds of CPU cores, tens of Terabytes of NVMe drives, and Terabytes of Memory are not difficult nor expensive. However, many popular BigData technologies cannot use such instances efficiently. There are fundamental differences between the server applications designed to be efficient on instances with resource abundance and those written to be efficient in resource scarcity. This talk discusses these differences and the future of big data.
Speaker
Moore’s Law And The Future Of Big Data
Big Data LDN 2022, 22 Sept, 12:00pm, Data Engineering Theatre
Despite the reports that suggest Moore’s law is slowing down, the specification of the commodity hardware is still growing. Renting machines with hundreds of CPU cores, tens of Terabytes of NVMe drives, and Terabytes of Memory are not difficult nor expensive. However, many popular BigData technologies cannot use such instances efficiently. There are fundamental differences between the server applications designed to be efficient on instances with resource abundance and those written to be efficient in resource scarcity. This talk discusses these differences and the future of big data.