What is NewSQL?

NewSQL (pronounced new ess-cue-ell or new sequel) is a relational database management system (RDMS) that aims to provide NoSQL system scalability while also maintaining the consistency of a traditional database system.

NewSQL combines ACID (atomicity, consistency, isolation and durability) compliance with horizontal scaling for online transaction processing workloads. Enterprise systems that handle data, such as financial and order processing systems, are too big for a traditional relational database. At the same time, these enterprise systems aren’t practical for NoSQL systems because they have transactional and consistency requirements. NewSQL provides the scale and reliability without requiring more infrastructure or development expenditures.

NewSQL uses SQL to ingest new information, execute transaction processing at a large scale, and change the contents of the database. The main categories of NewSQL include new architectures, transparent sharding middleware, SQL engines and database as a service (DBaaS).

Key Features of NewSQL

NewSQL databases incorporate several key features that make them stand out in the data management landscape, especially when compared to traditional relational database management systems (RDBMS) and NoSQL databases. Here are the core features that define NewSQL systems:

SQL Compatibility with Scalability and Performance

NewSQL systems are designed to retain the use of SQL, the structured query language widely used in traditional databases, while overcoming the performance and scalability limitations of conventional SQL databases. NewSQL systems introduce distributed, scalable architectures, often referred to as a shared-nothing architecture, which allows for horizontal scaling. This means that as data volumes grow, NewSQL databases can efficiently distribute workloads across multiple nodes without sacrificing SQL functionality.

ACID Compliance

ACID properties—atomicity, consistency, isolation, and durability—are crucial for ensuring reliable transaction processing in databases. Unlike NoSQL databases, which often relax ACID compliance in favor of scalability and flexibility, NewSQL systems maintain full ACID guarantees, even in distributed environments. This allows NewSQL systems to offer the consistency and transactional integrity of traditional SQL databases while meeting modern scalability demands.

Distributed, Shared-Nothing Architecture

NewSQL databases typically adopt a distributed system architecture to improve scalability and availability. The shared-nothing model ensures that there is no single point of contention between nodes, making these databases ideal for handling big data workloads and maintaining high availability. By partitioning data across many servers, NewSQL systems provide fault tolerance and the ability to scale out seamlessly as the dataset grows.

High Availability and Fault Tolerance

Many NewSQL databases are designed with high availability and fault tolerance in mind. They use mechanisms such as replication and automatic failover to ensure that data is accessible at all times, even in the event of hardware or network failures. Systems like Google Spanner exemplify this by providing geographically distributed databases that ensure data is always available, even across data centers.

Improvements over Traditional Relational Databases

NewSQL addresses the primary performance and scalability challenges of traditional relational databases. While relational databases offer strong consistency, they often struggle with horizontal scalability, making them less suitable for modern, high-velocity workloads. NewSQL resolves this by combining the transactional integrity of relational databases with the ability to scale across distributed systems.

Comparison of Key Features

Comparison of NewSQL vs. SQL and NoSQL

When discussing NewSQL, it's important to understand its position between traditional SQL databases and the newer NoSQL systems. Each of these database types offers distinct advantages and disadvantages, depending on the workload and business needs.

NewSQL vs. SQL

NewSQL retains many core features of traditional SQL databases, such as SQL support and ACID compliance. However, NewSQL improves upon SQL databases by providing:

• Scalability: Traditional SQL databases, while powerful, typically struggle to scale horizontally, which limits their ability to handle large volumes of data across distributed systems. NewSQL overcomes this with distributed architectures that allow horizontal scaling across nodes.

• Performance: NewSQL databases enhance performance, especially in high-traffic environments where online transaction processing (OLTP) is critical. Systems like Google Spanner demonstrate how NewSQL can combine the reliability of traditional SQL with modern performance needs.

• Fault tolerance: NewSQL is built with high availability in mind. Through mechanisms such as replication and automatic failover, it provides better data durability and fault tolerance than traditional SQL systems.

Table: Comparison of NewSQL, SQL, and NoSQL

Use Cases for NewSQL Databases

NewSQL databases are particularly valuable in scenarios that require the performance and scalability of NoSQL systems but without sacrificing transactional guarantees and data consistency. Below are some common use cases for NewSQL:

• High-Volume Transactional Applications: Systems with massive user bases, such as e-commerce platforms, often need to handle thousands or millions of transactions per second. Traditional relational databases often struggle to scale for these demands. NewSQL systems like Google Spanner and VoltDB excel here due to their ability to scale horizontally while maintaining ACID properties.

• Real-Time Analytics: Big data analytics systems that rely on real-time transaction processing benefit from NewSQL’s efficient handling of both reads and writes. This includes applications like financial trading platforms, which need instantaneous updates without compromising on data consistency.

• Hybrid Applications: Systems that combine elements of OLTP and OLAP, such as customer relationship management (CRM) platforms or IoT applications, benefit from the ability of NewSQL to support complex, mixed workloads with both transactional and analytical requirements.

• Distributed Applications: NewSQL shines in geographically distributed systems where consistency and partition tolerance are critical. For instance, global SaaS providers or cloud applications that serve users in multiple regions can benefit from NewSQL's capability to provide distributed SQL across various locations while ensuring low latency.

NewSQL systems provide robust performance and reliability across diverse data management scenarios, especially where high throughput and distributed consistency are required.

Use Cases of NewSQL

NewSQL databases are designed to handle the transactional workloads of modern applications that require scalability without sacrificing the consistency and reliability of traditional SQL databases. Below are key use cases where NewSQL systems excel:

1. Real-Time Analytics NewSQL systems can process large volumes of real-time data, making them ideal for analytics platforms that require low-latency and high-throughput processing. Businesses rely on real-time analytics to make immediate data-driven decisions, a necessity in sectors like ad tech and telecommunications.

2. E-commerce Platforms E-commerce platforms involve vast amounts of user activity, including product searches, purchases, and inventory management, all of which require efficient handling of transactions and query processing. NewSQL provides the necessary scalability and ACID compliance for smooth operation during high-demand periods.

3. Financial Transactions Financial services require the highest level of data integrity and transactional reliability, particularly for operations like payment processing, fund transfers, and fraud detection. The ACID guarantees and distributed architecture of NewSQL ensure accuracy and availability.

High-throughput, Low-latency Applications Applications like online gaming, social networks, and IoT platforms demand systems capable of processing high volumes of queries with low-latency responses. NewSQL's ability to handle distributed, large-scale workloads while maintaining performance makes it a strong fit for these environments.

Related Articles:

• Glossary: real time database

• Trend-Setting Products in Data and Information Management for 2018