From Exascale to Global Sharding: Globally Distributed Exadata Database

In my last post, I explored how Oracle Exadata Exascale redefines cloud data elasticity by intelligently decoupling compute from storage. But what happens when your application’s requirements scale past the boundaries of a single region, demanding global scale, ultra-high resilience, and strict data sovereignty compliance?

For these mission-critical scenarios, Oracle has introduced a natural evolution to its stack: the Oracle Globally Distributed Exadata Database on Exascale Infrastructure.

Understanding Globally Distributed Databases (Sharding)

Managing geographically distributed applications has traditionally forced a painful trade-off between massive operational complexity and performance degradation. The Oracle Globally Distributed Database eliminates this compromise by implementing native sharding directly at the database layer.

In practice, the database behaves as a single logical entity for developers and applications. You write code, run queries, and connect to it just like any standard Oracle Database. Under the hood, however, the data is physically partitioned into multiple independent databases (called shards) distributed across different OCI availability domains or regions worldwide.

To orchestrate this network, Oracle uses a specialized routing tier called the Shard Director (Global Service Manager). When an application sends a request, the Shard Director automatically routes it to the specific shard holding that data. For operations that span multiple locations, the shards communicate securely with each other via internal high-speed network links, using an automated query coordinator to aggregate results and present them as a single, cohesive response.

By adopting this shared-nothing distributed architecture, you gain three fundamental architectural advantages:

  • Fault Isolation and High Availability: Since data is isolated into independent shards, a failure in one region or data center does not take down the entire system. Only the fraction of data in that specific shard is temporarily impacted, while the rest of the global database continues to process requests normally.
  • Linear Horizontal Scalability: Traditional databases hit a scaling ceiling when you try to add more CPU or memory (vertical scaling). With sharding, you can scale horizontally and linearly by simply adding new shards to the pool as your data and user base grow, without any disruption.
  • Geographic Proximity (Low Latency): By placing specific shards closer to where the users are physically located, you drastically reduce network latency. A user in Europe connects directly to a European shard, ensuring near-instantaneous read and write responses.

The Perfect Match: Bringing Exadata and Exascale into the Mix

While sharding solves the geographic distribution problem, running it on standard infrastructure can still introduce bottlenecks in I/O and resource provisioning. This is where the magic happens: by running the Globally Distributed Database on top of Exadata Exascale Infrastructure, you get the best of both worlds—global distribution combined with enterprise-grade performance.

Running this on the new Exascale architecture grants each individual shard unique advantages:

  • True Separation of Compute and Storage: You no longer need to over-provision hardware for each shard. You can independently scale compute and storage resources for each regional shard, paying strictly for what you use under a serverless, pay-per-use model.
  • Low-Latency Exadata Performance: Exascale’s smart technology offloads SQL and AI operations directly to the storage tier. This ensures lightning-fast response times and high throughput, even for complex, globally distributed queries.
  • Raft-Based Replication with Zero Data Loss: To guarantee global survival, the service leverages internal replication built on the Raft consensus protocol. If an entire OCI region goes down, failover is automatic with zero data loss (RPO=0) across the shards.

Seamless Data Sovereignty at the Architectural Layer

One of the most great aspects of this Exadata-based solution is how it tackles Data Residency requirements.

In highly regulated industries like finance and healthcare, compliance frameworks demand that local citizen data remains within national borders. Instead of building isolated databases and attempting to sync them via messy application code, you can define centralized data distribution policies. The intelligent router ensures a specific regional located user’s writes go straight to the OCI shard physically located at that region, handling compliance natively and transparently.

Provisioning the Architecture

The deployment process for the Oracle Globally Distributed Database on OCI strictly requires, as a mandatory initial step, the creation and provisioning of a VM Cluster, which serves as the compute foundation for hosting the distributed database nodes. To meet this requirement, you can choose between an Exascale VM Cluster (within the Exadata Database Service on Exascale Infrastructure model), ideal for those seeking high elasticity with dynamic costs tied to a smart shared storage pool, or a traditional Exadata VM Cluster running on Exadata Database Service on Dedicated Infrastructure, which fits best for enterprise environments requiring full physical hardware isolation and absolute resource control.

Once the VM cluster is established, the core of the distributed architecture lies in configuring the Data Distribution model, where the OCI console provides three distinct strategies:

  • Automated: OCI takes full control and automatically distributes data evenly across nodes (shards) using a consistent hashing strategy, eliminating the complexity of manual sharding management.
  • User Managed: Grants the architect absolute control to explicitly specify the exact mapping of data to specific nodes. This is the ideal choice for meeting strict regulatory data sovereignty laws (e.g., ensuring European customer data physically resides within Europe) or achieving extreme local latency optimization.
  • Multi-Level: A hybrid approach that combines the best of both worlds, allowing you to create a tiered distribution scheme—such as partitioning data first by geographic region using user-defined rules, and then automatically distributing it via hash across local nodes within each region.

Finally, to secure high availability and multi-region consistency, the deployment concludes with selecting the replication options: the Single-Raft Cluster topology (a single global group) or the robust Multi-Raft Cluster configuration, which splits and distributes multiple groups across shards to enable scalable read replicas and automatic regional disaster recovery with zero data loss.

Conclusion: When to Choose Globally Distributed Exadata

In general, consider opting for the Globally Distributed Exadata Database when your system meets the following criteria:

  • Massive Transactional Volumetry (OLTP): Your application handles thousands of concurrent global transactions per second that can be naturally partitioned by a logical key (such as Customer ID, Country, or Account Number).
  • Strict SLA and Zero-Downtime Requirements: You are designing financial, e-commerce, or payment gateways where a regional cloud outage cannot be tolerated, demanding automatic cross-region failover with zero data loss.
  • Predictable Exadata Performance Requirements: When your shards demand more than standard cloud compute can offer—such as extreme I/O throughput, smart scans, and high-performance AI vector searches directly at the storage level—all while leveraging the cost efficiency of the Exascale pay-per-use model.

To learn more about Globally Distributed Exascale Database, below is the official doc:

https://docs.oracle.com/en-us/iaas/globally-distributed-exascale-database/index.html

In the next post, I will move on and share a little bit about DB automation with the Oracle Autonomous DB options in OCI.

See you there!

Discover more from Red Architects

Subscribe now to keep reading and get access to the full archive.

Continue reading