Cloud Spanner is fully managed relational database with unlimited scale, strong consistency, and up to 99.999% availability. In this post we will explore exporting data for a Spanner Table or SQL Query using Dataproc Serverless. Key Benefits Dataproc Serverless is fully managed, serverless and autoscaling. SpannerToGCS template is open source, fully customizable…

Introduction SQL Server Always On Availability Groups (AOAG) allows users to deploy highly available and automated failover with SQL Server databases. It is commonly deployed using multi-subnets in Google Cloud. However, sometimes it might be desirable to deploy it in a single subnet configuration. Which could be because network design was…

GKE for Databases — Introduction Containerization of software applications has transformed ease of packaging software applications. On top of it Google Kubernetes Engine (GKE) has made management of those containers far more easier. In this post we will look at how stateful applications such as database(s) can take advantage of the same technology. Architecture Diagram Identify database…

Update: Stateful MIG does not failover automatically to another Availability Zone (AZ). Review limitations page. TLDR; Deploying traditional database(s) like SQL Server, MySQL, Postgresql etc in a Highly Available setup with minimal cost using GCP. Introduction GCP offers stateful managed instance groups which provide an easy and convenient way to deploy a highly available “stateful” service such as database(s). It can be useful when…

TL;DR : This solutions focuses on usage of multi zonal disks (called regional disks) for achieving durable MySQL HA Replication. This is GCE based implementation of CloudSQL’s replication technique. Problem Statement Public clouds such as GCP start showing replication lag for MySQL Replica instances when durability is ON (i.e. sync_binlog = 1)…

Quick Summary (TL;DR) In this post, will cover a real life walkthrough and recommendations of GCE Snapshot based replication on Google Cloud Platform. This solution is relevant for database administers and application teams, with reliance on databases hosted on GCE VMs. This solution leverages cloning disks via snapshot. Same concept can be applicable…

Quick Summary (TL;DR) This article describes the limitation and workaround solution of using VPC Service Controls (VPC-SC) with Shared VPC in Google Cloud Platform. Issue arises from the fact that VPC-SC observes service project VMs’ as resources of Shared VPC (instead of service project resources). On one hand if VPC-SC is enabled…

Context Applications often require loosely coupled file sharing systems. Sometimes data files need to be shared across companies or teams within company which do not share storage infrastructure. SFTP has been common interface in such cases. Why Sync files to Google Cloud Storage ? While applications on GCP may directly read from SFTP server. But in several cases syncing…