Open in app

Sign In

Write

Sign In

Shashank Agarwal
Shashank Agarwal

85 Followers

Home

About

Published in Google Cloud - Community

·May 26, 2022

Fast export large database tables — using GCP Serverless Dataproc

Import large tables from MySQL (any JDBC) to Cloud Spanner (or GCS, BigQuery) Introduction Are you looking to export/import large tables with 100s of GBs-TBs fast? Approach to export/import data out in multiple threads parallelly ? Prefer to preserve the schema of the export the data ? Using a robust, proven…

Spanner

6 min read

Fast export large database tables — using GCP Serverless Dataproc (Spark)
Fast export large database tables — using GCP Serverless Dataproc (Spark)
Spanner

6 min read


Published in Google Cloud - Community

·Mar 31, 2022

Cloud Spanner export query results using Dataproc Serverless

Cloud Spanner is fully managed relational database with unlimited scale, strong consistency, and up to 99.999% availability. In this post we will explore exporting data for a Spanner Table or SQL Query using Dataproc Serverless. Key Benefits Dataproc Serverless is fully managed, serverless and autoscaling. SpannerToGCS template is open source, fully customizable…

Dataproc

3 min read

Cloud Spanner export query results using Dataproc Serverless
Cloud Spanner export query results using Dataproc Serverless
Dataproc

3 min read


Published in Google Cloud - Community

·Apr 9, 2021

GCP — SQL Server AO-AG with Single Subnet

Introduction SQL Server Always On Availability Groups (AOAG) allows users to deploy highly available and automated failover with SQL Server databases. It is commonly deployed using multi-subnets in Google Cloud. However, sometimes it might be desirable to deploy it in a single subnet configuration. Which could be because network design was…

Sql Server

2 min read

GCP — SQL Server AO-AG with Single Subnet
GCP — SQL Server AO-AG with Single Subnet
Sql Server

2 min read


Published in Google Cloud - Community

·Apr 7, 2021

GCP — Deploying highly available databases with GKE

GKE for Databases — Introduction Containerization of software applications has transformed ease of packaging software applications. On top of it Google Kubernetes Engine (GKE) has made management of those containers far more easier. In this post we will look at how stateful applications such as database(s) can take advantage of the same technology. Architecture Diagram Identify database…

MySQL

2 min read

GCP — Deploying highly available databases with GKE
GCP — Deploying highly available databases with GKE
MySQL

2 min read


Nov 29, 2020

[Deprecated] GCP SQL Server using Stateful MIGs for HA and DR

Update: Stateful MIG does not failover automatically to another Availability Zone (AZ). Review limitations page. TLDR; Deploying traditional database(s) like SQL Server, MySQL, Postgresql etc in a Highly Available setup with minimal cost using GCP. Introduction GCP offers stateful managed instance groups which provide an easy and convenient way to deploy a highly available “stateful” service such as database(s). …

Gcp

4 min read

GCP SQL Server using Stateful MIGs for HA and DR
GCP SQL Server using Stateful MIGs for HA and DR
Gcp

4 min read


Published in Google Cloud - Community

·Dec 30, 2019

GCP Solving MySQL HA Replication Lag

TL;DR : This solutions focuses on usage of multi zonal disks (called regional disks) for achieving durable MySQL HA Replication. This is GCE based implementation of CloudSQL’s replication technique. Problem Statement Public clouds such as GCP start showing replication lag for MySQL Replica instances when durability is ON (i.e. sync_binlog = 1)…

Cloud Computing

6 min read

GCP Solving MySQL HA Replication Lag
GCP Solving MySQL HA Replication Lag
Cloud Computing

6 min read


Published in Google Cloud - Community

·Jul 18, 2019

GCP PostgreSQL — Compute Engine Snapshot Based Replication (Eg: Production to Development)

Quick Summary (TL;DR) In this post, will cover a real life walkthrough and recommendations of GCE Snapshot based replication on Google Cloud Platform. This solution is relevant for database administers and application teams, with reliance on databases hosted on GCE VMs. This solution leverages cloning disks via snapshot. …

Google Cloud Platform

7 min read

GCP  PostgreSQL — Compute Engine Snapshot Based Replication (Eg: Production to Development)
GCP  PostgreSQL — Compute Engine Snapshot Based Replication (Eg: Production to Development)
Google Cloud Platform

7 min read


Published in Google Cloud - Community

·Jun 26, 2019

GCP VPC SC with Shared VPC Network

Quick Summary (TL;DR) This article describes the limitation and workaround solution of using VPC Service Controls (VPC-SC) with Shared VPC in Google Cloud Platform. Issue arises from the fact that VPC-SC observes service project VMs’ as resources of Shared VPC (instead of service project resources). On one hand if VPC-SC is enabled using…

Cloud Computing

4 min read

GCP VPC SC with Shared VPC Network
GCP VPC SC with Shared VPC Network
Cloud Computing

4 min read


Published in Google Cloud - Community

·Mar 25, 2019

Scheduled Mirror/Sync SFTP to GCS

Context Applications often require loosely coupled file sharing systems. Sometimes data files need to be shared across companies or teams within company which do not share storage infrastructure. SFTP has been common interface in such cases. Why Sync files to Google Cloud Storage ? While applications on GCP may directly read from SFTP server. But in several cases syncing…

Ubuntu

3 min read

Ubuntu

3 min read

Shashank Agarwal

Shashank Agarwal

85 Followers

Database Migrations Engineer, Google Cloud

Help

Status

Writers

Blog

Careers

Privacy

Terms

About

Text to speech