SOFTWARE ENGINEERING

Take-aways from the recent Amazon Kinesis outage that can help us build better systems. No rants!

The recent AWS outage came at a time which I can imagine to be probably the busiest time of the year for AWS and Amazon, being the Black Friday week and AWS re:Invent 2020 around the corner.

And, it’s probably the busiest time of the year for many other businesses who rely on AWS to build their solutions and consumer services.

Another major Cloud service outage strikes and the internet comes crumbling down. We have seen multiple cloud service disruptions in the recent times across major cloud providers like AWS, Microsoft Azure or Google Cloud.

With businesses born in the…


Personal Development

Lessons that have helped me in my personal & professional development

Photo by Greg Rakozy on Unsplash

We learn, unlearn, and relearn every day till the day we die. But, there are a few things we learn that stay with us forever.

I won’t be able to cover all the life lessons that I learned over the years as a professional in a single blog post. I admit that I might not be doing proper justice to all the good things I might have learned from my teammates and mentors. But, there are a few things that have stayed with me over the years. They have helped me on many occasions and various circumstances.

I am not…


Software Engineering

Using ArgoCD and other AWS services like CodeCommit, CodePipeline, CodeBuild, Amazon EKS

Photo by Fotis Fotopoulos on Unsplash

In this post, we’ll look into how to build a GitOps pipeline to deploy applications on Amazon EKS (Elastic Kubernetes Service). We’ll use ArgoCD and various AWS services like CodeCommit, CodePipeline, CodeBuild, and Amazon Elastic Container Registry (ECR).

Sometime back, I had written a post on GitOps and some of the challenges that we typically encounter, and a few key points to consider before adopting GitOps. Feel free to take a look if you are looking for a quick refresher.

Or, if you are new to GitOps, take a few minutes to go through the post as well before we…


Container Orchestration

One size does not fit all. Pick from Kubernetes, Docker Swarm, Nomad, Amazon ECS, Apache Mesos + Marathon (or DC/OS), etc.

Photo by NeONBRAND on Unsplash

Containers and container orchestration have become a key part of almost every IT organization’s cloud-native and microservices strategy. Containerization has transformed how we write, deploy, and manage software today.

Although several container orchestration products and technologies appeared on the scene, Kubernetes quickly became one of the most popular container orchestration system available as of today.

So, what makes Kubernetes popular? And, is it the silver bullet for all your container management and orchestration problems?

Kubernetes’ Popularity

GitHub stars or forks may not be the right yardstick to measure the popularity of Kubernetes, but it definitely gives an idea of its popularity given…


AWS Security

Using Amazon Macie, AppFlow’s Slack integration, CloudWatch Events to detect & notify on sensitive data leaks in Slack channels

Photo by Fernando Arcos from Pexels

AWS announced a new service called Amazon AppFlow recently. Amazon AppFlow allows us to integrate and automate data flow between various Software as a service (SaaS) applications and AWS services.

This can be a game-changer in many aspects and can open up many new possibilities and interesting use cases. Amazon AppFlow can enable data flows both from SaaS applications to AWS as well as from supported AWS services to SaaS applications. Data flow can happen in a secure way as well in case the SaaS application has been integrated with AWS PrivateLink.

Let Us Consider An Interesting Data Leakage Scenario


Software Delivery

Why Is GitOps Powerful? Key Considerations Before Embracing GitOps.

Photo by Andy Kelly on Unsplash

‘GitOps’ is an operating model for the delivery and management of cloud native applications on Kubernetes. It can be considered as an optimization of the DevOps and SRE (Site Reliability Engineering) best practices around Kubernetes based systems.

Given that ‘GitOps’ is a term that was coined at Weaveworks and it has its roots in Weaveworks’ history of running Kubernetes based systems, GitOps is commonly referred to in the context of Kubernetes. But, now GitOps as a fundamental concept or best-practices is being extended to various other platforms and tools like Nomad, Terraform, Ansible, Chef, Pulumi, etc. as well. …


AWS Networking

Deep-dive troubleshooting of AWS Security Groups and Network ACLs. What you should know to troubleshoot? And, a few useful networking utilities.

Photo by israel palacio on Unsplash

If you have been working on AWS for some time, either managing infrastructure or creating some fancy serverless applications, you must have run into some sort of networking issue at least once due to the wrong configuration of AWS Security Groups or Network Access Control Lists (ACL).

Let’s see why are they so critical, and why is it important to know how to troubleshoot them if something goes wrong in your AWS network.

Before we go ahead, let’s take a moment to understand the purpose of AWS Security Groups and Network ACLs in AWS networking.

AWS Security Group

In this context, we’ll refer…


AWS Networking

A reference HA architecture with AWS networking services and components, without single points of failure, and other considerations

Photo by Thomas Jensen on Unsplash

In this article, we’ll look into how we can build a highly available (HA) AWS Networking solution connecting AWS and On-Premise data center using Direct Connect. We’ll also look into how other AWS services like Direct Connect Gateway and Transit Gateway can help simplify the overall architecture and its management.

Although I am assuming that you have a fair understanding of the AWS networking services we’ll do a quick and dirty recap before we look into the architecture.

A Quick Detour -

It is important to have an understanding of AWS accounts and how various account structures can help to…


Tech Quick Bites

Learn the key concepts, features and basic commands of HashiCorp Consul

Photo by Pietro Jeng on Unsplash

What Is Consul?

From HashiCorp’s documentation:

“Consul is a service mesh solution providing a full-featured control plane with service discovery, configuration, and segmentation functionality. Each of these features can be used individually as needed, or they can be used together to build a full-service mesh. Consul requires a data plane and supports both a proxy and a native integration model. Consul ships with a simple built-in proxy so that everything works out of the box, but also supports 3rd party proxy integrations such as Envoy.”


Tech Quick Bites

Learn the key concepts, features and basic commands of HashiCorp Vault

Photo by Gabriel Wasylko on Unsplash

What Is Vault?

From HashiCorp’s documentation:

“Vault is a tool for securely accessing secrets. A secret is anything that you want to tightly control access to, such as API keys, passwords, or certificates. Vault provides a unified interface to any secret, while providing tight access control and recording a detailed audit log.”

Bideep Bezbaruah

Cloud Architect | Blogging whenever possible | https://www.linkedin.com/in/bideep/

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store