KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure
KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure

Modern ecommerce marketplaces are extremely popular, user-packed solutions that are so demanded for the ultimate convenience of bridging the gap between independent vendors and regular online shoppers.

And in order for a marketplace to decently stand the competition today, it needs a sturdy underlying software infrastructure. With the project at hand, we had to work with the extensive software powers of Magento, which granted us lots of infrastructural performance and flexibility potential.

The course of the project as a whole was very diverse, including at different stages integration of DevOps techniques with the client’s Magento-powered ecommerce workflow, deployment of cluster infrastructure in MS Azure, automation of project clusters’ deployment processes, and more

Challenge

The client approached us with a successfully running Azerbaijan-based marketplace that needed proper scaling for extension outside the local market and over the international arena (namely, over other Asian countries).

The global task was to set up a failsafe marketplace infrastructure with opportunities for flexible scaling in high-load traffic conditions. For this, we set out to create a project architecture from scratch, integrate DevOps approaches with the workflow of backend and frontend development teams, and more.

Going more in-depth, we needed to leverage the powers of Magento to automate deployments at the smallest downtime, work with next to no clear documentation, and absolutely no previous DevOps input for more efficient cluster support, resource management, and automated deployments/updates on the customer side.

This also posed a big task to migrate the internal infrastructure of the project and optimize the cloud management budget

KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure
KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure
KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure
KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure

Work agenda

Client:

E-commerce project

Location:

AZ

Team:

1 Lead DevOps + 1 Senior DevOps Engineer

Project Timeframe:

Consulting services and support have been provided since July 2021

Project goal:

Plan out architecture and deploy a virtual environment in MS Azure;

Minimize vendor dependence and implement open-source solutions

Configure CI/CD for fast clusters deployment for new customers

Move an on-premise development project to the cloud dev environment;

Integrate with the ERP and online banking solutions;

Provide a DevOps team that is a universal helper for the client’s dev team

KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure
KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure
KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure
KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure

Stack of tasks

KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure
KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure
KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure

Infrastructure development and optimization, which included:

Setting up dev kits with a spot node;

Configuring clusters via a Flux tool;

Configuring all infrastructure components;

Restoring development DB;

Modifying php.env for multi-environment (dev/prod) and deployment manifest;

Deploying Magento development;

Setting up the frontend application;

Integration frontend and with backend;

Setting up MinIO as media storage

Deployment of new dev/prod Kubernetes clusters in the existing Azure project;

Integration of project DevOps fine-tuning approaches;

Implementation of load testing via Jmeter server;

Configuration of autoscaling for Magento;

Configuration of health checks for Magento;

CI/CD automation via Azure DevOps and Flux;

Support of all project infrastructure development and maintenance processes

KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure

Client requirements

  • To provide a universal DevOps assistance and consulting team;
  • To standardize product deployment processes;
  • To conduct fast onboarding for dev teams and SDLS projects;
  • To boost the efficiency of resource utilization and infrastructure costs management;
  • To centralize access rights management and optimize project security;
  • To employ the infrastructure-as-code approach without vendor lock-in
KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure

Solution

In the course of the project, the whole marketplace infrastructure was rehauled in order to identify, recommend, and implement a set of optimizations that streamlines the dev team workflow and reinforces the overall sturdiness and performance of the system. Currently, we continue assisting and optimizing crucial internal project processes to achieve more software smoothness

How we did it

The project was kicked off with a detailed study of project failproofness requirements to see where we can offer better solutions infrastructure-wise

The initial technical task was to dockerize the project’s backend and frontend pieces

KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure
KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure
KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure
KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure

Then, we configured the server for gathering cluster metrics and set up its thorough monitoring via dashboards with respective metrics and a configured logging system

After that, we went on to deploy a Kubernetes cluster in MS Azure and set up third-party infrastructure services like Redis, ElasticSearch, etc. We also configured a Kubernetes-native service for storing and processing media data, adapting Magento to interact with this solution along with the client’s dev team

KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure

We employed a GitOps approach to automate CI/CD processes, split up assembly and deployment processes, implemented code version management via Azure DevOps, and configured cluster deployment via Flux

After we successfully deployed the test version of the application and ERP/banking integration configurations, we conducted load testing and implemented basic configuration of tools for infrastructure autoscaling

KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure

Among other crucial tasks was also configuration of additional clusters and deployments for different project localizations

Continuing testing, a bunch of solutions for stress testing was also set up in Azure with the testing-on-demand opportunity

We continue maintaining internal development processes and assisting developers

KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure
KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure
KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure
KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure
KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure

DevOps tech stack

KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure
KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure

Containers & Cloud Providers

KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure

MS Azure

KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure

Docker

KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure

AKS

CI/CD

KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure

Bitbucket

KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure

Azure DevOps

KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure

Flux

Database

KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure

MongoDB

Monitoring & Logging

KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure

Prometheus+
Grafana

KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure

ELK

Services

KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure

Terraform

KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure

MinIO

KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure

Redis

KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure

Varnish

KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure

Elasticsearch

Results

Our ultimate task was to grant the client a consistent DevOps input and optimize the project on the internal level in order to enable more efficient and smoother scaling while making the client’s dev team’s life easier and guaranteeing top-notch performance among end users.

And this is what we ultimately achieved via a firm grasp on professional, individually-tailored DevOps – in the long run, technical DevOps work and consulting reduced the internal infrastructure costs by 40%.

We also automated tons of cumbersome manual tasks and implemented SLA that enables reliable tech team assistance and regular project monitoring to keep things top-notch long-term

KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure
KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure
KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure

Contacts

KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure
KontaktHome - Complex Deployment, Configuration, and Optimization of a Sturdy Marketplace Infrastructure

Do you have a similar marketplace or other solution that just about needs to scale and expand further? We have seasoned specialists to help you optimize and enhance your system while providing invaluable DevOps input

Click to rate this post!
[Total: 0 Average: 0]