Contents

Unprecedented Automotive AI
Solution

Artificial Intelligence steadily makes its way into all possible industries, with providers such as Mriyar already providing AI-powered platforms for hassle-free integration with third-party marketplaces.

When the client turned to us, the project infrastructure has long passed the MVP stage, but it ultimately needed configuration of resource utilization tools (integration of the monitoring deployment playbook via Ansible) and migration from AWS to the private cloud environment in order to save the infrastructure budget and keep up with resources scaling.

Challenge

The project infrastructure was initially planned and structured by the client’s development team so we required a good share of narrow-profiled expertise in order to identify project bottlenecks as well as optimize and improve the underlying processes before sending the whole product into production stages.

The project was quite wide-scope from the get-go as it was intended to process extensive volumes of data. And this is exactly why it became difficult for the client to manage the cloud infrastructure budget and monitor resource utilization without additional assistance

Work agenda

Client:

BigData(ML)-based automotive startup for B2C and B2B market niches

Location:

Ukraine

Team:

2 Lead DevOps Engineers

Project Timeframe:

Consulting services have been provided since March 2020

Project goal:

Configure thorough monitoring of major high-load project services;

Create functional dashboards with a big number of system and custom business metrics;

Describe the configurations in Ansible playbooks and integrate the system with the main project playbook. Compose a plan of stage-by-stage project migration to dedicated capacities to minimize downtime;

Conduct full-on migration and test the performance of all services.Compose a plan of flexible project scaling and migration to Kubernetes

Stack of tasks

Monitoring:

Installation of Prometheus monitoring and deployment of Prometheus operators in Docker;

Deployment of monitoring and Grafan using Ansible with following configuration and deployment of the alert manager;

Integration with the general Ansible playbook;

Addition of rules to custom metrics for services such as PostgreSQL, PgBouncer, Kafka, ClickHouse, ScyllaDB, HaProxy, etc

Migration:

Preparation and demonstration of the project migration plan;

Composition of a Terraform script for infrastructure provisioning and deployment of environments (development and production ones);

Preparation of Ansible roles for main high-load project services;

Moving of databases via the backup-restore approach;

Connection of S3 bucket for static data;

Configuration of the secrets storage, role matrix, and firewall;

Switching of DNS records and adjustment of the CloudFlare service.

Client requirements

With this project, we’ve had a thorough pleasure of working with a client that has clear goals and poses transparent requirements

Plan out and conduct smooth project migration;
Adjust business-efficient system monitoring;
Provide convenient remote client-side communication with the dev team;
Cut the project infrastructure budget as much as possible;
Grant reliable tech support;
Implement project optimization tasks based on the major scaling plan.

Solution

At the first two stages of the project – monitoring and migration – we were working with the existing infrastructure solutions and client-defined technologies. The third stage – migration to Kubernetes – required the dev team to get rid of any serverless solutions, focusing heavily on managing resource utilization. What we also did was declaratively configuring clusters for project environments and designing the new project infrastructure

How we did it

Configured Prometheus+Grafana services on the basic level and approved a number of the desired metrics to be included in the dashboard

Described the logic via Ansible roles which we integrated with the general playbook

Analyzed infrastructure metrics and added new custom indicators to the dashboard to be used by the client’s team

Optimized the performance of a centralized logging system – ELK – in order to lower resource consumption rates

Prepared automations for new dedicated infrastructure deployment

Prepared Ansible playbooks for necessary services and finalized the project migration plan

Switched domains and launched the production stage

Moved high-load databases and re-initiated the project deployment flow

Currently, we are handli ng preparations for migrating the whole project to Kubernetes

DevOps tech stack

Services

Mriyar - an Unprecedented Automotive AI Solution

Kafka

Zookeeper

MinIO

Elasticsearch

Cloud providers & Containers

Docker

AWS

Kubernetes

Configuration management
and Infrastructure
provisioning

Terraform

Ansible

CI/CD

Gitlab

Flux

Database

PostgreSQL

NoSQL

ClickHouse

ScyllaDB

Monitoring & Logging

Prometheus+
Grafana

Graylog

Sentry

Results

As a result of our long-term efforts, As a result of our long-term efforts, we were able to adjust the detailed monitoring of over 35 servers and 7 services, which enabled us to also outline a clear infrastructure and underlying processes optimization plan.

The infrastructure budget is projected to be optimized approximately by 40%. On top of that, we formed a scope of tasks implying further optimization of the system for the rational use of resources by all services running in terms of the project

Contacts

Do you have a high-standard software project related to the field of financial handling that needs optimization, improvement, or maybe even creation from scratch? Contact us if you wish to see a similar job get done for your project based on its particular specifics

Click to rate this post!

[Total: 1 Average: 5]

Dmitry Vishnyov | Chief Business Development Officer

I am an IT professional with over 10 years of experience. My career trajectory is closely tied to strategic business development, sales expansion, and the structuring of marketing strategies.

Throughout my journey, I have successfully executed and applied numerous strategic approaches that have driven business growth and fortified competitive positions. An integral part of my experience lies in effective business process management, which, in turn, facilitated the adept coordination of cross-functional teams and the attainment of remarkable outcomes.

I take pride in my contributions to the IT sector’s advancement and look forward to exchanging experiences and ideas with professionals who share my passion for innovation and success.

Unprecedented Automotive AI Solution