Contents
Odaptos' Path to Scalable AI-Driven User Testing
Odaptos is transforming the way companies understand their users. Their innovative platform goes beyond traditional user testing — it incorporates AI-based emotional analysis. Odaptos captures and interprets users’ emotions during interviews, giving businesses a much clearer idea of the user experience.
The platform’s smart video player breaks down the videos into key moments, highlighting where users face difficulties and, most importantly, how they feel during these moments. This combination of functional and emotional insight gives companies a clearer picture of what works and what doesn’t in their products or services.
Project Description
Odaptos came to IT Outposts with an infrastructure primarily built on Lambda functions. Their entire system was made up of scripts running different tasks. However, as the company aimed to scale and integrate new services, they recognized the need for a more robust and flexible infrastructure. The client’s objectives are to fine-tune their existing setup and prepare for future growth.
Work Agenda
Client
Location
France
Technical team
1 DevOps engineer
1 SRE engineer
Project manager
Project timeframe
August 2024 - ongoing
Project goals
Resolve intermittent 503 errors to improve reliability and user experience
Consolidate multi-cloud services, focusing on migrating to Whisper for comprehensive speech recognition
Transition from a Lambda-centric infrastructure to a more flexible, container-based solution using Amazon ECS
Configure client-specific encryption for video uploads and conduct a thorough security audit
Implement a cost-effective, dynamic GPU-enabled processing system for AI model integration
Design a scalable, microservices-based architecture to support Odaptos's future growth
Tasks and Challenges
Resolving intermittent 503 errors
Odaptos was experiencing periodic 503 errors that were causing significant downtime. Our team quickly identified the root cause of these errors and resolved the issue within a day. This made the platform way more reliable and better for users.
Transitioning from Lambda-centric architecture
The existing Lambda-based infrastructure has limitations in terms of scalability and flexibility, particularly for running GPU-intensive tasks. We’re gradually moving critical processes from Lambda functions to a more versatile container-based solution using Amazon ECS.
Implementing GPU-enabled processing
Odaptos aims to integrate AI models that require GPU capabilities, but the expense of continually operating GPU-enabled instances is too high. To address this issue, our engineers created a system that automatically activates GPU-enabled machines as needed, runs the required tasks, and then powers them down. This greatly lowers costs while providing the essential processing power.
Multi-cloud service optimization
Another challenge Odaptos currently faces is their reliance on multiple cloud providers for various services. They use certain services from Amazon, others from Azure, and yet others from Google.
This multi-cloud approach was necessitated by specific capabilities offered by different providers. For instance, Azure provides French language translation, a feature not available in Amazon's offerings. However, this not only increases the complexity of infrastructure but also potentially raises costs.
The client wants to migrate their services to Whisper, a more comprehensive speech recognition system. This step will simplify their infrastructure and potentially reduce expenses.
Enhancing security measures
Odaptos places a high priority on data security and wants to implement client-specific encryption for video uploads. We’re configuring a system using Key Management Service (KMS) to generate unique encryption keys for each client. In addition, our team will perform a thorough security review to verify best practices are followed across their entire infrastructure.
Preparing for future scalability
The current setup, while functional, isn’t easily scalable to meet Odaptos's growth targets. IT Outposts is currently designing a roadmap to migrate their infrastructure to a more scalable, microservices-based architecture.
Contacts
Are you developing an AI-based project and seeking the ideal infrastructure solution? IT Outposts knows how to tackle the challenges of scaling AI models. Reach out to us today, and let’s architect the future of your AI project together. Your next breakthrough is waiting!
Results
Our collaboration with Odaptos has yielded major results. We’ve addressed their urgent infrastructure challenges, and the improvements are evident: their system is now operating more smoothly. However, we’re not focused on temporary solutions only. Our team understands that Odaptos has ambitious goals for the future, and we’re preparing for the next big steps.
DevOps Tech Stack
EC2
VPCs
Lambda
ECS
ECR
Cloud
Formation
CloudFront
CodeBuild
KMS
Event
Bridge
Secret
Manager
Certificate
Manager
SQS
GCP
AWS
MongoDB
Github
Contact us to increase your
IT infrastructure efficiency
Top-rated DevOps as a service company
50+
remotely
90%
2 years
4.7/5
score