Using Sedai as an autonomous cloud platform, Freshworks improved performance with a 34% latency reduction on its developer platform of 30,000 serverless functions
Remediations identified daily
Freshworks has quickly grown into a company with 1,000 employees, five offices, and more than 130,000 clients using its products ranging from customer support and help desk software to recruitment tools and sales CRM software. Freshworks has made moves to serve developers to extend the capability of its platform, and hosts thousands of developer apps on its developer platform.
As with all Freshworks services, optimal performance is expected. “At Freshdesk we are obsessed with providing a great experience to our customers .. speed is critical” shared a Site Reliability Engineer at Freshworks.
As the popularity of the developer platform grew, Freshworks was running 30,000 Lambda functions, but did not have a way of optimizing each service for performance.
Freshworks deployed Sedai’s Autonomous Optimization capability in order to keep each Lambda function optimized. Sedai was connected to AWS CloudWatch metrics and began to use the data to understand the performance and cost for different configurations.Based on high level direction as to whether to pursue cost, performance or a mix of goals, Sedai is able to both perform initial optimizations and make continued optimizations as new versions of the function are shipped and as application traffic changes.
Freshworks was able to find an average 34% latency reduction across their Lambdas, primarily by optimizing memory settings. Individual functions showed latency reductions of up to 95%. As a result, Sedai achieved 15 years of execution savings (5,618 days of execution time) as shown in the dashboard at right.
An alternative objective of cost reduction was also evaluated but not pursued; this would have yielded 27% cost savings with no performance change as performance was the priority.
The Freshworks Developer Platform Lambda optimization now operates autonomously and the Freshworks team does not need to spend time managing Sedai.
Each new release on the platform is scored based on the changes in cost, latency and errors from the prior version. The level of deviations from the prior version are reported on a dashboard inside Sedai (see chart at right).