Editor’s notice: Bukalapak, an ecommerce firm primarily based in Jakarta, is certainly one of Indonesia’s largest companies. As their platform grew to serve over 100 million prospects and 12 million retailers, they wanted an answer that may reliably and securely scale to deal with tens of millions of transactions a day. Right here, they talk about their migration to Google Cloud and the worth added from its managed providers.
Just like many different enterprises, Bukalapak’s ecommerce platform didn’t originate within the cloud. It was initially constructed leveraging on-premises applied sciences that labored fairly properly at first. Nevertheless, as our enterprise grew—processing over 2 million transactions per day and supporting 100 million prospects—it turned difficult to maintain up with the mandatory scale and availability wants. It wasn’t unusual to see site visitors spikes following promotional occasions, which had been frequent. Our infrastructure and general structure, nevertheless, simply wasn’t designed to deal with this scale of demand. It was clear we would have liked a brand new strategy to help the success of the enterprise, a method that may permit us to scale to fulfill fast-growing demand, whereas offering one of the best expertise to our prospects, all with out overburdening our group. This led us to implement important architectural adjustments, and contemplate a migration to the cloud.
Selecting Google Cloud
Provided that this migration could be a big and sophisticated endeavor, we needed a companion on this journey, not only a vendor. We began by evaluating the product and providers portfolio of potential suppliers, together with their means to innovate and resolve cutting-edge issues. With our very restricted expertise within the cloud, it was crucial to have an skilled skilled providers group that would successfully information and help us all through the migration journey. We additionally evaluated the general value and the provision of information facilities in Indonesia that may permit us to adjust to authorities necessities for monetary merchandise. Lastly, we would have liked to plan for a way we’d entice and retain expertise, so we regarded on the diploma of adoption throughout the suppliers throughout Southeast Asia, and particularly Indonesia. After cautious consideration throughout these areas, Google Cloud was the precise selection for us.
Embarking on the cloud migration
Our on-premises deployment included over 160 relational and NoSQL databases, We additionally maintained a Kubernetes cluster of over 1,000 nodes and over 30,000 cores, working 550 manufacturing microservices and one massive monolith utility. To deal with the big quantity of technical debt our platform had, we determined in opposition to a lift-and-shift strategy. As an alternative, we spent a great deal of time refactoring our providers, notably our monolith utility (a.okay.a., the mothership), and partitioning our databases. Enhancing our monitoring and alerting, deployment tooling, and testing frameworks had been crucial to enhance the standard of our software program, improvement and launch processes, and efficiency and incident administration. We additionally invested closely in automation, transferring away from guide testing to integration testing, API testing and front-end testing. Adopting the toolings and finest practices of DevOps, MLOps and ChatOps elevated our engineering velocity and improved the standard of our services.
For a group that had very restricted cloud expertise, it was clear early on that this was not only a expertise migration. It concerned a cultural migration as properly, and we needed to make sure our group may carry out the migration whereas gaining the talent set and expertise wanted to take care of and develop cloud-based purposes. We began by coaching a smaller group, which took on the duty of migrating our first providers. Incrementally, we labored on increasing the coaching, and looping in increasingly more engineers within the migration efforts. As extra engineering groups received concerned, we paired them with one of many engineers who joined the migration early on and acted as a coach. This strategy allowed us to switch data and roll out finest practices, incrementally however absolutely, throughout all the group.
We took a multi-step strategy for the migration. We began by specializing in the cloud basis work, introducing automation and new applied sciences like Ansible and Terraform. We additionally invested closely in establishing a powerful safety basis, onboarding WAF and Anti-DDoS, area menace detection, community scanning, and picture hardening instruments, to call a couple of. From there, we began emigrate the smaller, easier providers and labored our method as much as the extra complicated. That helped the group achieve expertise over time whereas managing danger appropriately. Ultimately, we efficiently accomplished the migration in simply 18 months, with very minimal downtime.
Managed providers for better peace of thoughts
Our group chosen Cloud SQL early on because the absolutely managed service for many of our MySQL and PostgreSQL databases. We appreciated how simple Cloud SQL made it to handle and preserve our databases. With only a few easy API calls, we may rapidly arrange a brand new occasion or learn reproduction. Auto-failovers and auto-increasing disk measurement ensured we may run reliably and not using a heavy operational burden. Along with Cloud SQL, we’ve now been capable of combine throughout the opposite Google Cloud information providers, together with BigQuery, Data Studio, Pub/Sub, and Dataflow. These services have been instrumental in serving to us course of, retailer, and achieve insights from an enormous quantity of information. That in flip allowed us to raised perceive our prospects and constantly discover new alternatives to make enhancements on their behalf.
Google Cloud’s managed providers give a better peace of thoughts. Our group spends much less time on upkeep and operations. As an alternative, we now have extra time and sources to concentrate on constructing merchandise and fixing issues associated to our core enterprise. Our engineering velocity has elevated, and our group has entry to Google’s cutting-edge expertise, enabling us to unravel issues extra effectively. As well as, our platform now has larger uptime, and might scale with ease to maintain up with unpredictable and rising demand. We additionally had been capable of enhance the general safety of our platform and now have a standardized safety mannequin that may simply be carried out for brand new purposes. The bigger impression has been on what our lean infrastructure group is now capable of accomplish. Migrating to Google Cloud gave us the strategic and aggressive benefits we had been on the lookout for.
Each all through the migration and now that we’re working in manufacturing, Google Cloud has been a terrific companion to us. The Google Cloud group put quite a lot of effort into understanding what we would have liked to achieve success, and advocating for our wants, typically connecting us to product groups or consultants from others within the group. Their need to go the additional mile on behalf of their prospects made our expertise optimistic and in the end made our cloud migration profitable.