Netflix engineers recently published how they built Studio Search, using Apache Kafka streams, an Apache Flink-based Data Mesh process, and Elasticsearch to manage the index. They designed the platform to take a portion of Netflix’s federated GraphQL graph and make it searchable. Today, Studio Search powers a significant portion of the user experience for many applications within the organisation.
During the past month, I enjoyed participating in InfoQ’s yearly Software Architecture & Design Trends. The key takeaways of this report are: The complete report is available here. Along with the report, we published an accompanying podcast episode. This podcast episode is a chance to listen in on part of the editors’ conversation and hear…
Dropbox recently published how it made the camera upload process for Android faster and more reliable. Dropbox engineers removed shared Android and iOS C++ code and replaced it with a platform-native Kotlin implementation. The engineers are pleased with the decision to rewrite the process, stating that error rates went down and upload performance greatly improved….
LinkedIn recently published how it handles overload detection and remediation in its microservices. Its solution, Hodor, provides an adaptive solution that works out of the box with no configuration. It is a platform-agnostic mechanism to run overload detectors and load shedders inside the monitored process that samples load and sheds traffic from within the application’s…
Andrew Harmel-Law recently published an article describing a decentralised, scalable software architecture process based on the “Advice Process”. The Advice Process promotes software architecture by encouraging a series of conversations driven by an empowering, almost anarchistic, decision-making technique. It comprises one rule – anyone can make an architectural decision. (Read more on InfoQ)
The Cloud Native Computing Foundation (CNCF) recently announced that it accepted the Distributed Application Runtime (Dapr) as a CNCF incubating project. This statement follows an earlier announcement by Dapr, announcing the formatAirbnb recently detailed how it designed and built a unified architecture for collaborative hosting. This architecture streamlines the development process of new products, as…
The Cloud Native Computing Foundation (CNCF) recently announced that it accepted the Distributed Application Runtime (Dapr) as a CNCF incubating project. This statement follows an earlier announcement by Dapr, announcing the formation of the Dapr project’s Steering and Technical Committee (STC). (Read more on InfoQ)
Airbnb announced that it has open-sourced Ottr, a serverless public key infrastructure framework developed in-house. Ottr handles end-to-end certificate rotations without the use of an agent. Ottr’s primary design goal is to be a scalable and configurable serverless framework on AWS with little operational overhead or reliance on enrollment protocols. (Read more on InfoQ)
Cockroach Labs announced today the public beta of CockroachDB Serverless. CockroachDB Serverless delivers a fully elastic cloud data infrastructure that enables building applications with less planning for capacity, performance, or availability. It’s based on CockroachDB, a NewSQL database that seeks to combine the scalability of NoSQL systems with ACID guarantees of a traditional database system….
PayPal recently published a blog post describing PayPal’s adoption of GraphQL over the recent years. It started with a single Checkout application in 2018 and amounted to creating a unified federated API with GraphQL federation. The adoption of GraphQL across the organisation promoted increased developer productivity and faster application shipment. (Read more on InfoQ)
Uber Engineering recently published how it collects, standardises and uses data from the Uber Rider app. Rider data comprises all the rider’s interactions with the Uber app. This data accounts for billions of events from Uber’s online systems every day. Uber uses this data to deal with top problem areas such as increasing funnel conversion, user…
Facebook Engineering recently published how it built its general-purpose key-value store, known as ZippyDB. ZippyDB is Facebook’s biggest key-value store, which has been in production for more than six years. It offers flexibility to applications in terms of tunable durability, consistency, availability, and latency guarantees. (Read more on InfoQ)