Newslurp

<< Stories

Self-Serve Kafka 🏗️, Good Retry, Bad Retry 📉, Azure Global Batch Offering 🌍

TLDR DevOps <dan@tldrnewsletter.com>

August 14, 11:17 am

TLDR DevOps
DoorDash is streamlining its infrastructure by transitioning Kafka management to a self-serve platform, reducing reliance on infrastructure engineers. 

TLDR

Together With Sonrai Security

TLDR DevOps 2024-08-14

Grab The Ultimate Guide to Service Control Policies (Sponsor)

Service Control Policies (SCPs) can be intimidating, but they are an essential part of working in AWS, especially when used to keep a lid on excessive permissions and reduce unnecessary risk!

Whether you're new to SCPs or looking for more advanced use cases, The Ultimate Guide to Service Control Policies will help you level up. 

Start with the basics — what are SCPs, how does their logic work, and why are they useful — and then dive much deeper into topics such as:

👉 Download the Free Guide

📱

News & Trends

Announcing Azure OpenAI Global Batch Offering: Efficient processing at scale with 50% less cost (4 minute read)

Azure has launched a public preview of its OpenAI Global Batch offering, which is designed for efficient large-scale processing with a 24-hour turnaround time. The service provides a 50% cost reduction compared to standard pricing and includes a separate quota for batch requests to avoid impacting online workloads.
Monitor your Anthropic applications with Datadog LLM Observability (4 minute read)

Datadog has launched an integration with Anthropic to provide enhanced monitoring, troubleshooting, and security for Anthropic's AI models. The integration allows users to track performance metrics, identify errors, and ensure the quality and safety of AI applications built with Anthropic's technology.
🚀

Opinions & Tutorials

Kubectl Get Context : Current Context, Switching & Listing (8 minute read)

Kubectl contexts let you manage multiple Kubernetes clusters from a single kubectl installation by switching between them as needed. This guide offers a cheat sheet for kubectl config commands to check and manage your active context.
Demystifying the CNI by Writing One From Scratch (9 minute read)

This blog post provides a detailed explanation of the Container Network Interface (CNI) and guides readers through building a basic CNI plugin from scratch.
DoorDash Empowers Engineers with Kafka Self-Serve (18 minute read)

DoorDash is streamlining its infrastructure by transitioning Kafka management to a self-serve platform, reducing reliance on infrastructure engineers. The new system simplifies resource management, automates best practices, and allows engineers to focus on strategic tasks, enhancing efficiency and reducing errors.
🧑‍💻

Resources & Tools

Calculate the true cost of building vs. buying analytics for your SaaS app (Sponsor)

The decision to build or buy product capabilities should come down to the ROI. Try Qrvey's free build vs buy ROI calculator to get a realistic cost estimate of both approaches, accounting for database resources, headcount, financial trade-offs, and revenue opportunities. Calculate your costs (free tool, no form).
logu (GitHub Repo)

logu simplifies the analysis of unstructured log data by grouping similar log messages into clusters for better organization and interpretation.
SpoofDPI (GitHub Repo)

A simple and fast anti-censorship tool written in Go.
🎁

Miscellaneous

Create a powerful Kubernetes security duo with Custom Org Policy and Policy Controller (5 minute read)

Google Cloud's Custom Org Policy and Policy Controller work together to provide comprehensive security and compliance for Google Kubernetes Engine (GKE) clusters. Custom Org Policies enforce centralized, hierarchical resource configurations, while Policy Controller offers dynamic, in-cluster guardrails, allowing organizations to implement a defense-in-depth strategy for their Kubernetes environments.
Creating Cloud Managed Platform Services (7 minute read)

This post discusses how Box transitioned to using Google Cloud SQL to meet its relational database needs for non-customer applications through a platform engineering approach.

Quick Links

AWS announces private IPv6 addressing for VPCs and subnets (1 minute read)

AWS has introduced private IPv6 addressing for VPCs and subnets, allowing customers to use Unique Local IPv6 Unicast Addresses (ULA) and Global Unicast Addresses (GUA) for private access.
Nomad's internal garbage collection and optimization discovery during the Nomad Bench project (5 minute read)

This post explores Nomad's garbage collection process and the performance optimization discovered during the Nomad Bench project.
Good Retry, Bad Retry: An Incident Story (21 minute read)

This post shares an experience with implementing retries in Yandex Go's extensive microservices system.

Love TLDR? Tell your friends and get rewards!

Share your referral link below with friends to get free TLDR swag!
Track your referrals here.

Want to advertise in TLDR? 📰

If your company is interested in reaching an audience of devops professionals and decision makers, you may want to advertise with us.

If you have any comments or feedback, just respond to this email!

Thanks for reading,
Kunal Desai & Martin Hauskrecht


If you don't want to receive future editions of TLDR DevOps, please unsubscribe from TLDR DevOps or manage all of your TLDR newsletter subscriptions.