Newslurp

<< Stories

Regatta Storage 🆕, Bazel For Web At Scale ⚖️, No Such Thing As A Free Lunch ‼️

TLDR DevOps <dan@tldrnewsletter.com>

November 20, 12:16 pm

TLDR DevOps
Regatta Storage is a scalable cloud file system with local-like performance and automatic sync to S3. It allows instant access to large S3 datasets ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌  ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ 

TLDR

Together With Exoscale

TLDR DevOps 2024-11-20

A Deep Dive into Exoscale SKS Internals (Sponsor)

Launching Kubernetes clusters has become a simple task for many, but have you ever wondered what happens behind the scenes?

In this blog post, Exoscale takes you inside the architecture of their Scalable Kubernetes Service (SKS), revealing the intricate processes that power their managed Kubernetes offering. Discover insights into:
• Exoscale's foundational infrastructure
• The role of internal Kubernetes clusters and orchestrators
• How SKS control planes and etcd clusters are managed
• The lifecycle of SKS clusters, from provisioning to upgrades

Read the blog to dive deeper →

📱

News & Trends

Regatta Storage – Turn S3 into a local-like, POSIX cloud FS (3 minute read)

Regatta Storage is a scalable cloud file system with local-like performance and automatic sync to S3 storage. It allows instant access to large S3 datasets for data processing tools without local storage. Built with experience from Amazon EFS and Netflix, Regatta addresses cloud storage gaps by integrating S3 with efficient caching and high performance. Users are invited to try it and provide feedback.
Introducing DjangoVer (6 minute read)

DjangoVer ties package versions to the latest supported Django release, making compatibility clear. The system helps users quickly see maintenance and support status for Django-related packages and offers a practical alternative to other versioning schemes.
🚀

Opinions & Tutorials

How to Differentiate Manual Changes from Terraform Changes in S3 Bucket (3 minute read)

This article explains how to track manual changes made to an S3 bucket managed by Terraform using AWS services like CloudTrail, EventBridge, Lambda, and SNS for notifications. It outlines a workflow where CloudTrail logs all S3 activities, EventBridge filters these events, and a Lambda function sends SNS notifications only for manual changes, effectively excluding those made by Terraform.
Effortless Kubernetes Deployment: The AKS Deployment Feature in AKS VS Code Extension (3 minute read)

The AKS Deployment feature in the AKS VS Code extension streamlines Kubernetes deployment by integrating Azure Container Registry, Draft tool for automated configuration, and GitHub deployment for CI/CD. These features simplify the setup and deployment process, enhancing productivity and enabling seamless, automated workflows for developers.
RE: your application environment variables (2 minute read)

env is a new package for managing environment variables that, unlike typical environment-based configurations, allows for variable definitions, descriptions, and subcommand-specific sets. It addresses the lack of a built-in interface to show expected values.
🧑‍💻

Resources & Tools

Building a Data Warehouse for Multi-Tenancy: What You Need to Know (Sponsor)

Data warehouses (and data lakes) aren't inherently designed to handle the nuances of multi-tenancy, which can create issues if you're using them for embedded analytics. Read about the critical challenges of building a data warehouse in a multi-tenant environment, and the solutions, on the Qrvey blog.
AWS CDK (GitHub Repo)

The AWS Cloud Development Kit (CDK) is an open-source framework that allows developers to define and provision cloud infrastructure using modern programming languages. It provides reusable components called constructs, which simplify AWS service integration and infrastructure management.
eks-node-viewer (GitHub Repo)

eks-node-viewer is a tool for visualizing node usage in a cluster. It displays scheduled pod resource requests versus allocatable capacity. The tool was originally developed at AWS to demonstrate consolidation with Karpenter.
🎁

Miscellaneous

Adopting Bazel for Web at Scale. How and Why We Migrated Airbnb's (10 minute read)

Airbnb successfully migrated its large-scale web monorepo to Bazel. This resulted in significant performance improvements and enhanced scalability for TypeScript type checking, ESLint linting, and Jest unit tests.
There's No Such Thing as a Free Lunch! (11 minute read)

Slack's "Incident Lunch" exercise, inspired by a training session with Blackrock 3 Partners, offers employees a fun and practical experience in incident management by simulating real-time problem-solving scenarios with time pressure, role-playing, and constraints, all centered around the enjoyable task of obtaining lunch.
⚡

Quick Links

Edera's Big Container Security Question: Am I Isolated? (3 minute read)

Am I Isolated is an open-source container security tool that evaluates container runtime environments for isolation gaps and offers security improvement suggestions.
Hyrum's Law in Golang (4 minute read)

Hyrum's Law states that all observable API behaviors become relied upon by users, even unintended ones.
Playground Wisdom: Threads Beat Async/Await (20 minute read)

While async/await brought concurrency to focus, future language design should prioritize intuitive, thread-based models with structured concurrency and robust communication tools.

Love TLDR? Tell your friends and get rewards!

Share your referral link below with friends to get free TLDR swag!
https://refer.tldr.tech/fc7198a6/10
Track your referrals here.

Want to advertise in TLDR? 📰

If your company is interested in reaching an audience of devops professionals and decision makers, you may want to advertise with us.

If you have any comments or feedback, just respond to this email!

Thanks for reading,
Kunal Desai & Martin Hauskrecht


If you don't want to receive future editions of TLDR DevOps, please unsubscribe from TLDR DevOps or manage all of your TLDR newsletter subscriptions.