Skip to content
DevMeme
3234 of 7590
DevOps SRE Post #3556 · source on Telegram

The GitHub Paradox: Who Deploys the Deployer?

Description

A screenshot of a tweet by Nacho Iacovino that poses a classic philosophical question for software engineers. The tweet asks, 'Does GitHub uses GitHub to build GitHub? And most importantly, can GitHub rollback GitHub to fix GitHub when GitHub is down?'. The image captures a humorous but very real concern in the world of DevOps and SRE: the problem of circular dependencies in critical infrastructure. For senior engineers, this is a well-known thought experiment that touches on topics like bootstrap problems, disaster recovery, and the importance of avoiding a single point of failure in deployment pipelines

Comments

17
Anonymous ★ Top Pick This is why the emergency 'break glass' procedure for GitHub's SRE team probably involves a carrier pigeon with a USB stick
  1. Anonymous ★ Top Pick

    This is why the emergency 'break glass' procedure for GitHub's SRE team probably involves a carrier pigeon with a USB stick

  2. Anonymous

    GitHub building GitHub on GitHub is the cloud-native remake of compiling GCC with GCC - perfect right up until the outage turns your incident runbook into an unmergeable pull request

  3. Anonymous

    The real question is: when GitHub's status page goes down, do they update the status of the status page on the status page? It's turtles all the way down, except the turtles are git commits and they're all force-pushed to main during an outage

  4. Anonymous

    This is the distributed systems equivalent of 'who watches the watchmen?' - except the watchmen are also the infrastructure, the deployment pipeline, AND the rollback mechanism. It's a beautiful illustration of why you need out-of-band recovery paths and why 'eating your own dog food' becomes significantly less appetizing when the dog food factory catches fire and the fire extinguisher blueprints are stored inside the burning factory. Senior engineers know this isn't just philosophical humor - it's a 3 AM incident waiting to happen when your GitOps pipeline depends on the very Git service that just went down

  5. Anonymous

    GitHub can roll back GitHub - until your control plane is a GitHub Action and the rollback runbook lives in a repo behind GitHub SSO; suddenly “out-of-band” isn’t optional

  6. Anonymous

    Dogfooding Actions is awesome until your control plane shares the blast radius - then ‘rollback’ is whoever still has a laptop with a stale clone and the break‑glass deploy key

  7. Anonymous

    GitHub outages: the rare case where self-dogfooding exposes your entire build pipeline as a single point of failure

  8. @Odbjorn 5y

    Well Gitlab does

  9. @declonter 5y

    Having one GitHub you can build anything except GitHub. Having two GitHubs you can build abdolutely anything.

  10. @AaronDewes 5y

    They do, the repository is GitHub.com/GitHub/GitHub (It exists, their developers referenced it multiple time in public issues.

    1. @biskwiq 5y

      can't find enough proofs

      1. @AaronDewes 5y

        https://github.com/primer/css/search?q=https%3A%2F%2Fgithub.com%2Fgithub%2Fgithub&type=code

  11. @asm3r 5y

    Расскажите ему откуда берутся скомпилированные компиляторы

    1. @sylfn 5y

      Please use English in this chat. Other langs are allowed while you provide a translation.

    2. @Dark_Embrace 5y

      ENG "Can somebody tell, where the compiled compilers come from?"

      1. @asm3r 5y

        Please tell him, how compiled compilers built

      2. @Darkangeel_hd 5y

        https://en.m.wikipedia.org/wiki/Bootstrapping_(compilers) And https://stackoverflow.com/a/9429536

Use J and K for navigation