[{"data":1,"prerenderedAt":1065},["ShallowReactive",2],{"/blog/high-availability-git-storage-with-praefect":3,"navigation-en-us":312,"banner-en-us":750,"footer-en-us":758,"blog-post-authors-en-us-Zeger-Jan van de Weg":1005,"blog-related-posts-en-us-high-availability-git-storage-with-praefect":1020,"blog-share-wrapper-en-us":1045,"next-steps-en-us":1055},{"id":4,"title":5,"authors":6,"body":8,"category":288,"date":289,"description":290,"extension":291,"externalUrl":292,"faq":292,"featured":293,"heroImage":294,"hidePromo":293,"meta":295,"navigation":296,"path":297,"seo":298,"slug":302,"stem":303,"tags":304,"template":310,"updatedDate":292,"__hash__":311},"blogPosts/en-us/blog/high-availability-git-storage-with-praefect.md","Meet Praefect: The traffic manager making your Git data highly available",[7],"Zeger-Jan van de Weg",{"type":9,"value":10,"toc":273},"minimark",[11,22,27,36,45,53,61,70,74,82,85,94,98,101,104,112,115,141,145,148,168,177,181,190,193,198,201,205,208,212,215,218,222,241,249,259],[12,13,14,15,21],"p",{},"As critical software projects grow, scaling infrastructure to make the service ",[16,17,20],"a",{"href":18,"rel":19},"https://en.wikipedia.org/wiki/High_availability",[],"highly available"," is key. At GitLab, our biggest struggle in scaling was right in our name: Git.",[23,24,26],"h2",{"id":25},"the-trouble-with-scaling-git","The trouble with scaling Git",[12,28,29,30,35],{},"Git is software that is distributed, but not usually run in a ‘highly available cluster,’ which is what GitLab needs. At first, we solved this with a ",[16,31,34],{"href":32,"rel":33},"https://handbook.gitlab.com/handbook/values/#boring-solutions",[],"boring solution",", NFS – which exposes a shared filesystem across multiple machines and generally worked. As we’d soon find out, most NFS appliances were for bulk storage and not fast enough. This led to problems with GitLab’s Git access being slow.",[12,37,38,39,44],{},"To solve the speed problem we built ",[16,40,43],{"href":41,"rel":42},"https://docs.gitlab.com/administration/gitaly/",[],"Gitaly, our service that provides high-level RPC access to Git repositories",".",[12,46,47,48,52],{},"When we started with ",[16,49,51],{"href":50},"/blog/the-road-to-gitaly-1-0/","Gitaly v1.0",", our goal was to remove the need for a network-attached filesystem access for Git data. When that was complete, the next problem to tackle was that all your data is only stored once. So, if you have a server down, or your hard disk dies, or something happens to this one copy, you're in deep trouble until a backup is restored. This is an issue for GitLab.com, but it’s also a big risk for our customers and community.",[12,54,55,56,60],{},"Back at our Summit in Cape Town in 2018, the Gitaly team (at the time, that was ",[16,57,59],{"href":58},"/company/?department=all#jacobvosmaer-gitlab","Jacob Vosmaer"," and me) and some other engineers discussed pursuing a fault-tolerant, highly available system for Git data. For about a month we went back and forth about how we would go about it – ranging from wild ideas to smaller iterations towards what we want. The challenge here was that the ultimate aim is always going to be 100% availability, but you’re never going to make that. So let's aim for a lot of nines (three nines being 99.9%, five being 99.999%, etc.) Ideally, we'd be able to iterate to 10 nines if we wanted to.",[12,62,63,64,69],{},"Eventually we chose the design of a proxy: introduce a new component in the GitLab architecture, which is Praefect, and then route all the traffic through it to Gitaly storage nodes to provide a ",[16,65,68],{"href":66,"rel":67},"https://docs.gitlab.com/administration/gitaly/praefect/",[],"Gitaly Cluster",". Praefect inspects the request and tries to route it to the right Gitaly backend, checks that Gitaly is up, makes sure the copies of your data are up to date, and so on.",[23,71,73],{"id":72},"first-iteration-eventual-consistency","First iteration: Eventual consistency",[12,75,76,77,81],{},"To cut the scope, for our first iterations we settled on eventual consistency, which is fairly common – we even use it for some GitLab features. With Git data, if we are behind a minute, it's not a big deal because at GitLab at least 90% of operations on our Git data are just reads, compared to a very small volume of writes. If I run ",[78,79,80],"code",{},"git pull"," and I'm one commit behind master, that's not ideal, but not a deal breaker in most cases.",[12,83,84],{},"With eventual consistency, each repository gets three copies: one primary and two secondary. We replicate your data from the primary to the other copies, so that if your primary is inaccessible, we can at least give you read access to the secondary copies until we recover the primary. There’s a chance the secondaries are one or two commits behind your primary, but it’s better than no access.",[12,86,87,88,93],{},"We rolled this out in ",[16,89,92],{"href":90,"rel":91},"https://docs.gitlab.com/releases/#gitaly-cluster-for-high-availability-git-storage",[],"13.0"," as generally available.",[23,95,97],{"id":96},"strong-consistency","Strong consistency",[12,99,100],{},"The next stage was to work on strong consistency, where all of your three copies are always up to date.",[12,102,103],{},"When you write to your Git repository, there’s a moment where Praefect says, “OK, I'm going to update branch A from #abc to #cbd.” If all three copies agree on the updates, then Praefect tells everyone to apply this update and now, almost at the same moment in time, they'll update the data to the same thing. Now you've got three copies that are up to date.",[12,105,106,107,111],{},"So, if one copy is offline for some reason – let’s say a network partition, or the disk is corrupted – we can serve from the other two copies. Then the data remains available, and you have more time to recover the third copy as an admin. Effectively, while you always have a designated primary, it's actually more like having ",[108,109,110],"em",{},"three"," primaries, because they are all in the same state.",[12,113,114],{},"If the default state of a system is consistent it requires maintaining this consistency on each mutation to the data that's performed. All possible requests to Gitaly are grouped into two classes: mutators and accessors. Meaning that there was a risk we had to migrate each mutator RPC individually. That would've been a major effort, and if possible, we wanted to push this problem to Git. Gitaly uses Git for the majority of write operations, and was thus the largest common denominator.",[12,116,117,118,123,124,129,130,135,136,44],{},"So Git had to become aware of transactions, which ideally isn't part of Git. There are more areas where it would be nice if Git was aware of business logic, but if we're honest with ourselves, it's not really Git's concern: authentication and authorization. At GitLab we use ",[16,119,122],{"href":120,"rel":121},"https://git-scm.com/docs/githooks.html#_hooks",[],"Git Hooks"," for that. So the idea ",[16,125,128],{"href":126,"rel":127},"https://public-inbox.org/git/1de96b96e3448c8f7e7974f7c082fd08d2d14e96.1592475610.git.ps@pks.im/T/#m9ae42f583968aa1d8ca43bd3007333cf51a618cc",[],"applied and contributed"," (thanks, Patrick Steinhardt!) was the same: when events happen with Git, execute a hook and allow Gitaly to execute business logic. Through the exit code of the hook, Git is signaled on how to proceed. In Git, these events are updates of any reference (for example, branches or tags). When this happens Git will then allow Gitaly to participate in a ",[16,131,134],{"href":132,"rel":133},"https://en.wikipedia.org/wiki/Three-phase_commit_protocol",[],"three-phase commit"," transaction by communicating back to Praefect, and enforce consistency. So we got that released in Git, fixed a bug, and now we’re ",[16,137,140],{"href":138,"rel":139},"https://gitlab.com/gitlab-org/git/-/issues/79",[],"rolling it out to almost all write requests",[23,142,144],{"id":143},"a-defensible-cost-increase","A defensible cost increase",[12,146,147],{},"Now strong consistency is great, but we are effectively asking our customers, “Instead of one copy, why don't you triple your storage costs and your server costs and whatnot, and you have zero benefits unless something goes wrong.” That wasn't really appealing for most customers, but now we’ve sweetened the deal with increased performance and making the cost increase more manageable.",[12,149,150,151,155,156,161,162,167],{},"So, if you have three copies of your data that are up to date, then all of them could serve any request that doesn't mutate the data, right? Because you know they're up to date. Right now, ",[16,152,154],{"href":153},"/company/?department=gitaly-team#8bitlife","Pavlo"," is working on ",[16,157,160],{"href":158,"rel":159},"https://gitlab.com/gitlab-com/www-gitlab-com/-/merge_requests/71960",[],"read distribution, which we are making generally available in 13.8"," (coming Jan. 22, 2021). ",[16,163,166],{"href":164,"rel":165},"https://gitlab.com/gitlab-com/www-gitlab-com/-/merge_requests/58694",[],"We rolled it out briefly before",", but it didn’t scale as expected, so we’ve worked with QA to mitigate that.",[12,169,170,171,176],{},"Right now, Praefect is rolled out to a very limited subset of projects on GitLab.com, because running it is expensive already. When I first proposed rolling it out for everyone, it was very quick to calculate that that will triple our Gitaly Clusters – not within the budget at all! So we're trying to iterate towards that goal. The first step is to work on allowing a ",[16,172,175],{"href":173,"rel":174},"https://docs.gitlab.com/administration/gitaly/praefect/#variable-replication-factor",[],"variable replication factor",". It can be expensive to store a lot of data multiple times, so why don't we make it so that you can store some repositories three times and some just one time, and you don't get the guarantees and the availability of those with three copies.",[23,178,180],{"id":179},"challenges-and-lessons-learned","Challenges and lessons learned",[12,182,183,184,189],{},"So we have Praefect, this new component, but it's not installed by default on GitLab Omnibus –\nyou have to enable it yourself. The ",[16,185,188],{"href":186,"rel":187},"https://gitlab.com/gitlab-org/gitlab-development-kit",[],"GitLab Development Kit"," uses it as well as the tests on GitLab.com, for GitLab projects, but that wasn’t always the case. When you have an optional part in your architecture, if you’re debugging or talking with customers, there is the additional mental burden of verifying what the architecture looks like. Without it, you can make much quicker assumptions on what's going on and why it's working or why it isn't. Officially, we have deprecated NFS, so it makes sense to make it a required component so we can depend on it being there.",[12,191,192],{},"Also, as we add more features to Praefect, if it’s still optional then some customers get those added benefits and some don’t.",[194,195,197],"h3",{"id":196},"we-should-have-put-it-in-production-sooner","We should have put it in production sooner",[12,199,200],{},"Our first iteration was just proxying the traffic, doing nothing with it, and verifying that it works. We didn't put it in production because it offered nothing to the community. But, it includes new components in your architecture, which our SREs need to know about, and there were a couple of bugs we found out much later. I was hesitant to put something in production that didn't offer anything in return, but if we’d been a little more aggressive with putting it out there – even just for a small subset of projects – we would understand more quickly what we're running, what was working, and what wasn't.",[194,202,204],{"id":203},"applying-big-architectural-changes-takes-time","Applying big architectural changes takes time",[12,206,207],{},"If you ask customers to make giant architectural changes, it's going to take longer than you think. When we released Praefect and Gitaly Clusters in 13.0, it was fairly rough around the edges and some things weren't working as you would expect, but it was a good time to release because now, six months later, we see customers finally starting to implement it. They want to validate, try it out on a subset, and then finally roll it out for their whole GitLab instance. While that took longer than I expected, it's cool to see the numbers going up now, and adoption is growing quite rapidly.",[23,209,211],{"id":210},"more-than-just-a-traffic-manager","More than just a traffic manager",[12,213,214],{},"Praefect does much more than just inspect the traffic. If Gitaly goes down, ideally you want to notice that before you actually fire a request, which Praefect does. It does failover, so if one fails and it was designated as a primary, then it fails over to a secondary, which is now designated as a primary.",[12,216,217],{},"I'm really excited for the next few years and the kind of things we are planning to build in Praefect and what that will deliver to GitLab.com and our customers and community. Where before we didn’t have very granular control over what we were doing or why we were doing it, now we can intercept and optimize.",[23,219,221],{"id":220},"whats-next","What's next",[12,223,224,225,230,231,236,237,44],{},"We're shipping ",[16,226,229],{"href":227,"rel":228},"https://gitlab.com/gitlab-org/gitaly/-/issues/3334",[],"HA Distributed Reads"," in GitLab 13.8 (Jan. 22, 2021). For 13.9, we're shooting for ",[16,232,235],{"href":233,"rel":234},"https://gitlab.com/groups/gitlab-org/-/epics/1189",[],"strong consistency in the Gitaly Cluster"," and ",[16,238,175],{"href":239,"rel":240},"https://gitlab.com/groups/gitlab-org/-/epics/3372",[],[12,242,243,244,248],{},"For GitLab self-managed users, consider enabling Praefect if you have high availability requirements. Visit our ",[16,245,247],{"href":66,"rel":246},[],"Gitaly Clusters documentation"," to get started.",[12,250,251],{},[108,252,253,254,258],{},"Major thanks to ",[16,255,257],{"href":256},"/company/#rebecca","Rebecca Dodd"," who contributed to this post.",[12,260,261,262,267,268],{},"Cover image by ",[16,263,266],{"href":264,"rel":265},"https://unsplash.com/@yoeljgonzalez?utm_source=unsplash&utm_medium=referral&utm_content=creditCopyText%22",[],"Yoel J Gonzalez"," on ",[16,269,272],{"href":270,"rel":271},"https://unsplash.com/s/photos/traffic?utm_source=unsplash&utm_medium=referral&utm_content=creditCopyText",[],"Unsplash",{"title":274,"searchDepth":275,"depth":275,"links":276},"",2,[277,278,279,280,281,286,287],{"id":25,"depth":275,"text":26},{"id":72,"depth":275,"text":73},{"id":96,"depth":275,"text":97},{"id":143,"depth":275,"text":144},{"id":179,"depth":275,"text":180,"children":282},[283,285],{"id":196,"depth":284,"text":197},3,{"id":203,"depth":284,"text":204},{"id":210,"depth":275,"text":211},{"id":220,"depth":275,"text":221},"engineering","2021-01-21","This router and transaction manager ensures there are multiple copies of each Git repository available in the event of an outage – no NFS required.","md",null,false,"https://res.cloudinary.com/about-gitlab-com/image/upload/v1749669204/Blog/Hero%20Images/traffic-intersection.jpg",{},true,"/en-us/blog/high-availability-git-storage-with-praefect",{"title":5,"description":290,"ogTitle":5,"ogDescription":290,"noIndex":293,"ogImage":294,"ogUrl":299,"ogSiteName":300,"ogType":301,"canonicalUrls":299},"https://about.gitlab.com/blog/high-availability-git-storage-with-praefect","https://about.gitlab.com","article","high-availability-git-storage-with-praefect","en-us/blog/high-availability-git-storage-with-praefect",[305,306,307,308,309],"testing","git","inside GitLab","integrations","open source","BlogPost","-c30YHkYXlZ-_0Z3vxuyTi8z8TxZDpZ9Ozitj97NSl4",{"logo":313,"freeTrial":318,"sales":323,"login":328,"items":333,"search":669,"minimal":701,"duo":720,"switchNav":729,"pricingDeployment":740},{"config":314},{"href":315,"dataGaName":316,"dataGaLocation":317},"/","gitlab logo","header",{"text":319,"config":320},"Get free trial",{"href":321,"dataGaName":322,"dataGaLocation":317},"https://gitlab.com/-/trial_registrations/new?glm_source=about.gitlab.com&glm_content=default-saas-trial/","free trial",{"text":324,"config":325},"Request a demo",{"href":326,"dataGaName":327,"dataGaLocation":317},"/request-a-demo/","sales",{"text":329,"config":330},"Sign in",{"href":331,"dataGaName":332,"dataGaLocation":317},"https://gitlab.com/users/sign_in/","sign in",[334,420,508,513,593,647],{"text":335,"left":296,"config":336,"menu":338},"Platform",{"dataNavLevelOne":337},"platform",{"type":339,"link":340,"columns":344,"feature":409},"lists",{"text":341,"config":342},"Explore the Platform",{"href":343,"dataGaName":337,"dataGaLocation":317},"/platform/",[345,368,391],{"title":346,"items":347},"DevOps",[348,353,358,363],{"text":349,"config":350},"CI/CD",{"href":351,"dataGaLocation":317,"dataGaName":352},"/solutions/continuous-integration/","ci/cd",{"text":354,"config":355},"Source Code Management",{"href":356,"dataGaLocation":317,"dataGaName":357},"/solutions/source-code-management/","source code management",{"text":359,"config":360},"Agile Delivery",{"href":361,"dataGaLocation":317,"dataGaName":362},"/solutions/agile-delivery/","agile delivery",{"text":364,"config":365},"Artifact Management",{"href":366,"dataGaLocation":317,"dataGaName":367},"/artifact-central/","artifact management",{"title":369,"items":370},"Security & Governance",[371,376,381,386],{"text":372,"config":373},"Application Security Testing",{"href":374,"dataGaLocation":317,"dataGaName":375},"/solutions/application-security-testing/","application security testing",{"text":377,"config":378},"Governance & Compliance",{"href":379,"dataGaLocation":317,"dataGaName":380},"/solutions/software-compliance/","governance and compliance",{"text":382,"config":383},"Secrets Management",{"href":384,"dataGaLocation":317,"dataGaName":385},"/gitlab-secrets-manager/","secrets management",{"text":387,"config":388},"Supply Chain Security",{"href":389,"dataGaLocation":317,"dataGaName":390},"/solutions/supply-chain/","supply chain security",{"title":392,"items":393},"Agentic AI & Context",[394,399,404],{"text":395,"config":396},"Duo Agent Platform",{"href":397,"dataGaLocation":317,"dataGaName":398},"/gitlab-duo-agent-platform/","duo agent platform",{"text":400,"config":401},"Orbit Context Graph",{"href":402,"dataGaLocation":317,"dataGaName":403},"/gitlab-orbit/","orbit",{"text":405,"config":406},"Visibility & Measurement",{"href":407,"dataGaLocation":317,"dataGaName":408},"/solutions/visibility-measurement/","visibility and measurement",{"config":410,"title":413,"text":414,"link":415},{"background":411,"textColor":412},"url('https://res.cloudinary.com/about-gitlab-com/image/upload/v1790185102/o7dn32anqcb6z8dgd3as.jpg')","#000","GitLab Orbit is generally available","Higher agent accuracy, lower token cost",{"text":416,"config":417},"Read the announcement",{"href":418,"dataGaName":419,"dataGaLocation":317},"/blog/gitlab-orbit-ga/","orbit ga announcement",{"text":421,"left":296,"config":422,"menu":424},"Solutions",{"dataNavLevelOne":423},"solutions",{"type":339,"link":425,"columns":429,"feature":499},{"text":426,"config":427},"View all Solutions",{"href":428,"dataGaName":423,"dataGaLocation":317},"/solutions/",[430,448,466],{"title":431,"items":432},"Outcomes",[433,438,443],{"text":434,"config":435},"DevOps Modernization",{"href":436,"dataGaLocation":317,"dataGaName":437},"/assessments/devops-modernization-assessment/","devops modernization",{"text":439,"config":440},"Security Modernization",{"href":441,"dataGaLocation":317,"dataGaName":442},"/assessments/security-modernization-assessment/","security modernization",{"text":444,"config":445},"AI Modernization",{"href":446,"dataGaLocation":317,"dataGaName":447},"/assessments/ai-modernization-assessment/","ai modernization",{"title":449,"items":450},"By size",[451,456,461],{"text":452,"config":453},"Enterprise",{"href":454,"dataGaLocation":317,"dataGaName":455},"/enterprise/","enterprise",{"text":457,"config":458},"Small Business",{"href":459,"dataGaLocation":317,"dataGaName":460},"/small-business/","small business",{"text":462,"config":463},"Startups",{"href":464,"dataGaLocation":317,"dataGaName":465},"/solutions/startups/","startups",{"title":467,"items":468},"Industries",[469,474,479,484,489,494],{"text":470,"config":471},"Financial Services",{"href":472,"dataGaLocation":317,"dataGaName":473},"/solutions/finance/","financial services",{"text":475,"config":476},"Public Sector",{"href":477,"dataGaLocation":317,"dataGaName":478},"/solutions/public-sector/","public sector",{"text":480,"config":481},"Telecommunications",{"href":482,"dataGaLocation":317,"dataGaName":483},"/solutions/telecommunications/","telecommunications",{"text":485,"config":486},"Automotive",{"href":487,"dataGaLocation":317,"dataGaName":488},"/solutions/automotive/","automotive",{"text":490,"config":491},"Education",{"href":492,"dataGaLocation":317,"dataGaName":493},"/solutions/education/","education",{"text":495,"config":496},"Aerospace",{"href":497,"dataGaLocation":317,"dataGaName":498},"/solutions/aerospace/","aerospace",{"config":500,"title":501,"text":502,"link":503},{"background":411,"textColor":412},"GitLab Security Standard","Learn how to harden your software factory and let AI agents earn autonomy, without trading away security.",{"text":504,"config":505},"Explore the standard",{"href":506,"dataGaName":507,"dataGaLocation":317},"/gitlab-security-standard/","gitlab security standard",{"text":509,"config":510},"Pricing",{"href":511,"dataGaName":512,"dataGaLocation":317,"dataNavLevelOne":512},"/pricing/","pricing",{"text":514,"config":515,"menu":517},"Resources",{"dataNavLevelOne":516},"resources",{"type":339,"link":518,"columns":522,"feature":584},{"text":519,"config":520},"View all resources",{"href":521,"dataGaName":516,"dataGaLocation":317},"/resources/",[523,556],{"title":524,"items":525},"Discover",[526,531,536,541,546,551],{"text":527,"config":528},"Docs",{"href":529,"dataGaName":530,"dataGaLocation":317},"https://docs.gitlab.com/","docs",{"text":532,"config":533},"University",{"href":534,"dataGaName":535,"dataGaLocation":317},"https://university.gitlab.com/","university",{"text":537,"config":538},"Demo Series",{"href":539,"dataGaName":540,"dataGaLocation":317},"/gitlab-technical-demo-series/","demo series",{"text":542,"config":543},"Demo Hub",{"href":544,"dataGaName":545,"dataGaLocation":317},"/demo-hub/","demo hub",{"text":547,"config":548},"Services",{"href":549,"dataGaName":550,"dataGaLocation":317},"/services/","services",{"text":552,"config":553},"Well Architected",{"href":554,"dataGaName":555,"dataGaLocation":317},"/resources/well-architected/","well architected",{"title":557,"items":558},"Connect",[559,564,569,574,579],{"text":560,"config":561},"Blog",{"href":562,"dataGaName":563,"dataGaLocation":317},"/blog/","blog",{"text":565,"config":566},"Community",{"href":567,"dataGaName":568,"dataGaLocation":317},"/community/","community",{"text":570,"config":571},"Customers",{"href":572,"dataGaName":573,"dataGaLocation":317},"/customers/","customers",{"text":575,"config":576},"Partners",{"href":577,"dataGaName":578,"dataGaLocation":317},"/partners/","partners",{"text":580,"config":581},"Events",{"href":582,"dataGaName":583,"dataGaLocation":317},"/events/","events",{"config":585,"title":586,"text":587,"link":588},{"background":411,"textColor":412},"What’s new in GitLab","Stay updated with our latest features and improvements.",{"text":589,"config":590},"Read the latest",{"href":591,"dataGaName":592,"dataGaLocation":317},"/whats-new/","whats new",{"text":594,"config":595,"menu":597},"Company",{"dataNavLevelOne":596},"company",{"type":339,"columns":598},[599],{"items":600},[601,606,612,617,622,627,632,637,642],{"text":602,"config":603},"About",{"href":604,"dataGaName":605,"dataGaLocation":317},"/company/","about",{"text":607,"config":608,"footerGa":611},"Jobs",{"href":609,"dataGaName":610,"dataGaLocation":317},"/jobs/","jobs",{"dataGaName":610},{"text":613,"config":614},"Press",{"href":615,"dataGaName":616,"dataGaLocation":317},"/press/","press",{"text":618,"config":619},"Handbook",{"href":620,"dataGaName":621,"dataGaLocation":317},"https://handbook.gitlab.com/","handbook",{"text":623,"config":624},"Leadership",{"href":625,"dataGaName":626,"dataGaLocation":317},"/company/team/e-group/","leadership",{"text":628,"config":629},"Investor relations",{"href":630,"dataGaName":631,"dataGaLocation":317},"https://ir.gitlab.com/overview/default.aspx","investor relations",{"text":633,"config":634},"Trust Center",{"href":635,"dataGaName":636,"dataGaLocation":317},"/security/","trust center",{"text":638,"config":639},"AI Transparency Center",{"href":640,"dataGaName":641,"dataGaLocation":317},"/ai-transparency-center/","ai transparency center",{"text":643,"config":644},"Newsletter",{"href":645,"dataGaName":646,"dataGaLocation":317},"/company/contact/#contact-forms","newsletter",{"text":648,"config":649,"menu":650},"Contact us",{"dataNavLevelOne":596},{"type":339,"columns":651},[652],{"items":653},[654,659,664],{"text":655,"config":656},"Talk to sales",{"href":657,"dataGaName":658,"dataGaLocation":317},"/sales/","talk to sales",{"text":660,"config":661},"Support portal",{"href":662,"dataGaName":663,"dataGaLocation":317},"https://support.gitlab.com/hc/en-us","support portal",{"text":665,"config":666},"Customer portal",{"href":667,"dataGaName":668,"dataGaLocation":317},"https://customers.gitlab.com/customers/sign_in/","customer portal",{"close":670,"login":671,"suggestions":678},"Close",{"text":672,"link":673},"To search repositories and projects, login to",{"text":674,"config":675},"gitlab.com",{"href":331,"dataGaName":676,"dataGaLocation":677},"search login","search",{"text":679,"default":680},"Suggestions",[681,684,687,689,693,697],{"text":682,"config":683},"GitLab Duo Agent Platform",{"href":397,"dataGaName":682,"dataGaLocation":677},{"text":685,"config":686},"Code Suggestions (AI)",{"href":397,"dataGaName":685,"dataGaLocation":677},{"text":349,"config":688},{"href":351,"dataGaName":349,"dataGaLocation":677},{"text":690,"config":691},"GitLab on AWS",{"href":692,"dataGaName":690,"dataGaLocation":677},"/partners/technology-partners/aws/",{"text":694,"config":695},"GitLab on Google Cloud",{"href":696,"dataGaName":694,"dataGaLocation":677},"/partners/technology-partners/google-cloud-platform/",{"text":698,"config":699},"Why GitLab?",{"href":700,"dataGaName":698,"dataGaLocation":677},"/why-gitlab/",{"freeTrial":702,"mobileIcon":707,"desktopIcon":712,"secondaryButton":715},{"text":703,"config":704},"Start free trial",{"href":705,"dataGaName":322,"dataGaLocation":706},"https://gitlab.com/-/trials/new/","nav",{"altText":708,"config":709},"Gitlab Icon",{"src":710,"dataGaName":711,"dataGaLocation":706},"https://res.cloudinary.com/about-gitlab-com/image/upload/v1758203874/jypbw1jx72aexsoohd7x.svg","gitlab icon",{"altText":708,"config":713},{"src":714,"dataGaName":711,"dataGaLocation":706},"https://res.cloudinary.com/about-gitlab-com/image/upload/v1758203875/gs4c8p8opsgvflgkswz9.svg",{"text":716,"config":717},"Get Started",{"href":718,"dataGaName":719,"dataGaLocation":706},"https://gitlab.com/-/trial_registrations/new?glm_source=about.gitlab.com/get-started/","get started",{"freeTrial":721,"mobileIcon":725,"desktopIcon":727},{"text":722,"config":723},"Learn more about GitLab Duo",{"href":397,"dataGaName":724,"dataGaLocation":706},"gitlab duo",{"altText":708,"config":726},{"src":710,"dataGaName":711,"dataGaLocation":706},{"altText":708,"config":728},{"src":714,"dataGaName":711,"dataGaLocation":706},{"button":730,"mobileIcon":735,"desktopIcon":737},{"text":731,"config":732},"/switch",{"href":733,"dataGaName":734,"dataGaLocation":706},"#contact","switch",{"altText":708,"config":736},{"src":710,"dataGaName":711,"dataGaLocation":706},{"altText":708,"config":738},{"src":739,"dataGaName":711,"dataGaLocation":706},"https://res.cloudinary.com/about-gitlab-com/image/upload/v1773335277/ohhpiuoxoldryzrnhfrh.png",{"freeTrial":741,"mobileIcon":746,"desktopIcon":748},{"text":742,"config":743},"Back to pricing",{"href":511,"dataGaName":744,"dataGaLocation":706,"icon":745},"back to pricing","GoBack",{"altText":708,"config":747},{"src":710,"dataGaName":711,"dataGaLocation":706},{"altText":708,"config":749},{"src":714,"dataGaName":711,"dataGaLocation":706},{"title":751,"button":752,"config":756},"GitLab Orbit is generally available. Increase agent accuracy and lower token cost",{"text":416,"config":753},{"href":418,"dataGaName":754,"dataGaLocation":755},"orbit-ga-banner","global-banner",{"layout":757,"disabled":293},"release",{"data":759},{"text":760,"config":761,"items":766,"minimal":994},"Git is a trademark of Software Freedom Conservancy and our use of 'GitLab' is under license",{"twitter":762,"facebook":763,"youtube":764,"linkedin":765},"https://twitter.com/gitlab","https://www.facebook.com/gitlab","https://www.youtube.com/channel/UCnMGQ8QHMAnVIsI3xJrihhg","https://www.linkedin.com/company/gitlab-com",[767,815,874,921,962],{"title":509,"links":768,"subMenu":784},[769,774,779],{"text":770,"config":771},"View plans",{"href":511,"dataGaName":772,"dataGaLocation":773},"view plans","footer",{"text":775,"config":776},"Why Premium?",{"href":777,"dataGaName":778,"dataGaLocation":773},"/pricing/premium/","why premium",{"text":780,"config":781},"Why Ultimate?",{"href":782,"dataGaName":783,"dataGaLocation":773},"/pricing/ultimate/","why ultimate",[785],{"title":786,"links":787},"Contact Us",[788,791,793,795,800,805,810],{"text":789,"config":790},"Contact sales",{"href":657,"dataGaName":327,"dataGaLocation":773},{"text":660,"config":792},{"href":662,"dataGaName":663,"dataGaLocation":773},{"text":665,"config":794},{"href":667,"dataGaName":668,"dataGaLocation":773},{"text":796,"config":797},"Status",{"href":798,"dataGaName":799,"dataGaLocation":773},"https://status.gitlab.com/","status",{"text":801,"config":802},"Terms of use",{"href":803,"dataGaName":804,"dataGaLocation":773},"/terms/","terms of use",{"text":806,"config":807},"Privacy statement",{"href":808,"dataGaName":809,"dataGaLocation":773},"/privacy/","privacy statement",{"text":811,"config":812},"Cookie preferences",{"dataGaName":813,"dataGaLocation":773,"id":814,"isOneTrustButton":296},"cookie preferences","ot-sdk-btn",{"title":335,"links":816,"subMenu":832},[817,820,822,824,826,828],{"text":818,"config":819},"Explore the platform",{"href":343,"dataGaName":337,"dataGaLocation":773},{"text":395,"config":821},{"href":397,"dataGaName":398,"dataGaLocation":773},{"text":349,"config":823},{"href":351,"dataGaName":352,"dataGaLocation":773},{"text":400,"config":825},{"href":402,"dataGaName":403,"dataGaLocation":773},{"text":382,"config":827},{"href":384,"dataGaName":385,"dataGaLocation":773},{"text":829,"config":830},"Why GitLab",{"href":700,"dataGaName":831,"dataGaLocation":773},"why gitlab",[833],{"title":834,"links":835},"Topics",[836,840,845,849,854,859,864,869],{"text":349,"config":837},{"href":838,"dataGaName":839,"dataGaLocation":773},"/topics/ci-cd/","cicd",{"text":841,"config":842},"GitOps",{"href":843,"dataGaName":844,"dataGaLocation":773},"/topics/gitops/","gitops",{"text":346,"config":846},{"href":847,"dataGaName":848,"dataGaLocation":773},"/topics/devops/","devops",{"text":850,"config":851},"Version Control",{"href":852,"dataGaName":853,"dataGaLocation":773},"/topics/version-control/","version control",{"text":855,"config":856},"DevSecOps",{"href":857,"dataGaName":858,"dataGaLocation":773},"/topics/devsecops/","devsecops",{"text":860,"config":861},"Cloud Native",{"href":862,"dataGaName":863,"dataGaLocation":773},"/topics/cloud-native/","cloud native",{"text":865,"config":866},"AI for Coding",{"href":867,"dataGaName":868,"dataGaLocation":773},"/topics/devops/ai-for-coding/","ai for coding",{"text":870,"config":871},"Agentic AI",{"href":872,"dataGaName":873,"dataGaLocation":773},"/topics/agentic-ai/","agentic ai",{"title":421,"links":875},[876,879,882,885,888,891,893,895,897,899,901,904,906,909,913,917],{"text":877,"config":878},"DevOps modernization",{"href":436,"dataGaName":437,"dataGaLocation":773},{"text":880,"config":881},"Security modernization",{"href":441,"dataGaName":442,"dataGaLocation":773},{"text":883,"config":884},"AI modernization",{"href":446,"dataGaName":447,"dataGaLocation":773},{"text":886,"config":887},"Financial services",{"href":472,"dataGaName":473,"dataGaLocation":773},{"text":889,"config":890},"Public sector",{"href":477,"dataGaName":478,"dataGaLocation":773},{"text":480,"config":892},{"href":482,"dataGaName":483,"dataGaLocation":773},{"text":485,"config":894},{"href":487,"dataGaName":488,"dataGaLocation":773},{"text":490,"config":896},{"href":492,"dataGaName":493,"dataGaLocation":773},{"text":495,"config":898},{"href":497,"dataGaName":498,"dataGaLocation":773},{"text":452,"config":900},{"href":454,"dataGaName":455,"dataGaLocation":773},{"text":902,"config":903},"Small business",{"href":459,"dataGaName":460,"dataGaLocation":773},{"text":462,"config":905},{"href":464,"dataGaName":465,"dataGaLocation":773},{"text":841,"config":907},{"href":908,"dataGaName":844,"dataGaLocation":773},"/solutions/gitops/",{"text":910,"config":911},"Software composition analysis",{"href":389,"dataGaName":912,"dataGaLocation":773},"software composition analysis",{"text":914,"config":915},"Value stream management",{"href":407,"dataGaName":916,"dataGaLocation":773},"value stream management",{"text":918,"config":919},"All solutions",{"href":428,"dataGaName":920,"dataGaLocation":773},"all solutions",{"title":514,"links":922},[923,928,933,935,937,939,941,943,945,947,949,951,953,955,958],{"text":924,"config":925},"Install",{"href":926,"dataGaName":927,"dataGaLocation":773},"/install/","install",{"text":929,"config":930},"Quick start guides",{"href":931,"dataGaName":932,"dataGaLocation":773},"/get-started/","quick setup checklists",{"text":527,"config":934},{"href":529,"dataGaName":530,"dataGaLocation":773},{"text":532,"config":936},{"href":534,"dataGaName":535,"dataGaLocation":773},{"text":537,"config":938},{"href":539,"dataGaName":540,"dataGaLocation":773},{"text":542,"config":940},{"href":544,"dataGaName":545,"dataGaLocation":773},{"text":547,"config":942},{"href":549,"dataGaName":550,"dataGaLocation":773},{"text":560,"config":944},{"href":562,"dataGaName":563,"dataGaLocation":773},{"text":565,"config":946},{"href":567,"dataGaName":568,"dataGaLocation":773},{"text":570,"config":948},{"href":572,"dataGaName":573,"dataGaLocation":773},{"text":575,"config":950},{"href":577,"dataGaName":578,"dataGaLocation":773},{"text":580,"config":952},{"href":582,"dataGaName":583,"dataGaLocation":773},{"text":643,"config":954},{"href":645,"dataGaName":646,"dataGaLocation":773},{"text":956,"config":957},"What's new",{"href":591,"dataGaName":592,"dataGaLocation":773},{"text":959,"config":960},"All resources",{"href":521,"dataGaName":961,"dataGaLocation":773},"all resources",{"title":594,"links":963},[964,966,968,970,972,974,976,978,980,984,989],{"text":602,"config":965},{"href":604,"dataGaName":596,"dataGaLocation":773},{"text":607,"config":967},{"href":609,"dataGaName":610,"dataGaLocation":773},{"text":613,"config":969},{"href":615,"dataGaName":616,"dataGaLocation":773},{"text":618,"config":971},{"href":620,"dataGaName":621,"dataGaLocation":773},{"text":623,"config":973},{"href":625,"dataGaName":626,"dataGaLocation":773},{"text":628,"config":975},{"href":630,"dataGaName":631,"dataGaLocation":773},{"text":633,"config":977},{"href":635,"dataGaName":636,"dataGaLocation":773},{"text":638,"config":979},{"href":640,"dataGaName":641,"dataGaLocation":773},{"text":981,"config":982},"Sustainability",{"href":983,"dataGaName":981,"dataGaLocation":773},"/sustainability/",{"text":985,"config":986},"Diversity, inclusion and belonging (DIB)",{"href":987,"dataGaName":988,"dataGaLocation":773},"/diversity-inclusion-belonging/","Diversity, inclusion and belonging",{"text":990,"config":991},"Modern Slavery Transparency Statement",{"href":992,"dataGaName":993,"dataGaLocation":773},"https://handbook.gitlab.com/handbook/legal/modern-slavery-act-transparency-statement/","modern slavery transparency statement",{"items":995},[996,999,1002],{"text":997,"config":998},"Terms",{"href":803,"dataGaName":804,"dataGaLocation":773},{"text":1000,"config":1001},"Cookies",{"dataGaName":813,"dataGaLocation":773,"id":814,"isOneTrustButton":296},{"text":1003,"config":1004},"Privacy",{"href":808,"dataGaName":809,"dataGaLocation":773},[1006],{"id":1007,"title":1008,"body":292,"config":1009,"content":1011,"description":292,"extension":1014,"meta":1015,"navigation":296,"path":1016,"seo":1017,"stem":1018,"__hash__":1019},"blogAuthors/en-us/blog/authors/zeger-jan-van-de-weg.yml","Zeger Jan Van De Weg",{"template":1010},"BlogAuthor",{"name":7,"config":1012},{"headshot":274,"ctfId":1013},"zjgitlab","yml",{},"/en-us/blog/authors/zeger-jan-van-de-weg",{},"en-us/blog/authors/zeger-jan-van-de-weg","uTVQwXNnBL0ibdUCEMyi-YCRI3IJbCiLvsRdKDbliM8",[1021,1029,1037],{"title":1022,"description":1023,"heroImage":1024,"category":288,"date":1025,"authors":1026,"slug":1028,"externalUrl":292},"Two front doors: Module-level access in a Django GRC app","A technical deep-dive on restructuring a Django internal tool to support two distinct GitLab teams: Security Compliance and Internal Audit.","https://res.cloudinary.com/about-gitlab-com/image/upload/v1750097663/Blog/Hero%20Images/Blog/Hero%20Images/Workflow%201800x945_2gQoQIbY9NvjLFpXtsxtXy_1750097663612.png","2026-10-05",[1027],"Donovan Felton","module-level-access-in-a-django-grc-app",{"title":1030,"description":1031,"heroImage":1032,"category":288,"date":1033,"authors":1034,"slug":1036,"externalUrl":292},"How GitLab reduced code-per-agentic-flow ratio by 45%","Learn how Flow Registry, a component-based framework that compiles YAML configurations into fully functional LangGraph flows, helped improve scalability and more.","https://res.cloudinary.com/about-gitlab-com/image/upload/v1774465167/n5hlvrsrheadeccyr1oz.png","2026-09-22",[1035],"Mikolaj Wawrzyniak","how-gitlab-reduced-code-per-agentic-flow-ratio",{"title":1038,"description":1039,"heroImage":1040,"category":288,"date":1041,"authors":1042,"slug":1044,"externalUrl":292},"Co-Create: Building GitLab with our users","How GitLab users collaborated with us to build practical product improvements in the first half of 2026.","https://res.cloudinary.com/about-gitlab-com/image/upload/v1750099203/Blog/Hero%20Images/Blog/Hero%20Images/blog-image-template-1800x945%20%2820%29_2bJGC5ZP3WheoqzlLT05C5_1750099203484.png","2026-09-10",[1043],"Isa Huerga","co-create-h1-2026",{"header":1046,"text":1047,"button":1051,"disclaimer":1054},"Start your free\n\n30-day GitLab trial\n",[1048,1049,1050],"GitLab Duo Agent Platform access","Try our most advanced features","Automate complex tasks with AI",{"text":319,"config":1052},{"href":1053,"dataGaName":322,"dataGaLocation":563},"https://gitlab.com/-/trials/new?glm_content=default-saas-trial&glm_source=about.gitlab.com/blog/","No credit card required.",{"header":1056,"blurb":1057,"button":1058,"secondaryButton":1063},"Start building faster today","See what your team can do with the intelligent orchestration platform for DevSecOps.\n",{"text":1059,"config":1060},"Get your free trial",{"href":1061,"dataGaName":322,"dataGaLocation":1062},"https://gitlab.com/-/trial_registrations/new?glm_content=default-saas-trial&glm_source=about.gitlab.com/","feature",{"text":789,"config":1064},{"href":657,"dataGaName":327,"dataGaLocation":1062},1794911779277]