[{"data":1,"prerenderedAt":1115},["ShallowReactive",2],{"/blog/year-of-kubernetes":3,"navigation-en-us":363,"banner-en-us":800,"footer-en-us":808,"blog-post-authors-en-us-John Jarvis":1055,"blog-related-posts-en-us-year-of-kubernetes":1070,"blog-share-wrapper-en-us":1095,"next-steps-en-us":1105},{"id":4,"title":5,"authors":6,"body":8,"category":342,"date":343,"description":344,"extension":345,"externalUrl":346,"faq":346,"featured":347,"heroImage":348,"hidePromo":347,"meta":349,"navigation":350,"path":351,"seo":352,"slug":356,"stem":357,"tags":358,"template":361,"updatedDate":346,"__hash__":362},"blogPosts/en-us/blog/year-of-kubernetes.md","What we learned after a year of GitLab.com on Kubernetes",[7],"John Jarvis",{"type":9,"value":10,"toc":326},"minimark",[11,15,36,41,50,53,57,60,68,71,75,78,81,109,126,134,138,141,146,153,156,165,169,176,185,189,208,211,214,218,233,237,251,254,257,276,290,294],[12,13,14],"p",{},"For about a year now, the infrastructure department has been working on migrating all services that run on GitLab.com to Kubernetes. The effort has not been without challenges, not only with moving services to Kubernetes but also managing a hybrid deployment during the transition. We have learned a number of lessons along the way that we will explore in this post.",[12,16,17,18,23,24,29,30,35],{},"Since the very beginning of GitLab.com, servers for the website have run in the cloud on virtual machines. These VMs are managed by Chef and installed using our ",[19,20,22],"a",{"href":21},"/install/#ubuntu","official Linux package",".\nWhen an application update is required, ",[19,25,28],{"href":26,"rel":27},"https://gitlab.com/gitlab-org/release/docs/-/blob/master/general/deploy/gitlab-com-deployer.md",[],"our deployment strategy"," is to simply upgrade fleets of servers in a coordinated rolling fashion using a CI pipeline.\nThis method, while slow and a bit ",[19,31,34],{"href":32,"rel":33},"https://handbook.gitlab.com/handbook/values/#boring-solutions",[],"boring",", ensures that GitLab.com is using the same installation methods and configuration as our self-managed customers who use Linux packages.\nWe use this method because it is especially important that any pain or joy felt by the community when installing or configuring self-managed GitLab is also felt by GitLab.com.\nThis approach worked well for us for a time but as GitLab.com has grown to hosting over 10 million projects we realized it would no longer serve our needs for scaling and deployments.",[37,38,40],"h2",{"id":39},"enter-kubernetes-and-cloud-native-gitlab","Enter Kubernetes and cloud native GitLab",[12,42,43,44,49],{},"We created the ",[19,45,48],{"href":46,"rel":47},"https://gitlab.com/gitlab-org/charts",[],"GitLab Charts"," project in 2017 to prepare GitLab for deployments in the cloud and enable self-managed users to install GitLab into a Kubernetes cluster. We knew then that running GitLab.com on Kubernetes would benefit the SaaS platform for scaling, deployments, and efficient use of compute resources. At the time though there were still many application features that depended on NFS mounts that delayed our migration off of VMs.",[12,51,52],{},"The push for cloud native and Kubernetes gave engineering an opportunity to plan a gradual transition that removes some of the network storage dependencies on the application while continuing to develop new features. Since we started planning the migration in the summer of 2019, most of these limitations have been resolved and the journey to running all of GitLab.com on Kubernetes is now well underway!",[37,54,56],{"id":55},"running-gitlabcom-on-kubernetes","Running GitLab.com on Kubernetes",[12,58,59],{},"For GitLab.com we use a single regional GKE cluster that services all application traffic. To minimize the complexity of the (already complex) migration we focus on services that don't depend on local storage or NFS. While GitLab.com is running from mostly monolithic Rails codebase, we route traffic depending on workload characteristics to different endpoints which are isolated into their own node pools.",[12,61,62,63,67],{},"On the frontend these types are divided into web, API, git SSH/HTTPs requests, and Registry.\nOn the backend we divide our queued jobs into different characteristics depending on ",[19,64,66],{"href":65},"/blog/scaling-our-use-of-sidekiq/","predefined resource boundaries"," that allow us to set Service-level Objective (SLO) targets for a range of different workloads.",[12,69,70],{},"All of these GitLab.com services are configured with the unmodified GitLab Helm chart, which configures them in sub-charts that can be selectively enabled as we gradually migrate services to the cluster.\nWhile we opted to not include some of our stateful services such as Redis, Postgres, GitLab Pages, and Gitaly, when the migration to Kubernetes is finished it will drastically reduce the number of VMs that we currently manage with Chef.",[37,72,74],{"id":73},"transparency-and-managing-the-kubernetes-configuration","Transparency and managing the Kubernetes configuration",[12,76,77],{},"All configuration is managed in GitLab itself in three configuration projects using Terraform and Helm.\nWhile we use GitLab to run GitLab wherever possible, we maintain a separate GitLab installation for operations.\nThis is done to ensure we do not depend on the availability of GitLab.com for deployments and upgrades of GitLab.com.",[12,79,80],{},"Even though our pipelines that execute against the Kubernetes cluster run on this separate GitLab deployment, the code repositories are mirrored and publicly viewable at the following locations:",[82,83,84,93,101],"ul",{},[85,86,87,92],"li",{},[19,88,91],{"href":89,"rel":90},"https://gitlab.com/gitlab-com/gl-infra/k8s-workloads/gitlab-com",[],"k8s-workloads/gitlab-com",": GitLab.com configuration wrapper for the GitLab Helm chart.",[85,94,95,100],{},[19,96,99],{"href":97,"rel":98},"https://gitlab.com/gitlab-com/gl-infra/k8s-workloads/gitlab-helmfiles/",[],"k8s-workloads/gitlab-helmfiles",": Contains the configuration for services that are not directly related to the GitLab application. This includes configurations for cluster logging and monitoring and integrations like PlantUML.",[85,102,103,108],{},[19,104,107],{"href":105,"rel":106},"https://gitlab.com/gitlab-com/gitlab-com-infrastructure",[],"gitlab-com-infrastructure",": Terraform configuration for the Kubernetes and legacy VM infrastructure. All the resources necessary to run the cluster are configured here, including the cluster, node pools, service accounts, and IP address reservations.",[12,110,111,120,121,125],{},[19,112,115],{"href":113,"rel":114},"https://gitlab.com/gitlab-com/gl-infra/k8s-workloads/gitlab-com/-/merge_requests/315#note_390180361",[],[116,117],"img",{"alt":118,"src":119},"hpa","https://res.cloudinary.com/about-gitlab-com/image/upload/v1782397911/blog/Content%20Images/a_year_of_k8s/hpa.png","\nWhenever a change is proposed, a public ",[19,122,124],{"href":113,"rel":123},[],"short summary"," is displayed, with a link to detailed diff that an SRE reviews before applying changes to the cluster.",[12,127,128,129,133],{},"For SREs, we link to a detailed diff on our operations GitLab instance that has limited access.\nThis allows employees and the community, who do not have access to the operational project which is limited to SREs, to have visibility into proposed config changes.\nBy having a public GitLab instance for code, and a private instance for ",[19,130,132],{"href":131},"/solutions/continuous-integration/","CI pipelines",", we are able to keep a single workflow while at the same time ensuring we don't have a dependency on GitLab.com for configuration updates.",[37,135,137],{"id":136},"the-lessons-we-learned-along-the-way","The lessons we learned along the way",[12,139,140],{},"We have learned a few things along the way, lessons that we are applying to future migrations and new deployments into Kubernetes.",[142,143,145],"h3",{"id":144},"increased-billing-from-cross-az-traffic","Increased billing from cross-AZ traffic",[12,147,148,152],{},[116,149],{"alt":150,"src":151},"git egress","https://res.cloudinary.com/about-gitlab-com/image/upload/v1782397910/blog/Content%20Images/a_year_of_k8s/git_egress.png","\nDaily egress bytes/day from the Git storage fleet on GitLab.com.",[12,154,155],{},"Google divides its network into regions and regions are divided into availability zones (AZs).\nBecause of the large amount of bandwidth required for Git hosting, it is important we are cognizant of network egress. For internal network traffic, egress is only free-of-charge if it remains in a single AZ.\nAt the time of writing this blog post, we deliver approximately 100TB on a typical work day for just Git repositories.\nOn legacy VM topology, services that were previously colocated on the same VMs are now running in Kubernetes pods.\nThis mean some network traffic that was previously local to a VM can now potentially traverse availability zones.",[12,157,158,159,164],{},"Regional GKE clusters provide the convenience of spanning multiple availability zones for redundancy.\nWe are considering ",[19,160,163],{"href":161,"rel":162},"https://gitlab.com/gitlab-com/gl-infra/delivery/-/issues/1175",[],"splitting the regional GKE cluster into single zonal clusters"," for services that use a lot of bandwidth to avoid network egress charges while maintaining redundancy at the cluster level.",[142,166,168],{"id":167},"resource-limits-requests-and-scaling","Resource limits, requests, and scaling",[12,170,171,175],{},[116,172],{"alt":173,"src":174},"replicas","https://res.cloudinary.com/about-gitlab-com/image/upload/v1782397912/blog/Content%20Images/a_year_of_k8s/replicas.png","\nNumber of replicas servicing production traffic on registry.gitlab.com, Registry traffic reaches it peak at ~15:00UTC.",[12,177,178,179,184],{},"Our migration story began in August 2019 when we migrated the GitLab Container Registry to Kubernetes, the first service to move.\nThough this was a critical and high traffic service, it was a good choice for the first migration because it is a stateless application with only a few external dependencies.\nThe first challenge we experienced was the large number of evicted pods, due to memory constraints on our nodes.\nThis required multiple changes to requests and limits. We found that with an application that increases its memory utilization over time, low requests (which reserves memory for each pod) and a generous hard limit on utilization was a recipe for node saturation and a high rate of evictions.\nTo adjust for this ",[19,180,183],{"href":181,"rel":182},"https://gitlab.com/gitlab-com/gl-infra/delivery/-/issues/998#note_388983696",[],"we eventually decided to use higher requests and lower limit"," which took pressure off of the nodes and allowed pods to be recycled without putting too much pressure on the node.\nAfter experiencing this once, we start our migrations with generous requests and limits that are close to the same value, and adjust down as needed.",[142,186,188],{"id":187},"metrics-and-logging","Metrics and logging",[12,190,191,195,196,201,202,207],{},[116,192],{"alt":193,"src":194},"registry-general","https://res.cloudinary.com/about-gitlab-com/image/upload/v1782397912/blog/Content%20Images/a_year_of_k8s/registry-general.png","\nThe Infrastructure department focuses on latency, error rates and saturation that have ",[19,197,200],{"href":198,"rel":199},"https://en.wikipedia.org/wiki/Service-level_objective",[],"Service-level objectives (SLOs)"," that tie into our ",[19,203,206],{"href":204,"rel":205},"https://dashboards.gitlab.net/d/general-slas/general-slas?orgId=1",[],"overall system availability",".",[12,209,210],{},"Over the past year, one of the major changes in the infrastructure department was improvements to how we monitor and manage SLOs.\nSLOs allowed us to set targets on individual services which were monitored closely during the migration.\nYet even with this improved observability, we can't always see problems right away with our metric reporting and alerting.\nFor example, focusing on latency and error rates may not adequately cover all uses of the service that is being migrated.\nWe discovered this problem very early with some of the workloads that were moved into the cluster. This challenge was particularly acute when we had to validate features that do not receive many requests but have very specific configuration dependencies.\nOne of the key migration lessons was to also evaluate more than just monitoring metrics, but also logs, and the long-tail of errors in our monitoring.\nNow for every migration we include a detailed list of log queries and plan a clear rollback procedures that can be handed off from one shift to the next in case of issues.",[12,212,213],{},"Serving the same requests on legacy VM infrastructure and Kubernetes simultaneously presented a unique challenge.\nUnlike a lift-and-shift migration, running on legacy VMs and Kubernetes at the same time requires that our observability is compatible with both and combines metrics into one view.\nMost importantly, we are using the same dashboards and log queries to ensure the observability is consistent during the transition period.",[142,215,217],{"id":216},"shifting-traffic-to-the-new-cluster","Shifting traffic to the new cluster",[12,219,220,221,226,227,232],{},"For GitLab.com we maintain a segmentation of our fleet named the ",[19,222,225],{"href":223,"rel":224},"https://handbook.gitlab.com/handbook/engineering/#canary-testing",[],"canary stage",".\nThis canary fleet services our internal projects, ",[19,228,231],{"href":229,"rel":230},"https://next.gitlab.com",[],"or can be enabled by users",", and is deployed to first for infrastructure and application changes.\nThe first service we migrated started with taking limited traffic internally and we are continuing to use this method to ensure we are meeting our SLOs before committing all traffic to the cluster.\nWhat this means for the migration is requests to internal projects are first routed to Kubernetes and then we slowly move other traffic to the cluster using HAProxy backend weighting.\nWe learned in the process of moving from VMs to Kubernetes that it was extremely beneficial for us to have an easy way to move traffic between the old and new infrastructure, and to keep legacy infrastructure available for rollback in the first few days after the migration.",[142,234,236],{"id":235},"reserved-pod-capacity-and-utilization","Reserved pod capacity and utilization",[12,238,239,240,245,246,250],{},"One problem we identified early was, while our pod start times for the Registry service were very short, our start times for Sidekiq took as long as ",[19,241,244],{"href":242,"rel":243},"https://gitlab.com/gitlab-org/charts/gitlab/-/issues/1775",[],"two minutes",".\nThe long Sidekiq start times posed a challenge when we started moving workloads to Kubernetes for workers that need to process jobs quickly and scale fast.\nThe lesson here was while the Horizontal Pod Autoscaler (HPA) works well in Kubernetes for adapting to increased traffic, it is also important to evaluate workload characteristics and set reserved pod capacity, especially for uneven demand.\nIn our case, we saw a sudden spike in jobs which caused a large scaling event which saturated CPU before we could scale the node pool.\nWhile it is tempting to squeeze as much as possible out of the cluster, after experiencing some initial performance problems we now start with a generous pod budget and scale down later, while keeping a close eye on SLOs.\nThe pod start times for Sidekiq service have improved significantly and now average about 40 seconds. ",[19,247,249],{"href":242,"rel":248},[],"Improving the pod start times"," benefited GitLab.com as well as all the self-managed customers using the official GitLab Helm chart.",[12,252,253],{},"After transitioning each service, we enjoyed many benefits of using Kubernetes in production, including much faster and safer deploys of the application, scaling, and more efficient resource allocation.\nThe migration benefits extend beyond GitLab.com. With each improvement of the official Helm chart, we provide additional benefits to our self-managed customers.",[12,255,256],{},"We hope you enjoyed reading about our Kubernetes migration journey. As we continue to migrate more services to the cluster you can read more at following links:",[82,258,259,266,269],{},[85,260,261],{},[19,262,265],{"href":263,"rel":264},"https://handbook.gitlab.com/handbook/engineering/architecture/design-documents/gitlab_to_kubernetes_communication/",[],"Why are we migrating to Kubernetes?",[85,267,268],{},"GitLab.com on Kubernetes",[85,270,271],{},[19,272,275],{"href":273,"rel":274},"https://gitlab.com/groups/gitlab-com/gl-infra/-/epics/112",[],"Tracking epic for the GitLab.com Kubernetes Migration",[12,277,278,279,284,285],{},"Cover image by ",[19,280,283],{"href":281,"rel":282},"https://unsplash.com/@xnico",[],"Nico E."," on ",[19,286,289],{"href":287,"rel":288},"https://www.unsplash.com/",[],"Unsplash",[37,291,293],{"id":292},"read-more-on-kubernetes","Read more on Kubernetes:",[82,295,296,302,308,314,320],{},[85,297,298],{},[19,299,301],{"href":300},"/blog/gko-on-ocp/","How to install and use the GitLab Kubernetes Operator",[85,303,304],{},[19,305,307],{"href":306},"/blog/threat-modeling-kubernetes-agent/","Threat modeling the Kubernetes Agent: from MVC to continuous improvement",[85,309,310],{},[19,311,313],{"href":312},"/blog/setting-up-the-k-agent/","How to deploy the GitLab Agent for Kubernetes with limited permissions",[85,315,316],{},[19,317,319],{"href":318},"/blog/gitlab-kubernetes-agent-on-gitlab-com/","A new era of Kubernetes integrations on GitLab.com",[85,321,322],{},[19,323,325],{"href":324},"/blog/kubernetes-terminology/","Understand Kubernetes terminology from namespaces to pods",{"title":327,"searchDepth":328,"depth":328,"links":329},"",2,[330,331,332,333,341],{"id":39,"depth":328,"text":40},{"id":55,"depth":328,"text":56},{"id":73,"depth":328,"text":74},{"id":136,"depth":328,"text":137,"children":334},[335,337,338,339,340],{"id":144,"depth":336,"text":145},3,{"id":167,"depth":336,"text":168},{"id":187,"depth":336,"text":188},{"id":216,"depth":336,"text":217},{"id":235,"depth":336,"text":236},{"id":292,"depth":328,"text":293},"engineering","2020-09-16","It's been one year since we moved GitLab.com to Kubernetes. We unpack the challenges and learnings from this major migration.","md",null,false,"https://res.cloudinary.com/about-gitlab-com/image/upload/v1749681569/Blog/Hero%20Images/nico-e-AAbjUJsgjvE-unsplash.jpg",{},true,"/en-us/blog/year-of-kubernetes",{"title":5,"description":344,"ogTitle":5,"ogDescription":344,"noIndex":347,"ogImage":348,"ogUrl":353,"ogSiteName":354,"ogType":355,"canonicalUrls":353},"https://about.gitlab.com/blog/year-of-kubernetes","https://about.gitlab.com","article","year-of-kubernetes","en-us/blog/year-of-kubernetes",[359,360],"inside GitLab","production","BlogPost","KAly6rE7QQZTfENJJecs4CKEMB_umFNLUc11OwgSg6Q",{"logo":364,"freeTrial":369,"sales":374,"login":379,"items":384,"search":719,"minimal":751,"duo":770,"switchNav":779,"pricingDeployment":790},{"config":365},{"href":366,"dataGaName":367,"dataGaLocation":368},"/","gitlab logo","header",{"text":370,"config":371},"Get free trial",{"href":372,"dataGaName":373,"dataGaLocation":368},"https://gitlab.com/-/trial_registrations/new?glm_source=about.gitlab.com&glm_content=default-saas-trial/","free trial",{"text":375,"config":376},"Request a demo",{"href":377,"dataGaName":378,"dataGaLocation":368},"/request-a-demo/","sales",{"text":380,"config":381},"Sign in",{"href":382,"dataGaName":383,"dataGaLocation":368},"https://gitlab.com/users/sign_in/","sign in",[385,470,558,563,643,697],{"text":386,"left":350,"config":387,"menu":389},"Platform",{"dataNavLevelOne":388},"platform",{"type":390,"link":391,"columns":395,"feature":459},"lists",{"text":392,"config":393},"Explore the Platform",{"href":394,"dataGaName":388,"dataGaLocation":368},"/platform/",[396,418,441],{"title":397,"items":398},"DevOps",[399,403,408,413],{"text":400,"config":401},"CI/CD",{"href":131,"dataGaLocation":368,"dataGaName":402},"ci/cd",{"text":404,"config":405},"Source Code Management",{"href":406,"dataGaLocation":368,"dataGaName":407},"/solutions/source-code-management/","source code management",{"text":409,"config":410},"Agile Delivery",{"href":411,"dataGaLocation":368,"dataGaName":412},"/solutions/agile-delivery/","agile delivery",{"text":414,"config":415},"Artifact Management",{"href":416,"dataGaLocation":368,"dataGaName":417},"/artifact-central/","artifact management",{"title":419,"items":420},"Security & Governance",[421,426,431,436],{"text":422,"config":423},"Application Security Testing",{"href":424,"dataGaLocation":368,"dataGaName":425},"/solutions/application-security-testing/","application security testing",{"text":427,"config":428},"Governance & Compliance",{"href":429,"dataGaLocation":368,"dataGaName":430},"/solutions/software-compliance/","governance and compliance",{"text":432,"config":433},"Secrets Management",{"href":434,"dataGaLocation":368,"dataGaName":435},"/gitlab-secrets-manager/","secrets management",{"text":437,"config":438},"Supply Chain Security",{"href":439,"dataGaLocation":368,"dataGaName":440},"/solutions/supply-chain/","supply chain security",{"title":442,"items":443},"Agentic AI & Context",[444,449,454],{"text":445,"config":446},"Duo Agent Platform",{"href":447,"dataGaLocation":368,"dataGaName":448},"/gitlab-duo-agent-platform/","duo agent platform",{"text":450,"config":451},"Orbit Context Graph",{"href":452,"dataGaLocation":368,"dataGaName":453},"/gitlab-orbit/","orbit",{"text":455,"config":456},"Visibility & Measurement",{"href":457,"dataGaLocation":368,"dataGaName":458},"/solutions/visibility-measurement/","visibility and measurement",{"config":460,"title":463,"text":464,"link":465},{"background":461,"textColor":462},"url('https://res.cloudinary.com/about-gitlab-com/image/upload/v1790185102/o7dn32anqcb6z8dgd3as.jpg')","#000","GitLab Orbit is generally available","Higher agent accuracy, lower token cost",{"text":466,"config":467},"Read the announcement",{"href":468,"dataGaName":469,"dataGaLocation":368},"/blog/gitlab-orbit-ga/","orbit ga announcement",{"text":471,"left":350,"config":472,"menu":474},"Solutions",{"dataNavLevelOne":473},"solutions",{"type":390,"link":475,"columns":479,"feature":549},{"text":476,"config":477},"View all Solutions",{"href":478,"dataGaName":473,"dataGaLocation":368},"/solutions/",[480,498,516],{"title":481,"items":482},"Outcomes",[483,488,493],{"text":484,"config":485},"DevOps Modernization",{"href":486,"dataGaLocation":368,"dataGaName":487},"/assessments/devops-modernization-assessment/","devops modernization",{"text":489,"config":490},"Security Modernization",{"href":491,"dataGaLocation":368,"dataGaName":492},"/assessments/security-modernization-assessment/","security modernization",{"text":494,"config":495},"AI Modernization",{"href":496,"dataGaLocation":368,"dataGaName":497},"/assessments/ai-modernization-assessment/","ai modernization",{"title":499,"items":500},"By size",[501,506,511],{"text":502,"config":503},"Enterprise",{"href":504,"dataGaLocation":368,"dataGaName":505},"/enterprise/","enterprise",{"text":507,"config":508},"Small Business",{"href":509,"dataGaLocation":368,"dataGaName":510},"/small-business/","small business",{"text":512,"config":513},"Startups",{"href":514,"dataGaLocation":368,"dataGaName":515},"/solutions/startups/","startups",{"title":517,"items":518},"Industries",[519,524,529,534,539,544],{"text":520,"config":521},"Financial Services",{"href":522,"dataGaLocation":368,"dataGaName":523},"/solutions/finance/","financial services",{"text":525,"config":526},"Public Sector",{"href":527,"dataGaLocation":368,"dataGaName":528},"/solutions/public-sector/","public sector",{"text":530,"config":531},"Telecommunications",{"href":532,"dataGaLocation":368,"dataGaName":533},"/solutions/telecommunications/","telecommunications",{"text":535,"config":536},"Automotive",{"href":537,"dataGaLocation":368,"dataGaName":538},"/solutions/automotive/","automotive",{"text":540,"config":541},"Education",{"href":542,"dataGaLocation":368,"dataGaName":543},"/solutions/education/","education",{"text":545,"config":546},"Aerospace",{"href":547,"dataGaLocation":368,"dataGaName":548},"/solutions/aerospace/","aerospace",{"config":550,"title":551,"text":552,"link":553},{"background":461,"textColor":462},"GitLab Security Standard","Learn how to harden your software factory and let AI agents earn autonomy, without trading away security.",{"text":554,"config":555},"Explore the standard",{"href":556,"dataGaName":557,"dataGaLocation":368},"/gitlab-security-standard/","gitlab security standard",{"text":559,"config":560},"Pricing",{"href":561,"dataGaName":562,"dataGaLocation":368,"dataNavLevelOne":562},"/pricing/","pricing",{"text":564,"config":565,"menu":567},"Resources",{"dataNavLevelOne":566},"resources",{"type":390,"link":568,"columns":572,"feature":634},{"text":569,"config":570},"View all resources",{"href":571,"dataGaName":566,"dataGaLocation":368},"/resources/",[573,606],{"title":574,"items":575},"Discover",[576,581,586,591,596,601],{"text":577,"config":578},"Docs",{"href":579,"dataGaName":580,"dataGaLocation":368},"https://docs.gitlab.com/","docs",{"text":582,"config":583},"University",{"href":584,"dataGaName":585,"dataGaLocation":368},"https://university.gitlab.com/","university",{"text":587,"config":588},"Demo Series",{"href":589,"dataGaName":590,"dataGaLocation":368},"/gitlab-technical-demo-series/","demo series",{"text":592,"config":593},"Demo Hub",{"href":594,"dataGaName":595,"dataGaLocation":368},"/demo-hub/","demo hub",{"text":597,"config":598},"Services",{"href":599,"dataGaName":600,"dataGaLocation":368},"/services/","services",{"text":602,"config":603},"Well Architected",{"href":604,"dataGaName":605,"dataGaLocation":368},"/resources/well-architected/","well architected",{"title":607,"items":608},"Connect",[609,614,619,624,629],{"text":610,"config":611},"Blog",{"href":612,"dataGaName":613,"dataGaLocation":368},"/blog/","blog",{"text":615,"config":616},"Community",{"href":617,"dataGaName":618,"dataGaLocation":368},"/community/","community",{"text":620,"config":621},"Customers",{"href":622,"dataGaName":623,"dataGaLocation":368},"/customers/","customers",{"text":625,"config":626},"Partners",{"href":627,"dataGaName":628,"dataGaLocation":368},"/partners/","partners",{"text":630,"config":631},"Events",{"href":632,"dataGaName":633,"dataGaLocation":368},"/events/","events",{"config":635,"title":636,"text":637,"link":638},{"background":461,"textColor":462},"What’s new in GitLab","Stay updated with our latest features and improvements.",{"text":639,"config":640},"Read the latest",{"href":641,"dataGaName":642,"dataGaLocation":368},"/whats-new/","whats new",{"text":644,"config":645,"menu":647},"Company",{"dataNavLevelOne":646},"company",{"type":390,"columns":648},[649],{"items":650},[651,656,662,667,672,677,682,687,692],{"text":652,"config":653},"About",{"href":654,"dataGaName":655,"dataGaLocation":368},"/company/","about",{"text":657,"config":658,"footerGa":661},"Jobs",{"href":659,"dataGaName":660,"dataGaLocation":368},"/jobs/","jobs",{"dataGaName":660},{"text":663,"config":664},"Press",{"href":665,"dataGaName":666,"dataGaLocation":368},"/press/","press",{"text":668,"config":669},"Handbook",{"href":670,"dataGaName":671,"dataGaLocation":368},"https://handbook.gitlab.com/","handbook",{"text":673,"config":674},"Leadership",{"href":675,"dataGaName":676,"dataGaLocation":368},"/company/team/e-group/","leadership",{"text":678,"config":679},"Investor relations",{"href":680,"dataGaName":681,"dataGaLocation":368},"https://ir.gitlab.com/overview/default.aspx","investor relations",{"text":683,"config":684},"Trust Center",{"href":685,"dataGaName":686,"dataGaLocation":368},"/security/","trust center",{"text":688,"config":689},"AI Transparency Center",{"href":690,"dataGaName":691,"dataGaLocation":368},"/ai-transparency-center/","ai transparency center",{"text":693,"config":694},"Newsletter",{"href":695,"dataGaName":696,"dataGaLocation":368},"/company/contact/#contact-forms","newsletter",{"text":698,"config":699,"menu":700},"Contact us",{"dataNavLevelOne":646},{"type":390,"columns":701},[702],{"items":703},[704,709,714],{"text":705,"config":706},"Talk to sales",{"href":707,"dataGaName":708,"dataGaLocation":368},"/sales/","talk to sales",{"text":710,"config":711},"Support portal",{"href":712,"dataGaName":713,"dataGaLocation":368},"https://support.gitlab.com/hc/en-us","support portal",{"text":715,"config":716},"Customer portal",{"href":717,"dataGaName":718,"dataGaLocation":368},"https://customers.gitlab.com/customers/sign_in/","customer portal",{"close":720,"login":721,"suggestions":728},"Close",{"text":722,"link":723},"To search repositories and projects, login to",{"text":724,"config":725},"gitlab.com",{"href":382,"dataGaName":726,"dataGaLocation":727},"search login","search",{"text":729,"default":730},"Suggestions",[731,734,737,739,743,747],{"text":732,"config":733},"GitLab Duo Agent Platform",{"href":447,"dataGaName":732,"dataGaLocation":727},{"text":735,"config":736},"Code Suggestions (AI)",{"href":447,"dataGaName":735,"dataGaLocation":727},{"text":400,"config":738},{"href":131,"dataGaName":400,"dataGaLocation":727},{"text":740,"config":741},"GitLab on AWS",{"href":742,"dataGaName":740,"dataGaLocation":727},"/partners/technology-partners/aws/",{"text":744,"config":745},"GitLab on Google Cloud",{"href":746,"dataGaName":744,"dataGaLocation":727},"/partners/technology-partners/google-cloud-platform/",{"text":748,"config":749},"Why GitLab?",{"href":750,"dataGaName":748,"dataGaLocation":727},"/why-gitlab/",{"freeTrial":752,"mobileIcon":757,"desktopIcon":762,"secondaryButton":765},{"text":753,"config":754},"Start free trial",{"href":755,"dataGaName":373,"dataGaLocation":756},"https://gitlab.com/-/trials/new/","nav",{"altText":758,"config":759},"Gitlab Icon",{"src":760,"dataGaName":761,"dataGaLocation":756},"https://res.cloudinary.com/about-gitlab-com/image/upload/v1758203874/jypbw1jx72aexsoohd7x.svg","gitlab icon",{"altText":758,"config":763},{"src":764,"dataGaName":761,"dataGaLocation":756},"https://res.cloudinary.com/about-gitlab-com/image/upload/v1758203875/gs4c8p8opsgvflgkswz9.svg",{"text":766,"config":767},"Get Started",{"href":768,"dataGaName":769,"dataGaLocation":756},"https://gitlab.com/-/trial_registrations/new?glm_source=about.gitlab.com/get-started/","get started",{"freeTrial":771,"mobileIcon":775,"desktopIcon":777},{"text":772,"config":773},"Learn more about GitLab Duo",{"href":447,"dataGaName":774,"dataGaLocation":756},"gitlab duo",{"altText":758,"config":776},{"src":760,"dataGaName":761,"dataGaLocation":756},{"altText":758,"config":778},{"src":764,"dataGaName":761,"dataGaLocation":756},{"button":780,"mobileIcon":785,"desktopIcon":787},{"text":781,"config":782},"/switch",{"href":783,"dataGaName":784,"dataGaLocation":756},"#contact","switch",{"altText":758,"config":786},{"src":760,"dataGaName":761,"dataGaLocation":756},{"altText":758,"config":788},{"src":789,"dataGaName":761,"dataGaLocation":756},"https://res.cloudinary.com/about-gitlab-com/image/upload/v1773335277/ohhpiuoxoldryzrnhfrh.png",{"freeTrial":791,"mobileIcon":796,"desktopIcon":798},{"text":792,"config":793},"Back to pricing",{"href":561,"dataGaName":794,"dataGaLocation":756,"icon":795},"back to pricing","GoBack",{"altText":758,"config":797},{"src":760,"dataGaName":761,"dataGaLocation":756},{"altText":758,"config":799},{"src":764,"dataGaName":761,"dataGaLocation":756},{"title":801,"button":802,"config":806},"GitLab Orbit is generally available. Increase agent accuracy and lower token cost",{"text":466,"config":803},{"href":468,"dataGaName":804,"dataGaLocation":805},"orbit-ga-banner","global-banner",{"layout":807,"disabled":347},"release",{"data":809},{"text":810,"config":811,"items":816,"minimal":1044},"Git is a trademark of Software Freedom Conservancy and our use of 'GitLab' is under license",{"twitter":812,"facebook":813,"youtube":814,"linkedin":815},"https://twitter.com/gitlab","https://www.facebook.com/gitlab","https://www.youtube.com/channel/UCnMGQ8QHMAnVIsI3xJrihhg","https://www.linkedin.com/company/gitlab-com",[817,865,924,971,1012],{"title":559,"links":818,"subMenu":834},[819,824,829],{"text":820,"config":821},"View plans",{"href":561,"dataGaName":822,"dataGaLocation":823},"view plans","footer",{"text":825,"config":826},"Why Premium?",{"href":827,"dataGaName":828,"dataGaLocation":823},"/pricing/premium/","why premium",{"text":830,"config":831},"Why Ultimate?",{"href":832,"dataGaName":833,"dataGaLocation":823},"/pricing/ultimate/","why ultimate",[835],{"title":836,"links":837},"Contact Us",[838,841,843,845,850,855,860],{"text":839,"config":840},"Contact sales",{"href":707,"dataGaName":378,"dataGaLocation":823},{"text":710,"config":842},{"href":712,"dataGaName":713,"dataGaLocation":823},{"text":715,"config":844},{"href":717,"dataGaName":718,"dataGaLocation":823},{"text":846,"config":847},"Status",{"href":848,"dataGaName":849,"dataGaLocation":823},"https://status.gitlab.com/","status",{"text":851,"config":852},"Terms of use",{"href":853,"dataGaName":854,"dataGaLocation":823},"/terms/","terms of use",{"text":856,"config":857},"Privacy statement",{"href":858,"dataGaName":859,"dataGaLocation":823},"/privacy/","privacy statement",{"text":861,"config":862},"Cookie preferences",{"dataGaName":863,"dataGaLocation":823,"id":864,"isOneTrustButton":350},"cookie preferences","ot-sdk-btn",{"title":386,"links":866,"subMenu":882},[867,870,872,874,876,878],{"text":868,"config":869},"Explore the platform",{"href":394,"dataGaName":388,"dataGaLocation":823},{"text":445,"config":871},{"href":447,"dataGaName":448,"dataGaLocation":823},{"text":400,"config":873},{"href":131,"dataGaName":402,"dataGaLocation":823},{"text":450,"config":875},{"href":452,"dataGaName":453,"dataGaLocation":823},{"text":432,"config":877},{"href":434,"dataGaName":435,"dataGaLocation":823},{"text":879,"config":880},"Why GitLab",{"href":750,"dataGaName":881,"dataGaLocation":823},"why gitlab",[883],{"title":884,"links":885},"Topics",[886,890,895,899,904,909,914,919],{"text":400,"config":887},{"href":888,"dataGaName":889,"dataGaLocation":823},"/topics/ci-cd/","cicd",{"text":891,"config":892},"GitOps",{"href":893,"dataGaName":894,"dataGaLocation":823},"/topics/gitops/","gitops",{"text":397,"config":896},{"href":897,"dataGaName":898,"dataGaLocation":823},"/topics/devops/","devops",{"text":900,"config":901},"Version Control",{"href":902,"dataGaName":903,"dataGaLocation":823},"/topics/version-control/","version control",{"text":905,"config":906},"DevSecOps",{"href":907,"dataGaName":908,"dataGaLocation":823},"/topics/devsecops/","devsecops",{"text":910,"config":911},"Cloud Native",{"href":912,"dataGaName":913,"dataGaLocation":823},"/topics/cloud-native/","cloud native",{"text":915,"config":916},"AI for Coding",{"href":917,"dataGaName":918,"dataGaLocation":823},"/topics/devops/ai-for-coding/","ai for coding",{"text":920,"config":921},"Agentic AI",{"href":922,"dataGaName":923,"dataGaLocation":823},"/topics/agentic-ai/","agentic ai",{"title":471,"links":925},[926,929,932,935,938,941,943,945,947,949,951,954,956,959,963,967],{"text":927,"config":928},"DevOps modernization",{"href":486,"dataGaName":487,"dataGaLocation":823},{"text":930,"config":931},"Security modernization",{"href":491,"dataGaName":492,"dataGaLocation":823},{"text":933,"config":934},"AI modernization",{"href":496,"dataGaName":497,"dataGaLocation":823},{"text":936,"config":937},"Financial services",{"href":522,"dataGaName":523,"dataGaLocation":823},{"text":939,"config":940},"Public sector",{"href":527,"dataGaName":528,"dataGaLocation":823},{"text":530,"config":942},{"href":532,"dataGaName":533,"dataGaLocation":823},{"text":535,"config":944},{"href":537,"dataGaName":538,"dataGaLocation":823},{"text":540,"config":946},{"href":542,"dataGaName":543,"dataGaLocation":823},{"text":545,"config":948},{"href":547,"dataGaName":548,"dataGaLocation":823},{"text":502,"config":950},{"href":504,"dataGaName":505,"dataGaLocation":823},{"text":952,"config":953},"Small business",{"href":509,"dataGaName":510,"dataGaLocation":823},{"text":512,"config":955},{"href":514,"dataGaName":515,"dataGaLocation":823},{"text":891,"config":957},{"href":958,"dataGaName":894,"dataGaLocation":823},"/solutions/gitops/",{"text":960,"config":961},"Software composition analysis",{"href":439,"dataGaName":962,"dataGaLocation":823},"software composition analysis",{"text":964,"config":965},"Value stream management",{"href":457,"dataGaName":966,"dataGaLocation":823},"value stream management",{"text":968,"config":969},"All solutions",{"href":478,"dataGaName":970,"dataGaLocation":823},"all solutions",{"title":564,"links":972},[973,978,983,985,987,989,991,993,995,997,999,1001,1003,1005,1008],{"text":974,"config":975},"Install",{"href":976,"dataGaName":977,"dataGaLocation":823},"/install/","install",{"text":979,"config":980},"Quick start guides",{"href":981,"dataGaName":982,"dataGaLocation":823},"/get-started/","quick setup checklists",{"text":577,"config":984},{"href":579,"dataGaName":580,"dataGaLocation":823},{"text":582,"config":986},{"href":584,"dataGaName":585,"dataGaLocation":823},{"text":587,"config":988},{"href":589,"dataGaName":590,"dataGaLocation":823},{"text":592,"config":990},{"href":594,"dataGaName":595,"dataGaLocation":823},{"text":597,"config":992},{"href":599,"dataGaName":600,"dataGaLocation":823},{"text":610,"config":994},{"href":612,"dataGaName":613,"dataGaLocation":823},{"text":615,"config":996},{"href":617,"dataGaName":618,"dataGaLocation":823},{"text":620,"config":998},{"href":622,"dataGaName":623,"dataGaLocation":823},{"text":625,"config":1000},{"href":627,"dataGaName":628,"dataGaLocation":823},{"text":630,"config":1002},{"href":632,"dataGaName":633,"dataGaLocation":823},{"text":693,"config":1004},{"href":695,"dataGaName":696,"dataGaLocation":823},{"text":1006,"config":1007},"What's new",{"href":641,"dataGaName":642,"dataGaLocation":823},{"text":1009,"config":1010},"All resources",{"href":571,"dataGaName":1011,"dataGaLocation":823},"all resources",{"title":644,"links":1013},[1014,1016,1018,1020,1022,1024,1026,1028,1030,1034,1039],{"text":652,"config":1015},{"href":654,"dataGaName":646,"dataGaLocation":823},{"text":657,"config":1017},{"href":659,"dataGaName":660,"dataGaLocation":823},{"text":663,"config":1019},{"href":665,"dataGaName":666,"dataGaLocation":823},{"text":668,"config":1021},{"href":670,"dataGaName":671,"dataGaLocation":823},{"text":673,"config":1023},{"href":675,"dataGaName":676,"dataGaLocation":823},{"text":678,"config":1025},{"href":680,"dataGaName":681,"dataGaLocation":823},{"text":683,"config":1027},{"href":685,"dataGaName":686,"dataGaLocation":823},{"text":688,"config":1029},{"href":690,"dataGaName":691,"dataGaLocation":823},{"text":1031,"config":1032},"Sustainability",{"href":1033,"dataGaName":1031,"dataGaLocation":823},"/sustainability/",{"text":1035,"config":1036},"Diversity, inclusion and belonging (DIB)",{"href":1037,"dataGaName":1038,"dataGaLocation":823},"/diversity-inclusion-belonging/","Diversity, inclusion and belonging",{"text":1040,"config":1041},"Modern Slavery Transparency Statement",{"href":1042,"dataGaName":1043,"dataGaLocation":823},"https://handbook.gitlab.com/handbook/legal/modern-slavery-act-transparency-statement/","modern slavery transparency statement",{"items":1045},[1046,1049,1052],{"text":1047,"config":1048},"Terms",{"href":853,"dataGaName":854,"dataGaLocation":823},{"text":1050,"config":1051},"Cookies",{"dataGaName":863,"dataGaLocation":823,"id":864,"isOneTrustButton":350},{"text":1053,"config":1054},"Privacy",{"href":858,"dataGaName":859,"dataGaLocation":823},[1056],{"id":1057,"title":7,"body":346,"config":1058,"content":1060,"description":346,"extension":1064,"meta":1065,"navigation":350,"path":1066,"seo":1067,"stem":1068,"__hash__":1069},"blogAuthors/en-us/blog/authors/john-jarvis.yml",{"template":1059},"BlogAuthor",{"name":7,"config":1061},{"headshot":1062,"ctfId":1063},"https://res.cloudinary.com/about-gitlab-com/image/upload/v1749678622/Blog/Author%20Headshots/jarv-headshot.jpg","jarv","yml",{},"/en-us/blog/authors/john-jarvis",{},"en-us/blog/authors/john-jarvis","VWpIs3Q1XFVS2133bt3YMUb_e7ezj1Rf6P2P1JogPvI",[1071,1079,1087],{"title":1072,"description":1073,"heroImage":1074,"category":342,"date":1075,"authors":1076,"slug":1078,"externalUrl":346},"Two front doors: Module-level access in a Django GRC app","A technical deep-dive on restructuring a Django internal tool to support two distinct GitLab teams: Security Compliance and Internal Audit.","https://res.cloudinary.com/about-gitlab-com/image/upload/v1750097663/Blog/Hero%20Images/Blog/Hero%20Images/Workflow%201800x945_2gQoQIbY9NvjLFpXtsxtXy_1750097663612.png","2026-10-05",[1077],"Donovan Felton","module-level-access-in-a-django-grc-app",{"title":1080,"description":1081,"heroImage":1082,"category":342,"date":1083,"authors":1084,"slug":1086,"externalUrl":346},"How GitLab reduced code-per-agentic-flow ratio by 45%","Learn how Flow Registry, a component-based framework that compiles YAML configurations into fully functional LangGraph flows, helped improve scalability and more.","https://res.cloudinary.com/about-gitlab-com/image/upload/v1774465167/n5hlvrsrheadeccyr1oz.png","2026-09-22",[1085],"Mikolaj Wawrzyniak","how-gitlab-reduced-code-per-agentic-flow-ratio",{"title":1088,"description":1089,"heroImage":1090,"category":342,"date":1091,"authors":1092,"slug":1094,"externalUrl":346},"Co-Create: Building GitLab with our users","How GitLab users collaborated with us to build practical product improvements in the first half of 2026.","https://res.cloudinary.com/about-gitlab-com/image/upload/v1750099203/Blog/Hero%20Images/Blog/Hero%20Images/blog-image-template-1800x945%20%2820%29_2bJGC5ZP3WheoqzlLT05C5_1750099203484.png","2026-09-10",[1093],"Isa Huerga","co-create-h1-2026",{"header":1096,"text":1097,"button":1101,"disclaimer":1104},"Start your free\n\n30-day GitLab trial\n",[1098,1099,1100],"GitLab Duo Agent Platform access","Try our most advanced features","Automate complex tasks with AI",{"text":370,"config":1102},{"href":1103,"dataGaName":373,"dataGaLocation":613},"https://gitlab.com/-/trials/new?glm_content=default-saas-trial&glm_source=about.gitlab.com/blog/","No credit card required.",{"header":1106,"blurb":1107,"button":1108,"secondaryButton":1113},"Start building faster today","See what your team can do with the intelligent orchestration platform for DevSecOps.\n",{"text":1109,"config":1110},"Get your free trial",{"href":1111,"dataGaName":373,"dataGaLocation":1112},"https://gitlab.com/-/trial_registrations/new?glm_content=default-saas-trial&glm_source=about.gitlab.com/","feature",{"text":839,"config":1114},{"href":707,"dataGaName":378,"dataGaLocation":1112},1794911801180]