[{"data":1,"prerenderedAt":1263},["ShallowReactive",2],{"/blog/advanced-search-data-migrations":3,"navigation-en-us":510,"banner-en-us":948,"footer-en-us":956,"blog-post-authors-en-us-Dmitry Gruzd":1203,"blog-related-posts-en-us-advanced-search-data-migrations":1218,"blog-share-wrapper-en-us":1243,"next-steps-en-us":1253},{"id":4,"title":5,"authors":6,"body":8,"category":489,"date":490,"description":491,"extension":492,"externalUrl":493,"faq":493,"featured":494,"heroImage":495,"hidePromo":494,"meta":496,"navigation":129,"path":497,"seo":498,"slug":502,"stem":503,"tags":504,"template":508,"updatedDate":493,"__hash__":509},"blogPosts/en-us/blog/advanced-search-data-migrations.md","GitLab's data migration process for Advanced Search",[7],"Dmitry Gruzd",{"type":9,"value":10,"toc":481},"minimark",[11,21,24,27,30,38,43,46,49,53,68,71,81,84,88,96,99,102,105,113,227,230,233,236,307,314,318,321,394,397,404,408,411,441,444,448,457,460,468,471,474,477],[12,13,14,15],"p",{},"For some time now, GitLab has been working on enabling the Elasticsearch integration on GitLab.com to allow as many GitLab.com users as possible access to the ",[16,17,20],"a",{"href":18,"rel":19},"https://docs.gitlab.com/user/search/advanced_search/",[],"Advanced Global\nSearch",[12,22,23],{},"features. Last year, after enabling Advanced Search for all licensed customers on",[12,25,26],{},"GitLab.com we were thinking how to simplify the rollout of some Advanced\nSearch features that require changing the data in Elasticsearch.",[12,28,29],{},"(If you're interested in the lessons we learned on our road to Enabling",[12,31,32,33,37],{},"Elasticsearch for GitLab.com, you can read ",[16,34,36],{"href":35},"/blog/elasticsearch-update/","all about it",".",[39,40,42],"h2",{"id":41},"the-data-migration-process-problem","The data migration process problem",[12,44,45],{},"Sometimes we need to change mappings of an index or backfill a field, and reindexing everything from scratch or using Zero downtime reindexing",[12,47,48],{},"might seem like an obvious solution. However, this is not a scalable option for big GitLab instances. GitLab.com is the largest known installation of GitLab and as such has a lot of projects, code, issues, merge requests and other things that need to be indexed. For example, at the moment our Elasticsearch cluster has almost 1 billion documents in it. It would take many weeks or even months to reindex everything and for all that time indexing would need to remain paused, therefore search results would quickly become outdated.",[39,50,52],{"id":51},"original-plan-for-multi-version-support","Original plan for multi-version support",[12,54,55,56,61,62,67],{},"Originally, we were planning to introduce multi-version support using an approach that is fully reliant on GitLab to manage both indices, reading from the old one and writing to both until the migration is finished. You can read more information at ",[16,57,60],{"href":58,"rel":59},"https://gitlab.com/gitlab-org/gitlab/-/merge_requests/18254",[],"!18254"," and ",[16,63,66],{"href":64,"rel":65},"https://gitlab.com/groups/gitlab-org/-/epics/1769",[],"&1769",". As of writing this, most of the code for this approach still exists in GitLab in a half-implemented form.",[12,69,70],{},"There were 2 primary concerns with this approach:",[72,73,74,78],"ol",{},[75,76,77],"li",{},"Reindexing would require the GitLab application to read every single\ndocument from the storage and send it to Elasticsearch again. Doing so would put a big strain on different parts of the application, such as database,\nGitaly, and Sidekiq.",[75,79,80],{},"Reindexing everything from GitLab to the cluster again may be very\nwasteful on occasions where you only need to change a small part of the index. For example, if we want to add epics to the index, it is very wasteful to reindex every document in the index when we could very quickly just index all the epics. There are many situations where we will be trying to perform some migration that can be done more efficiently using a targeted approach (e.g. adding a new field to a document type only requires reindexing all the documents that actually have that field).",[12,82,83],{},"For these reasons we've decided to create a different data migration process.",[39,85,87],{"id":86},"our-revised-data-migration-process","Our revised data migration process",[12,89,90,91,37],{},"We took inspiration from the ",[16,92,95],{"href":93,"rel":94},"https://guides.rubyonrails.org/active_record_migrations.html",[],"Rails DB migrations",[12,97,98],{},"We wanted to apply the best practices from it without having to re-architect what the Rails team has already implemented.",[12,100,101],{},"For example, we've decided that we would have a special directory with time-stamped migration files. We wanted to achieve a strict execution order so that many migrations might be shipped simultaneously. A special background processing worker will be checking this folder on schedule. This is slightly different to rails background migrations where the operator is required to manually run the migration. We decided to make it fully automated and run it in the background to avoid the need for self-managed customers to add extra steps to the migration process. This would have likely made it much more difficult for everyone involved as there are many ways to run GitLab. This extra constraint also forces us to always think of migrations as possibly incomplete at any point in the code which is essential for zero-downtime.",[12,103,104],{},"At first, we wanted to store the migration state in the Postgresql database, but decided against it since this may not be perfect for the situation where a user wants to connect a new Elasticsearch cluster to GitLab. It's better to store the migrations themselves in the Elasticsearch cluster itself so they're more likely to be in sync with the data.",[12,106,107,108,112],{},"You can see your new migration index in your Elasticsearch cluster. It's called ",[109,110,111],"code",{},"gitlab-production-migrations",". GitLab stores a few fields there. We use the version number as the document id. This is an example document:",[114,115,120],"pre",{"className":116,"code":117,"language":118,"meta":119,"style":119},"language-json shiki shiki-themes github-light","\n{\n    \"_id\": \"20210510143200\",\n    \"_source\": {\n        \"completed\": true,\n        \"state\": {\n        },\n        \"started_at\": \"2021-05-12T07:19:08.884Z\",\n        \"completed_at\": \"2021-05-12T07:19:08.884Z\"\n    }\n}\n\n","json","",[109,121,122,131,138,155,164,177,185,191,204,215,221],{"__ignoreMap":119},[123,124,127],"span",{"class":125,"line":126},"line",1,[123,128,130],{"emptyLinePlaceholder":129},true,"\n",[123,132,134],{"class":125,"line":133},2,[123,135,137],{"class":136},"sgsFI","{\n",[123,139,141,145,148,152],{"class":125,"line":140},3,[123,142,144],{"class":143},"sYu0t","    \"_id\"",[123,146,147],{"class":136},": ",[123,149,151],{"class":150},"sYBdl","\"20210510143200\"",[123,153,154],{"class":136},",\n",[123,156,158,161],{"class":125,"line":157},4,[123,159,160],{"class":143},"    \"_source\"",[123,162,163],{"class":136},": {\n",[123,165,167,170,172,175],{"class":125,"line":166},5,[123,168,169],{"class":143},"        \"completed\"",[123,171,147],{"class":136},[123,173,174],{"class":143},"true",[123,176,154],{"class":136},[123,178,180,183],{"class":125,"line":179},6,[123,181,182],{"class":143},"        \"state\"",[123,184,163],{"class":136},[123,186,188],{"class":125,"line":187},7,[123,189,190],{"class":136},"        },\n",[123,192,194,197,199,202],{"class":125,"line":193},8,[123,195,196],{"class":143},"        \"started_at\"",[123,198,147],{"class":136},[123,200,201],{"class":150},"\"2021-05-12T07:19:08.884Z\"",[123,203,154],{"class":136},[123,205,207,210,212],{"class":125,"line":206},9,[123,208,209],{"class":143},"        \"completed_at\"",[123,211,147],{"class":136},[123,213,214],{"class":150},"\"2021-05-12T07:19:08.884Z\"\n",[123,216,218],{"class":125,"line":217},10,[123,219,220],{"class":136},"    }\n",[123,222,224],{"class":125,"line":223},11,[123,225,226],{"class":136},"}\n",[12,228,229],{},"The state field is used to store data that's required to run batched migrations.",[12,231,232],{},"For example, for batched migrations we store a slice number and a task id for current Elasticsearch reindex operation and we update the state after every run.",[12,234,235],{},"This is how an example migration looks:",[114,237,241],{"className":238,"code":239,"language":240,"meta":119,"style":119},"language-ruby shiki shiki-themes github-light","\nclass MigrationName \u003C Elastic::Migration\n  def migrate\n    # Migrate the data here\n  end\n\n  def completed?\n    # Return true if completed, otherwise return false\n  end\nend\n\n","ruby",[109,242,243,247,263,271,277,282,286,293,298,302],{"__ignoreMap":119},[123,244,245],{"class":125,"line":126},[123,246,130],{"emptyLinePlaceholder":129},[123,248,249,253,257,260],{"class":125,"line":133},[123,250,252],{"class":251},"sD7c4","class",[123,254,256],{"class":255},"s7eDp"," MigrationName",[123,258,259],{"class":136}," \u003C ",[123,261,262],{"class":255},"Elastic::Migration\n",[123,264,265,268],{"class":125,"line":140},[123,266,267],{"class":251},"  def",[123,269,270],{"class":255}," migrate\n",[123,272,273],{"class":125,"line":157},[123,274,276],{"class":275},"sAwPA","    # Migrate the data here\n",[123,278,279],{"class":125,"line":166},[123,280,281],{"class":251},"  end\n",[123,283,284],{"class":125,"line":179},[123,285,130],{"emptyLinePlaceholder":129},[123,287,288,290],{"class":125,"line":187},[123,289,267],{"class":251},[123,291,292],{"class":255}," completed?\n",[123,294,295],{"class":125,"line":193},[123,296,297],{"class":275},"    # Return true if completed, otherwise return false\n",[123,299,300],{"class":125,"line":206},[123,301,281],{"class":251},[123,303,304],{"class":125,"line":217},[123,305,306],{"class":251},"end\n",[12,308,309,310,313],{},"This looks a lot like ",[16,311,95],{"href":93,"rel":312},[],", which was our goal from the beginning. The main difference is that it has an additional method to check if a migration is completed. We've added that method because we need to execute asynchronous tasks quite often and we want to check if it's completed later in a different worker process.",[39,315,317],{"id":316},"migration-framework-logic","Migration framework logic",[12,319,320],{},"This is a simple flow chart to demonstrate the high level logic of the new migration framework.",[114,322,326],{"className":323,"code":324,"language":325,"meta":119,"style":119},"language-mermaid shiki shiki-themes github-light","\ngraph TD\n    CRON(cron every 30 minutes) --> |executes| WORKER[MigrationWorker]\n    WORKER --> B(an uncompleted migration is found)\n    B --> HALT(it's halted)\n    B --> UN(it's uncompleted)\n    B --> COMP(it's finished)\n    HALT --> WARN(show warning in the admin UI)\n    WARN --> EX(exit)\n    UN --> PREF(migration preflight checks)\n    PREF --> RUN(execute the migration code)\n    COMP --> MARK(mark it as finished)\n    MARK --> EX\n","mermaid",[109,327,328,332,337,342,347,352,357,362,367,372,377,382,388],{"__ignoreMap":119},[123,329,330],{"class":125,"line":126},[123,331,130],{"emptyLinePlaceholder":129},[123,333,334],{"class":125,"line":133},[123,335,336],{"class":136},"graph TD\n",[123,338,339],{"class":125,"line":140},[123,340,341],{"class":136},"    CRON(cron every 30 minutes) --> |executes| WORKER[MigrationWorker]\n",[123,343,344],{"class":125,"line":157},[123,345,346],{"class":136},"    WORKER --> B(an uncompleted migration is found)\n",[123,348,349],{"class":125,"line":166},[123,350,351],{"class":136},"    B --> HALT(it's halted)\n",[123,353,354],{"class":125,"line":179},[123,355,356],{"class":136},"    B --> UN(it's uncompleted)\n",[123,358,359],{"class":125,"line":187},[123,360,361],{"class":136},"    B --> COMP(it's finished)\n",[123,363,364],{"class":125,"line":193},[123,365,366],{"class":136},"    HALT --> WARN(show warning in the admin UI)\n",[123,368,369],{"class":125,"line":206},[123,370,371],{"class":136},"    WARN --> EX(exit)\n",[123,373,374],{"class":125,"line":217},[123,375,376],{"class":136},"    UN --> PREF(migration preflight checks)\n",[123,378,379],{"class":125,"line":223},[123,380,381],{"class":136},"    PREF --> RUN(execute the migration code)\n",[123,383,385],{"class":125,"line":384},12,[123,386,387],{"class":136},"    COMP --> MARK(mark it as finished)\n",[123,389,391],{"class":125,"line":390},13,[123,392,393],{"class":136},"    MARK --> EX\n",[12,395,396],{},"As you can see above, there are multiple different states of a migration.\nFor example, the framework allows it to be halted when it has too many failed attempts.\nIn that case, the warning will be shown in the admin UI with a button for restarting the migration.",[12,398,399],{},[400,401],"img",{"alt":402,"src":403},"How the warning looks like","https://res.cloudinary.com/about-gitlab-com/image/upload/v1782397930/blog/Content%20Images/advanced_search/halted_warning.png",[39,405,407],{"id":406},"configuration-options","Configuration options",[12,409,410],{},"We've introduced many useful configuration options into the framework, such as:",[412,413,414,424,429,435],"ul",{},[75,415,416,419,420,423],{},[109,417,418],{},"batched!"," - Allows the migration to run in batches. If set, the worker\nwill re-enqueue itself with a delay which is set using the ",[109,421,422],{},"throttle_delay"," option described below. We use this option to reduce the load and ensure that the migration won't time out.",[75,425,426,428],{},[109,427,422],{}," - Sets the wait time in between batch runs. This time\nshould be set high enough to allow each migration batch enough time to finish.",[75,430,431,434],{},[109,432,433],{},"pause_indexing!"," - Pauses indexing while the migration runs. This setting\nwill record the indexing setting before the migration runs and set it back to that value when the migration is completed. GitLab only uses this option when absolutely necessary since we attempt to minimize the downtime as much as possible.",[75,436,437,440],{},[109,438,439],{},"space_requirements!"," - Verifies that enough free space is available in\nthe cluster when the migration is running. This setting will halt the migration if the storage required is not available. This option is used to prevent situations when your cluster runs out of space when attempting to execute a migration.",[12,442,443],{},"You can see the up-to-date list of options in this development documentation section.",[39,445,447],{"id":446},"data-migration-process-results","Data migration process results",[12,449,450,451,456],{},"We implemented the Advanced Search migration framework in the 13.6 release and have been improving it since. You can see some details in the original issue ",[16,452,455],{"href":453,"rel":454},"https://gitlab.com/gitlab-org/gitlab/-/issues/234046",[],"#234046",". The only requirement for this new feature is that you should create your index using at least version 13.0. We have that requirement since we're heavily utilizing aliases, which were introduced in 13.0. As you might know, over the last few releases we've been working on separating different document types into their own indices. This migration framework has been a tremendous help for our initiative.",[12,458,459],{},"We've already completed the migration of issues (in 13.8), comments (in 13.11), and merge requests (in 13.12) with a noticeable performance improvement.",[12,461,462,463,37],{},"Since we've accumulated so many different migrations over the last few releases and they require us to support multiple code paths for a long period of time, we've decided to remove older migrations that were added prior to the 13.12 release. You can see some details in this ",[16,464,467],{"href":465,"rel":466},"https://gitlab.com/gitlab-org/gitlab/-/issues/329952",[],"issue",[12,469,470],{},"We plan to continue the same strategy in the future, which is one of the reasons why you should always upgrade to the latest minor version before migrating to a major release.",[12,472,473],{},"If you're interested in contributing to features that require Advanced\nSearch migrations, we have a dedicated documentation section",[12,475,476],{},"that explains how to create one and lists all available options for it.",[478,479,480],"style",{},"html pre.shiki code .sgsFI, html code.shiki .sgsFI{--shiki-default:#24292E}html pre.shiki code .sYu0t, html code.shiki .sYu0t{--shiki-default:#005CC5}html pre.shiki code .sYBdl, html code.shiki .sYBdl{--shiki-default:#032F62}html .default .shiki span {color: var(--shiki-default);background: var(--shiki-default-bg);font-style: var(--shiki-default-font-style);font-weight: var(--shiki-default-font-weight);text-decoration: var(--shiki-default-text-decoration);}html .shiki span {color: var(--shiki-default);background: var(--shiki-default-bg);font-style: var(--shiki-default-font-style);font-weight: var(--shiki-default-font-weight);text-decoration: var(--shiki-default-text-decoration);}html pre.shiki code .sD7c4, html code.shiki .sD7c4{--shiki-default:#D73A49}html pre.shiki code .s7eDp, html code.shiki .s7eDp{--shiki-default:#6F42C1}html pre.shiki code .sAwPA, html code.shiki .sAwPA{--shiki-default:#6A737D}",{"title":119,"searchDepth":133,"depth":133,"links":482},[483,484,485,486,487,488],{"id":41,"depth":133,"text":42},{"id":51,"depth":133,"text":52},{"id":86,"depth":133,"text":87},{"id":316,"depth":133,"text":317},{"id":406,"depth":133,"text":407},{"id":446,"depth":133,"text":447},"engineering","2021-06-01","We needed a more streamlined data migration process for Advanced search.\nHere's what we did.","md",null,false,"https://res.cloudinary.com/about-gitlab-com/image/upload/v1749682017/Blog/Hero%20Images/advanced-search-migrations.jpg",{},"/en-us/blog/advanced-search-data-migrations",{"ogTitle":5,"ogImage":495,"ogDescription":491,"ogSiteName":499,"noIndex":494,"ogType":500,"ogUrl":501,"title":5,"canonicalUrls":501,"description":491},"https://about.gitlab.com","article","https://about.gitlab.com/blog/advanced-search-data-migrations","advanced-search-data-migrations","en-us/blog/advanced-search-data-migrations",[505,506,507],"features","releases","workflow","BlogPost","NAykRuBnV6GHkgphsgpe21al-XyKYdsc9iQOUcWFVY0",{"logo":511,"freeTrial":516,"sales":521,"login":526,"items":531,"search":867,"minimal":899,"duo":918,"switchNav":927,"pricingDeployment":938},{"config":512},{"href":513,"dataGaName":514,"dataGaLocation":515},"/","gitlab logo","header",{"text":517,"config":518},"Get free trial",{"href":519,"dataGaName":520,"dataGaLocation":515},"https://gitlab.com/-/trial_registrations/new?glm_source=about.gitlab.com&glm_content=default-saas-trial/","free trial",{"text":522,"config":523},"Request a demo",{"href":524,"dataGaName":525,"dataGaLocation":515},"/request-a-demo/","sales",{"text":527,"config":528},"Sign in",{"href":529,"dataGaName":530,"dataGaLocation":515},"https://gitlab.com/users/sign_in/","sign in",[532,618,706,711,791,845],{"text":533,"left":129,"config":534,"menu":536},"Platform",{"dataNavLevelOne":535},"platform",{"type":537,"link":538,"columns":542,"feature":607},"lists",{"text":539,"config":540},"Explore the Platform",{"href":541,"dataGaName":535,"dataGaLocation":515},"/platform/",[543,566,589],{"title":544,"items":545},"DevOps",[546,551,556,561],{"text":547,"config":548},"CI/CD",{"href":549,"dataGaLocation":515,"dataGaName":550},"/solutions/continuous-integration/","ci/cd",{"text":552,"config":553},"Source Code Management",{"href":554,"dataGaLocation":515,"dataGaName":555},"/solutions/source-code-management/","source code management",{"text":557,"config":558},"Agile Delivery",{"href":559,"dataGaLocation":515,"dataGaName":560},"/solutions/agile-delivery/","agile delivery",{"text":562,"config":563},"Artifact Management",{"href":564,"dataGaLocation":515,"dataGaName":565},"/artifact-central/","artifact management",{"title":567,"items":568},"Security & Governance",[569,574,579,584],{"text":570,"config":571},"Application Security Testing",{"href":572,"dataGaLocation":515,"dataGaName":573},"/solutions/application-security-testing/","application security testing",{"text":575,"config":576},"Governance & Compliance",{"href":577,"dataGaLocation":515,"dataGaName":578},"/solutions/software-compliance/","governance and compliance",{"text":580,"config":581},"Secrets Management",{"href":582,"dataGaLocation":515,"dataGaName":583},"/gitlab-secrets-manager/","secrets management",{"text":585,"config":586},"Supply Chain Security",{"href":587,"dataGaLocation":515,"dataGaName":588},"/solutions/supply-chain/","supply chain security",{"title":590,"items":591},"Agentic AI & Context",[592,597,602],{"text":593,"config":594},"Duo Agent Platform",{"href":595,"dataGaLocation":515,"dataGaName":596},"/gitlab-duo-agent-platform/","duo agent platform",{"text":598,"config":599},"Orbit Context Graph",{"href":600,"dataGaLocation":515,"dataGaName":601},"/gitlab-orbit/","orbit",{"text":603,"config":604},"Visibility & Measurement",{"href":605,"dataGaLocation":515,"dataGaName":606},"/solutions/visibility-measurement/","visibility and measurement",{"config":608,"title":611,"text":612,"link":613},{"background":609,"textColor":610},"url('https://res.cloudinary.com/about-gitlab-com/image/upload/v1790185102/o7dn32anqcb6z8dgd3as.jpg')","#000","GitLab Orbit is generally available","Higher agent accuracy, lower token cost",{"text":614,"config":615},"Read the announcement",{"href":616,"dataGaName":617,"dataGaLocation":515},"/blog/gitlab-orbit-ga/","orbit ga announcement",{"text":619,"left":129,"config":620,"menu":622},"Solutions",{"dataNavLevelOne":621},"solutions",{"type":537,"link":623,"columns":627,"feature":697},{"text":624,"config":625},"View all Solutions",{"href":626,"dataGaName":621,"dataGaLocation":515},"/solutions/",[628,646,664],{"title":629,"items":630},"Outcomes",[631,636,641],{"text":632,"config":633},"DevOps Modernization",{"href":634,"dataGaLocation":515,"dataGaName":635},"/assessments/devops-modernization-assessment/","devops modernization",{"text":637,"config":638},"Security Modernization",{"href":639,"dataGaLocation":515,"dataGaName":640},"/assessments/security-modernization-assessment/","security modernization",{"text":642,"config":643},"AI Modernization",{"href":644,"dataGaLocation":515,"dataGaName":645},"/assessments/ai-modernization-assessment/","ai modernization",{"title":647,"items":648},"By size",[649,654,659],{"text":650,"config":651},"Enterprise",{"href":652,"dataGaLocation":515,"dataGaName":653},"/enterprise/","enterprise",{"text":655,"config":656},"Small Business",{"href":657,"dataGaLocation":515,"dataGaName":658},"/small-business/","small business",{"text":660,"config":661},"Startups",{"href":662,"dataGaLocation":515,"dataGaName":663},"/solutions/startups/","startups",{"title":665,"items":666},"Industries",[667,672,677,682,687,692],{"text":668,"config":669},"Financial Services",{"href":670,"dataGaLocation":515,"dataGaName":671},"/solutions/finance/","financial services",{"text":673,"config":674},"Public Sector",{"href":675,"dataGaLocation":515,"dataGaName":676},"/solutions/public-sector/","public sector",{"text":678,"config":679},"Telecommunications",{"href":680,"dataGaLocation":515,"dataGaName":681},"/solutions/telecommunications/","telecommunications",{"text":683,"config":684},"Automotive",{"href":685,"dataGaLocation":515,"dataGaName":686},"/solutions/automotive/","automotive",{"text":688,"config":689},"Education",{"href":690,"dataGaLocation":515,"dataGaName":691},"/solutions/education/","education",{"text":693,"config":694},"Aerospace",{"href":695,"dataGaLocation":515,"dataGaName":696},"/solutions/aerospace/","aerospace",{"config":698,"title":699,"text":700,"link":701},{"background":609,"textColor":610},"GitLab Security Standard","Learn how to harden your software factory and let AI agents earn autonomy, without trading away security.",{"text":702,"config":703},"Explore the standard",{"href":704,"dataGaName":705,"dataGaLocation":515},"/gitlab-security-standard/","gitlab security standard",{"text":707,"config":708},"Pricing",{"href":709,"dataGaName":710,"dataGaLocation":515,"dataNavLevelOne":710},"/pricing/","pricing",{"text":712,"config":713,"menu":715},"Resources",{"dataNavLevelOne":714},"resources",{"type":537,"link":716,"columns":720,"feature":782},{"text":717,"config":718},"View all resources",{"href":719,"dataGaName":714,"dataGaLocation":515},"/resources/",[721,754],{"title":722,"items":723},"Discover",[724,729,734,739,744,749],{"text":725,"config":726},"Docs",{"href":727,"dataGaName":728,"dataGaLocation":515},"https://docs.gitlab.com/","docs",{"text":730,"config":731},"University",{"href":732,"dataGaName":733,"dataGaLocation":515},"https://university.gitlab.com/","university",{"text":735,"config":736},"Demo Series",{"href":737,"dataGaName":738,"dataGaLocation":515},"/gitlab-technical-demo-series/","demo series",{"text":740,"config":741},"Demo Hub",{"href":742,"dataGaName":743,"dataGaLocation":515},"/demo-hub/","demo hub",{"text":745,"config":746},"Services",{"href":747,"dataGaName":748,"dataGaLocation":515},"/services/","services",{"text":750,"config":751},"Well Architected",{"href":752,"dataGaName":753,"dataGaLocation":515},"/resources/well-architected/","well architected",{"title":755,"items":756},"Connect",[757,762,767,772,777],{"text":758,"config":759},"Blog",{"href":760,"dataGaName":761,"dataGaLocation":515},"/blog/","blog",{"text":763,"config":764},"Community",{"href":765,"dataGaName":766,"dataGaLocation":515},"/community/","community",{"text":768,"config":769},"Customers",{"href":770,"dataGaName":771,"dataGaLocation":515},"/customers/","customers",{"text":773,"config":774},"Partners",{"href":775,"dataGaName":776,"dataGaLocation":515},"/partners/","partners",{"text":778,"config":779},"Events",{"href":780,"dataGaName":781,"dataGaLocation":515},"/events/","events",{"config":783,"title":784,"text":785,"link":786},{"background":609,"textColor":610},"What’s new in GitLab","Stay updated with our latest features and improvements.",{"text":787,"config":788},"Read the latest",{"href":789,"dataGaName":790,"dataGaLocation":515},"/whats-new/","whats new",{"text":792,"config":793,"menu":795},"Company",{"dataNavLevelOne":794},"company",{"type":537,"columns":796},[797],{"items":798},[799,804,810,815,820,825,830,835,840],{"text":800,"config":801},"About",{"href":802,"dataGaName":803,"dataGaLocation":515},"/company/","about",{"text":805,"config":806,"footerGa":809},"Jobs",{"href":807,"dataGaName":808,"dataGaLocation":515},"/jobs/","jobs",{"dataGaName":808},{"text":811,"config":812},"Press",{"href":813,"dataGaName":814,"dataGaLocation":515},"/press/","press",{"text":816,"config":817},"Handbook",{"href":818,"dataGaName":819,"dataGaLocation":515},"https://handbook.gitlab.com/","handbook",{"text":821,"config":822},"Leadership",{"href":823,"dataGaName":824,"dataGaLocation":515},"/company/team/e-group/","leadership",{"text":826,"config":827},"Investor relations",{"href":828,"dataGaName":829,"dataGaLocation":515},"https://ir.gitlab.com/overview/default.aspx","investor relations",{"text":831,"config":832},"Trust Center",{"href":833,"dataGaName":834,"dataGaLocation":515},"/security/","trust center",{"text":836,"config":837},"AI Transparency Center",{"href":838,"dataGaName":839,"dataGaLocation":515},"/ai-transparency-center/","ai transparency center",{"text":841,"config":842},"Newsletter",{"href":843,"dataGaName":844,"dataGaLocation":515},"/company/contact/#contact-forms","newsletter",{"text":846,"config":847,"menu":848},"Contact us",{"dataNavLevelOne":794},{"type":537,"columns":849},[850],{"items":851},[852,857,862],{"text":853,"config":854},"Talk to sales",{"href":855,"dataGaName":856,"dataGaLocation":515},"/sales/","talk to sales",{"text":858,"config":859},"Support portal",{"href":860,"dataGaName":861,"dataGaLocation":515},"https://support.gitlab.com/hc/en-us","support portal",{"text":863,"config":864},"Customer portal",{"href":865,"dataGaName":866,"dataGaLocation":515},"https://customers.gitlab.com/customers/sign_in/","customer portal",{"close":868,"login":869,"suggestions":876},"Close",{"text":870,"link":871},"To search repositories and projects, login to",{"text":872,"config":873},"gitlab.com",{"href":529,"dataGaName":874,"dataGaLocation":875},"search login","search",{"text":877,"default":878},"Suggestions",[879,882,885,887,891,895],{"text":880,"config":881},"GitLab Duo Agent Platform",{"href":595,"dataGaName":880,"dataGaLocation":875},{"text":883,"config":884},"Code Suggestions (AI)",{"href":595,"dataGaName":883,"dataGaLocation":875},{"text":547,"config":886},{"href":549,"dataGaName":547,"dataGaLocation":875},{"text":888,"config":889},"GitLab on AWS",{"href":890,"dataGaName":888,"dataGaLocation":875},"/partners/technology-partners/aws/",{"text":892,"config":893},"GitLab on Google Cloud",{"href":894,"dataGaName":892,"dataGaLocation":875},"/partners/technology-partners/google-cloud-platform/",{"text":896,"config":897},"Why GitLab?",{"href":898,"dataGaName":896,"dataGaLocation":875},"/why-gitlab/",{"freeTrial":900,"mobileIcon":905,"desktopIcon":910,"secondaryButton":913},{"text":901,"config":902},"Start free trial",{"href":903,"dataGaName":520,"dataGaLocation":904},"https://gitlab.com/-/trials/new/","nav",{"altText":906,"config":907},"Gitlab Icon",{"src":908,"dataGaName":909,"dataGaLocation":904},"https://res.cloudinary.com/about-gitlab-com/image/upload/v1758203874/jypbw1jx72aexsoohd7x.svg","gitlab icon",{"altText":906,"config":911},{"src":912,"dataGaName":909,"dataGaLocation":904},"https://res.cloudinary.com/about-gitlab-com/image/upload/v1758203875/gs4c8p8opsgvflgkswz9.svg",{"text":914,"config":915},"Get Started",{"href":916,"dataGaName":917,"dataGaLocation":904},"https://gitlab.com/-/trial_registrations/new?glm_source=about.gitlab.com/get-started/","get started",{"freeTrial":919,"mobileIcon":923,"desktopIcon":925},{"text":920,"config":921},"Learn more about GitLab Duo",{"href":595,"dataGaName":922,"dataGaLocation":904},"gitlab duo",{"altText":906,"config":924},{"src":908,"dataGaName":909,"dataGaLocation":904},{"altText":906,"config":926},{"src":912,"dataGaName":909,"dataGaLocation":904},{"button":928,"mobileIcon":933,"desktopIcon":935},{"text":929,"config":930},"/switch",{"href":931,"dataGaName":932,"dataGaLocation":904},"#contact","switch",{"altText":906,"config":934},{"src":908,"dataGaName":909,"dataGaLocation":904},{"altText":906,"config":936},{"src":937,"dataGaName":909,"dataGaLocation":904},"https://res.cloudinary.com/about-gitlab-com/image/upload/v1773335277/ohhpiuoxoldryzrnhfrh.png",{"freeTrial":939,"mobileIcon":944,"desktopIcon":946},{"text":940,"config":941},"Back to pricing",{"href":709,"dataGaName":942,"dataGaLocation":904,"icon":943},"back to pricing","GoBack",{"altText":906,"config":945},{"src":908,"dataGaName":909,"dataGaLocation":904},{"altText":906,"config":947},{"src":912,"dataGaName":909,"dataGaLocation":904},{"title":949,"button":950,"config":954},"GitLab Orbit is generally available. Increase agent accuracy and lower token cost",{"text":614,"config":951},{"href":616,"dataGaName":952,"dataGaLocation":953},"orbit-ga-banner","global-banner",{"layout":955,"disabled":494},"release",{"data":957},{"text":958,"config":959,"items":964,"minimal":1192},"Git is a trademark of Software Freedom Conservancy and our use of 'GitLab' is under license",{"twitter":960,"facebook":961,"youtube":962,"linkedin":963},"https://twitter.com/gitlab","https://www.facebook.com/gitlab","https://www.youtube.com/channel/UCnMGQ8QHMAnVIsI3xJrihhg","https://www.linkedin.com/company/gitlab-com",[965,1013,1072,1119,1160],{"title":707,"links":966,"subMenu":982},[967,972,977],{"text":968,"config":969},"View plans",{"href":709,"dataGaName":970,"dataGaLocation":971},"view plans","footer",{"text":973,"config":974},"Why Premium?",{"href":975,"dataGaName":976,"dataGaLocation":971},"/pricing/premium/","why premium",{"text":978,"config":979},"Why Ultimate?",{"href":980,"dataGaName":981,"dataGaLocation":971},"/pricing/ultimate/","why ultimate",[983],{"title":984,"links":985},"Contact Us",[986,989,991,993,998,1003,1008],{"text":987,"config":988},"Contact sales",{"href":855,"dataGaName":525,"dataGaLocation":971},{"text":858,"config":990},{"href":860,"dataGaName":861,"dataGaLocation":971},{"text":863,"config":992},{"href":865,"dataGaName":866,"dataGaLocation":971},{"text":994,"config":995},"Status",{"href":996,"dataGaName":997,"dataGaLocation":971},"https://status.gitlab.com/","status",{"text":999,"config":1000},"Terms of use",{"href":1001,"dataGaName":1002,"dataGaLocation":971},"/terms/","terms of use",{"text":1004,"config":1005},"Privacy statement",{"href":1006,"dataGaName":1007,"dataGaLocation":971},"/privacy/","privacy statement",{"text":1009,"config":1010},"Cookie preferences",{"dataGaName":1011,"dataGaLocation":971,"id":1012,"isOneTrustButton":129},"cookie preferences","ot-sdk-btn",{"title":533,"links":1014,"subMenu":1030},[1015,1018,1020,1022,1024,1026],{"text":1016,"config":1017},"Explore the platform",{"href":541,"dataGaName":535,"dataGaLocation":971},{"text":593,"config":1019},{"href":595,"dataGaName":596,"dataGaLocation":971},{"text":547,"config":1021},{"href":549,"dataGaName":550,"dataGaLocation":971},{"text":598,"config":1023},{"href":600,"dataGaName":601,"dataGaLocation":971},{"text":580,"config":1025},{"href":582,"dataGaName":583,"dataGaLocation":971},{"text":1027,"config":1028},"Why GitLab",{"href":898,"dataGaName":1029,"dataGaLocation":971},"why gitlab",[1031],{"title":1032,"links":1033},"Topics",[1034,1038,1043,1047,1052,1057,1062,1067],{"text":547,"config":1035},{"href":1036,"dataGaName":1037,"dataGaLocation":971},"/topics/ci-cd/","cicd",{"text":1039,"config":1040},"GitOps",{"href":1041,"dataGaName":1042,"dataGaLocation":971},"/topics/gitops/","gitops",{"text":544,"config":1044},{"href":1045,"dataGaName":1046,"dataGaLocation":971},"/topics/devops/","devops",{"text":1048,"config":1049},"Version Control",{"href":1050,"dataGaName":1051,"dataGaLocation":971},"/topics/version-control/","version control",{"text":1053,"config":1054},"DevSecOps",{"href":1055,"dataGaName":1056,"dataGaLocation":971},"/topics/devsecops/","devsecops",{"text":1058,"config":1059},"Cloud Native",{"href":1060,"dataGaName":1061,"dataGaLocation":971},"/topics/cloud-native/","cloud native",{"text":1063,"config":1064},"AI for Coding",{"href":1065,"dataGaName":1066,"dataGaLocation":971},"/topics/devops/ai-for-coding/","ai for coding",{"text":1068,"config":1069},"Agentic AI",{"href":1070,"dataGaName":1071,"dataGaLocation":971},"/topics/agentic-ai/","agentic ai",{"title":619,"links":1073},[1074,1077,1080,1083,1086,1089,1091,1093,1095,1097,1099,1102,1104,1107,1111,1115],{"text":1075,"config":1076},"DevOps modernization",{"href":634,"dataGaName":635,"dataGaLocation":971},{"text":1078,"config":1079},"Security modernization",{"href":639,"dataGaName":640,"dataGaLocation":971},{"text":1081,"config":1082},"AI modernization",{"href":644,"dataGaName":645,"dataGaLocation":971},{"text":1084,"config":1085},"Financial services",{"href":670,"dataGaName":671,"dataGaLocation":971},{"text":1087,"config":1088},"Public sector",{"href":675,"dataGaName":676,"dataGaLocation":971},{"text":678,"config":1090},{"href":680,"dataGaName":681,"dataGaLocation":971},{"text":683,"config":1092},{"href":685,"dataGaName":686,"dataGaLocation":971},{"text":688,"config":1094},{"href":690,"dataGaName":691,"dataGaLocation":971},{"text":693,"config":1096},{"href":695,"dataGaName":696,"dataGaLocation":971},{"text":650,"config":1098},{"href":652,"dataGaName":653,"dataGaLocation":971},{"text":1100,"config":1101},"Small business",{"href":657,"dataGaName":658,"dataGaLocation":971},{"text":660,"config":1103},{"href":662,"dataGaName":663,"dataGaLocation":971},{"text":1039,"config":1105},{"href":1106,"dataGaName":1042,"dataGaLocation":971},"/solutions/gitops/",{"text":1108,"config":1109},"Software composition analysis",{"href":587,"dataGaName":1110,"dataGaLocation":971},"software composition analysis",{"text":1112,"config":1113},"Value stream management",{"href":605,"dataGaName":1114,"dataGaLocation":971},"value stream management",{"text":1116,"config":1117},"All solutions",{"href":626,"dataGaName":1118,"dataGaLocation":971},"all solutions",{"title":712,"links":1120},[1121,1126,1131,1133,1135,1137,1139,1141,1143,1145,1147,1149,1151,1153,1156],{"text":1122,"config":1123},"Install",{"href":1124,"dataGaName":1125,"dataGaLocation":971},"/install/","install",{"text":1127,"config":1128},"Quick start guides",{"href":1129,"dataGaName":1130,"dataGaLocation":971},"/get-started/","quick setup checklists",{"text":725,"config":1132},{"href":727,"dataGaName":728,"dataGaLocation":971},{"text":730,"config":1134},{"href":732,"dataGaName":733,"dataGaLocation":971},{"text":735,"config":1136},{"href":737,"dataGaName":738,"dataGaLocation":971},{"text":740,"config":1138},{"href":742,"dataGaName":743,"dataGaLocation":971},{"text":745,"config":1140},{"href":747,"dataGaName":748,"dataGaLocation":971},{"text":758,"config":1142},{"href":760,"dataGaName":761,"dataGaLocation":971},{"text":763,"config":1144},{"href":765,"dataGaName":766,"dataGaLocation":971},{"text":768,"config":1146},{"href":770,"dataGaName":771,"dataGaLocation":971},{"text":773,"config":1148},{"href":775,"dataGaName":776,"dataGaLocation":971},{"text":778,"config":1150},{"href":780,"dataGaName":781,"dataGaLocation":971},{"text":841,"config":1152},{"href":843,"dataGaName":844,"dataGaLocation":971},{"text":1154,"config":1155},"What's new",{"href":789,"dataGaName":790,"dataGaLocation":971},{"text":1157,"config":1158},"All resources",{"href":719,"dataGaName":1159,"dataGaLocation":971},"all resources",{"title":792,"links":1161},[1162,1164,1166,1168,1170,1172,1174,1176,1178,1182,1187],{"text":800,"config":1163},{"href":802,"dataGaName":794,"dataGaLocation":971},{"text":805,"config":1165},{"href":807,"dataGaName":808,"dataGaLocation":971},{"text":811,"config":1167},{"href":813,"dataGaName":814,"dataGaLocation":971},{"text":816,"config":1169},{"href":818,"dataGaName":819,"dataGaLocation":971},{"text":821,"config":1171},{"href":823,"dataGaName":824,"dataGaLocation":971},{"text":826,"config":1173},{"href":828,"dataGaName":829,"dataGaLocation":971},{"text":831,"config":1175},{"href":833,"dataGaName":834,"dataGaLocation":971},{"text":836,"config":1177},{"href":838,"dataGaName":839,"dataGaLocation":971},{"text":1179,"config":1180},"Sustainability",{"href":1181,"dataGaName":1179,"dataGaLocation":971},"/sustainability/",{"text":1183,"config":1184},"Diversity, inclusion and belonging (DIB)",{"href":1185,"dataGaName":1186,"dataGaLocation":971},"/diversity-inclusion-belonging/","Diversity, inclusion and belonging",{"text":1188,"config":1189},"Modern Slavery Transparency Statement",{"href":1190,"dataGaName":1191,"dataGaLocation":971},"https://handbook.gitlab.com/handbook/legal/modern-slavery-act-transparency-statement/","modern slavery transparency statement",{"items":1193},[1194,1197,1200],{"text":1195,"config":1196},"Terms",{"href":1001,"dataGaName":1002,"dataGaLocation":971},{"text":1198,"config":1199},"Cookies",{"dataGaName":1011,"dataGaLocation":971,"id":1012,"isOneTrustButton":129},{"text":1201,"config":1202},"Privacy",{"href":1006,"dataGaName":1007,"dataGaLocation":971},[1204],{"id":1205,"title":7,"body":493,"config":1206,"content":1208,"description":493,"extension":1212,"meta":1213,"navigation":129,"path":1214,"seo":1215,"stem":1216,"__hash__":1217},"blogAuthors/en-us/blog/authors/dmitry-gruzd.yml",{"template":1207},"BlogAuthor",{"name":7,"config":1209},{"headshot":1210,"ctfId":1211},"https://res.cloudinary.com/about-gitlab-com/image/upload/v1749682014/Blog/Author%20Headshots/dgruzd-headshot.jpg","dgruzd","yml",{},"/en-us/blog/authors/dmitry-gruzd",{},"en-us/blog/authors/dmitry-gruzd","sn1aawfqITI3w1Wr5m9KVxBsh6Ibzoq3aexMyVsy9_c",[1219,1227,1235],{"title":1220,"description":1221,"heroImage":1222,"category":489,"date":1223,"authors":1224,"slug":1226,"externalUrl":493},"Two front doors: Module-level access in a Django GRC app","A technical deep-dive on restructuring a Django internal tool to support two distinct GitLab teams: Security Compliance and Internal Audit.","https://res.cloudinary.com/about-gitlab-com/image/upload/v1750097663/Blog/Hero%20Images/Blog/Hero%20Images/Workflow%201800x945_2gQoQIbY9NvjLFpXtsxtXy_1750097663612.png","2026-10-05",[1225],"Donovan Felton","module-level-access-in-a-django-grc-app",{"title":1228,"description":1229,"heroImage":1230,"category":489,"date":1231,"authors":1232,"slug":1234,"externalUrl":493},"How GitLab reduced code-per-agentic-flow ratio by 45%","Learn how Flow Registry, a component-based framework that compiles YAML configurations into fully functional LangGraph flows, helped improve scalability and more.","https://res.cloudinary.com/about-gitlab-com/image/upload/v1774465167/n5hlvrsrheadeccyr1oz.png","2026-09-22",[1233],"Mikolaj Wawrzyniak","how-gitlab-reduced-code-per-agentic-flow-ratio",{"title":1236,"description":1237,"heroImage":1238,"category":489,"date":1239,"authors":1240,"slug":1242,"externalUrl":493},"Co-Create: Building GitLab with our users","How GitLab users collaborated with us to build practical product improvements in the first half of 2026.","https://res.cloudinary.com/about-gitlab-com/image/upload/v1750099203/Blog/Hero%20Images/Blog/Hero%20Images/blog-image-template-1800x945%20%2820%29_2bJGC5ZP3WheoqzlLT05C5_1750099203484.png","2026-09-10",[1241],"Isa Huerga","co-create-h1-2026",{"header":1244,"text":1245,"button":1249,"disclaimer":1252},"Start your free\n\n30-day GitLab trial\n",[1246,1247,1248],"GitLab Duo Agent Platform access","Try our most advanced features","Automate complex tasks with AI",{"text":517,"config":1250},{"href":1251,"dataGaName":520,"dataGaLocation":761},"https://gitlab.com/-/trials/new?glm_content=default-saas-trial&glm_source=about.gitlab.com/blog/","No credit card required.",{"header":1254,"blurb":1255,"button":1256,"secondaryButton":1261},"Start building faster today","See what your team can do with the intelligent orchestration platform for DevSecOps.\n",{"text":1257,"config":1258},"Get your free trial",{"href":1259,"dataGaName":520,"dataGaLocation":1260},"https://gitlab.com/-/trial_registrations/new?glm_content=default-saas-trial&glm_source=about.gitlab.com/","feature",{"text":987,"config":1262},{"href":855,"dataGaName":525,"dataGaLocation":1260},1794911776932]