{"id":13021,"date":"2023-09-09T00:38:02","date_gmt":"2023-09-09T00:38:02","guid":{"rendered":"https:\/\/mysourcefunding.com\/leadership\/prioritize-generative-ai-governance-over-location\/"},"modified":"2023-09-09T00:38:03","modified_gmt":"2023-09-09T00:38:03","slug":"prioritize-generative-ai-governance-over-location","status":"publish","type":"post","link":"https:\/\/mysourcefunding.com\/?p=13021","title":{"rendered":"Prioritize Generative AI Governance Over Location"},"content":{"rendered":"
\n

Should you run generative AI workloads on premises or in the public cloud? Yes, but your operational maturity and ability to master risk are more critical.<\/em><\/p>\n

Buckets of digital ink have been ladled out of late over whether generative AI applications should run internally or externally. Where GenAI workloads run does<\/em> matter, as the wrong location can have significant consequences for your organization.<\/p>\n

The increasing distributed nature of applications and data suggests these workloads will run in a combination of places, including on-premises environments, public and private clouds, and the edge.<\/p>\n

However, it’s more important that your organization\u2019s operational maturity is strong enough to mitigate risks to the business. This means ensuring that your data quality, security and other IT attributes help support the business strategy.<\/p>\n

In that vein, how well<\/em> your GenAI workloads run is more important than where they run\u2014whether that\u2019s the public cloud, on-premises systems or other locations across your multicloud estate.<\/p>\n

The Current Debate<\/strong><\/h2>\n

Zooming out, let\u2019s contextualize the current narrative. Organizations are still figuring out the best place to run large language models (LLMs) that power ChatGPT and other popular conversational assistants.<\/p>\n

The primary locations for running GenAI workloads are on-premises, the public cloud or at the edge, said EY Americas Emerging Technologies Leader Matt Barrington in a recent webinar regarding how organizations should articulate their GenAI strategy.<\/p>\n

Evidence suggests this is happening, with most organizations choosing on-premises and edge or the public cloud, according to industry pundits Dave Vellante and David Linthicum. \u201cWhere the systems run depends mainly on the type of problem you\u2019re looking to solve and the attributes of that generative AI system.,\u201d Linthicum wrote.<\/p>\n

For some mature organizations the answer may be both\u2014in different stages of a workload\u2019s lifecycle. An organization may initially run a GenAI application in a public cloud but bring it back on premises when it decides to incorporate sensitive intellectual property.<\/p>\n

Or consider this scenario: AI workloads typically require two main components\u2014inferencing and training. It may make more sense for IT organizations to train GenAI models, which are performance intensive, on premises, according to IDC research sponsored by Dell.1 <\/sup><\/p>\n

Fifty-five percent of IT decision makers Dell surveyed cited performance as the main reason for running GenAI workloads on premises.2 Conversely, inferencing tasks can be run in a distributed fashion at edge locations, in public cloud environments or on premises.<\/p>\n

Security also plays a critical factor in where organizations decide to run AI workloads. For instance, organizations can scrub the data of any sensitive information during the modeling phase before moving AI workloads to another environment.<\/p>\n

Fears of intellectual property leakage through GenAI consumption in the enterprise are very real. Thirty percent of ITDMs Dell surveyed said more control over their AI model was a critical factor in running their GenAI workloads on premises. For such organizations, it may make the most sense to bring the AI to their data or procure an off-the-shelf or open source LLM for their on-premises environment. This approach can deliver more value at great performance while reducing cost.<\/p>\n

Ultimately, the right location will depend on several factors, including performance, latency, reliability and security. As such, IT leaders would do well to square their GenAI requirements with their operating model options and risk appetite.<\/p>\n

Why Operational Maturity Matters Most<\/strong><\/h2>\n

Because LLMs are \u201csomewhat accurate and 100% confident\u201d organizations must orchestrate a great deal of governance while consuming them, said EY\u2019s Barrington.<\/p>\n

He recommended that organizations embrace top-down approaches; that is, executive leadership must work closely with line-of-business leaders to rethink customer interaction models and other operations. Ideally, IT will take the lead in deploying technology and architecting governance models.<\/p>\n

Organizations with strong operational maturity will deploy people, process and technology to extract the most value out of GenAI workloads. This includes assigning the right talent to build and train models, empowering them with the right tools, and implementing the right operational guardrails. Greater operational maturity, the thinking goes, will minimize business risks.<\/p>\n

There is no plug-and-play approach for how to achieve operational maturity; however, centralizing GenAI efforts within IT and implementing strong data management techniques are critical. Organizations that pair their corporate data with the right GenAI tools will have an advantage.<\/p>\n

\u201cData is the fuel for all of this,\u201d Barrington said. Companies that fail to build the right data constructs \u201care behind and going to have to play catch up.\u201d<\/p>\n

GenAI technologies are evolving swiftly. In this era of digital innovation, you don’t want to chase more nimble competitors.<\/p>\n

How will you rise to the challenge?<\/p>\n

Learn more about <\/em>Dell Generative AI Solutions<\/em>.<\/em><\/p>\n<\/div>\n

Read the full article here<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

Should you run generative AI workloads on premises or in the public cloud? Yes, but your operational maturity and ability to master risk are more critical. Buckets of digital ink have been ladled out of late over whether generative AI applications should run internally or externally. Where GenAI workloads run does matter, as the wrong […]<\/p>\n","protected":false},"author":1,"featured_media":13022,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"content-type":"","footnotes":""},"categories":[76],"tags":[],"class_list":{"0":"post-13021","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-leadership"},"yoast_head":"\nPrioritize Generative AI Governance Over Location | Brandiary<\/title>\n<meta name=\"description\" content=\"Should you run generative AI workloads on premises or in the public cloud? Yes, but your operational maturity and ability to master risk are more\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mysourcefunding.com\/?p=13021\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Prioritize Generative AI Governance Over Location | Brandiary\" \/>\n<meta property=\"og:description\" content=\"Should you run generative AI workloads on premises or in the public cloud? Yes, but your operational maturity and ability to master risk are more\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mysourcefunding.com\/?p=13021\" \/>\n<meta property=\"og:site_name\" content=\"Brandiary\" \/>\n<meta property=\"article:published_time\" content=\"2023-09-09T00:38:02+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-09-09T00:38:03+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/mysourcefunding.com\/wp-content\/uploads\/2023\/09\/1694219882_0x0.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"800\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"News Room\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"News Room\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/mysourcefunding.com\/?p=13021#article\",\"isPartOf\":{\"@id\":\"https:\/\/mysourcefunding.com\/?p=13021\"},\"author\":{\"name\":\"News Room\",\"@id\":\"https:\/\/mysourcefunding.com\/#\/schema\/person\/5062dafb0f932b59aa228f1a047332f4\"},\"headline\":\"Prioritize Generative AI Governance Over Location\",\"datePublished\":\"2023-09-09T00:38:02+00:00\",\"dateModified\":\"2023-09-09T00:38:03+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/mysourcefunding.com\/?p=13021\"},\"wordCount\":782,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/mysourcefunding.com\/#organization\"},\"articleSection\":[\"Leadership\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/mysourcefunding.com\/?p=13021#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/mysourcefunding.com\/?p=13021\",\"url\":\"https:\/\/mysourcefunding.com\/?p=13021\",\"name\":\"Prioritize Generative AI Governance Over Location | Brandiary\",\"isPartOf\":{\"@id\":\"https:\/\/mysourcefunding.com\/#website\"},\"datePublished\":\"2023-09-09T00:38:02+00:00\",\"dateModified\":\"2023-09-09T00:38:03+00:00\",\"description\":\"Should you run generative AI workloads on premises or in the public cloud? Yes, but your operational maturity and ability to master risk are more\",\"breadcrumb\":{\"@id\":\"https:\/\/mysourcefunding.com\/?p=13021#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/mysourcefunding.com\/?p=13021\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/mysourcefunding.com\/?p=13021#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/mysourcefunding.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Prioritize Generative AI Governance Over Location\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/mysourcefunding.com\/#website\",\"url\":\"https:\/\/mysourcefunding.com\/\",\"name\":\"Brandiary\",\"description\":\"Latest Business and Startup News and Updates\",\"publisher\":{\"@id\":\"https:\/\/mysourcefunding.com\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/mysourcefunding.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/mysourcefunding.com\/#organization\",\"name\":\"Brandiary\",\"url\":\"https:\/\/mysourcefunding.com\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/mysourcefunding.com\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/mysourcefunding.com\/wp-content\/uploads\/2023\/06\/b-logo-1.png\",\"contentUrl\":\"https:\/\/mysourcefunding.com\/wp-content\/uploads\/2023\/06\/b-logo-1.png\",\"width\":381,\"height\":100,\"caption\":\"Brandiary\"},\"image\":{\"@id\":\"https:\/\/mysourcefunding.com\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/mysourcefunding.com\/#\/schema\/person\/5062dafb0f932b59aa228f1a047332f4\",\"name\":\"News Room\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/mysourcefunding.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/mysourcefunding.com\/wp-content\/uploads\/2023\/06\/avatar_user_1_1688031660-96x96.png\",\"contentUrl\":\"https:\/\/mysourcefunding.com\/wp-content\/uploads\/2023\/06\/avatar_user_1_1688031660-96x96.png\",\"caption\":\"News Room\"},\"sameAs\":[\"https:\/\/mysourcefunding.com\"],\"url\":\"https:\/\/mysourcefunding.com\/?author=1\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Prioritize Generative AI Governance Over Location | Brandiary","description":"Should you run generative AI workloads on premises or in the public cloud? Yes, but your operational maturity and ability to master risk are more","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mysourcefunding.com\/?p=13021","og_locale":"en_US","og_type":"article","og_title":"Prioritize Generative AI Governance Over Location | Brandiary","og_description":"Should you run generative AI workloads on premises or in the public cloud? Yes, but your operational maturity and ability to master risk are more","og_url":"https:\/\/mysourcefunding.com\/?p=13021","og_site_name":"Brandiary","article_published_time":"2023-09-09T00:38:02+00:00","article_modified_time":"2023-09-09T00:38:03+00:00","og_image":[{"width":1200,"height":800,"url":"https:\/\/mysourcefunding.com\/wp-content\/uploads\/2023\/09\/1694219882_0x0.jpg","type":"image\/jpeg"}],"author":"News Room","twitter_card":"summary_large_image","twitter_misc":{"Written by":"News Room","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/mysourcefunding.com\/?p=13021#article","isPartOf":{"@id":"https:\/\/mysourcefunding.com\/?p=13021"},"author":{"name":"News Room","@id":"https:\/\/mysourcefunding.com\/#\/schema\/person\/5062dafb0f932b59aa228f1a047332f4"},"headline":"Prioritize Generative AI Governance Over Location","datePublished":"2023-09-09T00:38:02+00:00","dateModified":"2023-09-09T00:38:03+00:00","mainEntityOfPage":{"@id":"https:\/\/mysourcefunding.com\/?p=13021"},"wordCount":782,"commentCount":0,"publisher":{"@id":"https:\/\/mysourcefunding.com\/#organization"},"articleSection":["Leadership"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/mysourcefunding.com\/?p=13021#respond"]}]},{"@type":"WebPage","@id":"https:\/\/mysourcefunding.com\/?p=13021","url":"https:\/\/mysourcefunding.com\/?p=13021","name":"Prioritize Generative AI Governance Over Location | Brandiary","isPartOf":{"@id":"https:\/\/mysourcefunding.com\/#website"},"datePublished":"2023-09-09T00:38:02+00:00","dateModified":"2023-09-09T00:38:03+00:00","description":"Should you run generative AI workloads on premises or in the public cloud? Yes, but your operational maturity and ability to master risk are more","breadcrumb":{"@id":"https:\/\/mysourcefunding.com\/?p=13021#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mysourcefunding.com\/?p=13021"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/mysourcefunding.com\/?p=13021#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/mysourcefunding.com\/"},{"@type":"ListItem","position":2,"name":"Prioritize Generative AI Governance Over Location"}]},{"@type":"WebSite","@id":"https:\/\/mysourcefunding.com\/#website","url":"https:\/\/mysourcefunding.com\/","name":"Brandiary","description":"Latest Business and Startup News and Updates","publisher":{"@id":"https:\/\/mysourcefunding.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mysourcefunding.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/mysourcefunding.com\/#organization","name":"Brandiary","url":"https:\/\/mysourcefunding.com\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/mysourcefunding.com\/#\/schema\/logo\/image\/","url":"https:\/\/mysourcefunding.com\/wp-content\/uploads\/2023\/06\/b-logo-1.png","contentUrl":"https:\/\/mysourcefunding.com\/wp-content\/uploads\/2023\/06\/b-logo-1.png","width":381,"height":100,"caption":"Brandiary"},"image":{"@id":"https:\/\/mysourcefunding.com\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/mysourcefunding.com\/#\/schema\/person\/5062dafb0f932b59aa228f1a047332f4","name":"News Room","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/mysourcefunding.com\/#\/schema\/person\/image\/","url":"https:\/\/mysourcefunding.com\/wp-content\/uploads\/2023\/06\/avatar_user_1_1688031660-96x96.png","contentUrl":"https:\/\/mysourcefunding.com\/wp-content\/uploads\/2023\/06\/avatar_user_1_1688031660-96x96.png","caption":"News Room"},"sameAs":["https:\/\/mysourcefunding.com"],"url":"https:\/\/mysourcefunding.com\/?author=1"}]}},"_links":{"self":[{"href":"https:\/\/mysourcefunding.com\/index.php?rest_route=\/wp\/v2\/posts\/13021","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mysourcefunding.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mysourcefunding.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mysourcefunding.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/mysourcefunding.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=13021"}],"version-history":[{"count":1,"href":"https:\/\/mysourcefunding.com\/index.php?rest_route=\/wp\/v2\/posts\/13021\/revisions"}],"predecessor-version":[{"id":13023,"href":"https:\/\/mysourcefunding.com\/index.php?rest_route=\/wp\/v2\/posts\/13021\/revisions\/13023"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/mysourcefunding.com\/index.php?rest_route=\/wp\/v2\/media\/13022"}],"wp:attachment":[{"href":"https:\/\/mysourcefunding.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=13021"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mysourcefunding.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=13021"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mysourcefunding.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=13021"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}