Generative AI has established itself as a risk that enterprise leaders need to track and be aware of, according to new research

Generative AI is an emerging risk for enterprises


Generative AI has established itself as a risk that enterprise leaders need to track and be aware of, according to new research

China trade tensions rounded out the top five risks that were split between issues symptomatic of the current broad macroeconomic and geopolitical volatility, and technology-related concerns.

Mass generative AI availability

Gartner has previously identified six risks of generative AI and four areas of AI regulation that are relevant to assurance functions. In terms of managing enterprise risk, three main aspects must be addressed, according to Gartner experts:

  • Intellectual Property
    “Information entered into a generative AI tool can become part of its training set, meaning that sensitive or confidential information could end up in outputs for other users,” said Xu. “Moreover, using outputs from these tools could well end up inadvertently infringing the intellectual property rights of others who have used it.”

    It’s important to educate corporate leadership on the necessity for caution and transparency around the use of such tools so that intellectual property risks can be properly mitigated both in terms of input and output from generative AI tools.
  • Data Privacy
    Generative AI tools may possibly share user information with third parties, such as vendors or service providers, without prior notice. This has the potential to violate privacy law in many jurisdictions. For example, regulation has already been implemented in China and the EU, with proposed regulations emerging in USA, Canada, India and UK among others.
  • Cybersecurity
    “Hackers are always testing new technologies for ways to subvert it for their own ends, and generative AI is no different,” said Xu. “We’ve seen examples of malware and ransomware code that generative AI has been tricked into producing, as well as ‘prompt injections’ attacks that can trick these tools into giving away information they should not. This is leading to the industrialization of advanced phishing attacks.”

Causes and implications of third-party viability risk
“Persistent inflation that is less responsive to interest rate rises and contuse longer than anticipated has escalated costs and margin pressures on third parties,” said Xu. “As central banks increase interest rates to fight inflation, this also brings about a process of credit tightening that may force suppliers to suspend operations or become insolvent as borrowing costs rise.”

If economic conditions deteriorate broadly, this may cause an unexpected drop in demand that could affect vendor viability or their ability to provide goods and services in a timely manner. Gartner experts identified three potential third-party viability consequences for risk managers to monitor as the situation develops:

  • Loss of key inputs and materials: If third-parties are increasing their prices due to the wider economic situation there is a clear risk of losing access to key inputs and materials as third parties would favor customers willing to pay higher prices.
  • Flawed financial planning assumptions: Cost assumptions will be rendered invalid as suppliers increase prices or fail, necessitating switching costs and increased prices for obtaining goods and services.
  • Challenges outside the supply chain: Partners, such as managed service providers or commercial partners, creditors, or technology vendors may cease or curtail operations.

Gartner clients can read more in 2Q23 Emerging Risk Report. Non-clients can watch the webinar: Executive Leaders, Determine the Opportunities and Risks of Generative AI.

This press release originally appeared online.

Related: Higher ed experienced the most ransomware attacks of any sector

Sign up for our newsletter

Newsletter: Innovations in K12 Education
By submitting your information, you agree to our Terms & Conditions and Privacy Policy.

Laura Ascione