Saturday, November 23, 2024

Google survey says more than 75% of developers rely on AI. But there's a catch

Must read

lucadp/Getty Images

More than 75% of developers and IT professionals rely on artificial intelligence (AI) for at least one daily professional responsibility, but 39% say they don’t trust AI-generated code, according to Google’s 2024 State of DevOps report.

Google Cloud’s DevOps Research and Assessment (DORA) team surveyed nearly 3,000 technology professionals globally and AI adoption is increasing rapidly within technology shops. 

Also: 5 tips for choosing the right AI model for your business

Over three-quarters (76%) of respondents said they rely on AI for tasks like code writing, summarizing information, and code explanation. At least 81% said their companies have shifted technology resources into developing AI.

AI adoption was positively correlated with increased flow, productivity, job satisfaction, code quality, and internal documentation quality. At least 67% reported that AI is helping them improve their code.

Also: Asana launches a no-code tool for designing AI agents – aka your new ‘teammates’

So far, so good. Overall, a 25% increase in AI adoption in development shops is associated with the following metrics:

  • 7.5% increase in documentation quality
  • 3.4% increase in code quality
  • 3.1% increase in code review speed
  • 1.3% increase in approval speed
  • 1.8% decrease in code complexity

However, the researchers noted AI adoption is also associated with a decrease in delivery stability: “AI adoption may negatively impact software delivery performance,” according to Nathen Harvey and Derek DeBellis, both with DORA.

Also: Technologist Bruce Schneier on security, society and why we need ‘public AI’ models

Close to four in ten professionals (39%) reported having “little or no trust” in AI. “This unexpected low level of trust indicates to us that there is a need to manage AI integration more thoughtfully,” the researchers said. “Teams must carefully evaluate AI’s role in their development workflow to mitigate the downsides.”    

The survey revealed AI adoption was accompanied by an estimated decrease in delivery throughput of 1.5% and an estimated reduction in delivery stability of 7.2%. 

“Our data suggest that improving the development process does not automatically improve software delivery — at least not without proper adherence to the basics of successful software delivery, like small batch sizes and robust testing mechanisms,” the researchers said. 

Also: Gartner’s 2025 tech trends show how your business needs to adapt – and fast

“AI has positive impacts on many important individual and organizational factors which foster the conditions for high software delivery performance. But, AI does not appear to be a panacea.” 

These results led the research authors to suggest a potential need for change management practices in the age of AI-powered development. They urged companies to adopt the following measures:

  • “Enable your employees and reduce toil by orienting your AI adoption strategies towards empowering employees and alleviating the burden of undesirable tasks.”
  • “Establish clear guidelines for the use of AI and address procedural concerns and foster open communication about its impact.”
  • “Encourage continuous exploration of AI tools and provide them dedicated time for experimentation, and promote trust through hands-on experience.”

The survey also documents the benefits of a platform-engineering approach to development and operations. As many as 89% of respondents said they use an internal developer platform, reporting an average 6% gain in productivity at the team level when their organizations have dedicated platform teams.

A superior developer experience is the “cornerstone of success,” the researchers said: “A healthy culture can help reduce burnout, increase productivity, and increase job satisfaction. A move-fast-and-constantly-pivot mentality negatively impacts developer well-being.”

Also: Perplexity AI’s new tool makes researching the stock market ‘delightful’. Here’s how

The researchers concluded: “Creating a work environment where your team feels supported, valued and empowered to contribute is fundamental to achieving high performance.”

Latest article