Oct 03, 2024
How Iveco Group turned LLM user analytics into insights across dozens of AI copilots

Summary

Iveco Group is a global automotive manufacturer with over 35,000 employees across 20 industrial sites and 31 R&D centers.

Sector

Automotive

Use case

Internal copilots powered by LLMs

Launch

May 2024

nebuly deployment

Self-hosted on Iveco Group’s public cloud

Oct 03, 2024
How Iveco Group turned LLM user analytics into insights across dozens of AI copilots

Nebuly delivered an LLM analytics breakthrough that transformed scattered AI tools into a unified user intelligence platform  - with 100x more actionable feedback.

As Iveco rolled out dozens of internal AI copilots to automate tasks and support employee productivity, their IT team faced a critical challenge: understanding how these AI tools were actually being used by its users. Traditional methods like surveys and interviews couldn't scale, and stakeholders had no visibility into their AI investments.

Iveco needed comprehensive LLM analytics and GenAI monitoring to optimize performance across their entire AI ecosystem - without relying on slow, manual feedback collection.

The perception of new AI technologies among Iveco Group employees has been extremely positive, marking a significant step forward in the company’s digital transformation.”


Fabio RicciatoHead of IT Customer Journey & Digital Architecture, Artificial Intelligence and DEX

Here’s what Nebuly delivered to power Iveco’s LLM analytics transformation:

100x  
more feedback
Real LLM usage analytics from every interaction. No forms, no bias, just comprehensive data from actual user behavior across all GenAI copilots.
End-to-end
visibility
AI copilot analytics gave teams and stakeholders a clear view of adoption, satisfaction, and usage patterns across the entire enterprise AI landscape.
Faster decisions
with trusted AI data
A comprehensive foundation of enterprise AI analytics that drives action, enables better stakeholder reporting, and guides AI investment decisions.

→ Read more

The challenge

With multiple GenAI copilots live across the business, Iveco Group’s IT team needed a way to understand how these tools were actually performing. But feedback was fragmented: surveys lacked volume, interviews couldn’t scale, and stakeholders had little visibility into usage or value.

Iveco considered building an internal solution to tackle this, but Nebuly offered a faster path to insight, purpose-built to monitor LLM products at scale.

The Nebuly approach
01. Understand user behavior through LLM analytics

Nebuly's LLM analytics platform categorized interactions by topic and intent across dozens of GenAI copilots, eliminating the need for time-consuming interviews and unreliable surveys.

I used to have to rely entirely on user interviews. With Nebuly, we can validate findings from user surveys, but more importantly we can extend our intelligence to 100% of our chatbot users with just one click.


Andrea RussottoIT Artificial Intelligence / Generative AI and Prompt Engineering

02. Capture unbiased GenAI performance data

Traditional surveys lacked volume and introduced bias. Nebuly's passive, real-time GenAI monitoring revealed genuine issues based on actual user behavior across all AI copilots.

User surveys are great in some ways, but research also shows that they introduce an element of bias. Nebuly takes bias out of the equation with their unobtrusive and fully automated feedback collection process...
With Nebuly, we have data we can trust to prioritize LLM improvements.


Pasquale MorraIT Artificial Intelligence / IT AI Platform and Architecture

03. Enable stakeholder-ready AI insights

Reporting on Nebuly’s LLM analytics platform made adoption, satisfaction, and usage patterns easy to share, helping teams invest better and track cost-to-value across GenAI initiatives.

With Nebuly, we were able to easily share relevant insights with all stakeholders, who now have a clear picture of why, and how, their AI use cases are being used in production. Our stakeholders love it, and it also significantly reduces the reporting burden on the AI team, allowing us to focus on rolling out new initiatives. It’s a win-win.


Andrea RussottoIT Artificial Intelligence / Generative AI and Prompt Engineering

A future of continuous innovation

As Iveco Group anticipates a 40% increase in GenAI projects by mid-2025, Nebuly’s LLM analytics platform will play a key role in helping its teams continuously adapt AI solutions to real user needs—whether for employees, customers, or other stakeholders.

We’ve been extremely happy with the close collaboration with Nebuly. As the number and complexity of GenAI use cases increase, the need for a solution like Nebuly is clear.


Fabio RicciatoHead of IT Customer Journey & Digital Architecture, Artificial Intelligence and DEX

Nebuly fosters a culture of continuous learning and curiosity, which aligns with our DNA. This keeps our teams motivated, up-to-date on essential AI skills, and focused on innovation.


Andrea RussottoIT Artificial Intelligence / Generative AI and Prompt Engineering

Ready to unlock LLM analytics for your business?
Join leading enterprises using Nebuly to turn conversations into intelligent insights.
Our LLM analytics platform empowers your team to understand, optimize, and protect AI-driven user experiences.