Six Metrics And Success Factors For Agile In ERP

James Roberts

Part of the “Agile ERP” series

In my series of articles on adopting agile for ERP systems, I’ve talked about the reasons why you should do so, how to tackle resistance and negativity, and helpful steps to get started. What’s also vitally important is knowing what success looks like and how you might go about measuring it.

Most successful agile transformations start small and then are rolled out to the wider organization. But that usually won’t happen until there’s empirical evidence that improvements are being delivered.

So how do you know what to measure? How can you identify the things that are working and the areas that need to be tweaked?

Here are some metrics I’ve found helpful both within our business and for the clients we work with.

1. Business value

Generation of business value is a key reason to spend time and money on application development. How many ideas have you seen that have no effect on business performance? For me, the answer would be “a lot.” My advice is to focus on the ones that will create the most value.

Attributing business value to specific new features can help here. For example:

  • What is the anticipated increase in sales revenue?
  • Can you expect to gain more customers or market share?
  • Will operational costs be reduced?

If you define your value metrics before you start, you’ll be in a better position post-delivery to judge whether value is being generated by your investment (which, as we know, can be significant in ERP).

2. Velocity/on-time delivery

When you’re running an agile process, you should use “story points” as a means to estimate the size of requirements.

Look at the total number of story points you’re delivering in each development sprint. How does that compare to previous sprints? Is this increasing over time?

During the sprint review, take time to compare what was delivered with the number of stories and points you committed to in sprint planning. Assess whether promised delivery dates have been met. This will help you understand where estimation needs to be improved.

As your estimates improve, you’re more likely to be able to commit to delivering a realistic number of stories in each sprint. That will allow you to manage your customers’ expectations more effectively.

3. Quality

You can expect an increase in software quality when running agile. That should translate into greater stability, which is vital for ERP applications. “Don’t break the system” is probably the #1 development mandate in many organizations!

Consider metrics such as:

  • How many testing defects are being found?
  • How many production incidents are being raised?
  • How stable are the applications and requirements that are delivered in each sprint?
  • How many support tickets are being raised?

Smaller, more frequent releases ensure that issues are identified early and can be resolved with much less cost and that the recovery time from failure is significantly reduced. This approach will make the measurement of quality more straightforward as you build confidence in your processes.

4. Customer satisfaction

One of the key benefits of agile is the fact that the business gets visibility of what’s being built much sooner than with other approaches and thus can guide the process.

You’d, therefore, expect agile to provide greater business and user satisfaction, since what gets delivered is more likely to match what the end customer actually wants. Monitor user feedback and get feature-usage statistics to let you know when you’re getting it right.

You should also make sure that the business is involved in the development of user stories and acceptance criteria and that they’re present in sprint planning, stand-ups, and review meetings. That way you’ll get a much more direct read on whether or not they’re happy.

5. Visibility and status

Agile promotes visibility and transparency so that it’s clear to everybody what’s going on.

There are many agile tools that can help you monitor project status, and you should use them. Agree on metrics that show progress against a targeted plan. This way, the project management office can have confidence that things are on track.

Be religious about time bookings and use the sprint burndown chart to report on the time spent and time remaining against the plan. Use release charts to see whether progress is on track based on current performance to assess the predicted completion dates.

Measuring and sharing progress help get teams aligned with each other. The integrated nature of ERP means that there will be many dependencies across teams; it’s vital to have complete visibility to effectively manage impacts and risks.

6. Performance KPIs

Setting and measuring specific key performance indicators (KPIs) for development and testing teams can be immensely insightful. There are lots of options, but here are some common metrics:

  • Velocity: Analyze the functionality that is being delivered by reviewing the number of transports and changes being deployed into every ERP system and whether those were successful or in error.
  • Cycle times: Investigate how long it takes to get requirements into production so you can see how efficient your development and testing teams are.
  • Rework and waste: Understanding the amount of rework and waste in the process is a great barometer of quality and hidden cost.
  • Work in progress: The amount of work in progress gives insight into the current ongoing cost of development and testing activity.
  • Approval times: Approval wait times can kill any process. Understand where approvals are being delayed so these bottlenecks can be targeted.

Deploying tools to automate ERP change, approval, and deployment processes will help your agile approach succeed by eliminating manual activities, delays, and errors. Ask yourself how you’ll be able to extract the metrics you need ­– such as the ones above – from those tools.


Ultimately, businesses must have the ability and flexibility to change their ERP systems at the speed that matches the broader organization. There must be confidence in the process, culture, and tools if this is going to be achieved without compromising stability.

Agile development can deliver against these requirements, though constant measurement, learning, and improvement are vital as part of the overall process. It will take time, patience, and willingness for change to become properly embedded. But tangible evidence of progress and success can help motivate everyone involved, not to mention provide a solid business case for wider adoption.

If you’re looking to implement agile for ERP, take a look at this e-book on some key steps that can help you to get started.

This article originally appeared on the Basis Technologies blog. This adapted version is republished by permission. Basis Technologies is an SAP silver partner.

James Roberts

About James Roberts

James Roberts is chief technology officer at Basis Technologies, responsible for driving product vision, strategy, and direction across the company’s innovative automation portfolio, and for ensuring that the engineering teams deliver world-class solutions. He has 30 years of experience in the software industry and nearly 25 years of SAP expertise working in a multitude of roles at major multinational companies.