The hidden costs of underqualified software releases

The hidden costs of underqualified software releases

The hidden costs of bad software releases

Bad software releases cost organizations an average of €1.7 million a year, according to Gartner. For TotalEnergies, VRT and VDAB, this was not an abstract risk, but a concrete challenge that threatened their digital transformation. These three leading Belgian organizations took a structured approach under M2Q’s guidance, with results that exceeded expectations: up to 80% faster implementations, a 65% reduction in production incidents and a return on investment (ROI) achieved within six months.

When software is rolled out without adequate quality assurance, it creates a cascade of problems far beyond technical incidents. Customers experience downtime, development teams spend time putting out fires rather than innovating, and the organization’s reputation is at stake. For companies with complex IT landscapes, this challenge grows exponentially.

TotalEnergies Belgium, VRT and VDAB found themselves in exactly this situation. Despite talented teams and significant technological investments, software releases remained a source of uncertainty. The cause? Not a lack of expertise, but the lack of a structured quality framework that effectively integrates people, processes and technology.

TotalEnergies: from fragmentation to integrated quality assurance

The challenge: a fragmented testing landscape

TotalEnergies Belgium, a key player in the energy sector with millions of customers, was struggling with a fundamental problem in its software development process: testing activities were scattered across different teams, with no central coordination or standardized approach. Testers worked in isolation, with no clear methodology or shared tools.

The result was predictable, but disastrous: inefficient test cycles, inconsistent test results and a lack of insight into the actual quality of software releases. For an organization that must ensure 24/7 availability for energy consumers, this was untenable. A failure in the billing or customer portal could lead directly to reputational and financial losses.

Management realized they needed more than technical expertise – they required a strategic transformation of the entire quality assurance function.

The M2Q approach: Test Center of Excellence as the foundation

M2Q implemented a Test Center of Excellence (TCoE) as the central coordination point for all testing activities within TotalEnergies. This was not a cosmetic reorganization, but a fundamental restructuring of how quality was built into the development process.

Strategic focus on three pillars:

  • Process standardization: M2Q implemented a unified testing framework applied to all projects, with standardized methodologies, clear acceptance criteria and a structured approach to risk assessment. Teams received not only guidelines, but concrete manuals for daily work.
  • Tooling integration: Instead of fragmentation, M2Q implemented an integrated test management platform that provided full traceability from requirements to test results and real-time visibility into test progress and quality metrics.
  • Capacity building: M2Q recognized that sustainable transformation requires teams to develop their own expertise. They implemented a comprehensive training program, with on-the-job coaching and knowledge transfer that went beyond theoretical concepts.

Measurable Impact: From Chaos to Control
The results were significant and measurable:

  • 40% improvement in test efficiency, reducing weeks of ad hoc testing to systematic, complete test cycles in days.
  • Significant improvement in visibility of quality metrics, enabling data-driven go/no-go decisions.
  • Cultural change: Quality became a shared responsibility across the development team, fostering collaboration and common goals.

Test Center of Excellence

VRT: Test Automation as a Strategic Enabler

The Context: Digital Transformation in the Media World

VRT, the Flemish Radio and Television Broadcasting Corporation, is at the center of the digital media revolution. Their digital platforms, from VRT MAX to online news services, are increasingly the primary point of contact with their audience. With millions of users consuming content daily via web and mobile apps, continuous availability and an excellent user experience are non-negotiable.

The challenge for VRT was complex: How to increase the speed of software releases needed to compete in the digital media landscape while ensuring the quality expected of a public broadcaster? Their traditional testing approach, heavily reliant on manual test cycles, posed a bottleneck in the development process.

The Transformation: from Manual to Intelligent Automated Testing

M2Q introduced a strategic vision for test automation that went beyond simply automating existing manual tests. They began with a thorough analysis of VRT’s application landscape, usage patterns and risk areas, and developed a layered automation strategy based on the test automation pyramid:

  • Unit testing: Integrated into the development pipeline for immediate feedback on code changes.
  • API and Integration Testing: Crucial for validating content workflows from acquisition to distribution.
  • End-to-End Testing: Focused on critical user journeys, automated with robust frameworks.

Continuous testing in a CI/CD pipeline

Test automation was fully integrated into VRT’s CI/CD pipelines. Each code commit triggered relevant tests, and implementations required a “green” test suite. This enabled shift-left testing, where defects were detected within minutes of release, significantly shortening feedback loops.

Business transformation results

  • 70% reduction in regression test time, allowing multiple daily test cycles.
  • Quadruple increase in production release frequency, allowing VRT to better respond to market feedback and innovate.
  • Early detection of defects, which saved significant costs and reputational damage.

VDAB: Quality engineering for critical public services

The challenge in the public sector: scale, complexity and accountability

VDAB, the Flemish Service for Employment and Vocational Training, plays a crucial role in the Flemish labor market. Their digital platforms are used daily by hundreds of thousands of job seekers, employers and partners. A system failure has a direct impact on people looking for work, their livelihood and their future.

VDAB’s IT landscape is vast and complex, with integrations with numerous external parties. Regulatory compliance, privacy protection and accessibility are non-negotiable. Yet VDAB operates under budgetary constraints and increasing expectations.

The M2Q Approach: risk-based testing and pragmatic quality engineering

M2Q implemented a risk-based testing strategy, prioritizing testing efforts based on business impact, frequency of use and technical complexity:

  • High-risk functionality (e.g., job registration, application processes) received intensive test coverage, including edge cases and security testing.
  • Medium-risk functionality combined automated and manual testing.
  • Low-risk functionality was monitored through canary releases and production monitoring.

Performance Engineering as a differentiator

For VDAB, performance is a public good. M2Q implemented extensive performance testing, simulating realistic usage scenarios and identifying bottlenecks early on. The result: 50% improvement in response times and a stable infrastructure under peak load.

Measurable Impact in the Public Sector

  • 65% reduction in production incidents, which directly improved service and reduced operational costs.
  • Increased job seeker engagement, with more users applying for jobs independently and attending training.
  • Cultural change: Quality became an investment that contributed directly to VDAB’s public mission.

 

Common success factors: what made these transformations possible

Although TotalEnergies, VRT and VDAB operate in different sectors with unique challenges, their successful transformations share striking common patterns:

  • Executive Sponsorship and Strategic Vision: In all three cases, there was strong management support for quality transformation. Quality was not seen as an IT issue, but as a business enabler, directly linked to business results.
  • Pragmatism over perfection: M2Q’s approach was characterized by pragmatic realism, focusing on the 20% of efforts that deliver 80% of the value. This ensured quick successes and generation of momentum for further transformation.
  • Balance between tooling and people: M2Q invested in modern testing tools, but always combined this with capacity building. Training programs were tailored to the context of each organization, and communities of practice ensured sustainable knowledge sharing.
  • Metrics that matter: M2Q implemented measurement frameworks linked to business outcomes, such as average time to defect detection, implementation frequency and user satisfaction scores. These metrics were used for continuous improvement, not punishment.
  • Iterative implementation with continuous feedback: Transformations were not rigid, but iterative, starting with pilot projects that provided learning points and quick successes. This approach reduced risk and provided continuous learning.

 

The return on investment: Financial Business Case for quality engineering

To C-level executives, the financial business case for quality engineering may seem unclear. However, ROI follows a predictable pattern:

  • Months 1-3: Investment phase (tooling, training, process definition).
  • Months 4-6: Transition phase, with rapid successes and break-even around month 6.
  • Months 7-12: Scale phase, with accelerating returns and an ROI of 200-300% in the first year.
  • Year 2+: Optimization phase, with a cumulative ROI of 400-600% over three years.

For TotalEnergies, VRT and VDAB, the ROI break-even was achieved within six months, exceeding 300% within the first year.

The future of quality engineering

Quality engineering is evolving rapidly. Organizations must anticipate trends, such as:

  • AI augmented testing: Intelligent test generation, self-healing automation and predictive defect analysis.
  • Shift to production testing: Canary deployments, feature flags and A/B testing.
  • DevSecOps: Embedding security testing into CI/CD pipelines.
  • Platform Engineering: Self-service capabilities for teams to manage quality independently.

Practical next steps for organizations

For C-level executives considering a similar transformation:

  • Start with an honest assessment of the current situation.
  • Identify your “burning platform” , the business pain that drives the need for change.
  • Start small, but think big with a pilot project.
  • Invest in people and culture, not just tools.
  • Measure what matters, link metrics to business results.

 

The enduring value of quality excellence in software development

Software is no longer a support function, but the core of most business activities. TotalEnergies, VRT and VDAB recognized this and deliberately transformed their software delivery. The results, dramatic improvements in speed, quality and cost, confirm that quality engineering is not a cost center, but a strategic enabler of business success.

M2Q’s role in these transformations demonstrates the value of structured, pragmatic approaches to quality combined with deep technical expertise and organizational change management. Their focus on sustainable capacity building, rather than creating dependency, resulted in organizations that now autonomously maintain and continuously improve their quality practices.

For C-level executives, the question is not whether to invest in quality engineering, but when and how. The costs of poor quality, operational overhead, reputational damage and missed opportunities, are too great to ignore. The organizations that succeed in the increasingly digital economy are those that embed quality into their organizational DNA.

The cases of TotalEnergies, VRT and VDAB offer not only inspiration, but concrete guides. Their journeys show that transformation is possible, results are measurable and the investment pays for itself within reasonable timeframes.

Now is the time to take the first step. Start with an honest assessment, identify your “burning platform,” engage experts like M2Q to guide you, and commit to the journey. Your clients, teams and results will thank you for it.

Gerelateerde blogs