Table of Contents

Project Overview

Background

A global technology and e-commerce enterprise needed to modernize analytics for its internal employee application, used across APAC, AMET and North America.

Internal communications teams relied on manual reporting, inconsistent KPI definitions, and slow BI workflows.

They lacked:

  • A unified metrics model
  • A clear and easy to understand self-serve dashboard
  • Reliable MAU (Monthly Active Users) and engagement tracking
  • Automated MBR/QBR reporting
  • Clear employee engagement segmentation
  • Anomaly detection for usage drops
  • A semantic model compatible with Amazon QTopics for AI insights
  • ENGINE was engaged to deliver a fully automated, scalable analytics solution leveraging AWS Athena, S3, Amazon QuickSuite, and DataOps best practices.

Objectives

  • Standardize internal communications KPIs across APAC, AMET + NA
  • Find data gaps and flag them to the Tech Team
  • Deliver scalable dashboards powered by AWS
  • Automate MBR/QBR dashboards for leadership
  • Implement MAU/WAU frameworks
  • Build RFM-style engagement segmentation
  • Deploy anomaly detection for easy outliers detection
  • Optimize data pipelines to reduce BI workload
  • Align KPI logic to be QTopics-ready
  • Build a semantics layer for Amazon Q

Tech Stack

  • AWS Athena
  • Amazon QuickSuite
  • Amazon S3
  • Amazon Q
  • Internal app engagement logs (source)
  • ENGINE ready-to-use DataOps framework
  •  
amazon tech stack

Data Modeling & Processing

Unified KPI Model (QTopics-Compatible Semantic Layer)

ENGINE supported in developing a globally aligned KPI dictionary covering:

  • MAU / WAU
  • Feed deliveries
  • Impressions
  • Unique viewers
  • Engagement rate
  • CTR
  • Dwell time
  • Completion rate
  • Content category performance

 

Although QTopics was not deployed in this phase, ENGINE:

  • Ensured all metrics follow QTopics semantic conventions
  • Prepared KPI logic to support AI-driven natural language queries
  • Streamlined governance to reduce ambiguity

This future-proofed analytics for AI-enabled reporting.

MAU Framework

ENGINE implemented a standardized MAU calculation:

  • Monthly Active Users by region
  • Weekly-level activation patterns
  • Multi-quarter trendlines
  • Regional benchmarking
  • Baseline comparisons for anomaly detection

Replacing prior inconsistent definitions increased reporting accuracy.

RFM-Style Engagement Segmentation Model

ENGINE created an RFM-based segmentation system to classify employees:

Segment
Definition
Purpose

Champions

High-frequency engagers

Identify top content consumers

Regulars

Moderate, steady activity

Expand engagement volume

At-Risk

Engagement declining

Early intervention indicator

Dormant

Very low/no activity

Platform or awareness issues

New Users

Recently onboarded

Track onboarding effectiveness

This enabled insights beyond aggregate metrics.

RFM Heatmap

rfm-sketch

  • Sketch Example of the RFM used for the project

MBR/QBR Reporting Automation

ENGINE automated:

  • Quarterly KPI rollups
  • Multi-region comparisons
  • MAU & engagement shifts
  • Top/Bottom content insights
  • Executive summary KPIs

This removed hours of manual slide creation.

Anomaly Detection Engine

Detects:

  • Drops or spikes in engagements
  • Underperforming content clusters
  • Regional divergence
  • Platform outages reflected in behaviour
  • Misconfigurations causing reach issues

anomaly detection

DataOps & Pipeline Optimization

  • Standardized Athena models
  • Removed redundant data flows
  • Increased query efficiency for QuickSight
  • Documented full data lineage
  • Reduced BI engineering workload significantly

 

Results & Analysis

Key Insights Delivered

  • Clear MAU trends across the global region department
  • Identification of high-performing content categories
  • Visibility into content fatigue
  • RFM segmentation showing shifts in employee engagement
  • KPI alignment across regions
  • Faster insights for leadership via automated MBR/QBR dashboards
  • Early detection of abnormal usage patterns

Dashboards & Visualizations Delivered

  • MAU/WAU Trend Dashboard
  • RFM Engagement Heatmap
  • Content Engagement Heatmap
  • CTR and Engagements Trend Analysis
  • Top/Bottom Articles
  • Regional Performance Comparison
  • Anomaly Detection Alerts
  • MBR/QBR Leadership Summary

 

All dashboards refresh automatically on a daily basis without manual effort.

 

Implementation & Impact

Applications

The automated system now supports:

  • Weekly comms operations
  • Leadership-level reporting
  • Quarterly business reviews
  • Cross-region content optimization
  • Engagement strategy refinement
  • Platform health monitoring
  • AI-ready data governance

Impact

  • 30–50% reduction in BI and comms reporting workload
  • Zero manual MBR/QBR reporting
  • Higher content effectiveness across regions
  • Better decision-making driven by segmented insights
  • Improved internal KPI alignment
  • Semantics Layer in place for future AI-powered reporting (QTopics)
  • Scalable model ready for Global rollout

FAQs