Blog

Consulting

Consulting Case Study: Lookalike Models for Audience Expansion

October 19, 2021

Background

Our client is one of the largest news publishers in North America. With their print and digital formats reach millions of readers every week, they lead the national discussion by engaging audiences through its prestigious coverage of news, politics, business, investing and lifestyle topics, across multiple platforms.

The WeCloudData team worked with the client’s digital marketing and data analytics team on an audience segmentation and expansion project for customer acquisition.

weclouddata beam data consulting case study

Problem Statement

WeCloudData helped the client set ML strategies on how to generate look-alike users for the certain types of customers with similar behaviours or interests, further, to provide guidance on the marketing and bidding decisions with the most up-to-date and precise information.

The key challenge of the project is that the client collects hundreds of millions of session data generated by millions of readers on a daily basis. To drive subscriptions, the client is hoping to target anonymous users who will become high-LTV subscribers. The preliminary data cleaning and analysis must be done. Hence, we started our work on the following aspects:

  1. Preliminary data transforming and analysis
  2. Look-alike model development
  3. Model evaluations and testing
  4. Workflow automation

Tools used: Snowflake, Spark on Databricks, AWS (S3, EC2, Airflow), Machine Learning

Milestones

  1. Similarity-based Look-alike Model: Nearest Neighbors (NN) + Clustering
    1. Simple and easy to understand
    2. Difficult to test (A/B testing required)
    3. No feature importance to interpret
    4. Not with high precise but effective to detect “Neighbors (Targeted customers from the pool) Strangers (Unwanted customers for this segment)” with the defined Similarity Score
similarity based model for weclouddata beam data consulting case study

To solve the scalability problem, we also introduced the hashing algorithms, Locality Sensitive Hashing (LSH) to reduce the computational cost when calculating the distance.

LHS for weclouddata beam data case study

Precision vs Recall: i.e., “cost of targeting the wrong user is much smaller than the cost of failing to target the right user”. Also don’t want to waste resources on the wrong users though – Finding a balance is important.

weclouddata.com beam data consulting case study
  1. Classification Models
    1. More explanatory power – Feature importance and confusion matrix
    2. Randomly sampling users is difficult and introduced bias – Training models in Spark will improve reliability significantly
    3. Easier to evaluate results on test data
  2. Model Deployment and Data Flow
model deployment for weclouddata beam data case study
  1. The model automation:
    1. Audience segment creation in Cloud
    2. A batch job runs daily or hourly to find lookalikes to augment the segment size (real-time list generation possible)
    3. User selects number of lookalikes based on similarity score
    4. New users appended back to original segment and sent to 3 party Ad Manager
model automation for weclouddata beam data case study

Future works

  • Availability to adjust the metrics in determine the “similarity score” based on business needs in the future
  • Test on different segments and larger samples as the data gathered
  • Continue engineering features for the model interpretation
  • Optimized the AI data pipeline

Conclusion

Beam Data successfully delivered this half year project within digital media industry. It showed our capability in handling large amount of data and provide the data-driven insights in new areas. Throughout the project, one of the biggest challenges is to gain the variety types of domain knowledges in a short time and communicate with cross-functional teams to convey the tasks. In addition, we also quickly adjusted in grasping the client’s tech stacks to deliver the compatible works smoothly.

Beam Data then successfully gained trust with the client and continued the relationship with the same project team for further work contents such as the AI model optimization, pipeline design and other different data inquiries.

conclusion for weclouddata beam data case study
SPEAK TO OUR ADVISOR
Join our programs and advance your career in Business IntelligenceData EngineeringData Science

"*" indicates required fields

Name*
This field is for validation purposes and should be left unchanged.
Other blogs you might like
Blog
The Recap We continue with the unfolding saga of the data science jobs landscape, this time for the month…
by Cherice
December 19, 2023
Blog, Learning Guide, Student Blog
Natural Language Processing (NLP) is transforming the manufacturing industry by enhancing decision-making, enabling intelligent automation, and improving quality control….
by WeCloudData
March 26, 2025
Student Blog
The blog is posted by WeCloudData’s  student Sneha Mehrin. Steps to Create a Data Warehouse and Automate the Process…
by Student WeCloudData
November 4, 2020

Kick start your career transformation