Methodology 101: How Luminate collects, models and measures music data

Methodology 101: How Luminate collects, models and measures music data

Luminate tracks music consumption activity.

We do this by ingesting reported activity from thousands of data sources.

We use that data to construct and maintain a musical entity database.

This allows us to attach metadata and activity to artists, songs and albums.

Our model is upheld industry-wide as a standard metric of music performance.


The Luminate methodology combines unparalleled access to first-party data, advanced data science and a deep understanding of the music consumption landscape. From data ingestion on a massive scale to the fine print of chart eligibility, our methodology informs everything we do. It’s what makes Luminate an accurate, objective and essential source of entertainment industry data and insights. 


Read on to learn more about our methodology and how we apply it within CONNECT. 




Back to How it Works


What we track: Music consumption activity

CONNECT aggregates and visualizes data related to music consumption: all the different ways people listen to music. We track consumption activity within four main categories, called Activity Types: Streams, Product Sales, Song Sales and Airplay


These activities combined represent the vast majority of worldwide music listenership. 



Activity Types


  1. Streams

All music streaming


  1. Product Sales

Physical and digital sales of albums, EPs and singles


  1. Song Sales

Digital song sales


  1. Airplay 

Satellite and terrestrial radio play measured by spins and audience



Some Activity Types can be broken down into additional categories. For instance, we segment Streams by commercial model (ad-supported or premium), Product Sales by purchase method (online or storefront) and so on. Follow the link below or refer to our glossary of terms to learn more. 


Read more: Activity Types: Tracking music consumption methods




Equivalent weighting 

Streams, sales and spins are unequal measures of listener engagement and economic value. So we use a weighted activity metric to compare disparate units and present an accurate picture of music consumption. Our formulas convert Streams, Product Sales and Song Sales into equivalent units that can be tracked, ranked, and measured.

We mainly use Album Equivalent and Stream Equivalent units to measure performance across the industry and rank titles on the charts.


Album Equivalent

Weighted streaming, digital and physical sales figures converted to 1 album sale unit.


Stream Equivalent

Weighted streaming and digital song sales figures converted to 1 premium stream unit.


Luminate’s music consumption equivalents, developed and refined over more than 30 years, are the industry standard for evaluating music popularity and performance. Our framework for measuring music consumption sets industry benchmarks, helps determine market share and powers the Billboard charts. 

Learn more about each type of equivalent and how we use them in the link below.


Read more: Equivalent weighting: Measuring music consumption






How we track it: Data collection

CONNECT compiles over 23 trillion annual data points related to thousands of artists and millions of songs. Our data comes to us directly from more than 500 partners across entertainment, retail and technology. 


The CONNECT platform automatically ingests, validates, and processes the data and applies programming logic to build a database. We can then track activity and use equivalent formulas to measure consumption. 



Metadata

In addition to consumption activity, we capture metadata—i.e. release date, country of origin, language, format and other kinds of identifying information—for artists, songs and release groups (albums). Our metadata allows us to group related items and provide advanced analysis related to attributes like genre, location, artist type, release age and more. 



Musical entity groupings

We track activity data and metadata for hundreds of thousands of musical entities. A musical entity can be an artist, song or album. Within those broad categories, CONNECT recognizes five musical entity types: Recordings, Songs, Products, Releases, Release Groups and Artists.


Albums and Songs are both umbrella categories. Each one combines multiple lower-level entities. Here’s how we group them:


Artists

No subcategories


Albums

  • Release Groups

  • Releases

  • Products


Songs

  • Songs

  • Recordings 



Albums (a.k.a. Release Groups)

“Album” is an imprecise term. We use Release Group and Release to cover every multi-track musical product—mainly albums, EPs and singles.


A Release Group comprises every version and format of an album. These include Releases and Products. 


Release Group 

     ↳Release 

   ↳Product 


The Release level differentiates between versions of an album (i.e. initial release vs. expanded, remastered, or remixed). If an album has been reissued with the same title and tracklist, but now includes noticeable differences such as remastering or bonus songs or a second disc of unreleased demos, each of those versions is one Release. 


The Product level refers to individual barcodes (ICPNs). Most Releases are sold in more than one format: CD, vinyl, digital album, retailer exclusive, alternative cover art, limited-edition colored vinyl, et cetera. Each of these is its own Product. 



Songs

Songs (sometimes called tracks) are usually identified by title and artist. But one Song might have multiple Recordings. 


A Recording is just that: one recorded version of a song. It can be a studio version, a remaster, a re-recording, a live version, a demo or even a remix—as long as it’s the same song. Every Recording is identified by a unique code called an ISRC.


Song
       ↳Recording





How we manage it: Our database

We construct our database “from the ground up.” Providers share metadata and performance data for Recordings and Products. We then apply our grouping rules and use programming logic to sort entities into higher-level categories. 


Musical entities show up in CONNECT on Dashboards. Think of each Dashboard as a visual representation of an entry in the CONNECT database. 



Recordings → Songs

Activity tracking starts at the Recording (ISRC) level for streams and song sales. Our partners share streaming and sales data for individual ISRCs. We attach metadata to ISRCs, which allows CONNECT to group Recordings into Songs and assign them to Artists.


Products → Releases → Release Groups

We track album, single and EP sales at the Product (ICPN) level. Our sales data providers report product sales by barcode/ICPN; each ICPN submission includes metadata that helps us compile Products into Releases and Releases into Release Groups. 


Read more: ISRC, ICPN, ISNI: External IDs and product codes


Artists

Compiling artist metadata allows us to display key information on Artist Dashboards, attribute Recordings and Products correctly and calculate overall artist performance metrics. We receive artist data from our data partners or as manual submissions. 



Submitting and correcting data 

The above process allows us to maintain our database and populate the platform at scale. But some partner data shares contain errors. If we receive conflicting metadata from multiple sources, we apply programming logic to select the best option for each field. When necessary, our Operations team manually reviews and corrects data. 


We accept submissions, updates and corrections to help improve our database and maximize accuracy. And we allow individual registration (with verification) of new artists/titles or those not covered by our data sources. Follow the link below to learn how to register new items or correct CONNECT data.


Read more: Music registration: Add entries to our database






Reference material

Our methodology rests on a number of specialized concepts. We also sometimes use our own terminology to describe actions and features within CONNECT.


Follow the links below to learn more about our foundational concepts and how to define them.


Glossary: Acronyms, key terms and definitions

ISRC, ICPN, ISNI: External IDs and product codes

Data Controls: All Activity Types, breakouts and filters

About Genres: How Luminate classifies music






More to know



Read next: Data sources: Active reporters, providers and countries




    • Related Articles

    • About the Model: How SV(M) measures streaming data

      Luminate Film & TV Streaming Viewership (M) models streaming consumption data. Our streaming viewership model breaks new ground. In a fragmented entertainment landscape with no comprehensive source for first-party OTT viewing data, we’ve applied our ...
    • Data corrections: Report metadata errors

      Notice something wrong on a Dashboard? Report inaccuracies and request revisions by submitting a data correction. First, document and double-check Luminate IDs, external IDs, images, URLs and names/titles for accuracy. Copy and paste IDs somewhere ...
    • Luminate's Acquisition Of Quansic

      Luminate's Acquisition of Quansic On 2/6/2024 we announced the news that Luminate has acquired Quansic, a global leader in music artist identification services. The deal is aligned with Luminate’s mission to unify data for the entertainment industry, ...
    • Migrating from Music Connect: Overview for legacy users

      CONNECT is a significant—and essential—evolution of the Music Connect platform. Built for purpose Rather than update an existing product, we designed CONNECT from scratch. The reimagined UI combined with the speed and flexibility of the cloud-based ...
    • Music registration: Add entries to our database

      Luminate tracks music streaming and sales data. All musical entities—artists, songs and releases—must be registered with us in order to appear as a Dashboard in the CONNECT database and be included in our music consumption reporting. Use the forms ...
    • Popular Articles

    • Quickstart Guide: Set up CONNECT in minutes

      Whether you’re a new user or already have a Luminate Data account, here’s how to log in, access the CONNECT platform and start uncovering music insights. Back to Getting Started Quickstart steps If you’re already a Music Connect user, skip to Step 4 ...
    • What is Registration?

      Registration is a platform to register for identifiers. You can register for : ISNI - identifier for artists and bands ISRC - identifier for recordings BOWI - identifier for works To register any of the above please login here or click the direct ...
    • What is Quansic?

      Quansic offers exclusive services for the accurate identification of Music Artists based on Industry Identifiers (ISNI, IPI, IPN, wikidata, musicbrainz ID, DSP IDs,....) The Identification is based on patented graph technologies and new matching ...
    • How do I get an ISNI, ISRC, or a BOWI?

      In order to get an identifier (ISNI, ISRC, BOWI), fill in the corresponding form here. If you don't have a Quansic login, you can sign up here. Note that to get an ISRC or BOWI, you will need an ISNI first.
    • What is the Legal Depot?

      Legal Depot is a timestamp that proves you are in possession of a document at a given time Trusted timestamping is the process of securely keeping track of the creation and modification times of a document. Security here means that no one - not even ...