Methodology 101: How Luminate collects, models and measures music data

Methodology 101: How Luminate collects, models and measures music data


Luminate tracks music consumption activity.

We do this by ingesting reported activity from thousands of data sources.

We use that data to construct and maintain a musical entity database.

This allows us to attach metadata and activity to artists, songs and albums.

Our model is upheld industry-wide as a standard metric of music performance.



The Luminate methodology combines unparalleled access to first-party data, advanced data science and a deep understanding of the music consumption landscape. From data ingestion on a massive scale to the fine print of chart eligibility, our methodology informs everything we do. It’s what makes Luminate an accurate, objective and essential source of entertainment industry data and insights. 


Read on to learn more about our methodology and how we apply it within CONNECT. For specific questions, refer to Methodology FAQs.






Back to How it Works  


What we track: Music consumption activity

Activity Types

  1. Streams

All music streaming


  1. Product Sales

Physical and digital sales of albums, EPs and singles


  1. Song Sales

Digital song sales


  1. Airplay 

Satellite and terrestrial radio play measured by spins and audience



Some Activity Types can be broken down into additional categories. We segment Streams by commercial model (ad-supported or premium), Product Sales by purchase method (online or storefront) and so on. See below or refer to our glossary of terms for more. 


Read more: Activity Types: Tracking music consumption methods



Equivalent weighting: Comparing activities 

Streams, sales and spins are unequal measures of listener engagement and economic value. So we use a weighted activity metric to compare disparate units and present a more accurate big-picture view. Our formulas convert Streams, Product Sales and Song Sales into equivalent units that can be tracked, ranked, and measured. 

We (mainly) use Album Equivalent and Stream Equivalent units to measure music performance and rank titles on the charts.


Album Equivalent

Weighted streaming, digital and physical sales figures converted to 1 album sale unit.


Stream Equivalent

Weighted streaming and digital song sales figures converted to 1 premium stream unit.


Luminate’s music consumption equivalents, developed and refined over more than 30 years, are the industry standard for evaluating music popularity and performance. Our framework for measuring music consumption sets industry benchmarks, helps determine market share and powers the Billboard charts. 


Read more: Equivalent weighting: Measuring music consumption







How we track it: Data collection

Metadata

In addition to consumption data, we capture metadata—release date, country of origin, language, format and other identifying information—for artists, songs and release groups (albums). Our metadata allows us to group related items and provide advanced analysis based on attributes like genre, location, artist type, release age and more. 



Musical entities: Grouping artists, songs and albums

We track activity data and metadata for millions of musical entities. A musical entity can be an artist, song or album. Within those broad descriptors, CONNECT recognizes five musical entity types: Recordings, Songs, Products, Releases, Release Groups and Artists. 


Albums and Songs are both umbrella categories containing lower-level subcategories. 


Artists

No subcategories


Albums

  • Release Groups

  • Releases

  • Products


Songs

  • Songs

  • Recordings 


Albums (Release Groups)

“Album” is an imprecise term. We use Release Group and Release to cover every multi-track musical product—mainly albums, EPs and singles.


A Release Group comprises every version and format of an album. These include Releases and Products. 


Release Group 

↳Release 

       ↳Product 


The Release level differentiates between versions of an album (i.e. initial release vs. expanded, remastered or remixed). If an album has been reissued with the same title and tracklist, but now includes noticeable differences such as remastering or bonus songs or a second disc of unreleased demos, each of those versions is one Release. 


The Product level refers to individual barcodes (ICPNs). Most Releases are sold in more than one format: CD, vinyl, digital album, retailer exclusive, alternative cover art, limited-edition colored vinyl, et cetera. Each of these is its own Product. 



Songs

Songs (sometimes called tracks) are usually identified by title and artist. But one Song might have multiple Recordings. 


A Recording is just that: one recorded version of a song. It can be a studio version, a remaster, a re-recording, a live version, a demo or even a remix—as long as it’s the same song. Every Recording is identified by a unique code called an ISRC.


Song 

     ↳Recording

     ↳Recording

     ↳Recording





How we manage it: Our database

We construct our database “from the ground up.” Providers share metadata and performance data for Recordings and Products. We then apply our grouping rules and use programming logic to sort entities into higher-level categories. 


Musical entities (see above) show up in CONNECT on Dashboards. Think of a Dashboard as a visual representation of an entry in the CONNECT database. 


Recordings → Songs

Activity tracking starts at the Recording (ISRC) level for streams and song sales. Our partners share streaming and sales data for individual ISRCs. We attach metadata to ISRCs, which allows CONNECT to group Recordings into Songs and assign them to Artists.


Products → Releases → Release Groups

We track album, single and EP sales at the Product (ICPN) level. Retailers report product sales by barcode/ICPN; each ICPN submission includes metadata that helps us compile Products into Releases and Releases into Release Groups. 


            Read more: ISRC, ICPN, ISNI: External IDs and product codes


Artists

Tracking artist metadata allows us to disambiguate artists, display key information on Artist Dashboards, attribute Recordings and Products and calculate overall artist metrics. We receive artist data from our data partners or as manual submissions.  



Submitting and correcting data 

The above process allows us to maintain our database and populate the platform at scale. But some data shares contain errors. If we receive conflicting metadata from multiple sources, we apply programming logic to select the best option for each field. When necessary, our Operations team manually reviews and corrects data. 


We accept submissions, updates and corrections to help build our database and improve accuracy. And we allow individual registration (with verification) of new artists/titles or those not covered by our data sources. 


            Read more: Music registration: Add entries to our database






Additional reference material

Our methodology rests on a number of specialized concepts. We also use some terminology of our own.


Review (or bookmark!) these Knowledge Base links for quick reference. Log in with your CONNECT subscription email to access most Knowledge Base articles.


Glossary: Acronyms, key terms and definitions

ISRC, ICPN, ISNI: External IDs and product codes

Data Controls: Activity Types, Breakout Views and filters

About Genres: How Luminate classifies music






More to know

Methodology FAQs: Our formulas, data sources, and eligibility criteria

Equivalent weighting: Measuring music consumption

How to CONNECT: All tutorials, walkthroughs and video demos







    • Related Articles

    • Music registration: Add entries to our database

      Luminate tracks music streaming and sales data. All musical entities—artists, songs and releases—must be registered with us in order to appear as a Dashboard in the CONNECT database and be included in our music consumption reporting. Use the forms ...
    • ISRC, ICPN, ISNI: External IDs and product codes

      We attach at least one unique alphanumeric identifier to every musical entity in our database. These include our own Luminate IDs, industry-standard codes like ISRC and ISNI, platform/provider IDs and codes from various music databases. CONNECT ...
    • Reporting sales and streaming: Become a data provider

      Luminate receives verified music consumption data directly from thousands of reporting partners across the industry and around the world. Our data partners help us maintain CONNECT as a source of trusted, essential information for the entertainment ...
    • Troubleshooting music registration and reporting

      Having trouble submitting registration forms? Unsure how to proceed with your data provider application? Read on for a list of common problems and our recommended solutions. Back to Registration and Reporting Registering music I don’t know the ...
    • Data corrections: Report metadata errors

      Notice something wrong on a Dashboard? Report inaccuracies and request revisions by submitting a data correction. First, document and double-check Luminate IDs, external IDs, images, URLs and names/titles for accuracy. Copy and paste IDs and ...
    • Popular Articles

    • Quickstart Guide: Set up CONNECT in minutes

      Whether you’re a new user or already have a Luminate Data account, here’s how to log in, access the CONNECT platform and start uncovering music insights. Back to Getting Started Quickstart steps If you’re already a Music Connect user, skip to Step 4 ...
    • Welcome to CONNECT!

      CONNECT is the music database and analytics platform developed by Luminate to track, measure and visualize music consumption on a global scale. After 30+ years as the music industry’s most trusted source of consumption data, we leveraged our ...
    • Troubleshooting login and access issues

      Locked out of your Luminate account? Can’t log in to CONNECT? Getting a mysterious error message? Our Support team can help—but first, try our troubleshooting tips. See below for common login problems and our recommended solutions. Back to Getting ...
    • Client Support: Find answers and get the help you need

      Can’t find a feature? Having technical problems? Not sure where to start? We want you to get the most out of CONNECT: the best data, the clearest analysis and the most useful insights. That’s why we created resources to get you started, guide you ...
    • Methodology 101: How Luminate collects, models and measures music data

      Luminate tracks music consumption activity. We do this by ingesting reported activity from thousands of data sources. We use that data to construct and maintain a musical entity database. This allows us to attach metadata and activity to artists, ...