Welcome to the MacNN Forums.

If this is your first visit, be sure to check out the FAQ by clicking the link above. You may have to register before you can post: click the register link above to proceed. To start viewing messages, select the forum that you want to visit from the selection below.

You are here: MacNN Forums > Community > MacNN Lounge > Statistics Question: Correlation, Expected Value, etc.

Statistics Question: Correlation, Expected Value, etc.
Thread Tools
Mac Elite
Join Date: Jan 2004
Location: Berkeley, CA
Status: Offline
Reply With Quote
Mar 29, 2007, 08:13 PM
 
Let's say we have a correlation matrix for the ratings of different songs.

Now, let's say that one of the songs, song 2, is rated with a rating (between -5 and 5) of 2.5. Another one, song 3, is rated with a rating of -1.0. Using the correlation matrix, I also determine that the correlation between song 2 and song 7 is 0.2, and the correlation between song 3 and song 7 is -0.8.

I want to update the expected value of the rating of song 7, based on the fact that song 2's rating is a 2.5 and the correlation of song 2 and song 7 is 0.2, and on the fact that song 3's rating is a -1.1 and the correlation of song 3 and song 7 is -0.8.

I could multiply the correlations by the ratings, taking the average of 0.2 * 2.5 and -0.8 * -1.1, but is this the correct way to update the expected value? As I rate more songs, the averaged value would constantly be decreasing (because abs(correlation) <= 1).

Is there a proper way to do this?

Thanks .
"Give me a lever long enough and a fulcrum on which to place it, and I shall move the world." -Archimedes
     
Dedicated MacNNer
Join Date: Nov 2005
Status: Offline
Reply With Quote
Mar 29, 2007, 08:45 PM
 
You can't calculate a correlation between two numbers--a correlation is between two sets of numbers that have been paired in some way. For songs, correlations don't make much sense because there isn't much logical basis for putting them in matched sets.

You could find the MEAN ratings of songs in each genre or by each artist and makes some predictions using that, but there is so much variation between songs that it probably won't be a good predictor. For me, any album by one band might have a few great songs, a few average songs, and a few crappy songs. If you find a band that makes albums full of great songs, then maybe you could predict that you will like the next album by that band, and you don't need a computer to tell you that.
     
Mac Elite
Join Date: Jan 2004
Location: Berkeley, CA
Status: Offline
Reply With Quote
Mar 29, 2007, 08:54 PM
 
Forget the fact that this is songs. That's just an example. Let's call them pickles.

Each song is a random variable that holds a rating. It does make sense to have a correlation between two random variables:

"Give me a lever long enough and a fulcrum on which to place it, and I shall move the world." -Archimedes
     
   
Thread Tools
Forum Links
Forum Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On
Top
Privacy Policy
All times are GMT -5. The time now is 05:50 AM.
All contents of these forums © 1995-2011 MacNN. All rights reserved.
Branding + Design: www.gesamtbild.com
vBulletin v.3.8.7 © 2000-2011, Jelsoft Enterprises Ltd., Content Relevant URLs by vBSEO 3.3.2