Information - Man(agement) :: Data Mining :: Psychology :: Future

Data Mining _ Psychology _ Future

Data Understanding - a first glance at the data

More then 2 weeks have passed since the beginning of the Data Mining Cup 2007 and I know you guys are pretty far by now. I guess many of you already assembled dozens of prediction rules and models and are finetuning their systems.
But as I know myself, we all tend to draw conclusions much too fast. Let’s see if we have spend enough time on understanding and restructuring the data.

This is the very first statistic you should look at. The frequency of customer respondings on coupon A or B or Not responding at all. Remember from the Scenario, that each person of the 50k recieved coupon A and B via mail and here we have the respondings:

coupons

After performing some simple grouping operations on the customers you can see groups with significantly different frequencies.

group9

group31

group36

Shouldn’t we treat them different?
Next time more on simple and not so simple grouping.

Posted in student, information, data mining, DMC 2007 |

5 Comments so far

  1. ernst May 1st, 2007 6:06 pm United States United States Safari Safari Mac OS Mac OS X

    It’s nice to see some charts, but without any absolute values this is useless. I can give you easily a group with 100% N (containing 200 out of 50.000 datasets) ;)

    cheers!
    ernst

  2. Information Man May 1st, 2007 6:16 pm Germany Germany Mozilla Firefox Mozilla Firefox Windows Windows XP

    It’s not my intention to broadcast the solutions but to give some hints :P

  3. Jan June 24th, 2007 1:09 pm Germany Germany Safari Safari Mac OS Mac OS X

    And how is your ranking?

  4. stefan June 27th, 2007 4:41 pm Germany Germany Opera Opera Windows Windows XP

    HI!
    nice bolg!
    I ,a studnent from UNI Kassel, also took part at the DMC 2007.
    Now i´m writing a short text about my approach(something about Genetic Programming).
    Now I need some other approachs from competitors to name them in my text.
    Maybe you coud also say something about your ranking.
    so if you like mail me :-), or post it in you blog.
    kind regrads stefan

  5. Information Man June 28th, 2007 3:25 pm Germany Germany Mozilla Firefox Mozilla Firefox Windows Windows XP

    Contact me via email. You will find it on the “about” page.

Leave a reply