Why masters only?

Discussion in 'General' started by prakashkl, Nov 9, 2012.

  1. prakashkl

    prakashkl User

    Joined:
    Aug 3, 2012
    Messages:
    194
    Likes Received:
    0
    Recent times, there are flood of hits where masters are permitted to work. The number of hits are increasing day by day. Visible decrease in the number of hits, normal turkers are allowed to work. I think it will increase as time passes. Lot of changes are happening in Mturk.
     
    #1 prakashkl, Nov 9, 2012
    Last edited by a moderator: Nov 9, 2012
  2. iceblink

    iceblink User

    Joined:
    Apr 3, 2012
    Messages:
    550
    Likes Received:
    0
    Well, they added a 3rd masters qual entitled simply "Masters" and a lot of the new requesters seem to be using that.

    The annoying thing is, I checked and over 20,000 people have this new qual and I still don't :(
     
  3. prakashkl

    prakashkl User

    Joined:
    Aug 3, 2012
    Messages:
    194
    Likes Received:
    0
    What may be the criteria?. I am sure number of hits submitted is not the one.
     
  4. gingery

    gingery Member

    Joined:
    Aug 28, 2012
    Messages:
    17
    Likes Received:
    0
    If you look at the requester part of the mturk site you can find (slightly) more information:

    I'm guessing "demonstrated accuracy" is part of it?
     
  5. ewd76

    ewd76 User

    Joined:
    Oct 8, 2012
    Messages:
    1,133
    Likes Received:
    0
  6. sunny4691

    sunny4691 Active Member

    Joined:
    Jul 29, 2012
    Messages:
    40
    Likes Received:
    0
  7. Khalinov

    Khalinov User

    Joined:
    Dec 12, 2011
    Messages:
    873
    Likes Received:
    0
    That is an interesting read. I hadn’t realized that Masters was the combination of Categorization and Photo; I thought it was an entirely new qualification.

    Hmmm:

    Code:
    Categorization Masters       Qualified Users:      2405
    Masters	                     Qualified Users:     20686
    Photo Moderation Masters:    Qualified Users:      3160
    
    Now I am not so sure it is.

    It must be a very small part of it; I passed 90,000 approved recently with a 99.6% approval rate. :p
     
    #7 Khalinov, Nov 11, 2012
    Last edited by a moderator: Nov 12, 2012
  8. abrahamrohithroy

    Joined:
    May 24, 2012
    Messages:
    886
    Likes Received:
    0
    That was an awesome blog, too. Great find, ewd76.

    Amazon gets their cut from the requesters for each HIT they post. For a special qual as the Masters, I think Amazon is charging them more. I see no other reason why they are endorsing the Masters qual to such an extent that they're assigning it, BY DEFAULT for every HIT!!!
     
    #8 abrahamrohithroy, Nov 12, 2012
    Last edited by a moderator: Nov 12, 2012
  9. mturkconsultant

    mturkconsultant Verified Requester / HIT Consultant

    Joined:
    Jul 15, 2012
    Messages:
    75
    Likes Received:
    0
    I wrote that blog post.

    @Khalinov: You're wrong. I actually asked a lot of Master workers if they had the qualification and every single one with Cat or Photo did. None who had lost it had it, and no new workers reported getting it in droves. That means the counter is broken.

    Amazon makes 10% off of every HIT. They charge 20% more for Masters, and you can find more information about this here: https://requester.mturk.com/help/faq#how_fees_cost_computed

    This means that for a regular $1 HIT, without the Masters qual Amazon makes 10¢ and the Requester pays 10¢, or $1.10.

    With the Masters qual, the Requester pays 30¢ more or $1.30.
     
  10. ewd76

    ewd76 User

    Joined:
    Oct 8, 2012
    Messages:
    1,133
    Likes Received:
    0
    I wonder if the counter is deliberately "broken". Making masters the qualification to do your hit seems like a much better deal if there are 20,000 workers, than if there are 5000.
     
  11. ThirdClassIntMasterTurker

    Joined:
    Sep 8, 2012
    Messages:
    86
    Likes Received:
    0
    "Masters" qualification seems to be quite popular among dead people btw.
    There are 15 qualifications named "Masters" and for 14 of them the author is dead (according to google).

    Looks like some scammer has tried to grant masters qualification for himself.
    Or somebody is selling masters "Masters" qualifications?
     
  12. ewd76

    ewd76 User

    Joined:
    Oct 8, 2012
    Messages:
    1,133
    Likes Received:
    0
    Seems like most of the hits which might eventually get you the photo moderation master qualification are by requesters who reject half the submissions.
     
  13. j0sh

    j0sh User

    Joined:
    Nov 7, 2012
    Messages:
    627
    Likes Received:
    0
    On a side note since you posted the link, I love that Amazon explains in such vivid detail what happens when a Requester decides to go on a rejection bender. A. I don't have to pay for that, and B. It's no biggie to reject.

    It's no wonder as of late we are seeing Requester's who are apologizing after they realize the consequences of their actions.

     
  14. Khalinov

    Khalinov User

    Joined:
    Dec 12, 2011
    Messages:
    873
    Likes Received:
    0
    I’ll keep an eye on those counters, but I’ll put more faith in Amazon’s counters than in informal surveys of “a lot” of people by word-of-mouth. No offense intended.

    https://www.mturk.com/mturk/searchb...Amazon+Mechanical+Turk&minReward=0.00&x=0&y=0
     
  15. HaikuGemini

    Joined:
    Jul 25, 2012
    Messages:
    216
    Likes Received:
    0
    I wrote a requester who uses masters qualification only for a pretty strait forward hit. I just had to ask why he felt the need to use masters and I even gave him one of his answers for free since I couldn't actually do the hit. This masters qualification is making me angry, especially since I have a 99.9% rating out of 50,000 hits and don't have it.

    Requesters like Medcrowd and Geoffery Falk have it right. Do a small qualification back and go from there. That way you don't exclude valuable workers who work just as hard as a "master" turker does.

    I guess like the poster of this thread, I'm nervous that all the new requesters will start to go that route and those of us who haven't been granted this qualification will be left in the dust.
     
  16. mturkconsultant

    mturkconsultant Verified Requester / HIT Consultant

    Joined:
    Jul 15, 2012
    Messages:
    75
    Likes Received:
    0
    If you think that 15,000 people could have been granted Masters who never had it before with that change but not one of them posted about it, I guess I can't argue against that.

    https://www.youtube.com/watch?v=CEIeb85DkCs
     
  17. Joelsfood

    Joelsfood User

    Joined:
    Oct 10, 2012
    Messages:
    256
    Likes Received:
    0
    I'm a little curious why some requesters are using masters now in addition to their own qualification which they already had. It seems they're just blocking out people they originally considered qualified, when they could just revoke their qualification they had granted, no?
     
  18. mturkconsultant

    mturkconsultant Verified Requester / HIT Consultant

    Joined:
    Jul 15, 2012
    Messages:
    75
    Likes Received:
    0
    Because they don't understand the Requester UI or mTurk in general. It's very common among requesters. :( One of them told me they assumed that since all of their workers were good, they had Masters already.
     
  19. prakashkl

    prakashkl User

    Joined:
    Aug 3, 2012
    Messages:
    194
    Likes Received:
    0
    How many masters are there? Can any one tell. Approximate. In these forums also there are not many who reveals that they are masters. Is there ny breach of conduct in revealing that I am a master.
     
  20. mtnsurf

    mtnsurf User

    Joined:
    Jan 30, 2012
    Messages:
    1,504
    Likes Received:
    3
    If you all are not a fan of people asking for masters only email them, explain to them that's its better to just set up a qual and not use masters. Why do you think Matt Rubin dropped the masters? Because I sent Nick at Matt Rubin messages for 2 weeks none stop.
     

Share This Page