Can't Find Great HIT's?- 9/11 Wonderful Wednesday

Discussion in 'Great HITs' started by John, Sep 10, 2013.

Thread Status:
Not open for further replies.
  1. hBoBh

    hBoBh User

    Joined:
    Mar 6, 2013
    Messages:
    4,960
    Likes Received:
    0
    Alright, who's the jelly bean cat person?!
     
  2. Pockets On Swole

    Joined:
    Aug 10, 2013
    Messages:
    502
    Likes Received:
    0
    that was me haha :)

    Shes big, round, and white. I couldnt help it.

    EDIT: also im not korean, dont worry! :D
     
  3. Willyamm

    Willyamm User

    Joined:
    Sep 2, 2013
    Messages:
    6,213
    Likes Received:
    0
    I think I'm heading to bed in 30 if we don't get some GTRI.
     
  4. yancy

    yancy User

    Joined:
    May 7, 2013
    Messages:
    869
    Likes Received:
    0
    Since they only like to post those batches at some hour that guarantees I'll be up til 6 am if I wanna work on them, should be around fairly shortly.
     
  5. RockinRobin

    Joined:
    Apr 12, 2013
    Messages:
    4,796
    Likes Received:
    0
    Bear did you eat the mods?
     
  6. hBoBh

    hBoBh User

    Joined:
    Mar 6, 2013
    Messages:
    4,960
    Likes Received:
    0
    Bahaha! I just talk to my cats like they're people. My roomie's bf thinks it's hilarious that they "talk" back. Yah, I'm a Crazy Cat Lady, dealwithit.jpg

    Edit for your edit: My ex (who was born in Thailand but is Cambodian) named a kitten my parents gave him "BBQ".
     
    #2566 hBoBh, Sep 12, 2013
    Last edited by a moderator: Sep 12, 2013
  7. jekjek

    jekjek Banned

    Joined:
    Jun 25, 2013
    Messages:
    1,620
    Likes Received:
    0
    [​IMG]
     
  8. mechanical jerk

    Joined:
    Aug 6, 2013
    Messages:
    260
    Likes Received:
    0
    What did I tell you guys about the chit chat? Don't let me go all Tony Stark up in here aight? Now. less talk more spoon feeding my hits beotches!
     
  9. turkalufagus

    Joined:
    Jun 17, 2013
    Messages:
    5,754
    Likes Received:
    0
    ermagherd hertspert
     
  10. turkalufagus

    Joined:
    Jun 17, 2013
    Messages:
    5,754
    Likes Received:
    0
    [​IMG]
     
  11. xncqpdaxka

    xncqpdaxka Banned

    Joined:
    Aug 12, 2013
    Messages:
    2
    Likes Received:
    0
    Converse a

    Jeg synes også det skulle være converse all star for børnefamilierat arbejde mindre, men indtil det sker, gælder det om at sikre en ordentlig kvalitet i pasningen,converse," converse han. "Det kan man godt sige, men omvendt kan man ikke regne med, at selv en klub som FC København vinder hvert eneste mesterskab. Uffe Ellemann sig ikke så meget om. Kort og godt: Vi har en tilstand som folketinget har bestemt men som jeg mener er ulovlig, fordi folketinget ikke har noget som helst mandat udenfor rigets grænser. Anders Lund Madsen er et godt eksempel på det,men han er jo også intelligent.
    Steakhouse-konceptet holder åbenbart endnu, for der var mange gæster på en ganske almindelig kold hverdag. Samme udvikling har vi set i Danmark, hvor DBU med over 65. Og på den baggrund skal Sundhedsstyrelsen rådgive politikerne. Lyder det som lidt i øst og vest,så er det indtryk forkert,for den hakkemaskine, han betjener suverænt, kan sluge, hvad kød det skal være,converse, selv det, der ikke er meget kød på. Men nøgternt betragtet er der sorte skyer forude.
    Forlader skolenOnsdagens rejsegilde var noget af det sidste, Jørgen Skaftved deltog i på Højvangskolen. - Vi understreger, at der ikke er nogen fare for sikkerheden i byen, converse Bostons politi, som converse all star, at de anholdte ikke havde direkte relation til bombeeksplosionerne ved maratonløbet, men til handlinger senere. om, at definitionen på skrald er særdeles afhængig af den kulturelle kontekst. Allerede fra starten havde vi været overbevist om, at vi ikke skulle operere med en alt for realistisk lyd. Men hvad med fagforeningen?
    Men han er stadigvæk amerikaner. Højere strafSocialdemokraternes vil desuden skærpe mulighederne for bødestraf. »Gerne et program som BBC Worlds 'Africa Today' eller et tilsvarende, der slår vinduet op på vid gab til verden uden for vores egen kulturelle baghave. "- Du argumenterer imod embryon stamcelleforskning med frygt for en glidebane. Assistent sig over Bendtner er Danmarks landsconverse, Morten Olsen, imidlertid ikke enig i.
    - Vi havde allerede truffet en beslutning om at gå i strejke, hvis der kom en aktion i parken. Det vigtigste har trods alt været, at det overordnede mål for sundhed og beskyttelse af børn og unge er intakt. Og med Jens-Jacob Tychsen i midten skaber de et drømmeensemble af forvandlingskunstnere. Farvel til Folketinget:pension:Efter et års medlemskab af Folketinget har man optjent ret til pension. - Jeg får regelmæssigt undersøgt, om det har spredt sig - men det har det ikke.
    Det er absolut heller ikke gratis at være mand! Siden planerne om serien blev annonceret i december 2009, har den været genstand for omfattende kritik fra flere sider. Over for asymmetrien (at kun ved hiconverseiske blindgyder spiller sociale faktorer ind) har en kontekstuel strømning i videnskabshiconverse all starien forsøgt at beskrive alle udviklinger, hvad enten de etablerer sig som sund videnskab eller køres ud på hiconverse skoiens sidespor,converse, som komplekse samspil af såvel makro- og mikrosociale,erkendelses- og metodemæssige og mere ideologisk prægede faktorer. I Socialdemokraternes velfærdsoplæg fra 2005 var standpunktet en offentlig vækst på én procent, men i forbindelse med velfærdsforhandlinger i sommer, har man opnået så mange resultater, at man roligt kan lade den offentlige vækst stige, mener partiet. »Det converse dog ikke, at han slet ikke har adgang til at se sms'er på telefonen,« converse all star Martin Gräs Lind.
     
  12. gtri

    gtri Member

    Joined:
    Sep 13, 2013
    Messages:
    13
    Likes Received:
    0
    The "trusted worker" list is a list I'm building of those turkers who do not get flagged by our grading program to be rejected...
     
  13. gtri

    gtri Member

    Joined:
    Sep 13, 2013
    Messages:
    13
    Likes Received:
    0
    Mmmm - might not be the best guideline to follow... even "facts" can be stating bad news that convey negative sentiment.
     
  14. gtri

    gtri Member

    Joined:
    Sep 13, 2013
    Messages:
    13
    Likes Received:
    0


    Mmmm - might not be the best guideline to follow... even "facts" can be stating bad news that convey negative sentiment.
     
  15. gtri

    gtri Member

    Joined:
    Sep 13, 2013
    Messages:
    13
    Likes Received:
    0
    I appreciate the feedback and email questions, Step. Our bonus/accepted/rejected guidelines are pretty clearly explained in every HIT, and I've provided more in depth information for you (and anyone else) who has emailed me about it. I've seen some of those responses shared with the broader audience on this forum and on TO... so I'm not quite sure how much more 'explicit' you believe the feedback needs to be.

    A very large majority (uh-oh, I said 'majority') of the folks who have sent me email have expressed thanks and appreciation for being so transparent and open about the grading... but with literally thousands upon thousands of items to grade in each batch (i.e., in the neighborhood of 175 HITs X 20 items per HIT X 20 turk assignments per item = 105,000 items to grade per batch), it just would not be feasible to try to argue *why* one turker did not match the wisdom of the crowd regarding the sentiment category for a text snippet...

    For example, if 20 people classify a text snippet, and the distribution is something like:
    3 people classified it as “Extremely Positive”
    9 people classified it as “Very Positive”
    5 people classified it as “Moderately Positive”
    2 people classified it as “Slightly Positive”
    and
    1 person classified it as “Very Negative”

    The grading program flags the outlier answer. Note: It's okay to get a flag here and there (because it is subjective, after all)... but, you *do* have to get at least 8 out of 10 of the golden items (where we already know the acceptable range of responses ahead of time). Also, if you're getting more than 4 flags on the remaining 20 items where we don't already know the acceptable answers, you probably won't get the bonus. Finally, if you're getting more than 12 flags on all 30 items for a HIT, I have to go and manually review to see if the responses are just random/unconsidered to check whether to reject it. With this many flags, though, they HIT is almost always rejected...
     
  16. gtri

    gtri Member

    Joined:
    Sep 13, 2013
    Messages:
    13
    Likes Received:
    0
    They all still get graded the same - ('trusted workers' just know about them first with a friendly email, it doesn't mean their responses are accepted carte blanche). Review this thread, or look at requester feedback on TO to see more info on how they are graded...

    It's how close you match the 'wisdom of the crowd'. For example, if 20 people classify a text snippet, and the distribution is something like:
    3 people classified it as “Extremely Positive”
    9 people classified it as “Very Positive”
    5 people classified it as “Moderately Positive”
    2 people classified it as “Slightly Positive”
    and
    1 person classified it as “Very Negative”

    The grading program flags the outlier answer. Note: It's okay to get a flag here and there (because it is subjective, after all)... but, you *do* have to get at least 8 out of 10 of the golden items (where we already know the acceptable range of responses ahead of time). Also, if you're getting more than 4 flags on the remaining 20 items where we don't already know the acceptable answers, you probably won't get the bonus. Finally, if you're getting more than 12 flags on all 30 items for a HIT, I have to go and manually review to see if the responses are just random/unconsidered to check whether to reject it. However, a HIT from a worker that has this many flags in it most likely will be rejected.
     
  17. gtri

    gtri Member

    Joined:
    Sep 13, 2013
    Messages:
    13
    Likes Received:
    0
    Thanks, Steve Turkel!
     
  18. gtri

    gtri Member

    Joined:
    Sep 13, 2013
    Messages:
    13
    Likes Received:
    0
    I think we've been pretty clear about why we give out rejections...
     
  19. gtri

    gtri Member

    Joined:
    Sep 13, 2013
    Messages:
    13
    Likes Received:
    0
    Thanks for the interest, Step. The grading system is clearly explained in the HITs, is very fair (and is widely regarded as so), and is also pretty lenient...
     
Thread Status:
Not open for further replies.

Share This Page