Great hits 11/2/12

Discussion in 'Great HITs' started by trueakitalover, Nov 2, 2012.

Thread Status:
Not open for further replies.
  1. tbanny

    tbanny User

    Joined:
    Sep 17, 2012
    Messages:
    748
    Likes Received:
    0
    Hm, that's odd. He paid me just fine. It is possible that I accepted it and let it sit for a while.
     
  2. bredeanf

    bredeanf User

    Joined:
    Aug 7, 2012
    Messages:
    2,833
    Likes Received:
    0
    You're making me glad I missed the code and didn't submit it because I did that survey in like 5 minutes
     
  3. granit

    granit User

    Joined:
    Sep 5, 2012
    Messages:
    3,043
    Likes Received:
    0
  4. sasquatch

    sasquatch User

    Joined:
    Oct 19, 2012
    Messages:
    4,446
    Likes Received:
    0
    i was paid too, and i usually finish these pretty quickly...
     
  5. granit

    granit User

    Joined:
    Sep 5, 2012
    Messages:
    3,043
    Likes Received:
    0
  6. FlipChillson

    Joined:
    Oct 9, 2012
    Messages:
    344
    Likes Received:
    0
    Franklin Harrells are up.
     
  7. Swig5

    Swig5 User

    Joined:
    Aug 5, 2012
    Messages:
    502
    Likes Received:
    0
    Email I received about the HIT. I don't remember doing it that fast :(

    Thank you for contacting me regarding this study. In pretests of the study, the average completion time was approximately 10m. The average completion time by MTurk workers was 8m6s. We wanted to be generous in our acceptance/rejection rates, taking into account that some Turkers are indeed fast readers, so we set a threshold of 3m15s (or 195s) for HITs that could be accepted.

    Your completion time was under 195s (less than 3m15s), which is less than half (40%) of the average time that everyone else took to complete the study.

    A common practice in social science research is to discard data that are in the extremes, such as when people complete a task too quickly or too slowly as compared to the average or expected completion time for the task. We cannot be sure that these people paid full attention to the task, or responded in a non-random manner to the survey questions. Therefore, we cannot use their data.

    As you can see in the screenshot I have attached, I paid 557 people for their work and only rejected 28 workers for this HIT, which is small minority of workers (about 4%), and this is consistent with social science practice to discard about 5% of outliers in one’s dataset. You can rest assured that we took these decisions very seriously and based them on empirical data, and I am sorry if this caused you any inconvenience.

    Best,



    --
    Q / Que-Lam Huynh, PhD
     
  8. bredeanf

    bredeanf User

    Joined:
    Aug 7, 2012
    Messages:
    2,833
    Likes Received:
    0
    I swear Toto (my dog) seems to go super crazy during the Franklin HITs with the lowest audio. Come on!
     
  9. Joelsfood

    Joelsfood User

    Joined:
    Oct 10, 2012
    Messages:
    256
    Likes Received:
    0
    Certainly a reasonable and well thought out response, Swig, can't say that I disagree with his judgement.
     
  10. TurkworkOrange

    Joined:
    Sep 27, 2012
    Messages:
    434
    Likes Received:
    0
    pretty concise explanation. That said, it seems harsh to reject the outliers, as someone always has to be an outlier. Edit, actually on second thoughts it makes sense why they reject the outliers (have taken too many psych surveys this morning, don't mind my internal debate).
    One thing that might have happened is you did not accept it right away, but took the survey, then came back to find it not accepted. I know I've done that a few times and try to remember to let the timer sit a while before submitting.
     
    #190 TurkworkOrange, Nov 2, 2012
    Last edited by a moderator: Nov 2, 2012
  11. Swig5

    Swig5 User

    Joined:
    Aug 5, 2012
    Messages:
    502
    Likes Received:
    0
    I agree with what they are saying but that was the last hit I did yesterday and I thought it took me 6 minutes because I laid my baby down for a nap while the clock was going. Oh well.
     
  12. Caleb2476

    Caleb2476 Active Member

    Joined:
    Oct 28, 2012
    Messages:
    44
    Likes Received:
    0
    I've tried in Chrome and Firefox but none of the Audio will play for me :(
     
  13. mikey

    mikey User

    Joined:
    Sep 10, 2012
    Messages:
    416
    Likes Received:
    0
    Same thing here
     
  14. sasquatch

    sasquatch User

    Joined:
    Oct 19, 2012
    Messages:
    4,446
    Likes Received:
    0
    yup, same here. wouldn't go in opera either.
     
  15. Jahanzeb

    Jahanzeb User

    Joined:
    Oct 16, 2012
    Messages:
    179
    Likes Received:
    0
    Guys download and install quicktime player to work on franklin hits.
     
  16. WCH

    WCH User

    Joined:
    Oct 10, 2012
    Messages:
    9,816
    Likes Received:
    0
    I'm not having any luck either.
     
  17. durgidog

    durgidog User

    Joined:
    Oct 1, 2012
    Messages:
    91
    Likes Received:
    0
    I think you should be paid for the hit and he should then remove your results form his data, that's ridiculous.
     
  18. laneuffer

    laneuffer Banned

    Joined:
    Oct 8, 2012
    Messages:
    160
    Likes Received:
    0
  19. abrahamrohithroy

    Joined:
    May 24, 2012
    Messages:
    886
    Likes Received:
    0
  20. sasquatch

    sasquatch User

    Joined:
    Oct 19, 2012
    Messages:
    4,446
    Likes Received:
    0
    i have it, and it works with other hits just fine...
     
Thread Status:
Not open for further replies.

Share This Page