Lots of new HITs on labeling human pose in the images

Discussion in 'Do My HIT!' started by TurkPoseEstimation, Mar 29, 2013.

  1. bobbyjoeblue

    bobbyjoeblue Active Member

    Joined:
    Mar 27, 2013
    Messages:
    28
    Likes Received:
    0
    Did 25 of these last night and I rather enjoyed it. They're kind of fun. I hope I did them right. I hope, too, that the penalty for being off on them is just not being granted the qualification instead of rejection. Only have a little over 200 hits done in total so I'm nervous. Fingers crossed...
     
  2. Flora

    Flora Admin
    Staff Member

    Joined:
    Jul 16, 2012
    Messages:
    70,597
    Likes Received:
    18,623
    I agree with you on not getting the qualification instead of rejections because we all tried and gave it our best. I hope he goes by that method.
     
  3. bobbyjoeblue

    bobbyjoeblue Active Member

    Joined:
    Mar 27, 2013
    Messages:
    28
    Likes Received:
    0
    That would be awesome. In the meantime, better get busy increasing my hit count. Feeling a wee bit naked.
     
  4. delerium

    delerium User

    Joined:
    Dec 20, 2012
    Messages:
    149
    Likes Received:
    0
    I completed 26 HITs for the qualification because I made a mistake on one and submitted it (emailed you about this). I agree with everyone else in that if we are wrong I hope you simply do not assign us the qualification rather than rejecting such a large amount of HITs. I know I tried my best on the HITs I completed including writing in notes and sending you an email about one issue I had. I would hate to receive 26 rejections for the work I completed.
     
  5. Kights

    Kights User

    Joined:
    Mar 18, 2013
    Messages:
    1,198
    Likes Received:
    0
    Have any of you been paid yet?
     
  6. TurkPoseEstimation

    TurkPoseEstimation Verified Requester

    Joined:
    Mar 29, 2013
    Messages:
    65
    Likes Received:
    0
    Hi everyone,

    I have just processed the HITs, thank you very much! We have received many nicely labeled images in the last couple of days. I also granted qualifications to everyone who got 25 HITs accepted.

    I also had a minor setback with a large number of HITs with only 3 (!!!) points annotated, those got rejected.
     
  7. Flora

    Flora Admin
    Staff Member

    Joined:
    Jul 16, 2012
    Messages:
    70,597
    Likes Received:
    18,623
    Thank you! I got the qualification. I'm excited to do work for you.

    I have a question: There was batch of HITS where you do Video Segmentation (one object). I went in and I couldn't understand it at all. It says 'Fill in the objects that has scribbles'. I get it. So the picture appears. I see it already filled in with the color. I don't see any scribbles. After looking around for 8 minutes I had to return it because I was running out of time. I tried another HIT and the same thing happens. I see a deer already shaded in the color. I don't see any scribbles. This HIT is confusing.

    I will instead do the HIT that I was granted qualification for since I already understand how to do it and have had practice and approved for. Thanks.
     
  8. bobbyjoeblue

    bobbyjoeblue Active Member

    Joined:
    Mar 27, 2013
    Messages:
    28
    Likes Received:
    0
    Thank you for the qualification! I found these pretty pleasant to do and I'm looking forward to doing more. And thanks for the communication too.
     
  9. TurkPoseEstimation

    TurkPoseEstimation Verified Requester

    Joined:
    Mar 29, 2013
    Messages:
    65
    Likes Received:
    0
    those HITs are actually administered by another person, I will forward your comments to the responsible person to see what can be done
     
  10. swrogers

    swrogers New Member

    Joined:
    Mar 28, 2013
    Messages:
    4
    Likes Received:
    0
    I did five of them yesterday which have been approved. When will you be posting more so I can get up to the required 25 for the qualification? My mouse is kind of wonky (that's a technical term...) so I'm not able to burn through a lot of them at this point, unfortunately.
     
  11. TurkPoseEstimation

    TurkPoseEstimation Verified Requester

    Joined:
    Mar 29, 2013
    Messages:
    65
    Likes Received:
    0
  12. Flora

    Flora Admin
    Staff Member

    Joined:
    Jul 16, 2012
    Messages:
    70,597
    Likes Received:
    18,623
  13. Storms

    Storms User

    Joined:
    Feb 9, 2013
    Messages:
    416
    Likes Received:
    0
    Will there be more quals or do you have enough workers for now?
     
  14. Flora

    Flora Admin
    Staff Member

    Joined:
    Jul 16, 2012
    Messages:
    70,597
    Likes Received:
    18,623
    He says he will post more qualification tests soon.
     
  15. Jambin

    Jambin User

    Joined:
    Jan 18, 2013
    Messages:
    1,385
    Likes Received:
    0
    I have a question for you please, when you are working on annotating a small space, like a child in motion, is there an order of annotation that you advise. Should we mark those areas that are occluded first to ensure we get a reasonable point mark? I feel like I sometimes end up with a crowd of points at the end and am unsure if they all make sense.
     
  16. TurkPoseEstimation

    TurkPoseEstimation Verified Requester

    Joined:
    Mar 29, 2013
    Messages:
    65
    Likes Received:
    0
    I know some examples are tough because of the scale and image quality and will try to do something about that. If you feel like the image is unmanagable just skip it, that's fine. Otherwise, from personal experience I felt that it is easier to stick to the same ordering of points (e.g. as they are ordered in the panel on the right).
     
  17. Jambin

    Jambin User

    Joined:
    Jan 18, 2013
    Messages:
    1,385
    Likes Received:
    0
    Thanks very much for the tip - I'll work in the order presented :)
     
  18. beanamca

    beanamca User

    Joined:
    Feb 19, 2013
    Messages:
    67
    Likes Received:
    0
    Just want to let everyone know that out of 100 of these that I did, 14 were rejected with no explanation as to why.
     
    #38 beanamca, Apr 2, 2013
    Last edited by a moderator: Apr 2, 2013
  19. Sik06

    Sik06 User

    Joined:
    Mar 7, 2013
    Messages:
    88
    Likes Received:
    0
    I just read on Turkopticon that someone got all 531 that they did rejected...This kind of scared me. I really like doing these. Now I am afraid to do a bunch of them. :(
     
  20. beanamca

    beanamca User

    Joined:
    Feb 19, 2013
    Messages:
    67
    Likes Received:
    0
    Yeah, I was really liking them too. I guess I should be glad only some of mine got rejected.
     

Share This Page