Did 25 of these last night and I rather enjoyed it. They're kind of fun. I hope I did them right. I hope, too, that the penalty for being off on them is just not being granted the qualification instead of rejection. Only have a little over 200 hits done in total so I'm nervous. Fingers crossed...
I agree with you on not getting the qualification instead of rejections because we all tried and gave it our best. I hope he goes by that method.
That would be awesome. In the meantime, better get busy increasing my hit count. Feeling a wee bit naked.
I completed 26 HITs for the qualification because I made a mistake on one and submitted it (emailed you about this). I agree with everyone else in that if we are wrong I hope you simply do not assign us the qualification rather than rejecting such a large amount of HITs. I know I tried my best on the HITs I completed including writing in notes and sending you an email about one issue I had. I would hate to receive 26 rejections for the work I completed.
Hi everyone, I have just processed the HITs, thank you very much! We have received many nicely labeled images in the last couple of days. I also granted qualifications to everyone who got 25 HITs accepted. I also had a minor setback with a large number of HITs with only 3 (!!!) points annotated, those got rejected.
Thank you! I got the qualification. I'm excited to do work for you. I have a question: There was batch of HITS where you do Video Segmentation (one object). I went in and I couldn't understand it at all. It says 'Fill in the objects that has scribbles'. I get it. So the picture appears. I see it already filled in with the color. I don't see any scribbles. After looking around for 8 minutes I had to return it because I was running out of time. I tried another HIT and the same thing happens. I see a deer already shaded in the color. I don't see any scribbles. This HIT is confusing. I will instead do the HIT that I was granted qualification for since I already understand how to do it and have had practice and approved for. Thanks.
Thank you for the qualification! I found these pretty pleasant to do and I'm looking forward to doing more. And thanks for the communication too.
those HITs are actually administered by another person, I will forward your comments to the responsible person to see what can be done
I did five of them yesterday which have been approved. When will you be posting more so I can get up to the required 25 for the qualification? My mouse is kind of wonky (that's a technical term...) so I'm not able to burn through a lot of them at this point, unfortunately.
I have posted a new batch of HITs for workers that passed the qualification and will post HITs for qualification test soon: https://www.mturk.com/mturk/preview?groupId=2EFB3Q39Z0B8QZHXQ55V0TVRKPFVK3
I have a question for you please, when you are working on annotating a small space, like a child in motion, is there an order of annotation that you advise. Should we mark those areas that are occluded first to ensure we get a reasonable point mark? I feel like I sometimes end up with a crowd of points at the end and am unsure if they all make sense.
I know some examples are tough because of the scale and image quality and will try to do something about that. If you feel like the image is unmanagable just skip it, that's fine. Otherwise, from personal experience I felt that it is easier to stick to the same ordering of points (e.g. as they are ordered in the panel on the right).
Just want to let everyone know that out of 100 of these that I did, 14 were rejected with no explanation as to why.
I just read on Turkopticon that someone got all 531 that they did rejected...This kind of scared me. I really like doing these. Now I am afraid to do a bunch of them.