There have been times when I would like some sort of challege system on a hit. Granted, most aren't worth the hassle, but when % matters it would be great if turkers had a way of defending themselves against spiteful or abusive requesters. Something really should be done. Any ideas on how to make this better?
It would also be nice to have some background information about the requester. I realize we're all "nameless, faceless and anonymous" as Turkers, but knowing a little bit about the person and/or business asking us to complete these tasks might be nice. I guess I'm just curious what in the world some of these folks are doing with some of the stuff they're asking us to find!
I agree, and it is an interesting aspect about the anonymity. Hopefully this forum will do its part to shed light on it all.
Lewis, How do you figure that would be calculated? A requester would be weary to reject work that does not meet his standards!
I'd definitely like to be able to see a Requester's overall rejection rate. (Amazon itself probably has one of the worst records in that department, though I know they also get a lot of people trying to scam them on the quick HITs.)
When a requester rejects your work and gives a reason for doing so, that's not a problem, but when they block you from doing any more of their hits, now that's demeaning. they should give enough reasons for blocking you or give a warning prior to blocking.
The problem is when you are not wrong. Amazon has similar % for requestors too, but I dont know whether we can see them. I go by my personal experience, if a requestor has rejected my work twice, than I try to avoid his hits. I have had some rejections on the premise of word count being low or article not being unique, when on checking I have come up with more % or words than asked by them. They ask you to rewrite an article which is 50% unique than the one given by them, you rewrite one which is 65% unique and check it, but still find your work rejected. I dont' know what to do in such scenario, except for avoiding work from such requestors.
Rent A Coder does that where you can rate the requester and they also get to rate the person doing the job.I like that idea more of a back round and i get frustrated myself at times when doing a job and i know i did it right but they come back and say i did not do this when i did..grrr gets to me lol
The problem as I see it, is that we have no way of knowing if the Requestor is acting with integrity. For all we know, he's actually using our work, but telling us he's rejected it so he doesn't have to pay. This notion especially bothers me when I politely ask for some feedback so I can do a better job next time and I never get any reply. I feel demeaned when I'm ignored and I won't work for that person again.
accidental submits A big problem I have with rejected hits is that you are not given a second chance to determine if you want to submit the hit in the first place. There have been a few times when I have hit the submit buttom by mistake and there is nothing you can do about it, except just take the reject. I would like to see mturk ask requester to set up their hits so that accidental submits can be avoided. In other words have a pop-up come on the the screen asking you if you want to submit at this time?
Agree that we should be able to rate requesters and also have a system in place where we can take back hits that we send in on accident that weren't finished yet. One thing I would like to see more of is requesters saying a little more as to why some of our hits were rejected (most of them do a decent job) but for the ones like the "Are these items different" by Amazon...all of the ones I have sent in have all been rejected and I know for sure that the items were exactly the same (item number..color..size..etc) and I have yet to receive a reply when I asked them to explain what exactly I missed on that hit
Don't feel bad. I got the shaft from those hits too and so have many other people. I too, asked for an explanation but never received one so I won't work for them anymore. Just because I'm willing to work for third world wages does not mean I'm unworthy of being acknowledged. Being ignored burns my butt!
You can rate requesters on turkopticon and send out a message to others. Turkers will be wary of requestors who are not fair, or who are not prompt in paying. Regarding your rejections, I think turkers are forming a group and deciding what to click, on such hits. Since majority are clicking wrong answers, and you fall in minority, so your answers though correct are getting rejected. Amazon really needs to do something. I avoid such hits after getting negative feedback from others.