Discussion in 'General' started by kjross, Nov 21, 2012.
I've only made one comment on TO. That was when the requester rejected everybody by accident and then fixed it. I would always rate 5 for fairness as long as they don't reject. Giving a lousy fairness rating for paying less that you'd like doesn't seem right. You know what they pay before you accept the hit. In all honesty, the ones who really deserve a bad fairness rating it's people like Oscar Smith. Not because they pay a terrible amount, but because they approve everyone whether they spend two minutes making perfect copies or just click the card without typing anything.
I would rate low if the estimated time is wrong. For example, a quoted 10 minute survey at a normal rate of speed shouldn't take 20 minutes or more. Then there are the ones where you've invested so much time into the survey (when no time was quoted) and it goes on and on, then it winds up being 40 minutes for .50 or some nonsense. That would get a low rating.
But for regular stuff where everything is upfront, it doesn't seem fair to rate low. No one forces anyone to work here.
You reject for wrong reason
you get the red bars
end of story
Really? So who determines if the rejection was for the wrong reason?
Well, given that TO is the only tool that a worker has where he can express his opinion of the requester, outside of the few existing forums, the worker decides if the rejection was for the "wrong" reason, whatever the definition may be of "wrong" in his opinion.
Normally, work that is complete and accurate should not be rejected. However, since there have been and still are too many requesters, unfortunately, who reject for reasons other than inaccuracy, including but not limited to error on their own part, badly designed hits, blatant dishonesty, majority rules and myriad others, it seems to me that the worker has every right to use his own right of reply. Amazon Mturk administration refuses to play any role in mediation or policing the site.
Many requesters, even "good" ones, don't know how to reverse a rejection, or can't be bothered to, thinking that it has no real effect on the worker. But it DOES. So, perhaps, requesters need to accept that they too may sometimes be graded "unfairly".
I haven't responded to this thread, so I thought I would contribute to the best of my ability, and hope to give you a little insight. Some of which you most likely already know.
This story can really go both ways and there's a bunch of different details to take into consideration. Some turkers you have to understand, Turk for a living, not for play. So putting food in their stomach or their kids stomach, might depend on you approving that hit or rejecting that hit. You also have to take into consideration pay vs. performance ratio. Sure, if you go pay a professional researcher to handle everything you need done, it will get done to satisfy your needs. But how much will your profit margin be, considering how much you paid that professional researcher. You have to remember, some people on here make way over minimum wage, while others don't. Some are working for pennies on the hour, so your going to get pennies on the hour quality work. You get what you pay for right? Look at it from my shoes. I spent 4 hours working for one requester, knowing that I provide high quality work, all my work was rejected for a reason of X. So the Christmas presents for my daughter, how do you explain that? By telling them that people weren't fair and didn't pay you for your quality work? Obviously not.
Now looking at the other side, TO, is just like a product review page. For example, online at Sears, they have reviews on all their tools. People are going to leave their opinions no matter what. Considering what we are being paid, I believe if a hit is close to being to expectations, or it looks like an attempt was made, approve it! If someone scammed the work, and just typed words, I recommend you block them, reject them, flag them, and everything in the book. Why so harsh? They brought it on themselves. Do people really thing anything is free in life? One thing I will never understand completely, is people with a 100,000 hits submitted from clicking buttons, then want to come here and start a thread titled "Help! Recently Banned." I feel no sympathy for low down lazy people.
My suggestion is to you, evaluate your hits carefully. If you wan't quality work, pay well, and limit it to quality workers. I'm not saying by adding that you have a Masters Qualification, because we all know the system isn't fair. I've rarely seen Amazon hand out Masters to the highest quality workers. My suggestion would be to make turkers pass a test, before doing your writing hits. Make it a complicated test, but with fair grading. If their not skilled enough to complete the test, then their obviously not up to your standards, and obviously won't be able to work on your work. This eliminates all the non quality workers, because someone who is scamming, isn't going to take the time to summit a high quality test before doing your hits. Why? Because their lazy.
One thing you always have to remember in life, the positive will always out weight the negative. If people want to leave negative reviews, let them leave negative reviews. But block the, and reject them if their work is BS. There's always going to be other quality workers that know about your work, and their going to keep working with you, as long as your treating them fairly. Hope I could be of help.
There's going to be people disagree with what I have to say, as far as being blocked and rejected, all I can say is quit thinking that everything is free in life. It's called WORK. For all the scammers, that are messing up the good requester, I wish to the very most that you all get blocked and rejected, along with your IP blocked where you can no longer work on Mturk, messing things up for the hard working workers that sweat their hands for pennies on the hour.
Obviously, the Requester. It's their standard that we have to provide. It sucks that this question even has to be asked. In any other work force, people don't go around telling their boss how and what to write in their reviews or say, "no boss, you are wrong, I did my work to your standards."
Edit: Just wanted to make it clear. By their reviews, I meant the employees.
Most people can't seem to accept that they do the work incorrectly. Now, if many workers across the board are saying that a Requester is rejecting just to reject then there is a problem and as a Requester you should look into it. Maybe the instructions weren't clear, maybe you should have a testing Hit before allowing workers to submit a mass amount incorrectly and then get rejected.
I think that the best thing a worker can do is post an informative review, on the work, pay and what if any communication with the Requester occurred on TurkOpticon, not just this Requester is a cheat, or what ever people say. It helps no one in the end when we can't adequately write an informative review.
Thank you. I don't understand why all the cry baby's cry about their work being rejected, when it's their fault. It's sad what this worlds coming too, but very true. I wish I could ban every spammer, and force them to do some real labor in the Texas heat. =]
I ignore the ones that only say unfair, rejected my hits, etc. without more detail. Too bad these can't be flagged and marked invalid since they are worthless.
Smart thing. That's what I'm trying to explain to KRoss. The experienced turkers which you WANT working on your hits, aren't going to ignore your hits because of a few hard headed scum bags left negative reviews. Whoever left the review, I always investigate them myself my comparing their other reviews. I've caught a lot of BS reviews like this. I've also caught a lot of BS requester s by doing this because they like to create accounts, then leave positive reviews, but don't realized they only left reviews for themselves, and have left no other reviews. I automatically disqualify them reviews and laugh at the people who wasted their time writing them.