It'll be alright. That's a message to anyone that stresses out over mturk... It'll be alright, I promise.
Title: Academic survey investigate how people process information presented in the media (10-15 minutes long) Requester: Jeffrey Michael Hunger [A3I5QEK76TCFCJ] (TO) TO Ratings: (Submit a new TO rating for this requester) Description: Workers will read a brief article and complete questionnaires assessing your general thoughts, feelings, and opinions. Reward: $0.41 Qualifications: HIT approval rate (%) is not less than 95, Location is US 9 Minutes, slightly interesting.
Title: Thoughts and Impressions Survey Requester: Alysson Light [A2J4BZHBWEH9DC] (TO) TO Ratings: (Submit a new TO rating for this requester) Description: A short survey on your thoughts, feelings, and impressions of people and organizations Reward: $0.20 Qualifications: Total approved HITs is greater than 0, HIT approval rate (%) is not less than 90, Location is US 2:35
Well, now I feel kinda bad/not bad. I know I did a good job for the requester, but I also know I probably just handed a fellow Turker a rejection. I just did a review of a Crowdsurf transcription where the person who had transcribed it just made up words. The audio snippet was a math class, where the speaker was using the Greek letter "mu." The person who transcribed it wrote "mieu," both times, and also wrote "as tall as" for the word "tolerance." They also had extra words that the speaker never even said and incorrect words. The speaker had an accent (Indian), but it wasn't very hard to understand. It was just a really crappy transcription, so I rated it "poor." I honestly feel that the Turker who transcribed it did a very poor job and it would have been a disservice to Crowdsurf not to rate the job as "poor." I also feel that whoever did this transcription needs to be taught that you can't just make stuff up if you don't know a word that's being said. I mean, "mieu" isn't even a real word. It's probably not a good idea for this Turker to transcribe math HITs, since the use of Greek letters is extremely common in math. But, of course, what will happen is the Turker will just get a rejection with no explanation. I feel the rejection is deserved, but I'm willing to bet that without any feedback, the Turker who gets the rejection is going to feel unfairly treated. What do you guys think?
I think you did right. You followed procedure. Send CS a short message saying you forgot to leave feedback before you submitted that way they can reference back if the turker emails. If they made up words, the rejection is deserved and the chances are if they're making up words on a transcription, they won't have to waste their time emailing to find out why they were rejected.
Title: 5 second task Requester: Steven Gimenez [A9K0CV70JWG1W] (TO) TO Ratings: (Submit a new TO rating for this requester) Description: easy Reward: $0.01 Time: 10 minutes Hits Available: 1 Qualifications: Total approved HITs is not less than 0
Title: Social Behavior Questionnaire (5 minute survey) Requester: Fiona Barlow [A3PKBGTBHDH5L0] (TO) TO Ratings: (Submit a new TO rating for this requester) Description: We invite you to complete a 5 minute questionnaire about your social behavior. Reward: $0.20 Qualifications: HIT approval rate (%) is not less than 95, Location is US 2:15
Oh, no, the feedback is already there. If you rate someone "poor," you have to explain why. I put pretty much the same thing as what I wrote in my message here, about "mieu" for "mu," "as tall as" for "tolerance," and the extra/wrong words elsewhere. I just know from my own experience that it's unlikely that CS will actually give any of that info to the Turker who transcribed it. Sigh. Maybe I should just skip doing CS transcription reviews ... but that's hard to do because they pay quite well! Double sigh.
Missed that part... I thought you said somehow you submitted a blank feedback somehow. Honestly, everyones different. But (I) myself would not feel bad. If they made up words or replaced a phrase with made up words, they goofed up, whether it be purposely, scamming, or a plain out mistake. You get paid for doing your job. If you don't do your job, to protect a worker, then who's in the wrong considering CS is paying you better money to review them for a reason. If I mess up transcribing something, I expect you, him, her, or Crowdsurf to reject it. If I made an honest mistake it can go both ways, I hope for the best, and if it's rejected I just have to understand, I messed up. But if you make a devious mistake, that's something that shouldn't even be questionable from your part.
Title: Identify whether these images have watermarks Requester: ProductRnR [A2BAP2QO7MMQI9] [TO] Description: Identify whether these images have watermarks Reward: $0.05 Timer: 20 minutes (short timer) HITs Available: 799 Qualifications: Quality score 9.1 - AutoGranted on Request is less than 10, HIT abandonment rate (%) is less than 20, Quality score 9.2 - AutoGranted on Request is greater than 70, HIT approval rate (%) is greater than 95, Quality score - AutoGranted on Request is less than 17, Adult Content Qualification is 1 View this HIT
See, here's another one. This is what the Turker submitted: Okay,so if we take the first component the gradiant the x is the aspect is A the gradiant the is respect the aspect is identify matrix the gradiant in respect with the y and ys is the zero This is what was actually said: Okay, so if you take the first component, the gradient with respect to x is A, the gradient with respect to xs is the identity matrix, the gradient with respect to y and ys is 0. I gave this one a "poor" too, because, honestly, the Turker couldn't even spell the word "gradient" properly, let alone the fact that what was submitted was just plain gibberish because of missed/incorrect words, almost no punctuation, et cetera. I mean, this is just a bad, bad job. I honestly feel this Turker shouldn't even be attempting transcriptions (probably the same one as the other one since it's the same math class). But I know how much a rejection stings. Argh.
Title: Write about Lottery ($2 Bonus opportunity) Requester: berk celikyurek [AJ5BWL80V0HW3] (TO) Description: Easy hit, bonus opportunity Reward: $0.50 Qualifications: Link: https://www.mturk.com/mturk/preview?groupId=2593XERSQV66IKLQLSUH6WAVMM719H [size=-2]Powered by non-amazonian script monkeys [/size]
Title: Rating people in pictures Requester: Azim Shariff [A2NHZXB5A6RRE7] (TO) TO Ratings: (Submit a new TO rating for this requester) Description: A brief 5-10 minute survey asking you to make judgments of people. You will see pictures of people and make judgments about them, plus answer some questions about yourself. Reward: $0.21 Qualifications: Location is not IN, HIT approval rate (%) is not less than 90 Long 10 minutes.
That one has rule violations clearly and should have been marked as poor. It almost seems as if a combination of issues or as if they just don't care themselves. It seems they didn't take the time to read the stylesheet, are not using proper punctuation when transcribing, and in the way that their developing similar structure, but incorrect words, they might not be using headphones. I can understand how you would want to question it if it was one simple error, or one comma left out. But with sentences constructed like that, there's no way I would let it slide. After a requester receives enough nasty transcripts that slid through the reviewers, he's then coming after you. People complain about rejections and as we've discussed before, some don't deserve to be rejected. Especially, the ones that are rejected due to faulty auto-grading systems. But I don't justify letting someone walk, when they're clearly not following protocol. The goals to keep the bad workers out and the good requesters here.
I'm a sad panda.... because I missed these Math class transcriptions. While it does bring back evil, nasty memories of higher level math... they are easy for me because I know the "lingo"
For anyone that did the Christopher Jackson survey at the beginning of the year, the $12.00 survey already paid out today within a few hours. Edit* Still up if you haven't checked your emails.
I did a couple this evening that were nothing but (electrical engineering?) equations, "On the left side we have capital A plus b hat times v prime..." Mind-numbing, but pretty easy transcriptions.