Medallia -- I retrack anything GOOD i ever said about them.

Over the past few days I've submitted well over 500 hits, and every single one has been approved.

 

I think i did over 500 today and all of them have been approved and paid.

 

Medallia's rejection policy

Hi all,

We first would like to thank all of you who have done our HITs in the past. After reading the posts here, we feel it might be helpful to share our rejection policy so you will understand why sometimes we do have to reject all of HITs done by a worker. For each of our HITs, we rely on 3 workers' independent and reliable judgement to determine the correct category label for a sentence. If a worker's answers are different from those of other workers in most cases, we will manually review that worker's results. If the results are wrong in most cases, we basically cannot rely on that worker's judgement and therefore cannot use any of his/her results. In that case, we have to reject all of his/her results and re-post the HITs.

We are very careful about rejecting worker's results, as we understand the negative impact it can have to a worker's account. We also understand that our task can be subjective sometimes. So we won't reject a worker's results even though we may not agree with all of the answers. We will approve ALL of a worker's results as long as we believe that we can trust that worker's overall judgment and overall work quality. We have only rejected results containing a lot of obvious mistakes such as labeling 'The room stinks' as 'Positive', or labeling all of the HITs as the same category, or labeling all of the HITs using a fixed pattern, because such results led us to believe that we could not trust that worker's overall judgement and work quality.

We hope this helps, and please do not hesitate to contact us if you have any further questions.

We are looking forward to working with you more in the future.

Best,

Medallia

 

Thats the right way to go about it - Overall Worker Judgement and Quality. Much appreciated. Now, no one will be shy of working on your HITS.

So, when is the next batch ready to go under the hammer

 

Blocking, mass rejections and majority rules - a perfect combination to weed out all the good workers. Maybe they are doing an experiment to find the scammers. Oh, don't forget the vague instructions to ensure that no one can be successful. I still have this qual and have not had a rejection, but I won't touch these again. Not worth the risk.

 

As I was reading their post, I was thinking the same things. Majority rules is the deal breaker, in my opinion.

 

This. All the HITs I did for them were approved, but I won't do anymore. I only have 1500 approved HITs, and I cannot afford rejections because of that majority rules crap. I don't make much money turking yet in part because I'm so careful, i.e. slow. I want requesters to get what they want so they will come back and perhaps spread the word. However, because our stats matter, I have not worked for ANY requester who employs majority rules for their HITs.

To any requester who may read this: Majority rules sucks out loud. There are a lot of turkers who will work hard for you. Those of us who do are often punished unjustly by majority rules. It's not the way to go. Take the time to create a proper qualification test. It is much better for you and for us. Thank you in advance.

 

Medallia's rejection policy

Hi swiftkick, Whimsy and nobody,

If you have read our rejection policy carefully, you won't come to this conclusion. As we stated in our policy post, all of our rejection decisions were based on our MANUAL review. Only results demonstrating insincere effort are blocked. The majority rule only helps to flag a potentially unreliable worker for further manual investigation.

To summarize, as long as you put in sincere effort into your work, your results will never be rejected.

Thanks,

Medallia

 

darn my message is gone?

 

Hello I got 100+ rejections from this last batch Medallia had posted. I've done several other batches they had posted with no issues or prior rejections. I've done thousands of sentiment hits for other well paying requesters whose policies are to pull the qual(which has never happened to me) they've issued to you so you can no longer do their hits if the quality of work you are doing has fallen below what is expected. Word of mouth alone(oh not to mention Turkopticon reviews) has turkers not wanting to do anymore of their hits that combined with Majority Rules, mass rejections, and the dreaded block. This is an instance where the term "a triple threat" would be labeled as a negative sentiment. It is not fully understood what a mass rejection does. I'ts not about the money that was to be made from those rejected hits, it's ALL FUTURE monies that won't get earned because now approval ratings have dropped below what is required by other well paying requesters to do their well paying hits. Money for car payments, food, rent/mortgages and other things needed to maintain a household. Yep, word on the street is, Medallia will screw you over when you least expect it.

Medallia says they manually review but they didn't until AFTER I got all those rejections + block AFTER emailed them asking them to review the hits I did. They then said that my error rate was "slightly lower than that of a obvious unreliable worker." I feel the manual review should be done BEFORE the mass rejection.

The word insincere needs to be replaced because there was absolutely nothing insincere about the effort I put forth in this batch and all prior batches I've done with this or any other requester. I like so many others take pride in my work, I value my approval rating and don't take for granted what needs to be done to maintain it.


We are to judge these varying 1-4 words(sometimes phrases) that have been extracted from a larger context of a hotel review and say whether they are neutral, positive,etc. Sounds easy enough. If I see the term "roaches" I would label that 'very negative.' Why? These are hotel reviews, what can possibly be positive about that? Roaches and hotels don't go together. Am I suppose to think "roaches" came from "I was pleasantly surprised to see the roaches scatter when I turned on the light in the bathroom." Maybe Medallia disagrees, maybe I'm putting way too much thought into this. With that said, does this sound like the mindset of someone who is putting forth 'insincere effort' ? Better instructions and examples should be shown as to what you kind of results you are looking for. If a worker is submitting more quality work,pull their qual so they can't work on your hits anymore.

I still have my rejections after Medallia stated to me in an email that they would reverse it. I know for a fact there are 3 ways to do rejection reversals. Let's see who is insincere now.

 

I love the sentiment ones they put up and even though they're .01 I swear if they put out more I'd do them til my fingers fall off just because they pay so quickly and they're so simple to do if you do them correctly. I did somewhere around 1500 over a few days when they were putting the last batch up just a few days ago and I'd love to do more. Not a single rejection yet.

 

@Playa_hamm420 You may have resolved your issues with Medallia but myself and many great workers, haven't been. Everyone has their own experience with this requester and I'm sharing mine. You at one point were rejected and blocked and got it reversed so if you want to act like that never happened, hey if you're okay with that I'm okay with it. If I need to start my own thread then I will but Medallia is posting here so I'm posting here for ME to get a response from them, you my dear are irrelevant to my cause.

 

well it does if medallia is reading the thread (which they are).

I'm sorry it's your thread, but it may be the only way for someone to feel they've shared or will be heard, instead of another random thread (which may be ignored). There isn't a medallia forum/section.

It's kinda like the CW sucks? thread. We don't think they suck but that's where everyone lays their stuff out on the table. It's an active thread that doesn't get lost.

 

...So you want special consideration... but you don't want to give it to anyone else?