Tl;dr: We made a game out of our HITs that will give you pay bonuses for good work. The next HIT batch will be posted on Thursday, August 15 at 2:00PM EST.. Subscribe to this thread for exact information. Hey Turkers, I think it's high time I introduced myself. Who we are: We're a relatively new Requester named YCharts (formerly YCharts, Inc. in previous tests), and we've been working for about a month now on a system for crowdsourcing some of our data through Mechanical Turk. Some of you may have known me under the pseudonym Requester_Throwaway. I've made a couple posts on this forum asking for advice, and you were all very helpful. Our HITs would not be what they are right now without you guys. What our HITs are like: Our HITs will almost always require you to read a data table and record some data value and its date. This is typically a very quick process (<1min per HIT) and we try to make the form as straightforward as possible. No giant red text, confusing pictures or chaotic arrows. In order to incentivize timely responses and maintain a regular group of Turkers, we've decided to make a fun game out of this! There are Achievements you can earn for dong consistently good work, and with each Achievement comes a Pay Bonus. Here are some of the highlights: No rejections. Ever. Our system literally has no way of doing it. After completing a test run in which rejections were given for incorrect responses, we soon realized how unfair this was given the importance of your Approval Rating in doing future work. As a result, if you do a HIT incorrectly, you will still be approved. To weed out those who do poor work, we have a qualification called the YCharts Quality Score, which increases with each correct response and decreases with each incorrect one. If it hits zero, you'll have to wait a while before you can request it again. Note that if you deliberately attempt to scam our system via collusion or any other means, we will go out of our way to reject you and block you because data integrity is important. But in all honesty we should never have to do this and it definitely won't ever happen automatically. [*]Fair Majority Rule. I know this is taboo around here, but it had to be done. If you disagree with the majority, never fear. We know people make honest mistakes (all of these have been people looking at the wrong table by accident so far) and we're not going to reject you because of it. You'll lose some points on your YCharts Quality Score but if you've got a good track record it won't really matter too much. You'll still get paid for your time. We are considering alternatives or modifications to the majority rule element. Everything else about this will always remain the same (No rejections ever, chance to increase qualification, etc.). These changes should be pretty transparent to those working on the HITs. We have a couple ideas, but your input is always welcome. Quick payment. Most of the time you should receive your approval and payment within five minutes after the HIT is completed (i.e. everyone has responded). Even if we were to suddenly ignore our requester account forever, Amazon would automatically pay you within a week. Most of the time this means you'll have your payment in under an hour (18mins on avg. according to our tests). If it takes much longer, there was probably some disagreement among the answers that needs to be sorted out or people just aren't doing the HITs. Achievements and Pay Bonuses. Doing HITs early, accurately, accurately in a row or all of the above will earn you Pay Bonuses and various Achievement titles. There are 3 Achievement tracks, each with 10 levels. Once you pass the last level you will continue to receive a regular bonus. HIT batches posted at regular intervals. Our data tends to come out on a periodic basis, so our HITs will usually follow the same schedule. Email notification about the next HIT batch release. If you check off a box at the end of a HIT, you'll receive a one-time email telling you when the next batch of that type is scheduled to be released. Again I'd like to thank you all for your help. We'll be posting our first real batch at around 10:30AM EST tomorrow, and it will likely be posted every Friday morning from then on (the time may change to 9am or something similar… I will post back here if it does). As we need more types of data we'll be posting more batches, but I can't be sure when that'll be. We're still developing so if you do our HITs please post any thoughts, comments, criticisms, etc. that you may have. We're also curious to hear what you think of the game element. Anyway, I just wanted to reach out to you guys. I hope you give our HITs a try and most of all I hope you enjoy them. Best Wishes, -YCharts
Is your batch is not kind of location specified? Is it available to Indian Turkers? It would be really great to us. And What other qualifications you are making prior to get your batch Available?
I love the time and effort you are putting in to make this a fun and profitable hit for both of us. I have put you on my TO DO list for tomorrow and plan to start with you first in the morning. I am PDT. Thank you for setting up the email notification and I love your idea for the qual.
That's strange... My first post has disappeared. It's probably up for moderator approval? I think it might have to do with the one link I added (it was a link to a page on this site). Perhaps it was flagged. I hope it comes back soon... @riyazalikhan: Yes. Right now the only other qualification is that you must have an approval rating of over 50% (I will increase this if we get a lot of scammers.....) @LovetheBeach: Thank you! The qual idea actually came from a Turker. I look forward to your HIT responses tomorrow.
My new account (YCharts) seems to have been put on moderator approval. I will keep you guys posted on the status of the HITs. I may have to wait until Monday to post them if I'm not taken off soon :/ NOTE: If you plan on doing these HITs, please check back here before 10:30am EST tomorrow (Friday, July 19). I will probably post at around 9:30am or earlier. I may have to move the HITs to Monday since this post has been hidden for so long. I'll let you guys know! EDIT: Yup. I'm going to have to save these HITs for Monday, July 22 at 10:30am EST.. Have a good weekend until then! Feel free to discuss the HITs here before then if my original post shows up again.
Thank you very much for the care you are putting into your hits. I very much look forward to working on them. It's requesters like you who make this worthwhile. There are so many who don't care and don't realize it's not only respectable, but also profitable to do so. Once again, thank you very much.
Thanks for the explanations! One question: Will they always be posted at 10:30AM Eastern or is that just for the first one? I'm asking because that's 7:30AM Pacific, when most west coast turkers are probably waking up and not online yet. If it matters for your data, posting early in the day like that will likely get you a lot of responses from the east coast and not much from the west coast. Again, not sure if that matters, but I thought I'd mention it! Thanks and I look forward to checking out your HITs (if I'm online at that time!).
Same here. I'll be waking up later than that but I hope to get to get that batch at a later time, because I won't be available until 3 pm est :/
You do need a qualification and I believe all you need to do is request it. The qualification is performance based however, so your qualification score fluctuates with your hit performance. I think. If your qualification score drops below a certain number, you lose it. https://www.mturk.com/mturk/searchb...rchWords=ycharts&minReward=0.00&x=-1218&y=-89
drr91075: You're very welcome. I hope you enjoy the HITs! Rochelle, nanaki254: Thanks for bringing this up. This first batch will be created at around 10:30AM EST, but since the system isn't fully integrated yet and I'm creating these batches manually I have more control over the time. I'll see if I can push it back a bit for next week. In the long run it'll vary with each batch type since different economic indicator reports are released at different times. Unfortunately, for reasons beyond our control, these reports tend to be released between 8:30am EST and 10:00am EST. So once the system is fully established, you can expect HIT batches to be released at around those times. I know it's early and I apologize for that. BigginZ: lashonda's got it. There's a qualification you have to request called the YCharts Quality Score, and it'll be awarded to you immediately. If you want to request it early you can, but don't request the other ones. Our HIT system will give those to you automatically after you complete your first HIT. There will be a "Request Qualification" button on our HIT batch once we post it.
riyazalikhan, Presaw0870, svmcgee: I don't think so. The only consequence I can think of is that you won't get a welcome email. Don't request the qualifications that say "DO NOT REQUEST THIS QUALIFICATION" in the description. If you do you won't get a friendly welcome email! I would've put that in the name but I'd have to delete the qualification to do that which wouldn't be fair to those who had done some of the super early/broken tests.
Only Welcome Email is not an issue, requester's like Medcrowd, other will send a sandbox mail and normal mail when there is a batch going to be upload, Is this that kind of?