Hello all, I am not 100% positive but surely a fair number of you in this forum work for or have done work for me and my company in the past under my requester name Kevin Dodds. One of the main campaigns that we run every single month, right now you might know it as "URL Search 2014", is in jeopardy of going away because quality has fallen off slightly. The biggest problem we are having is that workers are finding companies with the same name but the wrong location to be the company that we are looking to find the URL for. It happens, there are simply a lot of companies in the U.S. that have the exact same name -- even very specific ones, not just AAA Glass. However, there are too many entries for companies that are in completely different states and this is upsetting to our client... Right now I am running the campaign called "URL correctness 2014". In this campaign, we are reviewing URLs that have been found to ensure that they are in fact for the correct company -- same city and state, or at least the same state. If they are in a completely different state altogether, it cannot be the correct URL. If you can't find an address on the site, but can find a phone number, do a Google search against the area code to find the location of the business. If you can do EXCELLENT work on the "URL correctness 2014" campaign runs, we can salvage this project. It is very, very important. I'm also obviously looking for feedback for ways we can improve the results that are gathered. There are going to have to be changes other than just Gold answers to ensure quality. Thanks to everyone, Kevin
Hi Kevin, it's Barb! I keep forgetting to tell you that one thing that would be really helpful is if your feedback form worked. It would save having to message you every time something is questionable. The problem is, that for .05 most workers aren't going to spend 2 or 3 minutes verifying that they have the correct information. I don't mind taking the extra time late at night or on a slow weekend but if I can make .20-.30 in the same amount of time that I earn .05 from you then I have to work on the other HITs. We are all here to earn money and time is money. I have noticed that some of your HITs have a special qualification. Do those workers give you more predictable results? If they do then maybe you will have to make all of your HITs qualification HITs only (but only if you give me the qualification )
Hi, Barb -- since the URL search project is our main campaign and it is tracked very closely by accuracy against known answers, I trust all of the workers that have high accuracy on that campaign and make the qualification "Company URL LOCATION qualification" for most of our campaigns. However, I need to vary things from time to time, to get different sets of eyes. In general, the qualifications are very consistent -- just a score of 90 or more on the URL location. I always try to pay as much as I possibly can and will hopefully be in a position to offer greater compensation for this effort in the future. Right now, all of this is overbudget and an attempt to maintain a healthy relationship with out client.
I know that money is always a consideration. We all need to make as much as we can, including you AND your client. It's never easy! Thanks for coming here and communicating with us. It's always appreciated!!
one day, i hope to reach the glorious nirvana of 50k approved hits, and i will dazzle you with my accuracy. Seriously though, hope it works out, i understand you're a great, steady requestor for a lot of folks who can do them, hope this works out so you're still around when i get there.
Kevin, the one thing that I'm still not clear on is when the address is totally wrong. The state is correct but the city isn't even close. Do we mark it Correct/Absolute Certainty?
That would depend on the specificity of the company name. If it's a fairly general company name in a big state, like AAA Plumbing in California, it's likely not correct. If it's fairly specific, like Hollis and Torrance Engineering and Design Firm and the city is not the same, but it's in Wisconsin, it's just got to be the same company, they've likely simply moved. Also, maybe check to see if there is any kind of listing at all for the company in the actual city in question. Thanks!
Okay, that makes sense. My other concern is when the form has the incorrect state abbreviation. Some of them sort of make sense, like IO for Iowa. I mark them correct because everything else is right but I'm concerned that you might not notice and then lower my approval rating.
Hopefully contacting you through this will net more results than emailing you through mturk. I am qualified for your HITs, and I have accepted a few of them over the past several days. Each of them allows to me see the HIT until I accept it. It then gives me the same message, "Template is not defined for the task." I have tried Chrome, Explorer, and Firefox. None of them work. Can you or someone else please tell me what I can do to work on these?
Hello all: The vendor had major issues over the past few days. The campaign is up and running successfully now.
Frankly, you're not paying enough for accuracy. If you are paying 5 cents, that HIT needs to be no more than 30 seconds. A "Hit Worth Turking for" (HWTF) is 10 cents *per minute*.
While this is a good guideline, this is by no means the standard opinion held by all turkers. I personally don't mind doing lower-paid hits if it's for a requester with a good amount of work that's not too difficult. The higher the quals you require, the higher the hit should pay, just like the more work the more pay, obviously. However, I think discounting a hit just because it's not $0.10/min is foolish. As for these hits, I haven't seen them, because apparently they're 50k and I'm only at 10k. Hopefully you can find out how to salvage your data.