Numerous Suggestions to Improve Mturk.

[mturkuser999]

This is all from the worker side of things:

- Allow workers to rate a requester after work was performed, and briefly describe why the rating was justified (optional). This is similar to Ebay feedback.

- I would like to see the total amount of funds I potentially made based on all my hits. Right now it only shows the amount based on the approved work, but I would like to see the total amount with "pending" work included.

- Categorizing the type of HIT jobs. For those, for example, only want to do transcription work, they would click the transcription filter so see all related work.

- At least allow workers to sort the HITs they have completed, so it would be easier to find a specific requester by name. For example, I don't want to fill out a survey twice so I look up in my list of HITs I've completed, sort requester names and check if I already did the survey by associating the survey by requester name.

- Allow the option for requesters to reverse rejected work in the case where they or their system has made an error and they manually reviewed work submitted to be correct.

- Have it work where once a HIT has been complete and submitted, the listing goes back to what page you were previously on. Currently, when you submit a complete HIT, the listing will GO BACK to page 1, forcing you to click constantly to go back to, for example, page 17, where you were scanning for HITs.

- Allow user to input page number that way if i wanted to jump to page 43, I would enter the page number into the input field, and it would jump to that page. Right now, you would need to click pages in increments in 2, because there is no better way to jump through pages, except jumping from first to last page, which isn't very helpful...

- Create a mechanism where workers can review their past work. That way, when a requester rejects work and gives a reason, we can go back and review our work and agree or dispute it.

Will update more as they come to mind...

[riazthemturkhelper]

You suggestions are very nice. Do you have send them to the Mturk Team??? if not please send let us see they will approve them...

[Danthony]

This is all from the worker side of things:

- Allow workers to rate a requester after work was performed, and briefly describe why the rating was justified (optional). This is similar to Ebay feedback.
Turkopticon
http://turkopticon.differenceengines.com/login

- I would like to see the total amount of funds I potentially made based on all my hits. Right now it only shows the amount based on the approved work, but I would like to see the total amount with "pending" work included.
Get the Pending money script
http://userscripts.org/scripts/show/111134

- Categorizing the type of HIT jobs. For those, for example, only want to do transcription work, they would click the transcription filter so see all related work.
Good one

- At least allow workers to sort the HITs they have completed, so it would be easier to find a specific requester by name. For example, I don't want to fill out a survey twice so I look up in my list of HITs I've completed, sort requester names and check if I already did the survey by associating the survey by requester name.
Good one

- Allow the option for requesters to reverse rejected work in the case where they or their system has made an error and they manually reviewed work submitted to be correct.
I think they actually can. They just dont

- Have it work where once a HIT has been complete and submitted, the listing goes back to what page you were previously on. Currently, when you submit a complete HIT, the listing will GO BACK to page 1, forcing you to click constantly to go back to, for example, page 17, where you were scanning for HITs.
Open the hit in another "tab" on your browser

- Allow user to input page number that way if i wanted to jump to page 43, I would enter the page number into the input field, and it would jump to that page. Right now, you would need to click pages in increments in 2, because there is no better way to jump through pages, except jumping from first to last page, which isn't very helpful...
Good one

- Create a mechanism where workers can review their past work. That way, when a requester rejects work and gives a reason, we can go back and review our work and agree or dispute it.

Will update more as they come to mind...
You can always get the contact info from a Requester who rejects your work by clicking on their name

Hope that helps you out. Good ideas

[riazthemturkhelper]

"- Allow the option for requesters to reverse rejected work in the case where they or their system has made an error and they manually reviewed work submitted to be correct.
I think they actually can. They just dont"

I highly recommend this

[chuck_h]

While I was waiting for my latest (and last) batch of HITs for Sebastian Darr to be processed, I also sent an E-mail to mturk support asking them if there was a dispute resolution process, and it was confirmed in that E-mail that requesters can reverse rejections, which I take to mean they can send a HIT back to you to have you correct it.

Specifically, the E-mail, from Isaac M., said "Please note Requesters can reverse rejections if you can correct the problem that cause[sic] the rejection."

While I was waiting for Sebastian Darr to review the HITs I'd done for him, another thing that sprang to my mind that would be a useful addition to the MTurk service would be the ability to withdraw submitted HITs.

After Sebastian Darr rejected 7 of the 11 hits I'd done, I really, really wanted to just yank the rest of the HITs I'd done for him out of the queue because I knew at that point that his approval process was badly broken and I didn't want my approval rate to take the hit (so to speak).

The last thing that the whole Sebastian Darr "experience" (I desperately want to use a colorful vulgarism here) has made me wish for is for Amazon to put some sort of dispute resolution process in place when workers disagree with the evaluation of requesters. However, I doubt this last will be put into place, as it'd probably cost Amazon money and developer time and create headaches they're unwilling to deal with.

[angelface83]

I use that turkopticon and do not use anyone who isn't rated well. FABULOUS tool. As when I first started doing Mturk when it first started- I got a BUNCH of unwarranted rejections that screwed my percentages because I did a bunch of little ones. Then, there was no way to contact anyone about it or dispute it.
Turkopticon is freaking fabulous. Mturk should have a link to it for people who do not know and can get get rejected by jackholes who try to get people to work for them for free.

[angelface83]

That would be great too! I have had hits submitted accidentally before as well and that would be useful. Especially if someone submits a transcription before they're finished editing etc- That would be a great tool- Or click to edit it more etc if no one is in the process of reviewing the HIT yet.