Want to earn a quick $5? Send me a PM - Cowfin
Page 1 of 4 1 2 3 ... LastLast
Results 1 to 10 of 36

Thread: CrowdFlower

  1. #1
    Verified Requester
    Join Date
    Feb 2013
    Posts
    13
    Thanks
    20
    Thanked 43 Times in 11 Posts

    Default CrowdFlower

    Hello Everyone!

    I wanted to introduce myself (and CrowdFlower) to all the wonderful Turkers on the mTurk Forum. It's been a long time coming. CrowdFlower has been absent from Turk forums in the past due to our wanting to respect the users of those sites. We of course have wanted to give ourselves a voice, but felt like we might better serve your community by remaining absent. But recent communication I've had with liladybugz26 (and most recently with with RWStein) convinced me that it would be a good idea to provide a voice to CrowdFlower and allow Turkers the chance to engage with us in this venue. I hope that our conversations can be as helpful and constructive as possible. We'll still manage our support task support via our support forum at GetSatisfaction, but hope to be as engaged in this forum as possible.

    CrowdFlower is always trying to make improvements to the experience of our Contributors. Unfortunately, as a small company with limited resources it can often take a frustratingly long time for those improvements to be realized. But we do have some exciting things coming down the line.

    1) We're nearly finished with a complete redesign of our Contributor Task interface. We think the changes there will make the tasking experience much more intuitive and enjoyable. We've even been using Contributors during the entire development process, isolating a small group of folks to test and provide feedback on every feature before it gets released.

    2) We're close to having new skills tests available to Contributors via their Contributor Dashboard. These tests will be used to identify our most skilled members and provide them exclusive access to higher paying tasks. These skill tests will also hopefully allow Contributors the ability to more easily identify tasks that are most suited to their interests.

    3) Much like Mturk, CrowdFlower also has many requestors that use our software to create and release tasks. We know that some of these requestors have been posting some problematic tasks as of late. As a result, we're soon going to add some transparency into which tasks have been verified by CrowdFlower and those which have not reached that distinction. This will help us and the community to quickly identify any problematic requestors using our platform.

    4) We're also about to begin a complete overhaul of our Test Question QA system. Our efforts should result in a MUCH improved QA system that doesn't needlessly reject good work and will hopefully lessen the frustration you often encounter in CrowdFlower tasks. I can talk more about that in the near future.

    5) This month we plan to have our first ever Contributor Question & Answer Webinar. We want to provide a venue to answer Contributor questions directly as well as provide more transparency as to our process. If you've ever been interested in any of the ins and outs of our platform, this will be a great way to have your questions answered. If you'd like to submit a question for us to answer, please visit the link below:

    Click Here to submit a question to CrowdFlower!

    In short, we know there are issues with CrowdFlower tasks, but we really are making strides to improve the Contributor experience. And we certainly do listen to our Contributors and value all the feedback we receive.

    Thanks! And it's good to be here.

    Brian @ CrowdFlower

  2. Thanks: (23)
  3. #2
    Furca Media Andy's Avatar
    Join Date
    Jan 2009
    Location
    Santa Monica, CA
    Posts
    1,955
    Thanks
    1,160
    Thanked 3,337 Times in 791 Posts

    Default

    Welcome to MTF Brian!

    Thank you for choosing to spend some time here representing CF.

  4. Thanks: (2)
  5. #3
    User RWStein's Avatar
    Join Date
    Aug 2012
    Location
    North Carolina
    Posts
    1,816
    Thanks
    996
    Thanked 1,051 Times in 417 Posts

    Default

    Brian:

    Thanks so much for coming!

    I think this will both give you better work and relieve a lot of the tensions workers have had!

    All my appreciation!

    Rob

    Quote Originally Posted by brian_cf View Post
    Hello Everyone!

    I wanted to introduce myself (and CrowdFlower) to all the wonderful Turkers on the mTurk Forum. It's been a long time coming. CrowdFlower has been absent from Turk forums in the past due to our wanting to respect the users of those sites. We of course have wanted to give ourselves a voice, but felt like we might better serve your community by remaining absent. But recent communication I've had with liladybugz26 (and most recently with with RWStein) convinced me that it would be a good idea to provide a voice to CrowdFlower and allow Turkers the chance to engage with us in this venue. I hope that our conversations can be as helpful and constructive as possible. We'll still manage our support task support via our support forum at GetSatisfaction, but hope to be as engaged in this forum as possible.

    CrowdFlower is always trying to make improvements to the experience of our Contributors. Unfortunately, as a small company with limited resources it can often take a frustratingly long time for those improvements to be realized. But we do have some exciting things coming down the line.

    1) We're nearly finished with a complete redesign of our Contributor Task interface. We think the changes there will make the tasking experience much more intuitive and enjoyable. We've even been using Contributors during the entire development process, isolating a small group of folks to test and provide feedback on every feature before it gets released.

    2) We're close to having new skills tests available to Contributors via their Contributor Dashboard. These tests will be used to identify our most skilled members and provide them exclusive access to higher paying tasks. These skill tests will also hopefully allow Contributors the ability to more easily identify tasks that are most suited to their interests.

    3) Much like Mturk, CrowdFlower also has many requestors that use our software to create and release tasks. We know that some of these requestors have been posting some problematic tasks as of late. As a result, we're soon going to add some transparency into which tasks have been verified by CrowdFlower and those which have not reached that distinction. This will help us and the community to quickly identify any problematic requestors using our platform.

    4) We're also about to begin a complete overhaul of our Test Question QA system. Our efforts should result in a MUCH improved QA system that doesn't needlessly reject good work and will hopefully lessen the frustration you often encounter in CrowdFlower tasks. I can talk more about that in the near future.

    5) This month we plan to have our first ever Contributor Question & Answer Webinar. We want to provide a venue to answer Contributor questions directly as well as provide more transparency as to our process. If you've ever been interested in any of the ins and outs of our platform, this will be a great way to have your questions answered. If you'd like to submit a question for us to answer, please visit the link below:

    Click Here to submit a question to CrowdFlower!

    In short, we know there are issues with CrowdFlower tasks, but we really are making strides to improve the Contributor experience. And we certainly do listen to our Contributors and value all the feedback we receive.

    Thanks! And it's good to be here.

    Brian @ CrowdFlower
    "If you're not Turkin' you're not workin'!"
    Now, "Go Make That Money!"

  6. Thanks: (2)
  7. #4
    User Meg9's Avatar
    Join Date
    Nov 2012
    Posts
    245
    Thanks
    37
    Thanked 126 Times in 70 Posts

    Default

    Thanks for coming here, and thanks very much for discussing point #3. The good number of crowdflower hits I've clicked into in the last few months have been the spammy ones that violate Mturk's rules and it gets very frustrating. It is nice to hear that CF also knows that they are a problem.
    The skills tests sound like a great idea.

  8. Thanks: (2)
  9. #5
    User BeerMe's Avatar
    Join Date
    Nov 2012
    Posts
    406
    Thanks
    68
    Thanked 237 Times in 120 Posts

    Default

    Thanks for coming to the forum. I think communication between workers and requesters is a win-win for all of us and I wish more of it took place. To be honest, I've stayed away from crowdflower for a while now because I've had more bad experiences than good. My biggest headache has been accepting HITs only to be told by the crowdflower interface that there are no more HITs available and I'm forced to return it. I look forward to rediscovering your work after the redesign you talked about is implemented. You want work done, we want to do the work, let's work together and get it done.
    Last edited by BeerMe; 02-09-2013 at 01:07 AM.

  10. Thanks: (4)
  11. #6
    User
    Join Date
    Dec 2012
    Posts
    5,962
    Thanks
    5,828
    Thanked 16,148 Times in 4,429 Posts

    Default

    Woohoo! Sometimes I don't do CF HITs because I'm confused about the instructions and by the time I would receive any reply the batch would be gone already. Hopefully having you here will help clear things up a lot faster.

  12. Thanks: (2)
  13. #7
    User bobbie01's Avatar
    Join Date
    Jan 2013
    Posts
    6,548
    Thanks
    2,621
    Thanked 4,986 Times in 2,702 Posts

    Default

    Quote Originally Posted by PavelDatsyuk View Post
    Woohoo! Sometimes I don't do CF HITs because I'm confused about the instructions and by the time I would receive any reply the batch would be gone already. Hopefully having you here will help clear things up a lot faster.
    This is my concern, as well. I have written, to CF, twice. Both times I was referred to your Forum but didn't know what to do once I got there. I am really happy to "see" your presence on this Forum!!
    Welcome!

  14. Thanks: (2)
  15. #8
    User bobbie01's Avatar
    Join Date
    Jan 2013
    Posts
    6,548
    Thanks
    2,621
    Thanked 4,986 Times in 2,702 Posts

    Default

    Can you give us an insight as to why this happens? I accept a Hit for which I am qualified, do 1 Hit out of hundreds or thousands available and this is what comes up.

    Thanks for your hard work!

    You have completed all of the work that you can for this task. Please check back again in the future. We are always adding new jobs and would love to have your help.

    You can find more of our tasks by searching for "crowdflower" on Mechanical Turk.

  16. #9
    User BeerMe's Avatar
    Join Date
    Nov 2012
    Posts
    406
    Thanks
    68
    Thanked 237 Times in 120 Posts

    Default

    Quote Originally Posted by bobbie01 View Post
    Can you give us an insight as to why this happens? I accept a Hit for which I am qualified, do 1 Hit out of hundreds or thousands available and this is what comes up.

    Thanks for your hard work!

    You have completed all of the work that you can for this task. Please check back again in the future. We are always adding new jobs and would love to have your help.

    You can find more of our tasks by searching for "crowdflower" on Mechanical Turk.
    I'm less interested in explanations and more interested in solutions. Crowdflower's interface is completely separate from Mturks. Their clients create HITs in CFs interface and it then gets inputted into Mturk most times without any control or review from CF. I think this has alot to do with the problems we all experience with their HITs. I hope we all benefit from these new changes that Brian mentioned, the quality workers on Mturk are on boards like these and they want to work on Crowdflower HITs.
    Last edited by BeerMe; 02-09-2013 at 03:40 AM.

  17. Thanks: (1)
  18. #10
    User janissary's Avatar
    Join Date
    Nov 2012
    Posts
    340
    Thanks
    204
    Thanked 381 Times in 147 Posts

    Default

    Brian, thank you for taking the time out to interact with some of your workforce, it really shows your company is focused on making better efforts.

    I'm assuming this will be brought up in one of the Q&A sessions, but I recommend worker reward being high on the agenda. Many times with CrowdFlower HITs, batches in particular, the pay is far less than an acceptable minimum hourly wage, and I know this is something that can be addressed and worked on in a positive way for both parties.

    Since you yourself have clients that I'm sure specify exactly what they want to pay workers, perhaps some direct transparency with them on this issue could be tasked.

    Again, thanks Brian, and looking forward to hearing more from you.

  19. Thanks: (4)
Page 1 of 4 1 2 3 ... LastLast

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •