Page 1 of 2 1 2 LastLast
Results 1 to 10 of 11

Thread: Hello from new requester: Mosaic

  1. #1
    User
    Join Date
    Sep 2015
    Posts
    21
    Thanks
    0
    Thanked 22 Times in 11 Posts

    Lightbulb Hello from new requester: Mosaic

    Hi everyone,

    New to mturk forum and wanted to introduce myself. We ran a few hit batches today (ID A13O1IUYSLY5M4), so if you participated, thanks a bunch. We will be doing a few thousand more over the next few days.

    Im part of a team of three ("mosaic") that is focusing on large volume receipt transcription for now, but were ramping up to a number of different tasks in the coming weeks and months.

    Wed love tips on how to best recruit as well as on how to design for speed. Already we've gotten great feedback on design, so tomorrow we're spending a few hours improving our approach.

    Ive enjoyed reading the forums and have learned a great deal there and through feedback on our initial hits. Thoughtful stuff and very helpful for someone who wants to streamline and properly craft the worker experience.

    Thanks for reading.

  2. Thanks: (2)
  3. #2
    User
    Join Date
    Sep 2015
    Posts
    21
    Thanks
    0
    Thanked 22 Times in 11 Posts

    Default

    Here is a live hit batch: https://www.mturk.com/mturk/preview?...C1OMGLXJ0QN9LN.

    I'd welcome any feedback. Thanks!

  4. #3
    probably eating
    Monica's Avatar
    Join Date
    Jan 2014
    Location
    INDY
    Posts
    9,568
    Thanks
    32,016
    Thanked 22,424 Times in 7,227 Posts

    Default

    Hi mosaic,

    Thanks for coming to our forum. There's a few things that were pointed out when this was posted on the main hits thread, and I'm not sure if you had caught them (it can move quickly).

    First, it seems like these pay appropriately for the amount of work that needs to be put into it. People had expressed that while they don't normally do receipt population tasks they were willing to do yours since it compensated well. Also, I had suggested that there be a function for us workers to rotate the image, in the case that it's oriented wrong. Another worker piggy backed off of that suggestion and said that she felt it would also be helpful if there was a way to zoom in on receipts also, since sometimes they are very small and hard to read.

    There was also a bit of concern over the message after completing the four tasks: "Thank you for working on our HITs! Unfortunately, all of the remaining HITs in this project have been reserved for other workers, and there are none left for you to do. Please check again later for more HITs to be available. We are new to the Mechanical Turk, and we appreciate your feedback. Please e-mail us with any thoughts. We hope you consider mentioning us on Turkopticon and elsewhere in the Turker community". This gives the impression that the work that had already been completed might not be accepted.

    I didn't see anything else personally, but I'm sure more workers will be willing to try your hit out and give feedback as they gain more popularity. It's always very refreshing to see a requester who's open to suggestions from their workers. Feel free to shoot me a PM if you have any more questions


    If I wanted to kill myself, I would jump from your ego to your IQ.

  5. #4
    User
    Join Date
    Sep 2015
    Posts
    21
    Thanks
    0
    Thanked 22 Times in 11 Posts

    Default

    @Monica, Thanks for this feedback. The four task limit is only for our "testing/development" phase, and then workers will be able to do them for a long period of time. We're working out the kinks and are ramping up to a qualification task and then more regular batches.

    Speaking of which:

    We're doing another batch at 3:00pm EST (~30 minutes from now). It'll be 2,400 receipts x 4 labels (business, date, total, currency).

    As mentioned above, since we're still in "testing/development" mode, you won't be able to do the task for an extended period of time, but we're working hard to get to that point.

    Also, we'll have a qualification task mid-day tomorrow (Thursday), with details to follow soon.

  6. Thanks: (2)
  7. #5
    probably eating
    Monica's Avatar
    Join Date
    Jan 2014
    Location
    INDY
    Posts
    9,568
    Thanks
    32,016
    Thanked 22,424 Times in 7,227 Posts

    Default

    Quote Originally Posted by mosaic View Post
    @Monica, Thanks for this feedback. The four task limit is only for our "testing/development" phase, and then workers will be able to do them for a long period of time. We're working out the kinks and are ramping up to a qualification task and then more regular batches.

    Speaking of which:

    We're doing another batch at 3:00pm EST (~30 minutes from now). It'll be 2,400 receipts x 4 labels (business, date, total, currency).

    As mentioned above, since we're still in "testing/development" mode, you won't be able to do the task for an extended period of time, but we're working hard to get to that point.

    Also, we'll have a qualification task mid-day tomorrow (Thursday), with details to follow soon.
    Oh, ok. So as I understand it now - the message at the end is referring to the receipt tasks being completed in the HIT and not the hit itself? I think that the message is a bit confusing, but put in that context makes much more sense.

    I'm very interested in the qualification task tomorrow - thank you for letting us know. It seems like something to look forward to. I really appreciate your feedback and I'm excited to see how this plays out for you. I'll likely be sending you a private message to talk about the qualification more in depth if you don't mind

    Thanks!


    If I wanted to kill myself, I would jump from your ego to your IQ.

  8. #6
    User
    Join Date
    Sep 2015
    Posts
    21
    Thanks
    0
    Thanked 22 Times in 11 Posts

    Default

    Hi everyone, we're almost there on this round of quals. Here is a PDF writeup with some preliminary results, with more to follow in the next few hours: http://bit.ly/1G4L5r9.

  9. #7
    User
    Join Date
    Sep 2015
    Posts
    21
    Thanks
    0
    Thanked 22 Times in 11 Posts

    Default

    Here are qual stats: http://bit.ly/1Vd4vRv. Enjoy!

  10. Thanks: (1)
  11. #8
    User
    Join Date
    Sep 2015
    Posts
    21
    Thanks
    0
    Thanked 22 Times in 11 Posts

    Default

    Hi everyone, just sent the first Mosaic weekly hits email.

    Our goal is to put our plans in one place, and make it into a place where you can easily see stats and know what to expect. The list includes qualified individuals as well as individuals who are not yet qualified, and anyone who wants to be involved in any tier of hits. Here is a link to subscribe if you haven't already! As always, email if you have any questions.

  12. Thanks: (1)
  13. #9
    User
    Join Date
    Sep 2015
    Posts
    21
    Thanks
    0
    Thanked 22 Times in 11 Posts

    Default

    Hi everyone, we are emerging from a few weeks of engineering work... we've been heads down on building up some behind the scenes parts of the system, which is fun because it's getting better little by little, but is tough because it hasn't left us with any time to communicate. We're also hiring on our team, which will help us do even more.

    I wanted to mention that this week we're starting to ADD new hit types. We're testing a batch of 10,000 images in a few minutes (before 8pm ET on Tuesday), so please look out for that and let us know what you think!

    The interface is actually not the very most recent, but I got impatient and didn't want to wait for the newest version to be merged in... it'll be even slicker soon, but for now, enjoy!!

  14. #10
    User
    Join Date
    Sep 2015
    Posts
    21
    Thanks
    0
    Thanked 22 Times in 11 Posts

    Default

    Hey everyone, we're trying something similar to what we did last night but with more hits. Last night you were capped at 50 images per worker, and today the cap is 2,000. Let us know what you think.

    We're posting 20,000 images in about 10 minutes, so spread the word.

    We are just looking for whether there is a person visible on foot.

Page 1 of 2 1 2 LastLast

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •