Page 1 of 9 1 2 3 ... LastLast
Results 1 to 10 of 89

Thread: Jon Brelig HIT's HELP THREAD!

  1. #1
    User
    Join Date
    Jun 2009
    Posts
    523
    Thanks
    46
    Thanked 106 Times in 68 Posts

    Default Jon Brelig HIT's HELP THREAD!

    Any questions you have about Jon Brelig's write them here and they shall be answered!

  2. #2
    User
    Join Date
    Sep 2012
    Posts
    10
    Thanks
    0
    Thanked 2 Times in 1 Post

    Default

    Hello! I work for the requester and we want to answer your questions and listen to your suggestions to make your work experience and our results better!
    I do not need to know who you are and nothing said here will have any impact on your ability to do our HIT's. All I ask is to keep this forum civil. Thank you!

  3. #3
    User petegq's Avatar
    Join Date
    May 2012
    Location
    Queens, New York
    Posts
    305
    Thanks
    71
    Thanked 51 Times in 18 Posts

    Default

    I got my first rejection in months from this requester, for a 0.02 hit this is what the hit said.

    Jon Brelig Extract store from receipt $0.02 Rejected blurry

    I sent an email asking what is blurry and got no response whatsoever.

  4. #4
    User
    Join Date
    Jun 2009
    Posts
    523
    Thanks
    46
    Thanked 106 Times in 68 Posts

    Default

    Here is what she replied to us earlier:

    In the HIT task where we ask for the "banner" this is step one. When we ask in this HIT if the receipt "is legible", we mean the WHOLE receipt, not just the store name and total! This is what seems to be misunderstood. If the store name and total can be seen but the rest of the receipt is not able to be read, then the next HIT worker cannot do their job properly. This is why we now reject for blurry in the banner ID step, too many of the receipts going out were not being transcribed correctly in the next step.

  5. #5
    User petegq's Avatar
    Join Date
    May 2012
    Location
    Queens, New York
    Posts
    305
    Thanks
    71
    Thanked 51 Times in 18 Posts

    Default

    Quote Originally Posted by trueakitalover View Post
    Here is what she replied to us earlier:

    In the HIT task where we ask for the "banner" this is step one. When we ask in this HIT if the receipt "is legible", we mean the WHOLE receipt, not just the store name and total! This is what seems to be misunderstood. If the store name and total can be seen but the rest of the receipt is not able to be read, then the next HIT worker cannot do their job properly. This is why we now reject for blurry in the banner ID step, too many of the receipts going out were not being transcribed correctly in the next step.
    Oh wow well next time I'll.... oh wait there won't be one.

  6. Thanks: (3)
  7. #6
    User
    Join Date
    Jun 2009
    Posts
    523
    Thanks
    46
    Thanked 106 Times in 68 Posts

    Default

    Question for you Celeste have you guys considered making a qualification for your HITS? If not I think you should that way you will weed out the good vs the bad workers. Most of the time mine are mistypes or I am typing faster than I realize.

    I know of a problem that is happening, when we are typing in the name of the store on the 0.02 HITS if we type it automatically is selecting certain stores. One example is when I do Walmart it does the Walmart Neighborhood Stores. If I am typing fast enough I am not paying attention to a drop down box. I am just trying to get it submitted as fast as possible.

    Is there a way a comment box can be added to the HITS so we can leave an explanation as to why we may have skipped a part of a receipt. Like I started a HIT yesterday and the receipt was folded right on the numbers and I couldn't read it, so I returned it instead of trying to get a rejection. Sometimes the folding of the receipts is harder to transcribe.

  8. Thanks: (1)
  9. #7
    User
    Join Date
    Sep 2012
    Posts
    10
    Thanks
    0
    Thanked 2 Times in 1 Post

    Default

    I am very sorry to hear that you were not answered. I was only recently given the task of improving our MTurk program. Not an excuse, but we are doing the best we can, we have grown faster than we expected and it is difficult to answer every email every time. We do plan to improve the entire MTurk process we have over the next few months, I hope you will bear with us. The amount of back end programming is enormous and takes 100's-1000's of man hours to make the supporting programs that we require. We cannot implement changes overnight as much as we would like to.

    Unfortunately blurry/illegible is a very difficult issue. What is blurry to me or you, is probably not the same. We are trying to find a workable solution.

    Celeste


    Quote Originally Posted by petegq View Post
    I got my first rejection in months from this requester, for a 0.02 hit this is what the hit said.

    Jon Brelig Extract store from receipt $0.02 Rejected blurry

    I sent an email asking what is blurry and got no response whatsoever.

  10. #8
    User
    Join Date
    Sep 2012
    Posts
    10
    Thanks
    0
    Thanked 2 Times in 1 Post

    Default

    (I will answer the questions separately) I did answer this but it seems to have gone to that black cyberspace hole so here goes again.

    Yes we have considered limiting out HIT's to more qualified workers and we are probably going to do that once we are finished the reorganization task. I am not fond of the idea for the simple reason there are always new workers that find MTurk and cannot find good HIT's to build up their credibility, if we become another "pre-qualified only" requester, we will only add to that. But from the POV of the requester, it is a natural wish to want the best/better workers.

    Can those of you that have done more than a few HIT's recommend a limit we should consider, are there limit categories set by Amazon, or do we have to pick a # from a hat? I apologize I do not know the MTurk system that well and I am not a programmer!

    Celeste

    [QUOTE=trueakitalover;29909]Question for you Celeste have you guys considered making a qualification for your HITS? If not I think you should that way you will weed out the good vs the bad workers. Most of the time mine are mistypes or I am typing faster than I realize.

  11. Thanks: (2)
  12. #9
    User
    Join Date
    Sep 2012
    Posts
    10
    Thanks
    0
    Thanked 2 Times in 1 Post

    Default

    I hate auto-fill and auto-correct and I try to disable it as much as I can. But it is not always possible.

    On the name of the store HIT, we need to have the store name about as perfect as you can get it because that will determine where the receipt will go next by the system. All stores are broken up into further HIT task categories from this point once your HIT is approved.

    This is why we will reject if the name is misspelled by even one letter. The computer cannot assign it to the next task and it will circle this HIT task bin till it gets done right, we cannot change that.

    Common mistakes in the store names HIT: Welcome to X named store, Xnamed store.com, misspelling and more. We need the simple name of the store only, spelled correctly.

    Of course many receipts are nightmares to figure out what the store name is, some are missing the name anywhere on the receipt (which means you must write "Not full receipt"), etc.

    In this HIT task, what we really need to explain better is what is legible and what is not meaning. I think it is an easy thing to misunderstand and is on the top of my list to change. When we ask in this task if it is legible, we mean the whole receipt, not just the store name and total. If you cannot read the items, their prices and UPC codes (if they are present) well enough to transcribe them in the next HIT, mark it as "not legible" in this one.

    If the store name and total are missing, mark it as "not full receipt". Also if a good sized chunk is missing from the items section, there is a stain, stamp, shadow or anything making it not possible to see the items (at least the majority of them), then mark it as either not full or blurry. This will stop the receipt from going further in the process. So when you see horrible receipts in the next HIT tasks that you are "lucky" enough to get, it is because it was not stopped at this stage.

    We have hundreds of receipts coming in daily, you can imagine how many MTurks we have working on them besides yourselves. Some receipts will get through that should not, we are just trying to keep that "some" to a minimum for all of our sakes. No one wants to strain their eyes and waste time on difficult receipts.

    Celeste
    _______________________________________
    I know of a problem that is happening, when we are typing in the name of the store on the 0.02 HITS if we type it automatically is selecting certain stores. One example is when I do Walmart it does the Walmart Neighborhood Stores. If I am typing fast enough I am not paying attention to a drop down box. I am just trying to get it submitted as fast as possible.

  13. #10
    User
    Join Date
    Sep 2012
    Posts
    10
    Thanks
    0
    Thanked 2 Times in 1 Post

    Default

    I will add this to the wish list and see if it is possible to make one, I think it could be helpful for both sides.

    Always look to see if the receipt is full and legible before you work on it. I always look at the total first, if that is not exactly correct, I must reject so there is no point of me looking at anything else you have done. I feel very bad when I have to reject for a simple total transposition of numbers error, I don't like it, I feel bad, I know you don't get paid if I reject and you also get an increase in your rejection rate. But our duplicate task (which is the last HIT task for us) relies on the correct total as part of the selection process. This is why we now must reject for incorrect total so please be sure it is right most of all.

    What is frustrating in the totals is the many stores have many words for total, many places to put it and so on. It is hard for me to find the right total sometimes too.

    Celeste
    ________________________________________
    Is there a way a comment box can be added to the HITS so we can leave an explanation as to why we may have skipped a part of a receipt. Like I started a HIT yesterday and the receipt was folded right on the numbers and I couldn't read it, so I returned it instead of trying to get a rejection. Sometimes the folding of the receipts is harder to transcribe.

Page 1 of 9 1 2 3 ... LastLast

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •