Want to earn a quick $5? Send me a PM - TurkingBear
Page 1 of 13 1 2 3 11 ... LastLast
Results 1 to 10 of 124

Thread: MTurk HIT DataBase (replaces MTurk Extended HIT Search)

  1. #1
    User ThirdClassIntMasterTurker's Avatar
    Join Date
    Sep 2012
    Posts
    86
    Thanks
    0
    Thanked 79 Times in 25 Posts

    Default MTurk HIT DataBase (replaces MTurk Extended HIT Search)

    This is rewrite of MTurk Extended HIT Search with some extra features. It now uses IndexedDB (http://en.wikipedia.org/wiki/Indexed_Database_API) to store the HITs.

    It also implements some ideas from 'HIT history Check'-thread that use of IndexedDB made possible. See screenshots on userscripts page: MTurk HIT DataBase (http://userscripts.org/scripts/show/149548).

    Other new features: pending/projected earnings (with progress bar), CSV export/import, requester notes and requester blocking (you can block specific HITs).

    Current version is: 1.2 (2012-12-11)

    Works on Firefox and latest Chrome (tested on 23.0.1271.64)
    Last edited by ThirdClassIntMasterTurker; 12-11-2012 at 12:54 PM. Reason: added current version

  2. Thanks: (1)
  3. #2
    User TurkworkOrange's Avatar
    Join Date
    Sep 2012
    Posts
    434
    Thanks
    213
    Thanked 503 Times in 147 Posts

    Default

    Hi ThirdClassIntMasterTurker, so I've just loaded this up this week and I like the potential of it, but had a quick question about the initial load in of information. When I first update the database do I have to go to each individual day? The output I'm looking at has a lot of my previous requesters, but also is definitely missing a bunch. Out of roughly 1,000 HITs done, it's pulling info for about 390. How do I make sure it grabs everything?
    Thanks!

  4. #3
    User Moutheater's Avatar
    Join Date
    Sep 2012
    Location
    California is Mind and Soul, Texas in Reality
    Posts
    1,452
    Thanks
    2
    Thanked 27 Times in 10 Posts

    Default

    Quote Originally Posted by TurkworkOrange View Post
    Hi ThirdClassIntMasterTurker, so I've just loaded this up this week and I like the potential of it, but had a quick question about the initial load in of information. When I first update the database do I have to go to each individual day? The output I'm looking at has a lot of my previous requesters, but also is definitely missing a bunch. Out of roughly 1,000 HITs done, it's pulling info for about 390. How do I make sure it grabs everything?
    Thanks!
    I'd also like to know this please.

    PM ME with any issues or questons!
    Will Turk for Food.

  5. #4
    User naturegirl's Avatar
    Join Date
    Aug 2012
    Location
    US
    Posts
    701
    Thanks
    186
    Thanked 136 Times in 96 Posts

    Default

    It's actually not working for me at all in Chrome. The monkeys say they are working, but no data is pulled. Darned simians!

    Also, it apparently played havoc with the auto-approval script. I finally had to disable it and will probably go back to the Extended HIT Search script (not sure right now whether that's the official name) that I was using before. Loved that.

  6. #5
    User ThirdClassIntMasterTurker's Avatar
    Join Date
    Sep 2012
    Posts
    86
    Thanks
    0
    Thanked 79 Times in 25 Posts

    Default

    Quote Originally Posted by TurkworkOrange View Post
    Hi ThirdClassIntMasterTurker, so I've just loaded this up this week and I like the potential of it, but had a quick question about the initial load in of information. When I first update the database do I have to go to each individual day?
    You don't need to go to individual days. At first update it should get all the data that is available from amazon. That is last 45 Days. After that it only refetches status pages that have changed. You still have to update it manually every now and then, it doesn't get new HITs automatically.

    Quote Originally Posted by TurkworkOrange View Post
    The output I'm looking at has a lot of my previous requesters, but also is definitely missing a bunch. Out of roughly 1,000 HITs done, it's pulling info for about 390. How do I make sure it grabs everything?
    Thanks!
    Have you done more than 390 HITs within last 45 days?
    You can find that from bottom of the submitted column on your status page (https://www.mturk.com/mturk/status). Thats the number of HITs there should be in DB after first update. Requester Overview button should then list all the requesters and show how many HITs there are in DB.

  7. #6
    User ThirdClassIntMasterTurker's Avatar
    Join Date
    Sep 2012
    Posts
    86
    Thanks
    0
    Thanked 79 Times in 25 Posts

    Default

    Quote Originally Posted by naturegirl View Post
    It's actually not working for me at all in Chrome. The monkeys say they are working, but no data is pulled. Darned simians!
    It works on chrome 23 beta. That I have tested. I hope they get it stable soon.

    Quote Originally Posted by naturegirl View Post
    Also, it apparently played havoc with the auto-approval script. I finally had to disable it and will probably go back to the Extended HIT Search script (not sure right now whether that's the official name) that I was using before. Loved that.
    Sometimes it helps if you change the running order of scripts. But of course it they both want to change same part of the page that doesn't help.

    Yes, Extended HIT Search is earlier version. I made this MTurk HIT DataBase as a separate script because current chrome still have problems with it. You can keep using earlier version and try HIT DataBase again later.

    But DataBase version is definitely the better one. It saves all HITs and should be more scalable. Extended HIT Search just searches last 45 days, HIT DataBase potentially all the HITs you have ever done!

  8. #7
    User naturegirl's Avatar
    Join Date
    Aug 2012
    Location
    US
    Posts
    701
    Thanks
    186
    Thanked 136 Times in 96 Posts

    Default

    Quote Originally Posted by ThirdClassIntMasterTurker View Post
    It works on chrome 23 beta. That I have tested. I hope they get it stable soon.


    Sometimes it helps if you change the running order of scripts. But of course it they both want to change same part of the page that doesn't help.

    Yes, Extended HIT Search is earlier version. I made this MTurk HIT DataBase as a separate script because current chrome still have problems with it. You can keep using earlier version and try HIT DataBase again later.

    But DataBase version is definitely the better one. It saves all HITs and should be more scalable. Extended HIT Search just searches last 45 days, HIT DataBase potentially all the HITs you have ever done!
    Thank you. You're always so helpful!

    I think I just finished my first 45 days (like, I'm on day 46 or 47), so that means that days 1 and 2 are forever lost to me, right, because HIT DataBase is not working and Extended HIT Search can no longer pull it?

    In other words, am I correct that if you don't start using HIT DataBase in your first 45 days, you will never be able to get the data that is any earlier than 45 days before the day that you started using it?

  9. #8
    User ThirdClassIntMasterTurker's Avatar
    Join Date
    Sep 2012
    Posts
    86
    Thanks
    0
    Thanked 79 Times in 25 Posts

    Default

    Quote Originally Posted by naturegirl View Post
    I think I just finished my first 45 days (like, I'm on day 46 or 47), so that means that days 1 and 2 are forever lost to me, right, because HIT DataBase is not working and Extended HIT Search can no longer pull it?

    In other words, am I correct that if you don't start using HIT DataBase in your first 45 days, you will never be able to get the data that is any earlier than 45 days before the day that you started using it?
    Well, Extended HIT Search doesn't currently remove any data so technically extra days are still there in its cache. And there will (almost certainly) be import function in MTurk HIT DataBase that gets old Extended HIT Search data and puts it in the new database.

    But yes, mturk only shows last 45 days. It used to be only 30 days if I remember correctly.

    If you want to make sure that you have almost all HIT data available in some form. You could temporarily install Firefox and HIT DataBase and then export HITs in CSV-format. Or just manually copy them to spredsheet from Extended HIT Search.

  10. #9
    User TurkworkOrange's Avatar
    Join Date
    Sep 2012
    Posts
    434
    Thanks
    213
    Thanked 503 Times in 147 Posts

    Default

    Quote Originally Posted by ThirdClassIntMasterTurker View Post
    Have you done more than 390 HITs within last 45 days?
    Yes, definitely. My status reports 1056 approved HITs, but the database only has 425. I am only just out of 45 days doing it. When I first did the update yesterday it took a couple minutes and then I did a couple updates during the day.
    It's useful in that it's a quick visual way to see recent ones I've done and that's basically what I wanted. I'm just not sure why it's not picking up the majority of HITs, so still leaves me questioning if I've done certain HITs before or not.

  11. #10
    User naturegirl's Avatar
    Join Date
    Aug 2012
    Location
    US
    Posts
    701
    Thanks
    186
    Thanked 136 Times in 96 Posts

    Default

    Quote Originally Posted by ThirdClassIntMasterTurker View Post
    If you want to make sure that you have almost all HIT data available in some form. You could temporarily install Firefox and HIT DataBase and then export HITs in CSV-format. Or just manually copy them to spredsheet from Extended HIT Search.
    Thank you! Unfortunately, I clean my cache out all the time, so I guess maybe that's why my monkeys are always working so hard...sounds like my first few days are lost, then. I'll see what I can do from here!

Page 1 of 13 1 2 3 11 ... LastLast

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •