MTurk HIT DataBase (replaces MTurk Extended HIT Search)

Discussion in 'Scripts' started by ThirdClassIntMasterTurker, Oct 3, 2012.

  1. ThirdClassIntMasterTurker

    Joined:
    Sep 8, 2012
    Messages:
    86
    Likes Received:
    0
    Ctrl+Shift+J opens error console. Sounds like there is problem with opening indexedDB. Restarting browser may help if it is some locking problem, but if it something more serious, you may have to start new database. Thats why it's always important to keep at least one working backup available.
     
  2. talz13

    talz13 User

    Joined:
    Oct 8, 2012
    Messages:
    89
    Likes Received:
    0
    One thought, could you put an export / import feature in? I see the Import button, but that's just for importing old "MTurk Extended HIT Search" entries, right?
     
  3. pcereola

    pcereola User

    Joined:
    Oct 8, 2012
    Messages:
    954
    Likes Received:
    0
    I opened the error console and had this error:Timestamp: 12/7/2012 9:48:56 AM
    Error: NotFoundError: The operation failed because the requested database object could not be found. For example, an object store did not exist but was being opened.
    How do I start a new database?
     
  4. ThirdClassIntMasterTurker

    Joined:
    Sep 8, 2012
    Messages:
    86
    Likes Received:
    0
    Yes, I have been thinking about this. Export part is easy, it already exports most data as CSV file. And so far there hasn't been any problems exporting tens of thousands HITs. But importing is little bit harder. Maybe copy paste CVS to text area, or something like that. Not very convenient, but it would definitely be nice to have plain text backup available.

    It's definitely on my TODO list.
     
  5. ThirdClassIntMasterTurker

    Joined:
    Sep 8, 2012
    Messages:
    86
    Likes Received:
    0
    Just click Delete database, if shoud create new one when you reload the page.
     
  6. pcereola

    pcereola User

    Joined:
    Oct 8, 2012
    Messages:
    954
    Likes Received:
    0
    Ok, I deleted the database and tried to update again. That didn't work. I uninstalled and reinstalled grease monkey and the script, that didn't work either. When I press update database it says:please wait: script monkeys are preparing to start working but nothing happens. it just stays like that.
     
  7. pcereola

    pcereola User

    Joined:
    Oct 8, 2012
    Messages:
    954
    Likes Received:
    0
    I am running the script on my netbook with firefox and it is working just fine, so I am not sure what happened with this one on the desktop. I updated the script on the desktop yesterday to 1.1 but have not updated the one on the netbook. Could that have anything to do with it?
     
  8. ThirdClassIntMasterTurker

    Joined:
    Sep 8, 2012
    Messages:
    86
    Likes Received:
    0
    There shoudn't be any big changes like that in 1.1.

    But could your Firefox be in private browsing mode? That would explain why it can't open indexedDB database.
     
  9. ChrisM77

    ChrisM77 Banned

    Joined:
    Nov 30, 2012
    Messages:
    1,412
    Likes Received:
    0
    I've installed 1.1 using the latest version of chrome. It shows up on my dashboard, and even says it updates the database, but when I click on anything to view information it just opens a blank white tab.
     
  10. pcereola

    pcereola User

    Joined:
    Oct 8, 2012
    Messages:
    954
    Likes Received:
    0
    No I'm not in private browsing, for now I just disabled it and started using the extended hit search script. That seems to be working.
     
  11. ThirdClassIntMasterTurker

    Joined:
    Sep 8, 2012
    Messages:
    86
    Likes Received:
    0
    HIT DataBase 1.2

    Versio 1.2 adds import from previously exported CSV-files.

    Copying indexedDB files is still best way to create full backups, but with csv-files you should be able to move the most important HIT data to different browser.
     
  12. j0sh

    j0sh User

    Joined:
    Nov 7, 2012
    Messages:
    627
    Likes Received:
    0
    Thanks for all the hard work.

    I've been fortunate enough to use your script within my first 45 days of turking. I want to backup this database and never lose it :) You mentioned that we should back up indexedDB/https+++www.mturk.com in order to have a complete history. I am really having trouble finding this directory on my PC. I've searched through C:\Program Files (x86)\Mozilla Firefox. I have also typed in general search strings like indexedDB, Firefox, and mturk (with the option of hidden files shown) to no avail. Any suggestions where I might look?

    Again thanks for the awesome script.
     
  13. ThirdClassIntMasterTurker

    Joined:
    Sep 8, 2012
    Messages:
    86
    Likes Received:
    0
    See this page: http://support.mozilla.org/en-US/kb/back-and-restore-information-firefox-profiles how to find your profile folder.
     
  14. j0sh

    j0sh User

    Joined:
    Nov 7, 2012
    Messages:
    627
    Likes Received:
    0
  15. j0sh

    j0sh User

    Joined:
    Nov 7, 2012
    Messages:
    627
    Likes Received:
    0
  16. ThirdClassIntMasterTurker

    Joined:
    Sep 8, 2012
    Messages:
    86
    Likes Received:
    0
    Yes, that looks like correct folder. On my Ubuntu it is ~/.mozilla/firefox/default.q9c/indexedDB. I always copy whole https+++www.mturk.com folder and no problems so far. And I need my backups quite often when I test new features.
     
  17. j0sh

    j0sh User

    Joined:
    Nov 7, 2012
    Messages:
    627
    Likes Received:
    0
    Check!

    Thanks again. I have my backup program set to store this directory in the cloud :)
     
  18. TurkworkOrange

    Joined:
    Sep 27, 2012
    Messages:
    434
    Likes Received:
    0
    Hi ThirdClassIntMasterTurker, hope turk is treating you well! Today I noticed a very minor thing and was wondering if it is fixable - I have 6 (I said it was minor!) HITs in my pending report that are no longer pending and got paid, but still show in the list. Is there a way to easily edit the database or not? As I say not a big deal at all, but just interested. Thanks again!
     
  19. ThirdClassIntMasterTurker

    Joined:
    Sep 8, 2012
    Messages:
    86
    Likes Received:
    0
    Yeah, that may currently be possible in some cases because it only checks that number of HITs match. I am going to rewrite that part anyway, that kind of errors shouldn't be possible.

    But yes, you can fix it. First export those HITs as csv. Just search pending approval HITs and check "export CSV" box. Save that file somewhere and open it with text editor. Then click Import button and copy HITs that you want to change from text editor to that text area. Change "Pending Approval" to "Paid" and click Import HITs.

    But update to 1.3 first. There was small bug in CSV-import, if feedback was empty it put 'undefined' instead of empty string. And of course: backup first!
     
  20. awfiedler84

    Joined:
    May 13, 2012
    Messages:
    58
    Likes Received:
    0
    Hai guys, over the last couple of days, my DataBase has completely stopped working. I've tried deleting it (through the script), updating it (it just says Script monkeys are getting ready to work or whatever or about five minutes, then resets), removing it and reinstalling it and nothing has helped thusfar. Any ideas what I can do? I love this script. =(
     

Share This Page