Castingwords Transcribers - Questions and Answers

Discussion in 'CastingWords' started by nobody, Jul 15, 2012.

  1. interneteditor

    Joined:
    Jul 6, 2012
    Messages:
    362
    Likes Received:
    0
    @ Whimsy - I do always try to be fair but then I felt so bad for grading Hapless down for the double words and I felt I'd been nit picky after :) Lack of self confidence showing there maybe ;)
     
  2. Whimsy

    Whimsy User

    Joined:
    Apr 22, 2012
    Messages:
    805
    Likes Received:
    0
    If you're an established editor then your grade carries more weight. As a newer editor you have to have others agree with you. At least, that's from what I understand.

    What's your PPT, if you don't mind me asking?
     
  3. Whimsy

    Whimsy User

    Joined:
    Apr 22, 2012
    Messages:
    805
    Likes Received:
    0
    On another note:

    After weeks (yup, really), my Improve a Transcript issue may be fixed. Apparently there was something wrong with the code and bonuses weren't being issued. I don't know how many people missed bonuses, but techs are working on making sure all bonuses are issued. I noticed that the Improve jobs I did last week had the appropriate bonuses attached. Now I'll just wait for the others to roll in.

    Also, I was doing an Improve job yesterday - the person tried using software or just fudging their way through parts (as in, only doing parts and completely skipping minutes at a time of audio) and just trying to pass off CrAp as a transcription.

    I wrote to CS, gave them the info -- note back was that the work was rejected and the worker blocked from working for cw in the future. I totally get being a new worker and making mistakes. I've fixed a lot of stuff. Missing speaker tokens. Wrong speaker tokens. One HUGE paragraph. Almost no punctuation. Few missing words here and there.

    But if they tried and seemed to give it an honest shot - even if the style guide wasn't mastered, I'll probably never master it - it's worth working on. For me, as long as most of the words are there I don't mind doing Improve jobs. It also helps keep me on my toes until I get a new laptop. Fixing others' mistakes makes me more aware.
     
  4. interneteditor

    Joined:
    Jul 6, 2012
    Messages:
    362
    Likes Received:
    0
    Can you tell me how to find the PPT score? Sorry :/
     
  5. Whimsy

    Whimsy User

    Joined:
    Apr 22, 2012
    Messages:
    805
    Likes Received:
    0
    Be sure to register here:
    http://turkers.castingwords.com/turkers/index

    If you have already, you can click on [MyUserName's] profile at the upper left.

    MTurk Qualifications:
    PPT: 96
    Unique Id: xxxxx
    Grader: 4
    New Editor: 80

    Or, you can search for a cw job, expand to show all - and besides straight editing jobs (where you have a different qualification number), your PPT is shown there.
     
  6. interneteditor

    Joined:
    Jul 6, 2012
    Messages:
    362
    Likes Received:
    0
    Ah, thank you, I was looking all over the CW site and couldn't see where it was. PPT is 80. I check on some stuff I did a few days ago and got a lot of 7s. Haven't looked to see why yet.
     
  7. Whimsy

    Whimsy User

    Joined:
    Apr 22, 2012
    Messages:
    805
    Likes Received:
    0
    There are a ton of HITs up right now but most of them require a PPT of 85 or 88. To become more comfortable with editing, I suggest trying to get your PPT to at least 90. At that point you can work on Improve a Transcript HITs. They pay less than original transcription, but the timer is 8 hours and bonuses are involved. They're perfect for me for a few reasons. They pay better than editing, too.

    I know transcriptions are hard to do with kids around, but sometimes you can find very short (30 second) bits to do. Do enough of those well and your PPT will shoot up.
     
  8. interneteditor

    Joined:
    Jul 6, 2012
    Messages:
    362
    Likes Received:
    0
    Thanks for the advice :)
     
  9. Scott

    Scott User

    Joined:
    Jun 12, 2012
    Messages:
    237
    Likes Received:
    0
    Anyone having trouble logging into the castingwords website? - I tried to recover my account info and myusername is blank but gives me a new PW. I have no idea what is up with that.
     
  10. Whimsy

    Whimsy User

    Joined:
    Apr 22, 2012
    Messages:
    805
    Likes Received:
    0
    I've been able to log into the site and the support site today. Haven't in the last hour or so because I can't run a browser while my gaming bots run. I'll see if I can from the nook.





    Logged in fine from here. Hopefully it clears up for you soon.
     
    #70 Whimsy, Jul 24, 2012
    Last edited by a moderator: Jul 24, 2012
  11. hapless

    hapless Guest

    Gotta watch out for those. Apparently, short paragraphs are preferred here in CW-land.

    I once got a 7 for failing to split two already-very-short paragraphs into even shorter ones. (That, and missing a comma on one sentential adverb.)

    On that one, the turker editor (who obviously has a sense of humor) wrote: "Proofreadcarefully." [sic] ;-)

    My next transcript, however, was, in his view, almost "pervect." [sic]

    (Give me a 7 for too many commas in that last sentence.)
     
  12. hapless

    hapless Guest

    Yo, chillax. :eek: I already tol'ja I'm cool with your edits (and grades). It's all good. (-;
     
  13. hapless

    hapless Guest

    Just a cautionary note:

    As you can see from the "http", those worker pages, and the support site, apparently are not secured with the HTTPS protocol.

    I complained to CW last month. They already use HTTPS on their customer logins, IIUC; so I don't know why they can't be bothered use HTTPS on the worker side. (It can't be too difficult; 'this is not rocket science.')

    (CW is not alone in this. I plan to complain to another well-known crowdsourcing company for a similar reason. That other company angers me because they display an explicit indication that both their customer and worker logins are secured, when in fact the latter is not properly secured.)

    BTW, you can also find your PPT under the Qualifications tab in M-Turk itself. (Note that M-Turk does use HTTPS, of course!)
     
    #73 hapless, Jul 24, 2012
    Last edited by a moderator: Jul 24, 2012
  14. hapless

    hapless Guest

    Yes, just do more transcripts (no stress, just proceed at your own pace), cross your fingers, and check the PPT occasionally (every couple of weeks or so) to see if it gradually starts to move up.

    I've been at this for just over a month, working at a slow pace. I get mostly 8's (some of which I've disputed). For reasons unknown to me, already they have boosted my PPT to 94, which is more than I think I deserve at this point. I can't complain about having access to more jobs.

    I understand that some of us have been working steadily for a significant amount of time without any recent boost in PPT. If I were in that situation, I wouldn't hesitate to submit a friendly support request asking CW to review your work and see if they're willing to bump up your score. It can't hurt to just ask (and there is no shame in asking).
     
  15. hapless

    hapless Guest

    "Whoa, Nelly."

    I wrote: "... For reasons unknown to me, already they have boosted my PPT to 94, which is more than I think I deserve at this point."

    I checked again, today.

    It's 96. :eek:

    OK, that is crazy? IMO, there is no way I deserve a 96 after just over a month of careful but slow-paced work.

    As I said, I get mostly 8's. I would judge that my work is slow but reasonably good in terms of accuracy. Regardless, it seems to me, getting to the stratosphere (96!) should've required more time and more transcripts. (IMHO)

    Is the PPT scoring process fair? I don't know, I have no information about how it works behind-the-scenes.
     
  16. Whimsy

    Whimsy User

    Joined:
    Apr 22, 2012
    Messages:
    805
    Likes Received:
    0
    Maybe those 9s given, but paid as 8s, helped? I have done many, many Improve jobs and got all but 2 of them to a 9. I wish wish wish wish I could get a new laptop so I could do longer transcription jobs. I've come to really enjoy doing this type of work. Cw customer support has always been kind in their replies, too. Of course, I don't fire off angry emails either. Well, mnot to someone paying me money at least :D

    My jump to 96 surprised me, too. I am thinking it will help promote more confidence in those grading, too. Fingers crossed.

    Eta - one of my previous posts in this thread is a reply from cw on how ppt is determined, from their standpoint.
     
  17. hapless

    hapless Guest

    BTW, I assume everyone here is familiar with the worker information pages at turkers.castingwords.com.

    The first time I visited the "Live CW Hits" page, I didn't realize that only base-level jobs are initially displayed under "Audio Transcription." At first I didn't realize :rolleyes: that we have to click other headings to see the higher-paying transcription jobs that require an elevated PPT score.

    Those headings (when present) include e.g. "Express Transcription," "Expedited Transcription," and (in the "Other" section) "Difficult Audio" and "Diff Audio Expr Trans." (and of course other headings for editing and grading jobs).

    (With luck, sometimes you may find a "difficult" transcription job that is not so difficult. I'm doing one right now.)
     
    #77 hapless, Jul 24, 2012
    Last edited by a moderator: Jul 24, 2012
  18. Whimsy

    Whimsy User

    Joined:
    Apr 22, 2012
    Messages:
    805
    Likes Received:
    0
    Hahaha I like your edit.

    Even if we do know that, it's good to put it in writing for others that come along in the future. That's the same reason why I don't do much mturk-talkimg through private message. Let everyone know the process, the tips, the frustrations. There's so much good information in these threads.

    I'm also grateful I'm not the only one currently working with them.


    Edit: sorry for typos. I'm typing with my thumbs
     
  19. pwt

    pwt User

    Joined:
    Apr 28, 2012
    Messages:
    191
    Likes Received:
    0
    Thanks. I had a few more come in like that. Same HITs, but a slightly higher premium ($1.09 instead of $0.98) that I had done much later in the morning. Of the 4 later ones, two came back as 9s, one an 8, and one hasn't been approved yet. The 8 was an auto-approval I noticed, all the rest were not.

    It added up very nicely for me for the day. The 9s could have be $22.60 as all 8s. Instead they ended up being $27.12, for a $32.50 day overall. Very nice, especially with all the 2-3 day spans with little to no work at all this summer.

    I don't think I'll ever top today. My best day with CW before this was June 22nd, $18.63.

    Those Bulk Express jobs are sweet.

    Virtually all of my 9s today were given an 8 by Turker graders. I get the feeling everyone ignores them these days. I've had too many Turker 9s and paid 8s, and now today, too many paid 9s and Turker 8s, for them to have any meaning.

    I've been doing more verbatim than ever before, and it seems to be helping my grades lately. Not 100% verbatim, but more than I was doing. I was doing a lot of cleanup before to make the transcript the best possible product for the customer, and I guess that's wrong. This guy in the Bulk Express HITs last night/this morning spoke pretty good English for someone who didn't have it as a first language (his syntax was great) but he missed obvious things for a natural language speaker. Missing an "s" for plural words, adding an "s" to make something plural when it shouldn't be, mostly things like that.

    (I think the Turker giving me 8s on them was in my old mindset, wanting me to fix that stuff.)

    I transcribed what he said 90% of the time and only added a "the" and whatnot here and there, to make it more readable. Those were that big load of 9s I just got.

    It reminded me of a HIT last year where I got feedback (after I asked in the comment area) from CastingWords saying "ethic should be ethnic."

    It was an African American woman talking about college basketball, and honestly, her English wasn't so great. In fact, it was far worse than the artist I was doing this morning who clearly didn't speak English as his first language, but had been speaking it for many, many years. But for some reason, while doing work this morning, that feedback kept coming back to me and hanging around in the back of my mind. "ethnic should be ethnic".

    CW really does want something as close to verbatim as possible, with only very obvious problems fixed, and fillers removed (sometimes).

    Anyway, it's something to think about.

    This hasn't been edited yet, but it's one of my 9s from today:

    Even if the first part wasn't necessary as context for the first, I'd have left it in anyway. These days, I'll only leave out a short and utterly meaningless false start. Here's another 9:

    My old mindset says that's very debatable. You could delete that first sentence and the second one would make perfect sense. It adds nothing to the transcript. But I left it anyway, under my new mindset of "ethnic should be ethnic", type what you hear unless it's a problem. You're not editing, you're transcribing.

    Today, anyway, that's worked very well for me.

    The style guide says to do that, but I've had editors put them right back in. And I've gotten a lot of 9s today with filler words to begin a sentence and paragraph (I've seen editors put them in to begin paragraphs, per the audio), and a lot of 8s this year with all of them taken out. So now I'm leaving some in and taking some out. I leave in one that makes the transcript flow better, based on a comment from CW a week or two ago that my paragraphs sucked ass (not their words), and that they should "flow together", not be chopped up into perfect little paragraphs that carefully meet the character limits.

    The style guide says to be as close to verbatim as possible while taking out fillers. That tells me (now) that not *all* fillers need to be taken out. The primary goal is "as close to verbatim as possible", subject to all the other rules.

    Right now, my new policy is to ignore feedback about fillers and look only at the edits and final grade I get paid for, and only then, look at what a majority of the edits have done. Not just one.

    I got dinged for that by CW once. A woman was trying to give a total count of animals she has on her farm, and she was very quietly counting out loud, and then she gave the total. But all she was doing was adding out loud. She wasn't saying "five chickens, three ducks, .." under her breath, she was saying "15, 18, 22....35", and 35 would have been the total. Transcribing her counting out loud added nothing to the transcript and shouldn't have been in there, but CW wanted it anyway and told me so in feedback.

    Oh well. Live and learn.

    I've been doing "alright" instead of "all right" lately. I'm getting annoyed about it, too. Yes, I understand that it's in the style guide. But 99% of people write "alright" and "alright" is a valid English word. It's not even one of those British English but not American English words. It's a valid word. I get that CW prefers one over the other, but frankly, CW's preference is stupid. :(

    It's also on the mTurk website, under your assigned qualifications (apparently you can see the last date it was updated there) and on all CW transcription HITs that have a PPT requirement:

    [​IMG]
     
  20. Chytay

    Chytay User

    Joined:
    Jul 7, 2012
    Messages:
    57
    Likes Received:
    0
    Haplass,

    I did some editing and final approval the last few days. I rarely do this type work, but there has been NOTHING but crap to work on the last few days.

    I remember saying to up a 94 to a 96, not sure if it was you. I rarely do that when I'm working, but I thought the few transcripts that person worked on looked pretty good, so I suggested to up their PPT. When we approve final transcripts, we don't always know who they are for. If they have registered with a name, that shows, if not, it's just their number.

    Also, my CW name is different from my name here. When I started, I didn't want other workers to identify the dumbass that was just starting out.
     

Share This Page