RP grading methods (slightly ranty)

Discussion in 'Suggestions & Ideas' started by Tsubori, May 19, 2012.

  1. Tsubori

    Tsubori Hunter of Beacon vet

    Messages:
    1,257
    Trophy Points:
    38
    Okay, this is only partially a suggestion, so that's why I put it here. It's also going to be a tad ranty, so warning. I'm not going to candy wrap this, I'm getting a bit annoyed by the Grading process here. It's the kind of process that can only be neutral or bad. At best, you get your reward as you've planned for. At worst, you're given an "I don't like it, redo it."

    Personally, due to a mental problem or ten, I find myself almost completely incapable of redoing things to a certain degree. But in an RP when I get to the end and feel good about it and it gets graded with "You didn't RP it how I thought you should have. Redo all these parts." I actually start to feel resentment. It makes me lose interest in the RPs and by connection, the forum. We don't have enough RPers that we can start alienating them by saying "Your grammar and spelling were off in a few posts. Go back and fix those or else you get nothing." (That's actually happened to me for my Fire temple run, mind you)

    There's a certain line between hobby and class. This is starting to move itself into being class. A project is fun and everything, but you start to really get pissed at the teacher when they force you to redo things for nitpicky, stupid reasons. RPing is about story writing. Not "Who has the best grammar and spelling of them all?" 

    An alternative I would suggest is actually being graded and given rupees based on how good the RPing is. (mind you, this isn't English skills, it's based on the RPing. Acting in character, realistic, etc) If someone spits out extremely short posts with zero grammar skills, their punishment is that people won't want to RP with them. 

    Now, I fully realize everyone's going to be pissed at me for posting this, but whatever. I think it needs to be a bit changed, because at this point the forum is becoming just another English classroom.
  2. Ribitta

    Ribitta What would you ask of me? reg

    Messages:
    823
    Trophy Points:
    18
    I'm not staff, and therefore anything I say has no sort of authority, but you raise an important point, and, since I may, I'd like to add a bit to the discussion. I'd like to make a point, though, in saying that while I think the staff may have made an error in your particular incident, I do not speak for them and am happy to concede points they may bring up.

    Okay, so the meat of the issue. I think you made a very strong point:

    I think pretty much 90% of all issues right now can be defaulted back to this point: roleplay should be supported and not hindered when possible. The unfortunate case, though, is that since HC was birthed out of a larger site with a lot more people trying to... push the limits, some rules were instated (or some systems made) that haven't translated as well as would be preferred. That is, of course, why the suggestion box is here, so I'm glad you brought this up, because I agree with you.

    However, in your case with the Fire Temple, I believe the rules were applied perhaps a bit erroneously. The rule in question is, of course:

    Okay, so the rule itself put the most emphasis on the very last sentence, and rightly so, and I think in your case a little too much focus was made by the staff on the "Was written decently enough" aspect. I agree with the way the rule is written (and consequently with you yourself) about the focus of the grading process, and I'm incredibly appreciative you endured through it anyway.

    I would, though, like to take a very brief moment to talk about the mod in question. (As a bit of an aside, so I'll spoiler it because it's not 100% related to the general issue)
    Show Spoiler
    Quill is HC's most recent mod, and he's been put into a bit of a tough spot at an interesting time for the site. Since taking the role he's done a ton of the manual work (grading, accepting, and so forth) and so I feel like the site is absolutely indebted to him for his awesome work so far. But let it be understood, though: being a mod is a hard job, especially when you don't have a very authoritative admin (in our instance, Guy or Toko) easily on hand to ask how to address an issue.

    It's possible some skin gets rubbed because of that, but if possible I'd ask you continue to (as you have already) extend him the benefit of the doubt, because he certainly takes the best interests of the site very seriously and with the best measures he can offer. It's in Quill's nature to be "nitpicky" and very thorough, and I can see why he would've felt obligated to do a bit of "quality control" via grammar and punctuation and such. In most situations, though, this has helped him (and us) a lot, and it's vital to the daily operations of the site.

    On a more personal note, as someone who has modded before, I absolutely hated having to go "You've gotta fix this" and then when they do that you realize it hasn't been fully taken care of and you have to ask them to go back to it. It really sucks, and no one enjoys it. This happens a lot, especially in the character creation aspect, but the mods are still obligated to have to make sure everything lines up all right.


    Alright, so the question is definitely, then: what do we do?

    I think it's important to note that the frustration you're describing hasn't happened very often, at least with roleplaying threads. Most RP threads don't get finished on HC in the first place, but when they do it usually goes by without the incident that happened to you. (If you have more examples though, I think they'd definitely be valuable to bring up)

    However, in the case of a potential recurrence, you brought up the possibility of grading based on quality of the RP, not on grammar/punctuation. This is a really awesome idea, and I've actually brought it up personally with some of the staff before.

    The issue with it right now, though, is that that sort of evaluation could range all across the board. An analysis Toko gave of a thread might be completely different than say one Eev did. More importantly, though, it would probably differ largely with what the roleplayer thought about the thread. While it's frustrating to be told to go back and fix your grammar or spelling, I feel like it could get even crazier if you finished a thread and someone told you "You weren't in character enough, *try* and fix it or better luck next time."

    RP is definitely a process that if you want to be bettered in it, you need to seek that yourself, and a mandatory totally subjective opinion that decides if your 2 months of RP means anything could be bad... I would love to see a system where people could opt-in to being graded that way, though.

    So here's my very, very personal opinion about how I think it should (and I feel like it has historically been done this way, for the most part) handled. Referring to the original rule:

    "Above anything, it should be clear that the role-players put some effort into it and the thread was not a headlong rush towards the rewards."

    That is the focus, and I personally don't think the clause about how-well-written it is, as was originally intended, really applies to anyone currently roleplaying here. I think it's main purpose is to guard us from completely thoughtless RP, not to make everyone here live up to the standard of individual staff opinions in every aspect.

    So anyway, coming full circle, I think your point about hindering roleplay vs. supporting it is the most important thing. We want good roleplay, yeah, but that's really hard to gauge and it needs to be done on a member-by-member basis -- it's not the current responsibility of the staff.

    Tl;dr

    As far as RP threads go, I think it'll be all right. Mistakes were made (yada yada yada) but it's an important thing to bring up. Also sorry for the length ;_;
  3. Blonde Panther

    Blonde Panther Not always sweet and delicate vet

    Messages:
    2,266
    Trophy Points:
    48
    3DS Friend Code:
    4270-0958-9582
    I actually agree with Tsu here. We're an international group RPing- not a bunch of native speakers writing a novel meant for public release. Personally I'm more nitpicky with my own grammar when writing for my novel than when RPing, since it's supposed to be casual. And while I agree that atrocious grammar can be a bother when you're reading an RP, it doesn't determine the quality of an RP (or character) all by itself.

    For example, an Asian friend of mine is an experienced RPer who comes up with good plots for both characters and separate RPs, and is in fact so good we want him as a beta-er for an ongoing project, but due to his non-native speaker status, his English can be horrible. If someone like him gets told to 'do it over' because of something he can't help, that doesn't sit well with some people for understandable reasons.

    Grading and rewards based on performance already happens, just not on HC, and works just fine. The only problem is that it can take a while if done by a slow mod, but it's better than having to stomach bad criticism (which personally makes me want to 'close the chapter' as I say it) and then having to go back and fix things. If the criticism is actually something substantial (like me slacking off on the White Wolfos fight in Canine Cold, which I admit had me worried as well), I can eventually set myself to getting over myself and do something about that.

    When it's my grammar, which you can't EXPECT to be perfect because, well, I've spoken Dutch for nineteen years and not English, it kinda rubs me the wrong way and makes me go, forgive the choice of words, 'screw this.'
  4. Quill

    Quill Leaf on the Wind reg

    Messages:
    1,213
    Trophy Points:
    38
    First off, thank you for posting this, Tsu. We need to hear things like this, otherwise the problem's never going to be fixed. Also, thanks for the nice words, Rib. :)

    Yes, Tsu, grading should be about effort and the RP, not about grammar. But we can't say that grammar is unimportant. When I point something out, it's because if I don't the problem will continue. I guess I'm hoping that by pointing it out, the recipient will improve. If you'll remember, I put a huge spoiler tag in one of your characters, nitpicking everything. I even called it Really Picky Stuff (or something similar). This isn't because I thought your thread was bad; it was because I thought that your character was good, and I didn't want the simple grammatical mistakes to mar it. I stated, directly after the spoiler tag, that I wouldn't withhold acceptance because of anything in the tag. If I did withhold acceptance of the Fire Temple because of grammar, well, that was wrong of me. I should of said, "here's how you can improve. It's not necessary, it's your choice if you want to listen, but if you want help, it's here." I'm trying to grade based on effort and "heart," not "zomg their grammar is ATROCIOUS." My point, then, is that grading is not, and never should be, centered on grammar. It should be an afterthought, a normal "you have a problem here, here's how you can fix it."

    Your point about "you didn't write this the way I thought you should have." When has this ever happened? In Canine Cold, I said that because the quest criteria firmly stated something that wasn't followed. In the Fire Temple, I said that the thread would have fit better into a normal RP than a Classic Dungeon. I do not grade by saying, "this is what I thought it should be. This is what you did. They're too different, go change it." I don't think anyone has done this, nor has anyone ever done this. If they have, then we were wrong, and I apologize profusely on our behalf.

    Finally, the idea of rewards based on the quality of the RP. Frankly, I think this is an awful idea. Not only would it create hostility between roleplayers, but it would also make people feel horrible about themselves when they don't get a super-awesome reward. It would be, as you said, about as far from encouraging as you can get. I think that the reward system is fine the way it is. And, how would one even go about making a grading system, for a site so diverse as this? It would end up being a vague goodness scale, which would be both awful to grade and even worse to receive. You put months of effort into something, and receive a "meh, this was a fine RP" review. I don't want to write it, and no-one wants to read it. If you do have a better system, then please put it forward. I would love to hear any and all suggestions that you might have.

    I think I addressed everything. There was a lot of stuff in your three posts, and I'm not sure if I missed anything. If I did leave any of your points unaddressed, or if anything I said was confusing, then please tell me. Thank you. :)
  5. Quill

    Quill Leaf on the Wind reg

    Messages:
    1,213
    Trophy Points:
    38
    Oh, and if there ever is any negative, non-constructive criticism, then that's not the system's fault, that's the mod's fault. If I, or anyone else, ever gives anything but constructive criticism, then we need to be told ASAP so we can improve our methods. Thanks!
  6. Eevachu

    Eevachu Admin admin

    Messages:
    931
    Trophy Points:
    28
    A lot to address here, so if I missed something, tell me and I'll respond to it.

    First of all, the entire issue of the first post, the grammar/spelling issues. Basically, "Your spelling and grammar were off in a few posts, go fix them." shouldn't happen. I try to make sure HC is very newbie friendly, and not very, well, elite? I mean, we do have differing levels of roleplay skill on the site, and they're all fine.

    With that said, you can't act like grammar/spelling don't matter. Sure, telling interesting stories, being realistic, in character, etc. are all important, more important than grammar/spelling, but if those are bad, how can you TELL a legible story? We shouldn't go grammar nazi because they made one grammar error in a few posts on a five page roleplay, for example, but if there are a bunch of errors where it becomes difficult to read, is it okay? Basically, you're right, we shouldn't nitpick over a few errors, but if it's a LOT of errors, especially over a short time, I think we should ask them to at least fix a few. Of course, we shouldn't expect someone to fix every error, that's just unrealistic and silly.

    Also, to clarify, the main problem with fire temple was it was more of a normal roleplay than a dungeon. However, since you guys had already done all of that work and it was still a creative idea, I told Quill it was okay to pass as long as it wasn't done again.

    As Quill said, no one has(or should have) graded by saying "this is wrong, fix it." Regardless of any asshole-ishness there(And yes I know this wasn't Quill's point, but he already said it so I thought I would mention this as he didn't), just saying something is wrong is bad. They should explain why it is wrong, and how to fix it. Of course, this is for things that are definitively wrong, and not just the moderator's opinion. I mean, they should still explain WHY, but they should never say "I don't like this because [x] so I'm not accepting it."

    Whew, that was a mouthful. I hope I conveyed my point on that well enough.

    NOW, for the second part. Rewards varying on RP skill. Although it doesn't really matter, something similar was actually on HS. Of course, that was kind of a bad system, so anything done here wouldn't be exactly like that. Basically, each dungeon had a "Passing, Good, and Excellent" grade. When approved, a moderator would assign one of these to it, and you would get that reward. Obviously, passing was the lowest, with Excellent being the highest.

    Now, while Quill does have legitimate complaints towards it, there is one more systematic I see. It has to do with how the treasure system works. In most normal cases, you get 50 rupees per roleplay. You can buy any treasure with this, paying the difference if necessary. You must roleplay obtaining it in some form. See the bold?

    The way it would presumably work is that there are differing rupee levels depending on what the mod grades you as. The problem is, they couldn't definitively decide on a treasure until after the quest was over. As such, they couldn't roleplay obtaining it if they got a higher grade than expected and wanted to use the additional rupees to get a more expensive treasure. What if they got a lower grade than expected and planned for a higher one? While, yes, it is dumb planning, I expect it to happen at some point.

    Plus, it kind of unbalances the system. The 50 rupees is in place is mostly so people can't get a bunch of treasures at once, due to the cap in place. If they want to exceed the cap, they can only get one treasure. Disregarding personal thoughts about this, it can somewhat unbalance things, especially when multiple characters are taken into account.

    One possible solution is similar to the "Rupee Riches" racial treasure Hylians get. Separate from quest gained rupees, the member gains bonus rupees depending on the grading given to them by the mod. They cannot use these rupees to buy a treasure in that quest, however, and must use them in a future quest or CD or whatever. This would prevent the problem I mentioned above, but there is still one problem; People getting too many rupees too fast. Of course, this depends on the numbers, and if we did it I'm sure I could make it balanced enough. I don't know what Quill's talking about, it wouldn't be very complicated for me to make.

    Of course, there are still the problems Quill mentioned. I'm all for rewarding great roleplayers, but I don't think this is the way we should go about it. That's KINDA what the Reg/Vet system is for, but it's kind of flawed too. Reg is essentially for almost everyone, and Vet is for, well, the best. There's no middle ground. I'm not saying we should MAKE a middle ground system, though, it's kind of unnecessary.

    Wow, that was a lot. If you guys have any ideas for rewarding good roleplayers, feel free to suggest them, but essentially a ranked grading system I'm kind of against. Although, the problems Quill mentioned are going to be present in any rewards system. I don't want to sound mean, but if one is added and someone gets a higher grading than them, they need to stop being a baby and get over it. Some people may be challenged to improve to get a higher grading, sure. However, Quill's problem is still present with some people getting down because they didn't get a high ranking. The "don't be a baby" mostly only applies to jealousy, it can be pretty demoralizing.
  7. Tsubori

    Tsubori Hunter of Beacon vet

    Messages:
    1,257
    Trophy Points:
    38
    Thanks for the quick responses guys; I’m pretty sure you nailed all the points given. Now, with regards to any ideas, I’ve always got an idea or two kicking around. For example, on the forum that BP and I hail from, the grading process is like… Wait, it’s faster to just link you, actually. http://forums.feplanet.net/index.php?showtopic=47699

    Pretty much what this is saying is that the rupees earned would be impacted by how well you RP. As a decent example, what if the set reward was lowered to say… 30. And then have the grading points go up to a max of 30 more rupees. Only ten rupees higher than usual, but it also rewards good rping. That way, there’s thirty rupees you can bank on, along with whatever extra reward from the last thread.

    Also, I’m not saying use that exact rubric, as it’s more suited to 3-5 person rps, which there aren’t too many of here. Making a rubric though wouldn’t be TOO hard and I could help if wanted. I’m kinda leaning towards that possibility, but I’m probably biased, having used the system before.
  8. Razgriz

    Razgriz Leader of the Revolution reg

    Messages:
    489
    Trophy Points:
    18
    Might as well throw my hat in the ring here, so on topic: for Tsu's idea that grading should be tiered based on quality of RP, there's two things, first: to a degree it already is, members receive an extra PWC point for each of their characters, the ability to have an extra major treasure for each character, access to more races, et cetera (while this isn't a case-by-case basis, it still rewards good RPing); second: doing so could alienate roleplayers as well, imagine if a person new to rollplaying, especially if they also had a poor grasp of the English language (kinda BP's point), were to join and be subjected to that system: he/she would see the other RPers being rewarded more for equal or less effort, because of their experience in RPing and English; this would likely cause the person to lose interest and quit.

    As for grammar, it's not really that important. Really, it should be a side suggestion unless it actually makes the writing difficult to understand. For example, take my first paragraph, it has 147 words, 4 colons, 2 semi-colons, 12 commas... and only one period. The entire first paragraph is a run-on of extreme proportions, and most English classes would fail a paper with such sentence in it. Yet, most people on here could probably understand it first read through, and so should be accepted. Hell, I even left a misspelling of "roleplaying" in it (rollplayers*), I doubt anyone would get confused on that. Many might not even notice the massive grammatical, punctual, and spelling mistakes because it still gets the point across well.

    As a final point, the reason grammar may have seemed so important was a specific active mod *coughQuill* may have come across as demanding improvement or not passing was because it threw all demands and criticisms together, such as asking us to RP getting the rewards in the quest and pointing out grammatical errors in the same sentence. Thus, it`s likely just a misunderstanding.
  9. Tsubori

    Tsubori Hunter of Beacon vet

    Messages:
    1,257
    Trophy Points:
    38
    Waitwut? when did I say it would have mostly a basis in use of English language? If anything the thing I've been pushing for the whole time has been making it LESS based about English mastery. With that system I mentioned, BP and my Asian friend has been able to get levels just as effective as everyone else, if not faster because he's a very good RPer. I don't see how this alienates people >.>
  10. Blonde Panther

    Blonde Panther Not always sweet and delicate vet

    Messages:
    2,266
    Trophy Points:
    48
    3DS Friend Code:
    4270-0958-9582
    I'm confused on this as well Raz. Our poorly English-speaking friend is on a completely different PLANET when it comes to levelling. The system we're used to only punishes poor English if you're a hopeless case.

    Eev, Quill: I understand your point about grading based on performance possibly making people feel bad if someone gets a better grading than them, but really, I dread gradings regardless of the used system. Actually with 'fix it or you get nothing' I dread gradings a little more because like I said, if I get bad comments on an RP I can just let it rest without having to remind myself of my own retardation by seeing the errors again.

    Just me though. If others gave their two cents maybe we could get a better idea of the general consensus.
  11. WillowtheWhisp

    WillowtheWhisp Admin admin

    Messages:
    1,093
    Trophy Points:
    48
    3DS Friend Code:
    3239-3393-6898
    I don't much pay attention to how other staff members grade... and I probably should.

    The way I grade, and honestly the way I feel it should be handled, is that the grading should be fairly lenient. A thread, in my opinion, should only not be allowed to pass if it blatantly breaks the rules, either intentionally or unintentionally. However, in terms of grammar, and spelling, a thread should be allowed to pass in almost all cases; unless the RPer absolutely butchers the english language (consistent lack of capitalization, use of "chat speak", etc.), then it should be fine.

    Of course, the grading staff member is free to give constructive criticism to the roleplayer, but it should never be more than that. The roleplayer, therefore, should be open to criticism, and hopefully improving their own writing. That said, if the roleplayer believes that their command of the english language is fine, then they should be free to ignore whatever pointers the staff member gives, and neither party should take insult to this. Razgriz was right; we already have a system that promotes good roleplaying, within the member ranks system.

    Back on Hylian Shield, we did have a grading system that included tiers of excellence. We decided to move away from this system for Hyrule Castle because it was restrictive, and as Tsubori said, made roleplaying more like an english class than anything. The whole point of roleplaying is to have fun, and if a person personally does not find improvement of their english skills to be fun, then that should be perfectly fine. The grading of a thread should only apply to things that pertain to the meeting of the goal of the quest; as long as the requirements of the rules, and the quest, have been met, then I see no problem in allowing a thread to pass.

    However, I WOULD like to point out that Quill is correct in saying that the reward of a quest must be obtained within the quest itself. This has been written into the rules. However, remember, even if you may have forgotten to gain the reward, you can always just tack on a little thing at the end that says that you received the reward, even if it's only a sentence or two. More so, there is nothing stopping you from having a thread be regraded if a staff member did not accept your roleplay.

    For those of you have asked me to grade their roleplays, you may have noticed that I have a pretty quick turn around time with a pass or a fail (and thus far, I have yet to fail a thread). The reason for this is that I have a checklist that I run through, and I make sure that the thread meets these goals, generally skimming the entire roleplay. In my eyes, as long as the thread is able to meet the standards of the checklist, then it's perfectly fine and should pass. Should I have a problem with anything in the thread, even if it meets everything on the list, I merely tack something onto my post, saying that "x could have been better, so please keep that in mind for future RPs." But these statements are generally limited to grammar and spelling errors; staff members should realize that each person has a unique writing voice, and even if we don't necessarily like to read it, the roleplayers of this site aren't here for our benefit.

    Hope this helps.