• Bhangra discussion is still going strong. Join us in our Facebook group!

    New user registration has been closed (as it was entirely spam). We encourage you to post in our Facebook group, even if it's a followup to an existing thread. BTF will continue to be archived and hosted here - Saleem

Judging Rubric Idea

J Wong

Member
Messages
301
So I was looking at various competition rubrics and I have noticed a lot of things that, in my opinion, shouldn't be there:


1. Points for segments (The point of a rubric is to determine who the best team is of the night, I don't agree that XYZ team should automatically get points because they had jhummar.)


2. Points for vardiyaan (I think it is generally expected that teams come in vardiyaan and not sweatpants.


3. Points for dholi/singer (While I personally like both, this puts teams without access at an inherent disadvantage.


Additionally, there is always the question of modern vs. traditional vs. live, and how to judge them equally. The only way to achieve this is to judge them on the merits of technical ability. Essentially stripping the rubric of all things that may be inherently biased. So I drafted a sample rubric that I believe does just that, the categories only pertain to the basic elements of judging competitive dance.


See link:


http://cl.ly/image/2Q0x460N443a
 

J-Skeet

New Member
Messages
252
I agree with the sentiment that proper vardiyan is expected by all teams, but not including it in the rubric could cause a problem. If it's expected then just add it to the list of deductions. Inherently, if there's a deduction point system, there should be a "bonus" point system for dholis/singers. Otherwise no one would bring dholis and singers to their sets etc. As for the segments...I believe the whole point behind it is to keep bhangra inherently "bhangra". More or less, imo, it's the "traditionality" part of the segment. Are teams still incorporating the different parts of bhangra? Maybe it should go into the deductions part of the rubric? Not sure, but a team that wouldn't get docked for leaving out a jhumar would be disappointing. As far as how the severe the deductions for leaving out a segment would go, that would probably be allocated based on the competition and their "aim" so to speak. Anyway my point is that a rubric should be a bit more specific to avoid bias judging. Just because vardiyan are a simple and "expected" part of the set doesn't mean it should be left from the rubric entirely.
 

siddyp

Tough times never last, but tough people do.
Messages
1,270
jordan i kinda like where it is headed.. but i think you missed a one big thing and here is what I would edit:

drop overall execution to 10, drop formations to 10.
Add a section that talks about nakrah, enjoyment, lachak, passion for 20.

Question about formations: is it the choreography of formations? (not combining both choreography and execution of formations) or is it the combo?

I think you have to describe each section to give judges more than just words to go off of. (as you can tell I don't know what you were looking for when you just left it at (formations") Do gimmicks go into choreographical elements?
All I'm trying to say is that you gotta elaborate what you want from each section.

I 100% agree about vardi, dholi/singer, and segments. 3 things that teams unnecessarily lose points on.
In regards to the segment thing, if a team really has no structure to their dance, their overall impact/choreography is going to take a huge hit.

If you want to bring up empire, they still have easily recognizable segments. This rubric gives teams like Empire and Virsa the ability to win in the same competition.
 

J Wong

Member
Messages
301
Things like vardiyaan could be stated in competition rules (which have a deduction). But my main aim is to avoid things like "traditionality" in a rubric. Dont get me wrong, I prefer folk choreo over more modern but a lot of people don't. As for dholi/singer, I feel that should fall under 'overall impact' because it does make the entire set better. I feel that a generalized rubric will be best utilized by proper judges who have been on the circuit long enough and have ample experience to judge fairly. I think if a judge is a solid judge, they should have to be told what should be in a set (e.g. jhummar) they will know.
 

J Wong

Member
Messages
301
True, nakhra is important and I forgot to add it. As for formations, I was going for the choreography of the formations and their complexity (box/line vs. intertwining mechanism).


Keywords would be helpful.


Gimmicks would go into overall impact.
 

Kartik

Member
Messages
319
WBBC rubric was trying to address this same issue; if you haven't already I'd suggest taking a look at that - I think it solves a lot of the problems you're trying to explore here. It also incorporated Sid's points about nakhre, energy, and the like.

Otherwise, I agree with the goal of moving beyond these loaded terms of traditionality etc.
 

Shahrukh

Active Member
Messages
505
How about you make execution worth 50 points broken down like this

1. difficulty of routine 1-10
- length of routine
- complexity of dance formations
- complexity of dance moves
- dance flow

2. execution of routine 1-10
- clean formations
- clean moves
- high energy
- smiles throughout

Multiply the result of the first with the result of the second. For Example. lets say a team has a relatively simple routine so you give it a 7, and they execute it to perfection so you give it a 10, you would give 70% of the 50 points. So that team would get 35/50 for execution.
or if a team has a very difficult routine lets say a 9, but they execute it poorly lets say a 6, then they get 54% of the 50 points (27)

Just an idea, i think execution is very important, and by handling it this way(not exactly this way with these exact point allocations just an idea) you can be more accurate when judging.

Thoughts?
 

siddyp

Tough times never last, but tough people do.
Messages
1,270
Shahrukh said:
How about you make execution worth 50 points broken down like this

1. difficulty of routine 1-10
- length of routine
- complexity of dance formations
- complexity of dance moves
- dance flow

2. execution of routine 1-10
- clean formations
- clean moves
- high energy
- smiles throughout

Multiply the result of the first with the result of the second. For Example. lets say a team has a relatively simple routine so you give it a 7, and they execute it to perfection so you give it a 10, you would give 70% of the 50 points. So that team would get 35/50 for execution.
or if a team has a very difficult routine lets say a 9, but they execute it poorly lets say a 6, then they get 54% of the 50 points (27)

Just an idea, i think execution is very important, and by handling it this way(not exactly this way with these exact point allocations just an idea) you can be more accurate when judging.

Thoughts?
this is really interesting. But I really think that you should separate difficulty of routine (a choreographical element) from the execution.

folks put a lot of time/effort into choreo. it should be appreciated on its own and not in comparison to how its executed.

without a doubt, if the routine is too hard for the team, the execution points will get hurt and ultimately the team won't have an easy shot at placing.. but I would rather a team take a chance then play it safe. Because you're idea of one effecting the other will force teams to play it safer...

Although, you're example could be a bit flawed. If a simple routine got a 4 or a 5 instead of a 7 this would make sense.
giving it a 7 and a complex/difficult one a 9 doesn't seem fair to me especially in this situation...

But it is solid
 

yraparla

SwizzeeMusic.com
Messages
2,072
SRK and I discussed this for over an hour over the phone one day, and the fact is that this is the right way to go, all you have to do is tweak the weight and make sure judges don't rate on a scale. i.e. 50% is average, not a 70% taht way the weights have real meaning.

There's no downside, you ARE judging each element (creativity, difficulty, execution) separately, the weight should not be on the judges mind, it is a inherent in the rubric and applied after the fact. Judges taking it into account will ruin the assumptions of the rubric.

Every team is faced with a balance of difficulty/creativity and execution anyway. A rubric that attempts to balance and reward that balance is a better rubric imo. If you go for a simpler routine and execute, then great you're maximizing your points around your strength. But if a team takes risks and manages to execute enough, they still have a chance to win. It doesn't become about who's the cleanest anymore, it's about balancing risk-reward!
 

J Wong

Member
Messages
301
I like the idea of risk-reward, it kind of reminds me of cooking competition shows, typically, more points with the judges are awarded for the person who took risks that paid off and points lost for those who take risks but fail.
 

akumgill

New Member
Messages
42
Shahrukh said:
How about you make execution worth 50 points broken down like this

1. difficulty of routine 1-10
- length of routine
- complexity of dance formations
- complexity of dance moves
- dance flow

2. execution of routine 1-10
- clean formations
- clean moves
- high energy
- smiles throughout

Multiply the result of the first with the result of the second. For Example. lets say a team has a relatively simple routine so you give it a 7, and they execute it to perfection so you give it a 10, you would give 70% of the 50 points. So that team would get 35/50 for execution.
or if a team has a very difficult routine lets say a 9, but they execute it poorly lets say a 6, then they get 54% of the 50 points (27)

Just an idea, i think execution is very important, and by handling it this way(not exactly this way with these exact point allocations just an idea) you can be more accurate when judging.

Thoughts?

Haha I was actually talking to a friend about doing something like this pretty recently. This scoring system is what they use in Olympic diving and I think it's definitely a good way to compare a very clean yet arguably "boring" team with a team that is really creative but is sloppier. The first downside I thought of was that this would probably wreck live teams. Live sets aren't necessarily "hard" to execute, but they're very difficult to execute well. In other words, a bad live team is far more frustrating to watch than a bad music team, but I feel like this standard would hurt all live teams because I can't imagine any live set really maxing out the "difficulty" metric. The second downside I can think of is the lack of objectivity in the difficulty of a set. I know this is already a problem in judging now, but we currently just add values together so messing up one category will rarely have very deep consequences. When you introduce multiplication, the impact that a small discrepancy in judging will have deeper implications.


Also, should cleanliness of a routine be the same category as execution? I can think of a situation where a team is clean, but they aren't executing the move as well as they could be. Maybe I'm getting a little carried away, but I think adding the third category would be kinda beneficial.
 

Shahrukh

Active Member
Messages
505
akumgill said:
Shahrukh said:
How about you make execution worth 50 points broken down like this

1. difficulty of routine 1-10
- length of routine
- complexity of dance formations
- complexity of dance moves
- dance flow

2. execution of routine 1-10
- clean formations
- clean moves
- high energy
- smiles throughout

Multiply the result of the first with the result of the second. For Example. lets say a team has a relatively simple routine so you give it a 7, and they execute it to perfection so you give it a 10, you would give 70% of the 50 points. So that team would get 35/50 for execution.
or if a team has a very difficult routine lets say a 9, but they execute it poorly lets say a 6, then they get 54% of the 50 points (27)

Just an idea, i think execution is very important, and by handling it this way(not exactly this way with these exact point allocations just an idea) you can be more accurate when judging.

Thoughts?

Haha I was actually talking to a friend about doing something like this pretty recently. This scoring system is what they use in Olympic diving and I think it's definitely a good way to compare a very clean yet arguably "boring" team with a team that is really creative but is sloppier. The first downside I thought of was that this would probably wreck live teams. Live sets aren't necessarily "hard" to execute, but they're very difficult to execute well. In other words, a bad live team is far more frustrating to watch than a bad music team, but I feel like this standard would hurt all live teams because I can't imagine any live set really maxing out the "difficulty" metric. The second downside I can think of is the lack of objectivity in the difficulty of a set. I know this is already a problem in judging now, but we currently just add values together so messing up one category will rarely have very deep consequences. When you introduce multiplication, the impact that a small discrepancy in judging will have deeper implications.


Also, should cleanliness of a routine be the same category as execution? I can think of a situation where a team is clean, but they aren't executing the move as well as they could be. Maybe I'm getting a little carried away, but I think adding the third category would be kinda beneficial.
i wouldnt apply my idea to live teams, live teams should have their own category.

i think cleanliness is a part of execution thats where you can start giving out 7.1's and 7.4s obviously the little bullets under execution can be expanded upon, but i still think cleanliness is apart of execution.
 

mafzal

Judge / Dancer
Messages
2,098
J Wong said:
2. Points for vardiyaan (I think it is generally expected that teams come in vardiyaan and not sweatpants.
3. Points for dholi/singer (While I personally like both, this puts teams without access at an inherent disadvantage.
Points for vardiyan are important because this is where you can deduct for a mishaps. Vardiyan should be taken seriously, and not put on sloppily where you have chunniyan and paggs falling off which causes distraction.
Edit: Just read some more posts. Standard deductions are fine instead, but personally I would give a team 4/5 if everyone wasn't wearing vests, phumans, the works. that's just me tho

Regarding points for dholi and singer for music teams, I'm neutral. it can have its own points section or be taken into consideration as part of "hypeness", either way it will somehow be considered subconsciously whether u like it or not. BUT we can't start talking about putting teams without access to an inherent disadvantage, because this could be argued about almost any aspect of a performance............ most teams don't have shykkey, khundey, vardiyan, or even dancers just given to them... but they find a way and make it happen if they really want it. we can't start considering "access/no access" into judging!
 

mafzal

Judge / Dancer
Messages
2,098
Swi said:
it's about balancing risk-reward!
yess haha as a risk professional, I concur

I like the (difficulty) x (execution) idea. What will we call it? Olympic method? Factor Method judging? Lol. I hope one of the next comps gives it a try

Live teams must be judged separately
 
Top