Tagged With "quality control"

Topic

Niche quality control

Malkazoid ·
Quick note about niche approvals in general. It may be that the prerogative was initially to get as many approved niches as fast as possible. I certainly get that impression with niches that the Tribunal is approving in appeals, and the way Team members are voting. I think it would be healthy to strongly question this prerogative. We now have 2128 approved niches. These were achieved from a user base of less than 6000 members. Niches are still being suggested at a steady rate. I don't think...
Reply

Re: Niche quality control

Slaz ·
Part of the problem of low quality niches sure is caused by democratic quality control, which is an unfortunate side effect of something that’s good by nature. That’s where appeals should come in, and the Tribunal should only be satisfied with perfect niches. Personally, I believe Narrative users, including myself, will notice and appeal niche errors more often once content drafting starts. It’ll make errors way more apparent.
Reply

Re: Niche quality control

Malkazoid ·
Quick updated thoughts on niche quality control. Here is the state of play of the upvoting/downvoting. Niches in approval process: 72 Niches that look like they will be rejected: 6 Projected rejection percentage: 8.33% That seems really good to me: we're getting over 90% success rate with niches proposed at this point in time, and that's with people being quite strict (and appropriately so in my view) in terms of standards. I think a few things are going on that have contributed to this...
Reply

Re: Niche quality control

Erik Blair ·
I think this is related to "niche quality control". If it's important to have niche quality, depth and value, why is it not important to have that same uniqueness for Publications. It appears, at least to this neophyte, that Publications will compete with Niches for traffic. Example, if I have a niche called, "fried chicken" then my channel will be: narrative.org/n/fried-chicken If I buy a publication for $99, and call it, "fried chicken", then the publication owner can have more control of...
Reply

Re: Niche quality control

Christina Gleason ·
@Erik Blair I think that the important different between niches and publications is the exclusivity. The Fried Chicken Publication has more editorial control, which theoretically means better quality content...but to the exclusion of the content they DON'T publish, whereas the Fried Chicken Niche gets anything and everything fried chicken-related, giving content creators and content consumers a wider variety of options. Additionally, as I understand it, publication owners can gatekeep...
Reply

Re: Niche quality control

Emily Barnett ·
From what I understand about publications @Erik Blair is they are two different beasts all together. Niches partake in the rewards pool, Publications do not. So yes Niches have their uphill battles, but so does Publications. Publications based on their own economic system within Narrative will have to maintain the strictest forms of quality if they want to survive, let alone thrive. The only money Publications make, is 90% of the membership fees people agree to pay the publication, because...
Issue

The death of Simple Rep

Malkazoid ·
Hello all, So we've all noticed the change in rep calculation. Overall, the changes have leveled the playing field, which is not necessarily a bad thing. But I'd like to dig a little deeper and see if perhaps we've gone a little too far with this change. My understanding of Simple Rep is that it accrued with voting, suggesting niches and commenting. The logic behind this was simple but important: it is good to motivate users to participate in these important aspects of Narrative. It not only...
Question

Reputation - Quality analysis

Szabo ·
Hello! My quality analysis is 30, with a sad emoticon next to it, from which I understand that the quality of my posts and comments and other stuff is low. My question is why is that score low when I have 5 posts published with all of them having only upvotes (100%) except one, which has 3 votes (69 % rating). As far as I know I don't have downvoted comments. It seems to me that this score does not give an accurate depiction of the quality of my posts. Thank you,
Reply

Re: Reputation - Quality analysis

David Dreezer ·
It's not just how many votes, but also WHO votes. I've not looked at all of your content, but I did look at Gloomy Street Photos . I see this It's 4 votes at 100%, but all of them by lower-ish rep people. It has less than 1 total vote point. How do I know? Because I liked your pictures and voted it up. That caused this See the blue ring? That means that it now has had more than one total vote point. Given what I know my rep to be, I can infer that the previous 4 in all were lower rep since...
Reply

Re: Reputation - Quality analysis

Szabo ·
I understand now. Thank you for the reply, David.
Reply

Re: Niche quality control

Erik Blair ·
Very well said!
Reply

Re: Niche quality control

Christina Gleason ·
AMEN! There are some seriously low-quality names and descriptions being approved. (And were approved early on before I joined.) It makes me very wary of the quality of the content we'll be seeing when even the minimal effort of niche suggesting is being blown off.
Reply

Re: Niche quality control

Malkazoid ·
To be completely honest, I've allowed the way @Narrative Network Team members have voted to sway my vote, on occasion, even when I believed the niche was sub par. Not often, but on occasion. Why? Because of reputation. We see the Tribunal members voting on niches, and we know they are going to be the ones fielding any appeal of the community decision to approve or reject the niche. So their votes become strong predictors of what is going to be considered the 'right' decision. I'm speaking up...
Reply

Re: Niche quality control

Malkazoid ·
@MOLLY O 's article: https://blog.narrative.network...rrative-9a97bec5d049
Reply

Re: Niche quality control

Christina Gleason ·
I'm with you, @Malkazoid . I'm the only naysayer on some niches up for approval, and it makes me wary of voting against the way Tribunal members do because I don't know if voting with the majority in any way affects my own reputation. As such, I've changed a few of my votes, wondering if I've been too harsh. But I've done content moderation for over a decade, and user moderation for a while before that, and about 25% of the approved niches up for auction make me want to cringe. (Maybe that...
Reply

Re: Niche quality control

Emily Barnett ·
I agree with everything @Malkazoid states her. There is no excuse for the tribunal to not be adhering to the very guidelines for quality and redundancy that they put out. If this format does not adhere to quality, then there will be no advertisers. If there are no advertisers there will be no content. Community is here to get paid for their content, and quickly via crypto. It is very simple. Further supporting what Malkazoid has stated, I go a step further and suggest that now that we have...
Reply

Re: Niche quality control

Emily Barnett ·
This is exactly why the reputation, and how it is added and subtracted needs to be transparent!! It affects behavior that compromises the quality of the platform. A big lose for Narrative if it persists in cloaking a rather benign aspect. It does no harm for people to have knowledge on how to improve their reputation.
Reply

Re: Niche quality control

Malkazoid ·
I am not in favour of the platform launching its Beta before this quality problem is resolved, both from a systemic viewpoint, and from a clean up of existing problems standpoint. Systemically, all it takes is for the Tribunal to adhere to @MOLLY O 's guidelines, and some messaging to the community that our votes should do so too. A clean up isn't hard after that, either. If the Tribunal promises to uphold the guidelines, we can appeal all the problem niches. Correct spelling and grammar...
Reply

Re: Niche quality control

Malkazoid ·
That would certainly solve the problem too. I am pretty confident the community will be sensitive to an election campaign based on upholding the guidelines in pursuit of lifting the quality to the levels the platform set out to achieve. So the new Tribunal would be crewed by people who are committed to this goal. I agree that the current Tribunal members are probably all stretched very thin - which could partially explain their voting patterns. Their time is certainly too valuable to be...
Reply

Re: Niche quality control

New Social Media ·
Many good ideas, @Malkazoid . I agree, quality matters more than speed, especially when it comes to liability for the content provided.
Reply

Re: Niche quality control

Melanie Mathos ·
Hey Emily—wanted to provide you with a quick update on this. As Ted shared this morning , we do have plans to publish the entire Reputation spec, including the formulas once we feel that it is stabilized and working as intended. Likely within the first year post beta launch.
Reply

Re: Niche quality control

Emily Barnett ·
This is great to hear Thank you @Melanie Mathos and @Ted
Reply

Re: Niche quality control

Erik Blair ·
It seems to me that Publications could potentially become significant topic competitors to Niches. And why call them "niches" if you don't actually have a niche because someone else has one too.
Reply

Re: Niche quality control

Emily Barnett ·
I don't see how they compete. If someone wants to pay a publication 5 dollars per month of their own money, for the opportunity to read their privately published information how is that stopping the actual paid subscriber form still voting over at all the free content on the Fried Chicken niche. There will be so many more people that prefer to read the free content on the niche. Those people will vote and the rewards pool will be divided up just like normal. They are separate. Publications...
Reply

Re: Niche quality control

Robert Nicholson ·
When you vote to reject a niche, you are asked to choose one of five reasons. The impression this gives is that those are the only valid reasons for rejecting a niche. If that's not the case, then this needs to be clearly articulated in the interface.
Reply

Re: Niche quality control

Emily Barnett ·
I believe that they are technically the only reasons for voting down a niche. of course people are going to be people and defy those rules, and vote down niches that are not redundant, or pick other reasons such as the person uses the word "I" in the description, or even vote up a niche even though it is redundant, all as examples. That is why we have the tribunal. But i agree with you, it would be better if it was clearly stated that those are the justified parameters for rejecting a niche.
Reply

Re: Niche quality control

Malkazoid ·
I think that is the intent - for those to be the only valid reasons. But like @Emily Barnett mentioned, a lot can fit under those five reasons. Especially the last one about name/description being unclear or incorrect.
Reply

Re: Niche quality control

Christina Gleason ·
I think that unclear/incorrect description is where most of our disagreements come from when voting on niche suggestions. It is much more subjective than the others.
Reply

Re: The death of Simple Rep

Ted ·
FYI Simple Rep scores were not really impacted by quantity (number of times you voted/rated), so that is a red herring. You might argue that rating/voting more might help you get out of Reputation Negative status sooner, but fewer people will ever be Conduct Negative (the equivalent of Reputation Negative) going forward anyway. The Narrative Rewards system is designed to incentivize rating/voting.
Reply

Re: The death of Simple Rep

Erik Blair ·
At first glance, I see this in my "Reputation" profile: QUALITY ANALYSIS (60%) A score that reflects the quality of your content, comments, followers, and more. In thinking about how my activity has had an impact upon that quality rating or not, I wonder... why my score is so low . I have been involved wholeheartedly since the very beginning, and I have commented, shared, recruited, posted, purchased, recommended, voted, suggested, and more. Yet my "quality score" is a 6 . I spend what...
Reply

Re: The death of Simple Rep

Malkazoid ·
Well - not a red herring - a misunderstanding perhaps, which is to be expected since the community does not understand the mechanics of the reputation system. Rather than try to guess at what is behind the curtain in precise terms, I'll simplify things by being more general. Am I and others wrong in sensing that our reputation was growing over time with sustained contributions, and that that growth has been removed? People who joined a week ago have the same rep as people who have been...
Reply

Re: The death of Simple Rep

Christina Gleason ·
I have spent entire days with the approvals tab open, refreshing it every hour or so to vote on new suggestions and comment where appropriate. I comment EXTENSIVELY. Now my vote percentage is all the way back down to newbie level. (I'm still waiting to be certified from last night.) I've never had any of my suggested niches rejected. I vote on almost every single niche suggested. I was rather shocked to see that my lower score was deemed "more accurate," as people who have had several niches...
Reply

Re: The death of Simple Rep

Erik Blair ·
Anybody that spends an hour a month voting or suggesting should have a high 'quality analysis' in my humble opinion. But why listen to me, I only have a 6.
Reply

Re: The death of Simple Rep

Malkazoid ·
Well the time spent doesn't guarantee the quality aspect... but certainly the quantity should influence things as well as quality. If two Narrators are producing the same quality output in terms of votes and comments and niche suggestions, but one has contributed four times more than the other in the past month, they should not end up with the same score. Yet that seems to be what we're seeing since people who started a week ago can have the same overall rep as people who have been around...
Reply

Re: The death of Simple Rep

Erik Blair ·
I got aboard this train some time ago. I purchased a couple of niches, voted, suggested, commented, promoted, recruited, submitted issues to tribunal, liked comments, followed people, etc, and did what I could to participate. But now, after all this time I have a Quality Analysis score of 6. My overall reputation score is 44, and it suggests that I need a score of 85 to get the perks of my efforts. To me that either says something significantly wrong with the metric or the whole system is...
Reply

Re: The death of Simple Rep

MOLLY O ·
I think it is important to remember that there is still not a lot you can do on the platform to measure quality. When content streams go live - there will be many more things you can do to earn quality points. For those of you who have been working diligently in the platform voting on niches, you are earning Narrative Rewards for this activity. You should be earning a lot more than the person who came 2 weeks ago. https://spec.narrative.org/docs/network-rewards
Reply

Re: The death of Simple Rep

Erik Blair ·
@MOLLY O I must be reading the rewards spec wrong. Says Activity and Electorate " will not be added until Q2/Q3 2019". Also, where do I see the Activity Rewards I have received from actively voting? I just found the minimum "committed NRVE" to participate clause. So in other words, since I don't have 2,000 NRVE in my account, I have basically lost all my participation for the last 6 months... am I reading this wrong? If not, then someone should be spelling this out a whole lot better during...
Reply

Re: The death of Simple Rep

Malkazoid ·
I'm stuck in the past - I never noticed that Activity Points had become actual rewards, rather than a qualifying metric required to be able to earn rewards, as I believe it was in the white paper. Are we earning rewards now? I thought that only started at launch time... Right now, I thought all we were doing was building reputation...
Reply

Re: The death of Simple Rep

David Dreezer ·
Guys - The Electorate component will not be available with the initial Beta launch of Narrative. We currently project that this component will not be added until Q2/Q3 2019. Until it is added the rewards reserved for the Electorate will instead be applied to Activity Rewards.
Reply

Re: The death of Simple Rep

Malkazoid ·
So I'll make on last attempt at trying to communicate what I feel is off here. In early reputation discussions, it was very reasonably professed that positive activities such as voting, suggesting niches, etc... would boost reputation, and the more frequently you did it, the bigger the boost BUT that boost would wear off over time. So that there would be no resting on ones laurels for too long. Well here, it feels like there's no soft decay of that boost in effect. If someone can join one...
Reply

Re: The death of Simple Rep

Erik Blair ·
However, according to the SPEC, the Activity Rewards " will not be added until Q2/Q3 2019." So if the Electorate rewards are supposed to be applied to the Activity Rewards, where does one view their own Activity Rewards given that that feature has not yet been added either?
Reply

Re: The death of Simple Rep

MOLLY O ·
@Erik Blair . As Dave mentioned, the Electorate related activity points won't be ready until Q2/3 as we need to prepare for the staking aspects (should you decide to stake your rewards to earn more). Until then, voting counts as Activity Points and will be calculated monthly and credits to be distributed like all the other rewards. The hard part about being part of the Alpha is that you are seeing changes and trying to react and understand changes and the entire platform isn't ready yet. So,...
Reply

Re: The death of Simple Rep

Christina Gleason ·
So just to ask this as simply as possible, we're earning NRVE already, but it won't be credited to (well, visible in) our accounts until that feature goes live? But we are earning NRVE?
Reply

Re: The death of Simple Rep

MOLLY O ·
@Christina Gleason . Yes, you are correct. All of the Niche votes during the Alpha will count toward your Activity points to be eligible for NRVE. Activities are 8% of the total reward pool. You are also correct that these rewards will not be credited until after the Beta is launched. It won't be the day of the Beta, it will be about a month later when the first monthly distribution occurs! As a side note, I think there is some confusion with this Community Platform. No Narrative rewards for...
Reply

Re: The death of Simple Rep

Christina Gleason ·
Thank you for the clarification!
Reply

Re: The death of Simple Rep

Erik Blair ·
Ok, so the activity rewards are being accumulated by some system in the background and eventually credited to our accounts a month after the launch. Got it. And I assume those are currently accumulating regardless of the 2,000 NRVE minimum commitment since there's nowhere to add the NRVE commitment at this time, right? Also, how does one "stake your rewards" to earn more? And when does that happen?
Reply

Re: The death of Simple Rep

MOLLY O ·
We will announce when Electorate Rewards take into effect. These are a special group of Activity rewards focused on voting. Again, for now, they are simply lumped into regular Activity Rewards. Post Beta when Electorate Rewards are ready, Electorate type activities get a bonus if you Stake. Staking is just keeping a balance in your NRVE credits in the system. Here is the blog that explains it.
Reply

Re: The death of Simple Rep

Erik Blair ·
@MOLLY O I am sorry if I am pestering you... I appreciate the answers since I have looked over the SPEC and can't find these answers, only more questions. I read the article you suggested, and it says, under "How NRVE Is Committed", "Anyone with an average balance (on their Narrative account) of 2,000 NRVE or more at the end of the month would qualify for Electorate rewards. Average balance is calculated based on daily balance snapshots." That passage seems to suggest that people don't...
Reply

Re: The death of Simple Rep

MOLLY O ·
Erik, Good catch. I did mislead you unintentionally. Since this isn't on the immediate plate, I should have looked more clearly in the spec. You are correct, it does state you have to have a minimum staked at 2,000 NRVE to qualify for the Electorate. What isn't stated is what if you don't have 2,000 staked? I am not sure if in that case, it just counts as an Activity. We will need to clarify this in the Spec. (BTW, I just edited my original answer to you so it doesn't get quoted wrong...
Reply

Re: The death of Simple Rep

Erik Blair ·
@MOLLY O thank you. I look forward to that Spec clarification. So my take away so far is that all the activity I have been doing is being credited and at some point will be added to my account. And at some point, I will accumulate 2,000 NRVE (because I can't add it), and until then, nobody gets a bonus if they have less than 2,000 NRVE. Please keep us posted. Thank you for your time.
 
×
×
×
×