Problem with Top Ten Listing?

[xeonx]

Currently #10 on the open-source engine listing is an ancient dos ~3D engine which is in active and no longer really usable. It also has only 2 rating which average out to 2.5, has relativly empty feature set, and only one screenshot. RealmForge on the other hand, has an average rating of 4.5 over two review, and has even been updated several times. What is the algorithem that is applied to listings to deritmine the top 10? It seems as if RealmForge would come out over this novelty engine listing which I could never even see a use for and was likely listed for purely archiving purposes, but which seems to be the 10th best rated open-source engine on DevMaster.net instead.

[xeonx]

It would seem as if RealmForge would be placed 8th, right above Axiom if any of the above mentioned features, changes, or ratings were actually considered in the algorithem.

[Dia Kharrat]

Thanks for raising your concern. The algorithm takes into account both the overall rating and the total number of ratings. We can't reveal the exact algorithm at the moment as that may cause abuse. Also, ratings affect the engine immediately, but the ranking is only updated every 5 minutes. So you won't see your rank immeidately after submitting.

Looking at the issue closer, it seems the algorithm is working correclty. At the time you had this issue, both RealmForge and Kaboom engine had only one rating, with Kaboom slightly higher. Although I won't agree with that rating myself (since RealForge is much more advanced), it is correct from a mathematical point of view.

I hope I cleared up the issue. Let me know if you still see problems.

[xeonx]

Thanks for raising your concern. The algorithm takes into account both the overall rating and the total number of ratings. We can't reveal the exact algorithm at the moment as that may cause abuse. Also, ratings affect the engine immediately, but the ranking is only updated every 5 minutes. So you won't see your rank immeidately after submitting.

Looking at the issue closer, it seems the algorithm is working correclty. At the time you had this issue, both RealmForge and Kaboom engine had one only rating, with Kaboom slightly higher. Although I won't agree that rating myself (since RealForge is much more advanced), it is correct from a mathematical point of view.

I hope I cleared up the issue. Let me know if you still see problems.
12136


In that case i think it is a problem with the delay, but a delay much greater then 5 minutes. At the time that i posted this issue, there had been two rating for some time now. Also, Kaboom has had 2 ratings for since the 27th and they averaged to be 2.5, far less then RealmForge's even though it has only one rating. Is the number of rating supposed to be this critical in the overall ranking??

Then i when i checked back again early this morning, RealmForge had two ratings which averaged out to 4.5, yet it remained off of the top engine list for at least a couple hours. This means that both engines had the same number of reviews and RealmForge had about 2x the rating, yet the delay was *far* more then 5 minutes. When you said that Kaboom had only 1 rating, is that what the actually data showed, because then that would mean that the backend data and the webpage are out out sync.

[Dia Kharrat]

I'll look into it and see if that's true. The Top Ten seem correct at this moment though, right?

We are planning on modifying the review system slightly so that the rating score gets weighted depending on how useful and accurate the review is. Ultimitely, the score is meaningful when there's many reviews. I see that you have already written a review for a couple of engines already in an objective way, which is good. Keep up!

As for your problem, I'll take a closer look at it and see if it is indeed a problem.

[xeonx]

I'll look into it and see if that's true. The Top Ten seem correct at this moment though, right?

We are planning on modifying the review system slightly so that the rating score gets weighted depending on how useful and accurate the review is. Ultimitely, the score is meaningful when there's many reviews. I see that you have already written a review for a couple of engines already in an objective way, which is good. Keep up!

As for your problem, I'll take a closer look at it and see if it is indeed a problem.
12159



Yep, it is corrected now and I am at the rank that i had predicted it should be so everything is good. Thanks. I wounder how you will detirmine how useful a review is other then manual admin rating or user-based rating, but cant wait to see it in action. One thing that would be nice is kind of general information section in which i could post useful links, and give a more in-depth idea of what the framework is without it being in one of the features lists. It just wouldnt fit to start listing Urls and mixing descriptions with bullet points, and i would rather use that then deal with trying to update my intial review with information and treating it as the general info page. Just a thought.