Please upgrade your browser for the best possible experience.

Chrome Firefox Internet Explorer
×

Random number generator for reverse engineering flaky

STAR WARS: The Old Republic > English > Crew Skills
Random number generator for reverse engineering flaky

allquixotic's Avatar


allquixotic
01.30.2013 , 10:39 PM | #21
Funny how people have posted to this thread who claim they know something about mathematics or statistics.

Put simply, what it means to say "you have a 20% chance of succeeding each time you try this" is that, if you had a statistically significant sample set, you should find that somewhere close to 20% of the attempts resulted in successes. This correlation should increase the larger your sample set.

So, if your sample set is 1 attempt, you aren't going to derive ANY meaningful data. Same with 10, 100, 1000. Ok, so maybe at 1000 you will start to get SOME meaningful data.

But imagine if you had 100,000,000,000,000,000,000,000,000,000,000,000,00 0,000,000,000,000,000,000,000 attempts recorded down, and in that enormous sample set, only 6% of the attempts actually succeeded.

Assuming you had this huge sample set and this observed result of 6%, how accurate is the original claim that "you have a 20% chance of succeeding each time you try this"? Well, given the astronomically huge sample set and the extremely skewed results, your conclusion would be "the original claim is totally bunk".

That is just one extreme example, where I demonstrated that, with an enormous sample set whose results do not even come remotely close to matching the original claim, the descriptive statistics of the results do not match the inductive statistics of the prediction.

All we're looking at with SWTOR is a much, much smaller sample set, where the data is still nonetheless skewed. That doesn't mean "you can't derive any conclusions from it at all because it's random" -- there are different types of randomness, different "qualities" of randomness. If the randomness source were ideal, then the more data points you have, the less likely you are to observe results which do not agree with the inductive principle (the 20% chance) -- assuming that (1) the inductive principle is CORRECT, and (2) assuming that the random number generator produces true random numbers.

So, if we HAD a significant sample size and could demonstrate that the sum of all our player-experience data is statistically significant, and we found that the results were skewed, then we could conclude that either (1) the inductive principle is INCORRECT, or (2) the random number generator DOES NOT produce true random numbers.

While it is true that one player's results would not be enough data, I think it'd be neat to have some kind of collaborative spreadsheet on Google Docs where a ton of people record their RE attempt results. This would allow us to gather a significant sample set.

Of course, "significant" is in the eye of the beholder. What's significant? How many is enough? It really depends on how many chance events are occurring within a practical timeframe that you're willing to measure.

For example, if you are measuring probabilistic quantum events that occur thousands or millions of times per second, a sample size of 1000 is not statistically significant. But, if you are measuring a baseball player's chance of hitting a home run when he steps up to the plate, 1000 could be very significant as a means of coming up with an inductive principle.

What Bioware has done is they've given us an inductive principle (20% chance of success) without providing us the "source code" (the mathematical theory or empirical evidence) supporting that principle. So, basically, without a statistically significant number of rolls of the dice from their random number generator in a spreadsheet, we can't be sure that what they claim is true, unless we observe the results ourselves (which will take a long time to get a goodly amount of data).

Right now, "20% chance of success" means nothing. It may as well be 0.1%. Any inductive probability claim is only as true as the data supporting it.

Yaesive's Avatar


Yaesive
02.02.2013 , 02:50 AM | #22
First off as an individual with a Six Sigma Green Belt, I always find the statistical numbers interesting. Yet, even with my background combined with the fact that I understand the assumed logic of the 1K flips of a coin and the odds that align with this for heads and tails.

It is as one of the previous posters points out; the number (e.g. 20% Green to Blue) is simply that without the understanding of the formula used to determine this and the alignment of the code to implement the formula it truly does means nothing. Honestly I do not foresee BioWare or EA allowing their code to become public regardless of the concept that has evolved of F2P.

I do remember a discussion over a year ago (shortly after launch) that revolved around the logic of real world thinking. That discussion in this forum based that even if I fail at something I learn from the mistake to improve my odds of success the next time I attempt the same thing. This was when the BioWare coders actually and openly admitted the formula did not account for "n" attempts to create a new formula after each attempt due to the complexity it would require.

Now even with the odds and the statistical studies we all point to with different trains of thought and methods that work for one person and not another, we have to remember that the underlying code is nothing without understanding of how it integrates into the system. Thus the fact that without evidence of the code and the formula being used to drive the code all this is simply assumptions on what should occur and how it works.

So in basic terms I would declare it more a myth and base it on the fact that it works every now and then for me. This assumption also plays around that I have the patients at times to waste hours gathering resources (including credits) to craft with only to have to spend more time doing it all over to get the desired outcome.

Hence the real question we are asking is are we satisfied with crafting in general cause it is not delivering what an individual wants, but might for someone else.
Yaesive | Jo'lin | Fojea
Jedi Sage | Jedi Guardian | Smuggler
Jedi Covenant - Outer-Rim Recon Battalion Formerly Canderous Ordo
"Do or Do Not. There is no Try" - Yoda