View Single Post

finelinebob's Avatar

12.24.2012 , 09:40 PM | #5
Quote: Originally Posted by Holinyx View Post
i've read your post 3 times. and i have no idea what you are talking about. UT isn't broken, people just want to get rare metals EVERY time and that's not how it works.
I didn't say it was broken. Quite the contrary: just like with RE, I am certain that the system is working as designed. I did say that there is evidence of a bias in mission distributions that could only happen by BioWare programming it to work that way. The statistical tests that you have no idea about are the sorts of tools that could show just how biased things are. Yes, I realize that by saying "i have no idea what you are talking about" you may simply be disagreeing with me, but if you understood the stats involved you would know that you do not have enough information to make that decision. This is not a simple matter.

It may be because of all the complaints of RE being "broken" when it clearly isn't -- when RE is a very straight-forward application of simple probability of single, independent events -- that people who do understand that RE is working as designed have the same simple faith that the randomization schemes used in crew mission selection is also done using a "fair coin", a process of random selection that shows no "favoritism" to either gift or fabric or metal missions. What I am saying is that using a set of 3000 data points, not just the last few times I tried to run missions, I've been able to do a few simple statistical tests that demonstrate a bias in mission selection that cannot be explained by a random fluctuation and therefore indicate some systematic variation. I can also state that the probability that these tests have falsely indicated a pattern when there really wasn't one, it was just a highly improbably random fluke, is less than 0.001, or a chance of less than 0.1% of being wrong. Statistically speaking, when human decision-making is involved, that level of precision is quite high.

What I am also saying is that there are structural design decisions that BioWare made, such as the absolute availability of gift, fabric and metal missions by yield and by Grade, that even if BioWare was using a truly "fair coin" to select which five missions appear per Grade for each time your mission list gets randomized there would exist a bias in mission availability due to that structure. If you would take the time to look at the Darth Hater Database of Underworld Trading Missions, as I have, you would see quite clearly where the biases lay. I am not saying anything further, or more definitive, because as I said my knowledge of the more advanced statistical tests needed to look at these more complex issues has faded somewhat in the 18 years since I last used them, and I have enough respect for how misleading statistics can be when they are done properly yet twisted to indicate what they do not (the old "lies, damned lies and statistics" issue), let alone the damage they can do when not done properly in the first place, to keep my mouth shut about saying anything more.

So yes, I am putting teasers out there regarding things I can claim with a high degree of certainty to hopefully grab someone's attention who could work with me on this. To be blunt about it, the questions that BioWare's structuring of mission distributions raise involve a model that would require at least a Two-Way Analysis of Variance (ANOVA) test involving a Between-Subjects design with unequal population sizes and a sampling without replacement involving the whole populations of each group. The limited sizes of the populations and the fact that they vary by nearly a factor of 2 between grades is what raises all sorts of red flags for me in thinking about just "tossing" the numbers into Excel and running the tests anyway: they may violate some of the root assumptions that are required for valid ANOVA designs. The biggest problem overall, though, is the one distinct systematic bias that I have been able to verify and the interaction affects it might create. Because of these possible interactions, I cannot make any definitive claims based solely on BioWare's design and a logical argument assuming simple random assignment.

If you didn't understand my earlier posts, I am certain you didn't understand that. But it's not my intent to confuse people, rather, I am trying to make clear what stats knowledge is required so people with some stats knowledge can rule themselves out or not. This is not a situation parallel to whether "a 20% Chance for Success means I will always get a success in 5 tries or less" is right or wrong (that's patently wrong for anyone with an understanding of simple probability). But go ahead and look up some of those terms I tossed around in Wikipedia and you'll quickly find out how complex an issue this is.
Jedi Guardian JonBonJovi'wan
"Wanted: Dead or Alive"
Defenders of Monkeys - Prophecy of the Five
DatacronHunter's Video Guides to Datacrons | Datacron Spreadsheet