-------------------------------------------- EMMIX - Mixture Analysis(Clustering) of (Range of G) Sample in File test.dat -------------------------------------------- input file:test.dat output file:test.out2 -------------------------------------------- Initial fit Tolerance: 9.99999997E-07 Initial fit Max Iterations: 500. FINAL fit Tolerance: 9.99999997E-07 FINAL fit Max Iterations: 500. -------------------------------------------- number of entities: 150 number of variables: 2 Range of number of components is: 1 to 10 components Unrestricted covariance matrices -------------------------------------------- automatic methods used for initial groupings with 10 random start(s), 10 k-mean(s) starts and -------------------------------------------- random seeds = 100 200 300 -------------------------------------------- Stepwise bootstrap analysis to be done with 99 replications -------------------------------------------- ************************************************************* Results for 1 cluster(s) ************************************************************* Final Log-Likelihood is -636.764 Estimated mean (as a row vector) for each component -0.38452 0.75875E-01 Estimated common covariance matrix 10.5948 0.405222E-01 1.57487 Criteria for this Clustering are AIC BIC AWE 1283.52884 1298.58202 1333.6352 ************************************************************* Results for 2 cluster(s) ************************************************************* Results of search for initial Grouping ******* ** ****** *** ******* ******** Random Initial Grouping ~~~~~~ ~~~~~~~ ~~~~~~~~ 10 Random Starts used All the data used to form starts Random start Number ( Random seeds ) Like ------------------------------------------------------------------------ random start 1 100 200 300 Log Likelihood value from EM algorithm started from this grouping is -624.771 ------------------------------------------------------------------------ random start 2 29760 20220 13259 Log Likelihood value from EM algorithm started from this grouping is -608.804 ------------------------------------------------------------------------ random start 3 18028 13673 5116 Log Likelihood value from EM algorithm started from this grouping is -608.804 ------------------------------------------------------------------------ random start 4 1466 21556 11019 Log Likelihood value from EM algorithm started from this grouping is -608.804 ------------------------------------------------------------------------ random start 5 408 3269 29429 Log Likelihood value from EM algorithm started from this grouping is -608.804 ------------------------------------------------------------------------ random start 6 24560 6211 1121 Log Likelihood value from EM algorithm started from this grouping is -624.771 ------------------------------------------------------------------------ random start 7 14227 12700 19929 Log Likelihood value from EM algorithm started from this grouping is -624.771 ------------------------------------------------------------------------ random start 8 2349 11076 25990 Log Likelihood value from EM algorithm started from this grouping is -608.804 ------------------------------------------------------------------------ random start 9 14983 4486 19645 Log Likelihood value from EM algorithm started from this grouping is -624.771 ------------------------------------------------------------------------ random start 10 3344 4991 10608 Log Likelihood value from EM algorithm started from this grouping is -608.804 ------------------------------------------------------------------------ K-means Starting allocation 1 ~~~~~~~ ~~~~~~~~ ~~~~~~~~~~~ K-means Start 1 8405 10586 17632 1 2 1 1 2 2 1 2 2 1 2 1 1 2 2 2 2 1 1 2 1 1 2 1 1 2 2 1 1 1 1 2 2 2 2 2 1 1 1 2 2 2 2 2 2 1 2 2 1 1 2 2 1 1 2 2 2 2 2 1 1 2 1 1 2 1 2 2 1 1 1 1 1 2 2 2 2 2 2 1 2 1 1 2 2 1 2 1 2 1 1 1 1 2 2 2 2 1 1 1 1 1 2 1 1 1 1 1 1 1 2 1 1 1 2 1 1 1 2 2 2 2 2 1 2 2 2 1 1 1 2 1 1 2 1 1 2 1 1 1 1 1 1 1 2 1 1 2 2 1 Log Likelihood value from EM algorithm started from this grouping is -624.771 K-means Starting allocation 2 ~~~~~~~ ~~~~~~~~ ~~~~~~~~~~~ K-means Start 2 16594 13993 17108 2 1 2 2 1 1 2 1 1 2 1 2 2 1 1 1 1 2 2 1 2 2 1 2 2 1 1 2 2 2 2 1 1 1 1 1 2 2 2 1 1 1 1 1 1 2 1 1 2 2 1 1 1 2 1 1 1 1 1 2 2 1 2 1 1 2 1 1 2 2 2 1 2 1 1 1 1 1 1 2 1 2 2 1 1 2 1 2 1 2 2 2 2 1 1 1 1 1 2 2 1 2 1 2 2 2 2 1 1 1 1 2 2 2 1 2 2 2 1 1 1 1 1 2 1 1 1 2 2 2 1 2 2 1 2 2 1 2 2 1 2 2 2 1 1 2 2 1 1 2 Log Likelihood value from EM algorithm started from this grouping is -624.771 K-means Starting allocation 3 ~~~~~~~ ~~~~~~~~ ~~~~~~~~~~~ K-means Start 3 13084 5599 4685 1 2 1 1 2 2 1 2 2 1 2 1 1 2 2 2 2 1 1 2 1 1 2 1 1 2 2 1 1 1 1 2 2 2 2 2 1 1 1 2 2 2 2 2 2 1 2 2 1 1 2 2 1 1 2 2 2 2 2 1 1 2 1 1 2 1 2 2 1 1 1 1 1 2 2 2 2 2 2 1 2 1 1 2 2 1 2 1 2 1 1 1 1 2 2 2 2 1 1 1 1 1 2 1 1 1 1 1 1 1 2 1 1 1 2 1 1 1 2 2 2 2 2 1 2 2 2 1 1 1 2 1 1 2 1 1 2 1 1 1 1 1 1 1 2 1 1 2 2 1 Log Likelihood value from EM algorithm started from this grouping is -624.771 K-means Starting allocation 4 ~~~~~~~ ~~~~~~~~ ~~~~~~~~~~~ K-means Start 4 19353 13061 4305 2 1 2 2 1 1 2 1 1 2 1 2 2 1 1 1 1 2 2 1 2 2 1 2 2 1 1 2 2 2 2 1 1 1 1 1 2 2 2 1 1 1 1 1 1 2 1 1 2 2 1 1 2 2 1 1 1 1 1 2 2 1 2 2 1 2 1 1 2 2 2 2 2 1 1 1 1 1 1 2 1 2 2 1 1 2 1 2 1 2 2 2 2 1 1 1 1 2 2 2 2 2 1 2 2 2 2 2 2 2 1 2 2 2 1 2 2 2 1 1 1 1 1 2 1 1 1 2 2 2 1 2 2 1 2 2 1 2 2 2 2 2 2 2 1 2 2 1 1 2 Log Likelihood value from EM algorithm started from this grouping is -624.771 K-means Starting allocation 5 ~~~~~~~ ~~~~~~~~ ~~~~~~~~~~~ K-means Start 5 22118 12681 29554 1 2 1 1 2 2 1 2 2 1 2 1 1 2 2 2 2 1 1 2 1 1 2 1 1 2 2 1 1 1 1 2 2 2 2 2 1 1 1 2 2 2 2 2 2 1 2 2 1 1 2 2 2 1 2 2 2 2 2 1 1 2 1 2 2 1 2 2 1 1 1 2 1 2 2 2 2 2 2 1 2 1 1 2 2 1 2 1 2 1 1 1 1 2 2 2 2 2 1 1 2 1 2 1 1 1 1 2 2 2 2 1 1 1 2 1 1 1 2 2 2 2 2 1 2 2 2 1 1 1 2 1 1 2 1 1 2 1 1 2 1 1 1 2 2 1 1 2 2 1 Log Likelihood value from EM algorithm started from this grouping is -624.771 K-means Starting allocation 6 ~~~~~~~ ~~~~~~~~ ~~~~~~~~~~~ K-means Start 6 24984 14658 2659 2 1 2 2 1 1 2 1 1 2 1 2 2 1 1 1 1 2 2 1 2 2 1 2 2 1 1 2 2 2 2 1 1 1 1 1 2 2 2 1 1 1 1 1 1 2 1 1 2 2 1 1 2 2 1 1 1 1 1 2 2 1 2 2 1 2 1 1 2 2 2 2 2 1 1 1 1 1 1 2 1 2 2 1 1 2 1 2 1 2 2 2 2 1 1 1 1 2 2 2 2 2 1 2 2 2 2 2 2 2 1 2 2 2 1 2 2 2 1 1 1 1 1 2 1 1 1 2 2 2 1 2 2 1 2 2 1 2 2 2 2 2 2 2 1 2 2 1 1 2 Log Likelihood value from EM algorithm started from this grouping is -624.771 K-means Starting allocation 7 ~~~~~~~ ~~~~~~~~ ~~~~~~~~~~~ K-means Start 7 14829 9716 6618 2 1 2 2 1 1 2 1 1 2 1 2 2 1 1 1 1 2 2 1 2 2 1 2 2 1 1 2 2 2 2 1 1 1 1 1 2 2 2 1 1 1 1 1 1 2 1 1 2 2 1 1 1 2 1 1 1 1 1 2 2 1 2 1 1 2 1 1 2 2 2 1 2 1 1 1 1 1 1 2 1 2 2 1 1 2 1 2 1 2 2 2 2 1 1 1 1 1 2 2 1 2 1 2 2 2 2 1 1 1 1 2 2 2 1 2 2 2 1 1 1 1 1 2 1 1 1 2 2 2 1 2 2 1 2 2 1 2 2 1 2 2 2 1 1 2 2 1 1 2 Log Likelihood value from EM algorithm started from this grouping is -624.771 K-means Starting allocation 8 ~~~~~~~ ~~~~~~~~ ~~~~~~~~~~~ K-means Start 8 11364 6556 13039 2 1 2 2 1 1 2 1 1 2 1 2 2 1 1 1 1 2 2 1 2 2 1 2 2 1 1 2 2 2 2 1 1 1 1 1 2 2 2 1 1 1 1 1 1 2 1 1 2 2 1 1 2 2 1 1 1 1 1 2 2 1 2 2 1 2 1 1 2 2 2 2 2 1 1 1 1 1 1 2 1 2 2 1 1 2 1 2 1 2 2 2 2 1 1 1 1 2 2 2 2 2 1 2 2 2 2 2 2 2 1 2 2 2 1 2 2 2 1 1 1 1 1 2 1 1 1 2 2 2 1 2 2 1 2 2 1 2 2 2 2 2 2 2 1 2 2 1 1 2 Log Likelihood value from EM algorithm started from this grouping is -624.771 K-means Starting allocation 9 ~~~~~~~ ~~~~~~~~ ~~~~~~~~~~~ K-means Start 9 1642 18211 3179 2 1 2 2 1 1 2 1 1 2 1 2 2 1 1 1 1 2 2 1 2 2 1 2 2 1 1 2 2 2 2 1 1 1 1 1 2 2 2 1 1 1 1 1 1 2 1 1 2 2 1 1 1 2 1 1 1 1 1 2 2 1 2 1 1 2 1 1 2 2 2 1 2 1 1 1 1 1 1 2 1 2 2 1 1 2 1 2 1 2 2 2 2 1 1 1 1 1 2 2 1 2 1 2 2 2 2 1 1 1 1 2 2 2 1 2 2 2 1 1 1 1 1 2 1 1 1 2 2 2 1 2 2 1 2 2 1 2 2 1 2 2 2 1 1 2 2 1 1 2 Log Likelihood value from EM algorithm started from this grouping is -624.771 K-means Starting allocation 10 ~~~~~~~ ~~~~~~~~ ~~~~~~~~~~~ K-means Start 10 7088 16992 24733 2 1 2 2 1 1 2 1 1 2 1 2 2 1 1 1 1 2 2 1 2 2 1 2 2 1 1 2 2 2 2 1 1 1 1 1 2 2 2 1 1 1 1 1 1 2 1 1 2 2 1 1 2 2 1 1 1 1 1 2 2 1 2 2 1 2 1 1 2 2 2 2 2 1 1 1 1 1 1 2 1 2 2 1 1 2 1 2 1 2 2 2 2 1 1 1 1 2 2 2 2 2 1 2 2 2 2 2 2 2 1 2 2 2 1 2 2 2 1 1 1 1 1 2 1 1 1 2 2 2 1 2 2 1 2 2 1 2 2 2 2 2 2 2 1 2 2 1 1 2 Log Likelihood value from EM algorithm started from this grouping is -624.771 ------------------------------------------------------------------------ Final log likelihood values from each initial grouping -624.8 -608.8 -608.8 -608.8 -608.8 -624.8 -624.8 -608.8 -624.8 -608.8 -624.8 -624.8 -624.8 -624.8 -624.8 -624.8 -624.8 -624.8 -624.8 -624.8 Best initial grouping (corresponding to the highest value of likelihood found by the Random Start 004 method ------------------------------------------------------------------------ Estimated mean (as a row vector) for component 1 3.96009 0.108047 Estimated mean (as a row vector) for component 2 -1.80401 0.653633E-01 Estimated covariance matrix for component 1 0.585467 -0.232830 3.28843 Estimated covariance matrix for component 2 5.68303 0.692438E-01 1.01457 Mixing proportion from each component 0.246 0.754 Starting Partition Found 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 Determinants of component covariance matrices 1.87105502 5.76102117 After iteration 0 the log likelihood = -608.804 Determinants of component covariance matrices 1.87105311 5.7610414 After iteration 1 the log likelihood = -608.804 Determinants of component covariance matrices 1.871052 5.76105311 After iteration 2 the log likelihood = -608.804 Determinants of component covariance matrices 1.87105136 5.76105989 After iteration 3 the log likelihood = -608.804 Determinants of component covariance matrices 1.87105099 5.76106381 After iteration 4 the log likelihood = -608.804 Determinants of component covariance matrices 1.87105078 5.76106608 After iteration 5 the log likelihood = -608.804 Determinants of component covariance matrices 1.87105065 5.7610674 After iteration 6 the log likelihood = -608.804 Determinants of component covariance matrices 1.87105058 5.76106816 After iteration 7 the log likelihood = -608.804 Determinants of component covariance matrices 1.87105054 5.7610686 After iteration 8 the log likelihood = -608.804 Determinants of component covariance matrices 1.87105052 5.76106886 After iteration 9 the log likelihood = -608.804 Determinants of component covariance matrices 1.8710505 5.761069 After iteration 10 the log likelihood = -608.804 Final Log-Likelihood is -608.804 In loop 11 log likelihood is -608.804 Observation | mixture log density|Grp1 Grp2 ..etc...| 1 0.24014E-02 0.1292 0.8708 2 0.23257E-01 0.0000 1.0000 3 0.34288E-01 0.0000 1.0000 4 0.28062E-01 0.0000 1.0000 5 0.23894E-01 0.0003 0.9997 6 0.35408E-02 0.0001 0.9999 7 0.11888E-01 0.0000 1.0000 8 0.48458E-01 0.0000 1.0000 9 0.29737E-01 0.0000 1.0000 10 0.36820E-01 0.0000 1.0000 11 0.43682E-01 0.0000 1.0000 12 0.36874E-01 0.0000 1.0000 13 0.43098E-01 0.0000 1.0000 14 0.37231E-01 0.0000 1.0000 15 0.26125E-01 0.0002 0.9998 16 0.38650E-01 0.0000 1.0000 17 0.39620E-01 0.0000 1.0000 18 0.39045E-01 0.0000 1.0000 19 0.11319E-01 0.0006 0.9994 20 0.16143E-01 0.0000 1.0000 21 0.12681E-01 0.0358 0.9642 22 0.13971E-02 0.0007 0.9993 23 0.41056E-02 0.0022 0.9978 24 0.18035E-01 0.0021 0.9979 25 0.41962E-01 0.0000 1.0000 26 0.39149E-02 0.0000 1.0000 27 0.42856E-01 0.0000 1.0000 28 0.16089E-01 0.0000 1.0000 29 0.12623E-01 0.0000 1.0000 30 0.37010E-01 0.0000 1.0000 31 0.27438E-01 0.0001 0.9999 32 0.32494E-01 0.0000 1.0000 33 0.17394E-01 0.0000 1.0000 34 0.23594E-01 0.0000 1.0000 35 0.33944E-01 0.0000 1.0000 36 0.10622E-02 0.0082 0.9918 37 0.22300E-01 0.0000 1.0000 38 0.45041E-01 0.0000 1.0000 39 0.40831E-01 0.0000 1.0000 40 0.32864E-01 0.0000 1.0000 41 0.35216E-01 0.0000 1.0000 42 0.26937E-01 0.0000 1.0000 43 0.23042E-01 0.0000 1.0000 44 0.84027E-02 0.0000 1.0000 45 0.32346E-01 0.0000 1.0000 46 0.30826E-01 0.0000 1.0000 47 0.31431E-01 0.0000 1.0000 48 0.22358E-01 0.0001 0.9999 49 0.41603E-01 0.0000 1.0000 50 0.30304E-01 0.0000 1.0000 51 0.25618E-01 0.0000 1.0000 52 0.24089E-02 0.0001 0.9999 53 0.14672E-01 0.0772 0.9228 54 0.35481E-01 0.0000 1.0000 55 0.34519E-01 0.0000 1.0000 56 0.42991E-01 0.0000 1.0000 57 0.29784E-01 0.9271 0.0729 58 0.98140E-02 0.9575 0.0425 59 0.22572E-01 0.8596 0.1404 60 0.26671E-01 0.9359 0.0641 61 0.38604E-02 0.9948 0.0052 62 0.27979E-01 0.9322 0.0678 63 0.24317E-01 0.8372 0.1628 64 0.20675E-01 0.9365 0.0635 65 0.26514E-01 0.8337 0.1663 66 0.18241E-02 0.9185 0.0815 67 0.12978E-01 0.9481 0.0519 68 0.23526E-01 0.9386 0.0614 69 0.27681E-01 0.8505 0.1495 70 0.14514E-01 0.8958 0.1042 71 0.14917E-01 0.9474 0.0526 72 0.29176E-01 0.9293 0.0707 73 0.18003E-01 0.9396 0.0604 74 0.22933E-01 0.9556 0.0444 75 0.76666E-03 1.0000 0.0000 76 0.75066E-02 0.9205 0.0795 77 0.16942E-01 0.9719 0.0281 78 0.49729E-02 0.8085 0.1915 79 0.21003E-01 0.8011 0.1989 80 0.10648E-01 0.9885 0.0115 81 0.20700E-01 0.9524 0.0476 82 0.10598E-01 0.9735 0.0265 83 0.22250E-01 0.7503 0.2497 84 0.23634E-02 0.9476 0.0524 85 0.23202E-01 0.9433 0.0567 86 0.11724E-01 0.7579 0.2421 87 0.11231E-01 0.7638 0.2362 88 0.10365E-01 0.9537 0.0463 89 0.19429E-01 0.9136 0.0864 90 0.11203E-01 0.9867 0.0133 91 0.27653E-02 0.9985 0.0015 92 0.24183E-02 0.9085 0.0915 93 0.99805E-02 0.8861 0.1139 94 0.60327E-02 0.9951 0.0049 95 0.12361E-01 0.9828 0.0172 96 0.27202E-01 0.9403 0.0597 97 0.18106E-01 0.0000 1.0000 98 0.10202E-01 0.0000 1.0000 99 0.12692E-01 0.0000 1.0000 100 0.33315E-01 0.0000 1.0000 101 0.17462E-01 0.0000 1.0000 102 0.35653E-01 0.0000 1.0000 103 0.16412E-03 0.0000 1.0000 104 0.25337E-01 0.0000 1.0000 105 0.29625E-01 0.0000 1.0000 106 0.39072E-01 0.0000 1.0000 107 0.31143E-01 0.0000 1.0000 108 0.63688E-02 0.0000 1.0000 109 0.49836E-01 0.0000 1.0000 110 0.39463E-01 0.0000 1.0000 111 0.17070E-01 0.0000 1.0000 112 0.41653E-01 0.0000 1.0000 113 0.41791E-01 0.0000 1.0000 114 0.11285E-01 0.0000 1.0000 115 0.86830E-02 0.0000 1.0000 116 0.12237E-01 0.0000 1.0000 117 0.15731E-01 0.0000 1.0000 118 0.37661E-02 0.0000 1.0000 119 0.12670E-01 0.0000 1.0000 120 0.41484E-02 0.0000 1.0000 121 0.23880E-01 0.0000 1.0000 122 0.38324E-01 0.0000 1.0000 123 0.22167E-01 0.0000 1.0000 124 0.31433E-01 0.0000 1.0000 125 0.14422E-01 0.0000 1.0000 126 0.47716E-01 0.0000 1.0000 127 0.37851E-02 0.0000 1.0000 128 0.32106E-01 0.0000 1.0000 129 0.40011E-01 0.0000 1.0000 130 0.20663E-01 0.0000 1.0000 131 0.36878E-01 0.0000 1.0000 132 0.48876E-01 0.0000 1.0000 133 0.18903E-01 0.0000 1.0000 134 0.11002E-01 0.0000 1.0000 135 0.45288E-01 0.0000 1.0000 136 0.44790E-01 0.0000 1.0000 137 0.15509E-01 0.0000 1.0000 138 0.24141E-01 0.0000 1.0000 139 0.40267E-01 0.0000 1.0000 140 0.15356E-01 0.0000 1.0000 141 0.24887E-01 0.0000 1.0000 142 0.24685E-01 0.0000 1.0000 143 0.25870E-01 0.0000 1.0000 144 0.38462E-01 0.0000 1.0000 145 0.55446E-02 0.0000 1.0000 146 0.27169E-01 0.0000 1.0000 147 0.26784E-01 0.0000 1.0000 148 0.25588E-01 0.0000 1.0000 149 0.19816E-01 0.0000 1.0000 150 0.16850E-01 0.0000 1.0000 Implied grouping of the entities into 2 groups 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 Number assigned to each component 40 110 Estimate of mixing proportion for each component 0.246 0.754 Estimates of correct allocation rates for each component 0.993 0.971 Estimate of overall correct allocation rate 0.976 Estimated mean (as a row vector) for each component 3.9601 0.10805 -1.8040 0.65363E-01 Estimated covariance matrix for component 1 0.585464 -0.232831 3.28844 Estimated covariance matrix for component 2 5.68307 0.692445E-01 1.01457 Criteria for this Clustering are AIC BIC AWE 1239.60851 1272.7255 1349.84249 and P-value from bootstrap of 0.00999999978 ************************************************************* Results for 3 cluster(s) ************************************************************* Results of search for initial Grouping ******* ** ****** *** ******* ******** Random Initial Grouping ~~~~~~ ~~~~~~~ ~~~~~~~~ 10 Random Starts used All the data used to form starts Random start Number ( Random seeds ) Like ------------------------------------------------------------------------ random start 1 28732 3855 3524 Log Likelihood value from EM algorithm started from this grouping is -588.209 ------------------------------------------------------------------------ random start 2 20839 10903 25158 Log Likelihood value from EM algorithm started from this grouping is -588.209 ------------------------------------------------------------------------ random start 3 8649 14272 8749 Log Likelihood value from EM algorithm started from this grouping is -588.209 ------------------------------------------------------------------------ random start 4 13185 286 867 Log Likelihood value from EM algorithm started from this grouping is -588.209 ------------------------------------------------------------------------ random start 5 19155 4669 27099 Log Likelihood value from EM algorithm started from this grouping is -588.209 ------------------------------------------------------------------------ random start 6 9956 26523 18424 Log Likelihood value from EM algorithm started from this grouping is -588.209 ------------------------------------------------------------------------ random start 7 14705 17490 26690 Log Likelihood value from EM algorithm started from this grouping is -588.209 ------------------------------------------------------------------------ random start 8 17472 10433 10152 Log Likelihood value from EM algorithm started from this grouping is -615.673 ------------------------------------------------------------------------ random start 9 29722 27369 2330 Log Likelihood value from EM algorithm started from this grouping is -588.209 ------------------------------------------------------------------------ random start 10 12773 18161 13020 Log Likelihood value from EM algorithm started from this grouping is -588.209 ------------------------------------------------------------------------ K-means Starting allocation 1 ~~~~~~~ ~~~~~~~~ ~~~~~~~~~~~ K-means Start 1 11566 8565 23562 1 2 3 1 3 2 1 3 3 3 3 3 3 3 3 3 3 3 1 2 1 1 2 3 3 2 3 1 1 3 3 3 2 2 3 2 1 3 3 3 3 2 2 2 2 3 3 3 3 1 2 2 3 3 3 3 3 2 2 1 1 2 3 3 3 1 2 2 3 1 1 3 3 2 2 3 2 2 3 1 2 1 3 2 2 1 2 1 2 1 1 1 1 2 2 3 3 3 1 3 3 3 2 1 3 3 3 3 3 3 3 3 3 1 2 1 3 1 2 2 3 3 3 3 3 3 3 3 3 1 3 3 1 3 3 3 2 3 3 3 1 1 1 3 3 3 3 3 3 3 Log Likelihood value from EM algorithm started from this grouping is -588.209 K-means Starting allocation 2 ~~~~~~~ ~~~~~~~~ ~~~~~~~~~~~ K-means Start 2 4722 68 21859 1 2 3 3 3 2 1 3 2 3 3 3 3 2 3 3 2 3 1 2 3 1 2 3 3 2 3 1 1 3 3 3 2 2 3 2 3 3 3 3 3 2 2 2 2 3 2 2 3 3 2 2 3 3 2 3 2 2 2 3 1 2 3 3 3 1 2 2 3 1 1 3 3 2 2 3 2 2 2 1 2 1 3 2 2 1 2 1 2 1 1 1 1 2 2 2 2 3 1 3 3 3 2 3 3 3 3 3 3 3 3 3 3 1 2 1 3 1 2 2 3 2 3 3 3 3 3 3 3 3 3 3 1 3 3 3 2 3 3 3 3 3 3 3 2 3 3 3 2 3 Log Likelihood value from EM algorithm started from this grouping is -588.209 K-means Starting allocation 3 ~~~~~~~ ~~~~~~~~ ~~~~~~~~~~~ K-means Start 3 26120 29752 26311 3 2 1 1 1 2 3 1 2 1 1 1 1 2 1 1 2 1 3 2 1 3 2 1 1 2 1 3 3 1 1 1 2 2 1 2 1 1 1 1 1 2 2 2 2 1 2 2 1 1 2 2 1 1 2 1 2 2 2 1 3 2 1 1 1 3 2 2 1 3 3 1 1 2 2 1 2 2 2 3 2 3 1 2 2 3 2 3 2 3 3 3 3 2 2 2 2 1 3 1 1 1 2 1 1 1 1 1 1 1 1 1 1 3 2 3 1 3 2 2 1 2 1 1 1 1 1 1 1 1 1 1 3 1 1 1 2 1 1 1 1 1 1 1 2 1 1 1 2 1 Log Likelihood value from EM algorithm started from this grouping is -588.209 K-means Starting allocation 4 ~~~~~~~ ~~~~~~~~ ~~~~~~~~~~~ K-means Start 4 12857 8541 24982 3 2 1 1 1 2 3 1 2 1 1 1 1 2 1 1 1 1 3 2 1 3 2 1 1 2 1 3 3 1 1 1 2 2 1 2 1 1 1 1 1 2 2 2 2 1 2 2 1 1 2 2 1 1 2 1 1 2 2 1 3 2 1 1 1 3 2 2 1 3 3 1 1 2 2 1 2 2 2 3 2 3 1 2 2 3 2 3 2 3 3 3 3 2 2 2 2 1 3 1 1 1 2 1 1 1 1 1 1 1 1 1 1 3 2 3 1 3 2 2 1 2 1 1 1 1 1 1 1 1 1 1 3 1 1 1 2 1 1 1 1 3 1 1 1 1 1 1 2 1 Log Likelihood value from EM algorithm started from this grouping is -588.209 K-means Starting allocation 5 ~~~~~~~ ~~~~~~~~ ~~~~~~~~~~~ K-means Start 5 19376 14526 8603 2 1 3 2 3 1 2 3 3 3 3 3 3 3 3 3 3 3 2 1 2 2 1 2 3 1 3 2 2 2 3 3 1 1 3 1 2 3 3 3 3 1 1 1 3 3 3 3 3 2 1 1 3 3 3 3 3 1 3 2 2 3 2 3 3 2 3 1 3 2 2 3 2 1 1 3 1 1 3 2 1 2 3 1 1 2 1 2 1 2 2 2 2 1 1 3 3 3 2 3 3 2 1 2 2 3 3 3 3 3 3 3 3 2 1 2 2 2 1 1 3 3 3 3 3 3 3 2 3 2 3 3 2 3 3 3 1 2 3 3 2 2 2 3 3 3 3 3 3 2 Log Likelihood value from EM algorithm started from this grouping is -588.209 K-means Starting allocation 6 ~~~~~~~ ~~~~~~~~ ~~~~~~~~~~~ K-means Start 6 11475 23172 6729 3 1 2 3 2 1 3 2 1 2 2 2 2 1 2 2 2 2 3 1 2 3 1 2 2 1 2 3 3 2 2 2 1 1 2 1 2 2 2 2 2 1 1 1 1 2 1 1 2 3 1 1 2 2 1 2 2 1 1 3 3 1 2 2 2 3 1 1 2 3 3 2 2 1 1 2 1 1 1 3 1 3 2 1 1 3 1 3 1 3 3 3 3 1 1 1 1 2 3 2 2 2 1 3 2 2 2 2 2 2 2 2 2 3 1 3 2 3 1 1 2 2 2 2 2 2 2 2 2 3 2 2 3 2 2 2 1 2 2 2 3 3 3 2 2 2 2 2 1 2 Log Likelihood value from EM algorithm started from this grouping is -588.209 K-means Starting allocation 7 ~~~~~~~ ~~~~~~~~ ~~~~~~~~~~~ K-means Start 7 19398 12328 17219 1 2 3 1 3 2 1 3 3 3 3 3 3 3 3 3 3 3 1 2 3 1 2 3 3 2 3 1 1 3 3 3 2 2 3 2 1 3 3 3 3 2 2 2 2 3 2 2 3 1 2 2 3 3 2 3 3 2 2 1 1 2 3 3 3 1 2 2 3 1 1 3 3 2 2 3 2 2 2 1 2 1 3 2 2 1 2 1 2 1 1 1 1 2 2 2 2 3 1 3 3 3 2 1 3 3 3 3 3 3 3 3 3 1 2 1 3 1 2 2 3 3 3 3 3 3 3 3 3 1 3 3 1 3 3 3 2 3 3 3 1 1 1 3 3 3 3 3 2 3 Log Likelihood value from EM algorithm started from this grouping is -588.209 K-means Starting allocation 8 ~~~~~~~ ~~~~~~~~ ~~~~~~~~~~~ K-means Start 8 18571 18827 22220 3 1 2 3 2 1 3 2 2 2 2 2 2 2 2 2 2 2 3 1 3 3 1 3 2 1 2 3 3 3 2 2 1 1 2 1 3 2 2 2 2 1 1 1 2 2 2 2 2 3 1 1 2 2 2 2 2 1 2 3 3 2 3 2 2 3 2 1 2 3 3 2 3 1 1 2 1 1 2 3 1 3 2 1 1 3 1 3 1 3 3 3 3 1 1 2 2 2 3 2 2 3 1 3 3 2 2 2 2 2 2 2 2 3 1 3 3 3 1 1 2 2 2 2 2 2 2 3 2 3 2 2 3 2 2 2 1 3 2 2 3 3 3 2 2 2 2 2 2 3 Log Likelihood value from EM algorithm started from this grouping is -588.209 K-means Starting allocation 9 ~~~~~~~ ~~~~~~~~ ~~~~~~~~~~~ K-means Start 9 13240 25952 27041 2 1 3 2 3 1 2 3 3 3 3 3 3 3 3 3 3 3 2 1 2 2 1 2 3 1 3 2 2 2 3 3 1 1 3 1 2 3 3 3 3 1 1 1 3 3 3 3 3 2 1 1 3 3 3 3 3 1 3 2 2 3 2 3 3 2 3 1 3 2 2 3 2 1 1 3 1 1 3 2 1 2 3 1 1 2 1 2 1 2 2 2 2 1 1 3 3 3 2 3 3 2 1 2 2 3 3 3 3 3 3 3 3 2 1 2 2 2 1 1 3 3 3 3 3 3 3 2 3 2 3 3 2 3 3 3 1 2 3 3 2 2 2 3 3 3 3 3 3 2 Log Likelihood value from EM algorithm started from this grouping is -588.209 K-means Starting allocation 10 ~~~~~~~ ~~~~~~~~ ~~~~~~~~~~~ K-means Start 10 10828 14597 1511 2 3 1 2 1 3 2 1 3 1 1 1 1 3 1 1 1 1 2 3 1 2 3 1 1 3 1 2 2 1 1 1 3 3 1 3 1 1 1 1 1 3 3 3 3 1 3 3 1 2 3 3 1 1 3 1 1 3 3 2 2 3 1 1 1 2 3 3 1 2 2 1 1 3 3 1 3 3 3 2 3 2 1 3 3 2 3 2 3 2 2 2 2 3 3 3 3 1 2 1 1 1 3 2 1 1 1 1 1 1 1 1 1 2 3 2 1 2 3 3 1 1 1 1 1 1 1 1 1 2 1 1 2 1 1 1 3 1 1 1 2 2 2 1 1 1 1 1 3 1 Log Likelihood value from EM algorithm started from this grouping is -588.209 ------------------------------------------------------------------------ Final log likelihood values from each initial grouping -588.2 -588.2 -588.2 -588.2 -588.2 -588.2 -588.2 -615.7 -588.2 -588.2 -588.2 -588.2 -588.2 -588.2 -588.2 -588.2 -588.2 -588.2 -588.2 -588.2 Best initial grouping (corresponding to the highest value of likelihood found by the K-Means 001 method ------------------------------------------------------------------------ Estimated mean (as a row vector) for component 1 -4.00521 0.306177 Estimated mean (as a row vector) for component 2 3.89578 0.119303 Estimated mean (as a row vector) for component 3 -0.322647 -0.146242 Estimated covariance matrix for component 1 2.14285 0.877420 0.788118 Estimated covariance matrix for component 2 0.669677 -0.239469 3.10713 Estimated covariance matrix for component 3 0.903406 0.116764 1.07726 Mixing proportion from each component 0.330 0.274 0.396 Starting Partition Found 3 3 3 1 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 1 1 1 1 1 1 1 1 1 1 1 1 3 1 1 1 1 1 1 1 1 1 1 1 1 3 1 1 1 3 1 1 1 1 1 3 1 1 1 1 3 1 3 1 1 3 1 1 1 1 1 1 1 1 Determinants of component covariance matrices 0.91895626 2.02342923 0.959564688 After iteration 0 the log likelihood = -588.209 Determinants of component covariance matrices 0.918972226 2.02341322 0.959556376 After iteration 1 the log likelihood = -588.209 Determinants of component covariance matrices 0.91898444 2.02340388 0.959549105 After iteration 2 the log likelihood = -588.209 Determinants of component covariance matrices 0.918993785 2.02339861 0.959542944 After iteration 3 the log likelihood = -588.209 Determinants of component covariance matrices 0.919000941 2.02339578 0.959537836 After iteration 4 the log likelihood = -588.209 Determinants of component covariance matrices 0.919006424 2.02339439 0.959533669 After iteration 5 the log likelihood = -588.209 Determinants of component covariance matrices 0.919010629 2.02339383 0.95953031 After iteration 6 the log likelihood = -588.209 Determinants of component covariance matrices 0.919013855 2.02339372 0.959527627 After iteration 7 the log likelihood = -588.209 Determinants of component covariance matrices 0.919016333 2.02339385 0.959525498 After iteration 8 the log likelihood = -588.209 Determinants of component covariance matrices 0.919018237 2.02339408 0.959523818 After iteration 9 the log likelihood = -588.209 Determinants of component covariance matrices 0.9190197 2.02339434 0.959522499 After iteration 10 the log likelihood = -588.209 Final Log-Likelihood is -588.209 In loop 11 log likelihood is -588.209 Observation | mixture log density|Grp1 Grp2 ..etc...| 1 0.15921E-02 0.0128 0.4202 0.5670 2 0.25834E-01 0.0002 0.0000 0.9998 3 0.51170E-01 0.0016 0.0000 0.9984 4 0.25646E-01 0.8003 0.0000 0.1997 5 0.25302E-01 0.0000 0.0013 0.9987 6 0.69573E-02 0.0000 0.0002 0.9998 7 0.16186E-01 0.0528 0.0000 0.9472 8 0.38589E-01 0.0204 0.0000 0.9796 9 0.53042E-01 0.0000 0.0000 1.0000 10 0.55286E-01 0.0019 0.0000 0.9981 11 0.61175E-01 0.0017 0.0000 0.9983 12 0.43409E-01 0.0290 0.0000 0.9710 13 0.58647E-01 0.0039 0.0000 0.9961 14 0.51259E-01 0.0004 0.0000 0.9996 15 0.29953E-01 0.0000 0.0007 0.9993 16 0.62312E-01 0.0004 0.0000 0.9996 17 0.48667E-01 0.0009 0.0000 0.9991 18 0.59785E-01 0.0013 0.0000 0.9987 19 0.12011E-01 0.0085 0.0022 0.9893 20 0.28392E-01 0.0000 0.0000 1.0000 21 0.54925E-02 0.0001 0.1836 0.8163 22 0.20012E-02 0.1813 0.0025 0.8162 23 0.40186E-02 0.0000 0.0076 0.9924 24 0.14350E-01 0.0003 0.0084 0.9913 25 0.48631E-01 0.0180 0.0000 0.9820 26 0.10265E-01 0.0000 0.0000 1.0000 27 0.62615E-01 0.0012 0.0000 0.9988 28 0.21139E-01 0.0879 0.0000 0.9121 29 0.17203E-01 0.0756 0.0000 0.9244 30 0.27725E-01 0.2531 0.0000 0.7469 31 0.33788E-01 0.0003 0.0003 0.9994 32 0.54394E-01 0.0000 0.0000 1.0000 33 0.28227E-01 0.0000 0.0001 0.9999 34 0.36851E-01 0.0000 0.0000 1.0000 35 0.57563E-01 0.0000 0.0000 0.9999 36 0.98166E-03 0.0000 0.0271 0.9729 37 0.29346E-01 0.0039 0.0001 0.9960 38 0.40512E-01 0.0443 0.0000 0.9557 39 0.57567E-01 0.0040 0.0000 0.9960 40 0.56217E-01 0.0000 0.0000 1.0000 41 0.61408E-01 0.0001 0.0000 0.9999 42 0.46347E-01 0.0000 0.0000 1.0000 43 0.29679E-01 0.0001 0.0000 0.9999 44 0.14600E-01 0.0000 0.0000 1.0000 45 0.13720E-01 0.0120 0.0000 0.9880 46 0.44318E-01 0.0014 0.0000 0.9986 47 0.56730E-01 0.0000 0.0000 1.0000 48 0.31276E-01 0.0000 0.0002 0.9998 49 0.51104E-01 0.0127 0.0000 0.9873 50 0.24280E-01 0.4386 0.0000 0.5614 51 0.39608E-01 0.0001 0.0000 0.9999 52 0.50654E-02 0.0000 0.0001 0.9999 53 0.50496E-02 0.0000 0.4326 0.5674 54 0.54030E-01 0.0008 0.0000 0.9992 55 0.44605E-01 0.0004 0.0000 0.9996 56 0.28473E-01 0.0111 0.0000 0.9889 57 0.29187E-01 0.0000 1.0000 0.0000 58 0.10157E-01 0.0000 1.0000 0.0000 59 0.22412E-01 0.0000 0.9993 0.0007 60 0.26102E-01 0.0000 1.0000 0.0000 61 0.41295E-02 0.0001 0.9998 0.0001 62 0.27654E-01 0.0000 1.0000 0.0000 63 0.23800E-01 0.0000 0.9986 0.0014 64 0.20309E-01 0.0000 1.0000 0.0000 65 0.25621E-01 0.0000 0.9990 0.0010 66 0.19906E-02 0.0000 1.0000 0.0000 67 0.13174E-01 0.0000 1.0000 0.0000 68 0.23684E-01 0.0000 0.9999 0.0001 69 0.26904E-01 0.0000 0.9992 0.0008 70 0.15381E-01 0.0000 0.9983 0.0017 71 0.15686E-01 0.0000 0.9995 0.0005 72 0.28387E-01 0.0000 1.0000 0.0000 73 0.17704E-01 0.0000 1.0000 0.0000 74 0.22684E-01 0.0000 1.0000 0.0000 75 0.65427E-03 0.0000 1.0000 0.0000 76 0.77896E-02 0.0000 1.0000 0.0000 77 0.17192E-01 0.0000 1.0000 0.0000 78 0.53818E-02 0.0000 0.9954 0.0046 79 0.20259E-01 0.0000 0.9982 0.0018 80 0.10492E-01 0.0000 1.0000 0.0000 81 0.20993E-01 0.0000 1.0000 0.0000 82 0.11237E-01 0.0000 0.9997 0.0003 83 0.20636E-01 0.0000 0.9963 0.0037 84 0.27053E-02 0.0000 1.0000 0.0000 85 0.23358E-01 0.0000 0.9999 0.0001 86 0.11759E-01 0.0000 0.9905 0.0095 87 0.11058E-01 0.0000 0.9959 0.0041 88 0.10384E-01 0.0000 1.0000 0.0000 89 0.19908E-01 0.0000 0.9997 0.0003 90 0.11157E-01 0.0000 1.0000 0.0000 91 0.27995E-02 0.0000 0.9999 0.0000 92 0.26000E-02 0.0000 1.0000 0.0000 93 0.10975E-01 0.0000 0.9966 0.0033 94 0.60977E-02 0.0000 1.0000 0.0000 95 0.12618E-01 0.0000 1.0000 0.0000 96 0.26677E-01 0.0000 1.0000 0.0000 97 0.23910E-01 0.9999 0.0000 0.0001 98 0.12649E-01 1.0000 0.0000 0.0000 99 0.14340E-01 0.9986 0.0000 0.0014 100 0.54402E-01 0.9991 0.0000 0.0009 101 0.34584E-01 1.0000 0.0000 0.0000 102 0.36001E-01 0.9507 0.0000 0.0493 103 0.43454E-03 1.0000 0.0000 0.0000 104 0.36375E-01 0.9894 0.0000 0.0106 105 0.44320E-01 0.9947 0.0000 0.0053 106 0.43890E-01 0.9949 0.0000 0.0051 107 0.48880E-01 0.9974 0.0000 0.0026 108 0.48691E-02 1.0000 0.0000 0.0000 109 0.18489E-01 0.3077 0.0000 0.6923 110 0.42221E-01 0.9941 0.0000 0.0059 111 0.37948E-01 1.0000 0.0000 0.0000 112 0.39442E-01 0.9817 0.0000 0.0183 113 0.32218E-01 0.9227 0.0000 0.0773 114 0.14021E-01 0.8600 0.0000 0.1400 115 0.15709E-01 1.0000 0.0000 0.0000 116 0.12267E-01 0.9995 0.0000 0.0005 117 0.17909E-01 1.0000 0.0000 0.0000 118 0.19636E-02 0.9945 0.0000 0.0055 119 0.10811E-01 0.9999 0.0000 0.0001 120 0.49101E-02 1.0000 0.0000 0.0000 121 0.48692E-01 1.0000 0.0000 0.0000 122 0.65221E-02 0.3376 0.0000 0.6624 123 0.45646E-01 1.0000 0.0000 0.0000 124 0.50404E-01 0.9981 0.0000 0.0019 125 0.31292E-01 1.0000 0.0000 0.0000 126 0.36519E-01 0.0167 0.0000 0.9833 127 0.47079E-02 1.0000 0.0000 0.0000 128 0.37757E-01 0.9696 0.0000 0.0304 129 0.43972E-01 0.9905 0.0000 0.0095 130 0.31094E-01 0.9984 0.0000 0.0016 131 0.18499E-01 0.9805 0.0000 0.0195 132 0.20004E-01 0.4612 0.0000 0.5388 133 0.24040E-01 0.9473 0.0000 0.0527 134 0.23010E-01 1.0000 0.0000 0.0000 135 0.26182E-01 0.8535 0.0000 0.1465 136 0.27051E-01 0.8651 0.0000 0.1349 137 0.14499E-01 0.0001 0.0000 0.9999 138 0.39906E-01 0.9996 0.0000 0.0004 139 0.54592E-01 0.0066 0.0000 0.9934 140 0.28520E-01 1.0000 0.0000 0.0000 141 0.34335E-01 0.9834 0.0000 0.0166 142 0.26758E-01 0.1444 0.0000 0.8556 143 0.29468E-01 0.9321 0.0000 0.0679 144 0.44017E-01 0.9959 0.0000 0.0041 145 0.11818E-01 1.0000 0.0000 0.0000 146 0.52345E-01 0.9999 0.0000 0.0001 147 0.49687E-01 0.9999 0.0000 0.0001 148 0.46386E-01 0.9999 0.0000 0.0001 149 0.21728E-01 0.9998 0.0000 0.0002 150 0.20923E-01 1.0000 0.0000 0.0000 Implied grouping of the entities into 3 groups 3 3 3 1 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 1 1 1 1 1 1 1 1 1 1 1 1 3 1 1 1 1 1 1 1 1 1 1 1 1 3 1 1 1 3 1 1 1 1 1 3 1 1 1 1 3 1 3 1 1 3 1 1 1 1 1 1 1 1 Number assigned to each component 48 40 62 Estimate of mixing proportion for each component 0.330 0.274 0.396 Estimates of correct allocation rates for each component 0.948 0.974 0.982 Estimate of overall correct allocation rate 0.969 Estimated mean (as a row vector) for each component -4.0051 0.30619 3.8958 0.11930 -0.32261 -0.14626 Estimated covariance matrix for component 1 2.14297 0.877435 0.788118 Estimated covariance matrix for component 2 0.669664 -0.239460 3.10713 Estimated covariance matrix for component 3 0.903373 0.116789 1.07725 Criteria for this Clustering are AIC BIC AWE 1210.41781 1261.59861 1380.77942 and P-value from bootstrap of 0.00999999978 ************************************************************* Results for 4 cluster(s) ************************************************************* Results of search for initial Grouping ******* ** ****** *** ******* ******** Random Initial Grouping ~~~~~~ ~~~~~~~ ~~~~~~~~ 10 Random Starts used All the data used to form starts Random start Number ( Random seeds ) Like ------------------------------------------------------------------------ random start 1 21776 4075 22913 Log Likelihood value from EM algorithm started from this grouping is -583.676 ------------------------------------------------------------------------ random start 2 21133 2838 9088 Log Likelihood value from EM algorithm started from this grouping is -583.676 ------------------------------------------------------------------------ random start 3 17444 2036 7056 Log Likelihood value from EM algorithm started from this grouping is -583.661 ------------------------------------------------------------------------ random start 4 27443 30059 3770 Log Likelihood value from EM algorithm started from this grouping is -583.661 ------------------------------------------------------------------------ random start 5 18622 17357 3888 Log Likelihood value from EM algorithm started from this grouping is -583.676 ------------------------------------------------------------------------ random start 6 8734 24263 29925 Log Likelihood value from EM algorithm started from this grouping is -583.676 ------------------------------------------------------------------------ random start 7 8212 1153 26277 Log Likelihood value from EM algorithm started from this grouping is -583.676 ------------------------------------------------------------------------ random start 8 28425 28678 25153 Log Likelihood value from EM algorithm started from this grouping is -583.676 ------------------------------------------------------------------------ random start 9 14229 8058 15098 Log Likelihood value from EM algorithm started from this grouping is -583.667 ------------------------------------------------------------------------ random start 10 8998 14559 16954 Log Likelihood value from EM algorithm started from this grouping is -583.676 ------------------------------------------------------------------------ K-means Starting allocation 1 ~~~~~~~ ~~~~~~~~ ~~~~~~~~~~~ K-means Start 1 8079 26271 13270 2 3 1 1 3 4 2 1 3 1 1 1 1 3 3 1 3 1 2 3 1 2 4 1 1 4 1 2 2 1 1 3 3 3 3 4 1 1 1 3 3 3 3 4 3 1 3 3 1 1 3 4 1 1 3 3 3 3 3 1 2 3 1 1 3 2 3 3 1 2 2 1 1 3 4 3 4 4 3 2 3 2 1 3 3 2 3 2 3 2 2 2 2 4 4 3 3 1 2 1 1 1 4 1 1 1 1 1 1 1 3 1 1 2 3 2 1 2 3 4 1 3 1 1 1 1 3 1 1 1 3 1 2 1 1 1 3 1 1 1 1 1 1 1 3 1 1 1 3 1 Log Likelihood value from EM algorithm started from this grouping is -583.966 K-means Starting allocation 2 ~~~~~~~ ~~~~~~~~ ~~~~~~~~~~~ K-means Start 2 23258 26947 20734 4 3 2 2 3 1 4 3 3 2 3 2 2 3 3 2 3 2 4 1 2 4 1 2 2 1 3 4 4 2 2 3 3 3 3 1 2 2 2 3 3 3 3 1 3 2 3 3 2 2 3 1 2 2 3 3 3 3 3 2 4 3 2 2 3 4 3 3 2 4 4 3 2 3 1 3 1 1 3 4 1 4 2 1 3 4 3 4 3 4 4 4 4 1 1 3 3 2 4 2 2 2 1 2 2 2 2 2 2 2 3 2 2 4 3 4 2 4 3 1 2 3 3 2 3 3 3 2 2 2 3 2 4 3 2 2 1 2 2 2 2 2 2 2 3 2 2 3 3 2 Log Likelihood value from EM algorithm started from this grouping is -580.789 K-means Starting allocation 3 ~~~~~~~ ~~~~~~~~ ~~~~~~~~~~~ K-means Start 3 12120 12131 15962 2 4 1 2 4 3 2 1 4 1 1 1 1 4 4 1 4 1 2 4 2 2 3 1 1 3 1 2 2 1 1 4 4 4 4 3 2 1 1 4 4 4 4 3 4 1 4 4 1 2 4 3 1 1 4 4 4 4 4 2 2 4 2 4 4 2 4 4 1 2 2 4 2 4 3 4 3 3 4 2 4 2 1 4 4 2 4 2 4 2 2 2 2 3 3 4 4 1 2 1 1 1 3 2 1 1 1 1 1 1 1 1 1 2 4 2 1 2 4 3 1 4 1 1 1 1 1 1 1 2 1 1 2 1 1 1 3 1 1 1 2 2 2 1 1 1 1 1 4 1 Log Likelihood value from EM algorithm started from this grouping is -580.789 K-means Starting allocation 4 ~~~~~~~ ~~~~~~~~ ~~~~~~~~~~~ K-means Start 4 15806 968 24538 3 4 1 2 1 4 2 1 1 1 1 2 1 1 1 1 1 1 2 4 2 3 4 2 1 4 1 2 2 2 1 1 4 4 1 4 2 1 1 1 1 4 4 4 4 2 1 1 1 2 4 4 1 1 1 1 1 4 4 2 3 4 2 1 1 3 4 4 1 3 3 1 2 4 4 1 4 4 1 3 4 3 1 4 4 2 4 2 4 3 3 2 3 4 4 1 1 1 2 1 1 2 4 2 2 1 2 1 1 1 1 1 2 2 4 2 2 3 4 4 1 1 1 2 1 1 1 2 1 2 1 1 2 1 1 1 4 2 1 1 2 2 2 1 1 1 1 1 1 2 Log Likelihood value from EM algorithm started from this grouping is -580.789 K-means Starting allocation 5 ~~~~~~~ ~~~~~~~~ ~~~~~~~~~~~ K-means Start 5 4020 26307 15480 3 2 4 3 2 1 3 4 2 4 4 4 4 2 2 4 2 4 3 2 3 3 1 4 4 1 4 3 3 4 4 2 2 2 2 1 3 4 4 2 2 2 2 1 2 4 2 2 4 3 2 1 4 4 2 2 2 2 2 3 3 2 3 2 2 3 2 2 4 3 3 2 3 2 1 2 1 1 2 3 2 3 4 2 2 3 2 3 2 3 3 3 3 1 1 2 2 4 3 4 4 4 1 3 4 4 4 4 4 4 4 4 4 3 2 3 4 3 2 1 4 2 4 4 4 4 4 4 4 3 4 4 3 4 4 4 1 4 4 4 3 3 3 4 4 4 4 4 2 4 Log Likelihood value from EM algorithm started from this grouping is -580.789 K-means Starting allocation 6 ~~~~~~~ ~~~~~~~~ ~~~~~~~~~~~ K-means Start 6 17530 24544 15161 3 4 1 1 2 4 3 2 2 1 2 1 1 2 2 2 2 1 3 4 1 3 4 1 1 4 2 3 3 1 1 2 2 2 2 4 1 1 1 2 2 2 4 4 2 1 2 2 1 1 2 4 2 1 2 2 2 4 2 1 3 2 1 2 2 3 2 4 1 3 3 2 1 2 4 2 4 4 2 3 4 3 1 4 4 3 4 3 4 3 3 3 3 4 4 2 2 2 1 1 2 1 4 1 1 1 1 2 2 2 2 1 1 3 2 1 1 3 2 4 2 2 2 1 2 2 2 1 1 1 2 1 1 2 1 1 4 1 1 2 1 1 1 2 2 1 1 2 2 1 Log Likelihood value from EM algorithm started from this grouping is -580.789 K-means Starting allocation 7 ~~~~~~~ ~~~~~~~~ ~~~~~~~~~~~ K-means Start 7 8526 28573 3356 3 4 2 1 2 4 1 2 2 2 2 1 2 2 2 2 2 2 1 4 1 3 4 1 2 4 2 1 1 1 2 2 4 4 2 4 1 2 2 2 2 4 4 4 4 1 2 2 2 1 4 4 2 2 2 2 2 4 4 1 3 4 1 2 2 3 4 4 2 3 3 2 1 4 4 2 4 4 2 3 4 3 2 4 4 1 4 3 4 3 3 3 3 4 4 2 2 2 1 2 2 1 4 1 1 2 1 2 2 2 2 2 1 1 4 1 1 3 4 4 2 2 2 1 2 2 2 1 2 1 2 2 1 2 2 2 4 1 2 2 1 1 1 2 2 2 2 2 2 1 Log Likelihood value from EM algorithm started from this grouping is -580.789 K-means Starting allocation 8 ~~~~~~~ ~~~~~~~~ ~~~~~~~~~~~ K-means Start 8 27692 9670 4517 2 3 4 4 3 1 2 4 3 4 4 4 4 3 3 4 3 4 2 3 4 2 1 4 4 1 4 2 2 4 4 3 3 3 3 1 4 4 4 3 3 3 3 1 3 4 3 3 4 4 3 1 4 4 3 3 3 3 3 4 2 3 4 3 3 2 3 3 4 2 2 3 4 3 1 3 1 1 3 2 3 2 4 3 3 2 3 2 3 2 2 2 2 1 1 3 3 4 2 4 4 4 1 4 4 4 4 4 4 4 3 4 4 2 3 2 4 2 3 1 4 3 4 4 4 3 3 4 4 4 3 4 2 4 4 4 1 4 4 4 4 4 4 4 3 4 4 4 3 4 Log Likelihood value from EM algorithm started from this grouping is -580.789 K-means Starting allocation 9 ~~~~~~~ ~~~~~~~~ ~~~~~~~~~~~ K-means Start 9 30100 6128 4896 4 1 3 3 1 2 4 1 1 3 1 3 3 1 1 1 1 3 4 2 3 4 2 3 3 2 1 4 4 3 3 1 1 1 1 2 3 3 3 1 1 1 1 2 1 3 1 1 3 3 1 2 1 3 1 1 1 1 1 3 4 1 3 1 1 4 1 1 3 4 4 1 3 1 2 1 2 2 1 4 2 4 3 2 2 4 2 4 2 4 4 4 4 2 2 1 1 3 3 3 3 3 2 3 3 3 3 3 3 3 1 3 3 4 1 3 3 4 1 2 1 1 1 3 1 1 1 3 3 3 1 3 3 1 3 3 2 3 3 3 3 3 3 3 1 3 3 1 1 3 Log Likelihood value from EM algorithm started from this grouping is -580.789 K-means Starting allocation 10 ~~~~~~~ ~~~~~~~~ ~~~~~~~~~~~ K-means Start 10 20873 15254 8180 1 4 3 3 4 2 1 4 4 3 4 3 3 4 4 4 4 3 1 2 3 1 2 3 3 2 4 1 1 3 3 4 4 4 4 2 3 3 3 4 4 4 4 2 4 3 4 4 3 3 4 2 4 3 4 4 4 4 4 3 1 4 3 4 4 1 4 4 3 1 1 4 3 4 2 4 2 2 4 1 2 1 3 2 2 1 2 1 2 1 1 1 1 2 2 4 4 3 3 3 3 3 2 3 3 3 3 3 3 3 4 3 3 1 4 3 3 1 4 2 4 4 4 3 4 4 4 3 3 3 4 3 3 4 3 3 2 3 3 3 3 3 3 3 4 3 3 4 4 3 Log Likelihood value from EM algorithm started from this grouping is -580.789 ------------------------------------------------------------------------ Final log likelihood values from each initial grouping -583.7 -583.7 -583.7 -583.7 -583.7 -583.7 -583.7 -583.7 -583.7 -583.7 -584.0 -580.8 -580.8 -580.8 -580.8 -580.8 -580.8 -580.8 -580.8 -580.8 Best initial grouping (corresponding to the highest value of likelihood found by the K-Means 007 method ------------------------------------------------------------------------ Estimated mean (as a row vector) for component 1 -3.87171 0.334209 Estimated mean (as a row vector) for component 2 -0.358388 -0.532013E-01 Estimated mean (as a row vector) for component 3 3.88249 0.117234 Estimated mean (as a row vector) for component 4 0.869853 -2.08398 Estimated covariance matrix for component 1 2.38106 0.919999 0.790709 Estimated covariance matrix for component 2 0.728435 0.351135 0.854068 Estimated covariance matrix for component 3 0.686673 -0.234322 3.07201 Estimated covariance matrix for component 4 0.129625 -0.350058E-02 0.502631E-01 Mixing proportion from each component 0.350 0.348 0.276 0.026 Starting Partition Found 2 2 2 1 2 4 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 4 2 2 2 2 2 2 2 2 2 2 2 2 4 2 2 2 2 2 2 2 2 2 2 2 2 2 1 2 4 3 2 2 2 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 2 1 1 1 1 1 1 1 1 1 1 2 1 2 1 1 2 1 1 1 1 1 1 1 1 Determinants of component covariance matrices 1.03632803 0.498837041 2.05455957 0.0065031285 After iteration 0 the log likelihood = -580.789 Determinants of component covariance matrices 1.03623992 0.498881061 2.05453385 0.0065031308 After iteration 1 the log likelihood = -580.789 Determinants of component covariance matrices 1.03616759 0.498917468 2.05451209 0.00650313277 After iteration 2 the log likelihood = -580.789 Determinants of component covariance matrices 1.03610817 0.498947544 2.05449381 0.00650313444 After iteration 3 the log likelihood = -580.789 Determinants of component covariance matrices 1.03605932 0.49897237 2.05447853 0.00650313584 After iteration 4 the log likelihood = -580.789 Determinants of component covariance matrices 1.03601915 0.49899285 2.05446581 0.00650313702 After iteration 5 the log likelihood = -580.789 Determinants of component covariance matrices 1.0359861 0.499009737 2.05445525 0.00650313799 After iteration 6 the log likelihood = -580.789 Determinants of component covariance matrices 1.0359589 0.499023655 2.0544465 0.0065031388 After iteration 7 the log likelihood = -580.789 Determinants of component covariance matrices 1.03593652 0.499035125 2.05443926 0.00650313947 After iteration 8 the log likelihood = -580.789 Determinants of component covariance matrices 1.03591809 0.499044575 2.05443328 0.00650314003 After iteration 9 the log likelihood = -580.789 Determinants of component covariance matrices 1.03590292 0.499052359 2.05442834 0.00650314049 After iteration 10 the log likelihood = -580.789 Final Log-Likelihood is -580.789 In loop 11 log likelihood is -580.789 Observation | mixture log density|Grp1 Grp2 ..etc...| 1 0.22112E-02 0.0312 0.6312 0.3375 0.0000 2 0.30955E-01 0.0004 0.9996 0.0000 0.0000 3 0.64835E-01 0.0035 0.9965 0.0000 0.0000 4 0.25901E-01 0.9684 0.0316 0.0000 0.0000 5 0.14238E-01 0.0000 0.9971 0.0029 0.0000 6 0.32412E-01 0.0000 0.0226 0.0000 0.9773 7 0.17401E-01 0.1005 0.8994 0.0001 0.0000 8 0.39197E-01 0.0380 0.9620 0.0000 0.0000 9 0.47077E-01 0.0001 0.9999 0.0000 0.0000 10 0.69581E-01 0.0041 0.9959 0.0000 0.0000 11 0.74724E-01 0.0035 0.9965 0.0000 0.0000 12 0.44392E-01 0.0558 0.9442 0.0000 0.0000 13 0.70561E-01 0.0077 0.9923 0.0000 0.0000 14 0.61931E-01 0.0009 0.9991 0.0000 0.0000 15 0.20716E-01 0.0001 0.9986 0.0013 0.0000 16 0.74945E-01 0.0009 0.9991 0.0000 0.0000 17 0.58969E-01 0.0019 0.9981 0.0000 0.0000 18 0.74616E-01 0.0028 0.9972 0.0000 0.0000 19 0.16655E-01 0.0177 0.9803 0.0020 0.0000 20 0.27691E-01 0.0000 1.0000 0.0000 0.0000 21 0.47578E-02 0.0007 0.7590 0.2403 0.0000 22 0.18816E-02 0.3445 0.6522 0.0033 0.0000 23 0.13145E-01 0.0000 0.0150 0.0029 0.9821 24 0.15613E-01 0.0013 0.9893 0.0094 0.0000 25 0.51941E-01 0.0342 0.9658 0.0000 0.0000 26 0.44862E-02 0.0000 0.9972 0.0000 0.0028 27 0.76908E-01 0.0026 0.9974 0.0000 0.0000 28 0.19318E-01 0.1759 0.8241 0.0000 0.0000 29 0.16779E-01 0.1481 0.8519 0.0000 0.0000 30 0.21583E-01 0.4942 0.5058 0.0000 0.0000 31 0.38318E-01 0.0009 0.9987 0.0004 0.0000 32 0.52359E-01 0.0001 0.9999 0.0000 0.0000 33 0.11882E-01 0.0000 0.9997 0.0003 0.0000 34 0.40762E-01 0.0001 0.9999 0.0000 0.0000 35 0.58879E-01 0.0002 0.9998 0.0000 0.0000 36 0.12615E-01 0.0000 0.0008 0.0026 0.9965 37 0.38687E-01 0.0084 0.9915 0.0001 0.0000 38 0.37872E-01 0.0863 0.9137 0.0000 0.0000 39 0.70041E-01 0.0078 0.9922 0.0000 0.0000 40 0.55210E-01 0.0001 0.9999 0.0000 0.0000 41 0.67013E-01 0.0002 0.9998 0.0000 0.0000 42 0.49748E-01 0.0001 0.9999 0.0000 0.0000 43 0.34706E-01 0.0002 0.9998 0.0000 0.0000 44 0.13012E-01 0.0000 1.0000 0.0000 0.0000 45 0.14664E-01 0.0206 0.9794 0.0000 0.0000 46 0.56434E-01 0.0032 0.9968 0.0000 0.0000 47 0.59322E-01 0.0001 0.9999 0.0000 0.0000 48 0.16306E-01 0.0000 0.9994 0.0006 0.0000 49 0.56846E-01 0.0241 0.9759 0.0000 0.0000 50 0.19935E-01 0.7499 0.2501 0.0000 0.0000 51 0.44515E-01 0.0001 0.9999 0.0000 0.0000 52 0.26989E-01 0.0000 0.0155 0.0000 0.9845 53 0.30938E-02 0.0000 0.2143 0.7857 0.0000 54 0.67229E-01 0.0020 0.9980 0.0000 0.0000 55 0.53841E-01 0.0008 0.9992 0.0000 0.0000 56 0.30494E-01 0.0198 0.9802 0.0000 0.0000 57 0.29127E-01 0.0000 0.0000 1.0000 0.0000 58 0.10150E-01 0.0000 0.0000 1.0000 0.0000 59 0.22752E-01 0.0000 0.0000 1.0000 0.0000 60 0.25967E-01 0.0000 0.0000 1.0000 0.0000 61 0.40824E-02 0.0003 0.0003 0.9994 0.0000 62 0.27624E-01 0.0000 0.0000 1.0000 0.0000 63 0.24091E-01 0.0000 0.0001 0.9999 0.0000 64 0.20233E-01 0.0000 0.0000 1.0000 0.0000 65 0.25970E-01 0.0000 0.0000 1.0000 0.0000 66 0.20408E-02 0.0000 0.0000 1.0000 0.0000 67 0.13156E-01 0.0000 0.0000 1.0000 0.0000 68 0.23733E-01 0.0000 0.0000 1.0000 0.0000 69 0.27173E-01 0.0000 0.0000 1.0000 0.0000 70 0.15547E-01 0.0000 0.0009 0.9991 0.0000 71 0.15693E-01 0.0000 0.0003 0.9997 0.0000 72 0.28269E-01 0.0000 0.0000 1.0000 0.0000 73 0.17641E-01 0.0000 0.0000 1.0000 0.0000 74 0.22539E-01 0.0000 0.0000 1.0000 0.0000 75 0.62901E-03 0.0000 0.0000 1.0000 0.0000 76 0.78568E-02 0.0000 0.0000 1.0000 0.0000 77 0.17154E-01 0.0000 0.0000 1.0000 0.0000 78 0.56255E-02 0.0000 0.0000 1.0000 0.0000 79 0.20693E-01 0.0000 0.0000 1.0000 0.0000 80 0.10323E-01 0.0000 0.0000 1.0000 0.0000 81 0.21017E-01 0.0000 0.0000 1.0000 0.0000 82 0.11189E-01 0.0000 0.0003 0.9997 0.0000 83 0.21069E-01 0.0000 0.0002 0.9998 0.0000 84 0.27487E-02 0.0000 0.0000 1.0000 0.0000 85 0.23383E-01 0.0000 0.0000 1.0000 0.0000 86 0.12063E-01 0.0000 0.0052 0.9948 0.0000 87 0.11441E-01 0.0000 0.0000 1.0000 0.0000 88 0.10370E-01 0.0000 0.0000 1.0000 0.0000 89 0.20132E-01 0.0000 0.0000 1.0000 0.0000 90 0.10993E-01 0.0000 0.0000 1.0000 0.0000 91 0.27378E-02 0.0002 0.0001 0.9997 0.0000 92 0.26604E-02 0.0000 0.0000 1.0000 0.0000 93 0.11167E-01 0.0001 0.0028 0.9971 0.0000 94 0.60721E-02 0.0000 0.0000 1.0000 0.0000 95 0.12591E-01 0.0000 0.0000 1.0000 0.0000 96 0.26550E-01 0.0000 0.0000 1.0000 0.0000 97 0.23738E-01 1.0000 0.0000 0.0000 0.0000 98 0.12873E-01 1.0000 0.0000 0.0000 0.0000 99 0.13722E-01 1.0000 0.0000 0.0000 0.0000 100 0.54636E-01 1.0000 0.0000 0.0000 0.0000 101 0.33373E-01 1.0000 0.0000 0.0000 0.0000 102 0.38912E-01 0.9958 0.0042 0.0000 0.0000 103 0.40589E-03 1.0000 0.0000 0.0000 0.0000 104 0.37203E-01 0.9997 0.0003 0.0000 0.0000 105 0.45197E-01 0.9999 0.0001 0.0000 0.0000 106 0.46490E-01 0.9997 0.0003 0.0000 0.0000 107 0.49405E-01 1.0000 0.0000 0.0000 0.0000 108 0.53178E-02 1.0000 0.0000 0.0000 0.0000 109 0.15376E-01 0.5439 0.4561 0.0000 0.0000 110 0.44960E-01 0.9996 0.0004 0.0000 0.0000 111 0.36415E-01 1.0000 0.0000 0.0000 0.0000 112 0.42952E-01 0.9985 0.0015 0.0000 0.0000 113 0.35353E-01 0.9900 0.0100 0.0000 0.0000 114 0.13669E-01 0.9907 0.0093 0.0000 0.0000 115 0.15024E-01 1.0000 0.0000 0.0000 0.0000 116 0.11697E-01 1.0000 0.0000 0.0000 0.0000 117 0.17276E-01 1.0000 0.0000 0.0000 0.0000 118 0.18348E-02 1.0000 0.0000 0.0000 0.0000 119 0.10904E-01 1.0000 0.0000 0.0000 0.0000 120 0.46962E-02 1.0000 0.0000 0.0000 0.0000 121 0.47117E-01 1.0000 0.0000 0.0000 0.0000 122 0.57988E-02 0.5463 0.4537 0.0000 0.0000 123 0.44122E-01 1.0000 0.0000 0.0000 0.0000 124 0.50730E-01 1.0000 0.0000 0.0000 0.0000 125 0.30228E-01 1.0000 0.0000 0.0000 0.0000 126 0.37783E-01 0.0308 0.9692 0.0000 0.0000 127 0.51610E-02 1.0000 0.0000 0.0000 0.0000 128 0.40212E-01 0.9982 0.0018 0.0000 0.0000 129 0.47021E-01 0.9994 0.0006 0.0000 0.0000 130 0.30357E-01 1.0000 0.0000 0.0000 0.0000 131 0.20747E-01 0.9972 0.0028 0.0000 0.0000 132 0.17683E-01 0.7323 0.2677 0.0000 0.0000 133 0.24757E-01 0.9976 0.0024 0.0000 0.0000 134 0.22527E-01 1.0000 0.0000 0.0000 0.0000 135 0.28390E-01 0.9713 0.0287 0.0000 0.0000 136 0.29422E-01 0.9750 0.0250 0.0000 0.0000 137 0.17384E-01 0.0002 0.9998 0.0000 0.0000 138 0.38764E-01 1.0000 0.0000 0.0000 0.0000 139 0.64715E-01 0.0127 0.9873 0.0000 0.0000 140 0.27723E-01 1.0000 0.0000 0.0000 0.0000 141 0.35419E-01 0.9995 0.0005 0.0000 0.0000 142 0.21499E-01 0.2980 0.7020 0.0000 0.0000 143 0.31028E-01 0.9951 0.0049 0.0000 0.0000 144 0.46425E-01 0.9998 0.0002 0.0000 0.0000 145 0.11921E-01 1.0000 0.0000 0.0000 0.0000 146 0.50875E-01 1.0000 0.0000 0.0000 0.0000 147 0.48229E-01 1.0000 0.0000 0.0000 0.0000 148 0.45500E-01 1.0000 0.0000 0.0000 0.0000 149 0.21954E-01 1.0000 0.0000 0.0000 0.0000 150 0.20108E-01 1.0000 0.0000 0.0000 0.0000 Implied grouping of the entities into 4 groups 2 2 2 1 2 4 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 4 2 2 2 2 2 2 2 2 2 2 2 2 4 2 2 2 2 2 2 2 2 2 2 2 2 2 1 2 4 3 2 2 2 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 2 1 1 1 1 1 1 1 1 1 1 2 1 2 1 1 2 1 1 1 1 1 1 1 1 Number assigned to each component 52 53 41 4 Estimate of mixing proportion for each component 0.350 0.348 0.276 0.026 Estimates of correct allocation rates for each component 0.962 0.965 0.985 0.999 Estimate of overall correct allocation rate 0.970 Estimated mean (as a row vector) for each component -3.8720 0.33414 -0.35844 -0.53080E-01 3.8825 0.11722 0.86985 -2.0840 Estimated covariance matrix for component 1 2.38024 0.919825 0.790668 Estimated covariance matrix for component 2 0.728588 0.351135 0.854184 Estimated covariance matrix for component 3 0.686621 -0.234299 3.07203 Estimated covariance matrix for component 4 0.129625 -0.350110E-02 0.502633E-01 Criteria for this Clustering are AIC BIC AWE 1207.57778 1276.8224 1438.06701 and P-value from bootstrap of 0.670000017 ****************************** Insignificant P-value reached 3 vs 4 ****************************** ANALYSIS SUMMARY ~~~~~~~~~~~~~~~~ -------------------------------------------------------------------------- | NG | Log Like | -2logLAM | AIC | BIC | AWE | P-VAL | -------------------------------------------------------------------------- | 1 | -636.76 | - | 1283.53 | 1298.58 | 1333.64 | - | -------------------------------------------------------------------------- | 2 | -608.80 | 55.92 | 1239.61 | 1272.73 | 1349.84 | 0.01 | -------------------------------------------------------------------------- | 3 | -588.21 | 41.19 | 1210.42 | 1261.60 | 1380.78 | 0.01 | -------------------------------------------------------------------------- | 4 | -580.79 | 14.84 | 1207.58 | 1276.82 | 1438.07 | 0.67 | --------------------------------------------------------------------------