Summary of Statistics Terms
In this post, I just want to summarize statistics terms, that might be used when analyzing data or reading papers.
Hypothesis Testing
In general, hypothesis testing is: comparing means!
*** run away ***
Well it’s oversimplification, but most of them tries to prove whether or not means between two segments of population are indeed different. There are a couple of ways on how to do this, I will simply summarize them for now:
Terms  Short Definition 

ANOVA  Analysis of Variance 
ANCOVA  Analysis of Covariance 
ttest  Student test 
MANOVA  Multivariate Analysis of Variance 
MANCOVA  Multivariate Analysis of Covariance 
ANOVA
Is a way to test difference in variance between two or more levels/factors/variants/treatments.
OneWay
ANOVA with 1 independent variable and 2 treatments.
TwoWay
ANOVA with 2 or more independent variables and 2 or more treatments.
ANCOVA
Is an extension of ANOVA, by taking into account another variable that might covariated/correlated (see difference between covariance and correlation) with dependent variable.
Another way to explain^{7}: ANCOVA evaluates if the means of dependent variable are equal across levels of treatment, while controling continuous nuisance variable.
When To Use?
If you believe that the effect of some variables depends on other variables^{8}.
Why Use ANCOVA?
3 general application for using ANCOVA^{6}:
 Increasing power of Ftest.
 Equating NonEquivalent Groups.
 Means Adjustment for Multiple Dependent Variables.
How to Conduct ANCOVA?
know the assumptions in ANCOVA!
5 Assumption in using ANCOVA^{7}:
 Linear relationship between dependent variable and nuisance variable (or concomitant variable).

Homogenuous Error Variances.
The error is random

Independence of Error Terms.
Errors is uncorrelated or in other words covariance matrix in diagonal.

Normality of Error.
The error should be normally distributed, \(\epsilon \sim \mathcal{N}(0,\sigma^2)\)

Homogeneity of regression slopes
In other words regression lines should be parallel among groups.
How to conduct ANCOVA:
 Test multicollinearity.
 Test the homogeneity of variance assumption: use Levene’s Test.
 Test the homogeneity of regression slopes assumption.
 Run ANCOVA analysis.
References
[1] https://keydifferences.com/differencebetweenttestandanova.html
[2] https://jessicaaro.wordpress.com/2012/03/25/whyusetheanovaoverattest/
[3] http://www.statisticshowto.com/levelsinstatistics/
[4] http://www.statisticshowto.com/probabilityandstatistics/hypothesistesting/anova/
[5] https://onlinecourses.science.psu.edu/stat502/node/183/
[6] http://www.statisticssolutions.com/generalusesofanalysisofcovarianceancova/