Maximum Likelihood Estimation

Given a dataset X assumed to be sampled from a certain probability distribution with unknown parameters p, the Maximum Likelihood Estimator for p is the point in the parameter space which maximizes the probability that X would be sampled. The probability of X given p, with fixed X and variable p, is referred to as the likelihood function.
Related concepts:
Maximum a Posteriori Estimation