What are the different independence assumptions in hMM & Naive Bayes ?

Both the hMM and Naive Bayes have conditional independence assumption.

hMM can be expressed by the equation below :

    \[p(x, y)=p(x|y)p(y)\]


Second equation implies a conditional independence assumption: Given the state y_{t} observed variable x_{t} is conditionally independent of previous observed variables, i.e. x_{t-1},x_{t-2},... and x_{1}

Naive Bayes Model is expressed as:


x_{d} is the d^{th} feature for the data sample x and y_{k} is the k^{th} label for k class problem.

The above equation can be written as


This implies a conditional independence assumption: given the class label, data features are independent of each other.

Leave a Reply

Your email address will not be published. Required fields are marked *