Thursday, April 23, 2009

If you cant do it right, do it random!

I was trying to understand how random projections can be used for dimensionality reduction instead of PCA. It was not obvious how random projections could even attempt to match projections computed through Eigen decomposition of the covariance matrix (which sounds computationally demanding!). After a discussion with my friend, I realised that random projections were essentially similar to finding the Eigen vector through the Power method. I was really amazed as I thought of Power method only as a numerical method.

Now for some philosophy :-)

I was trying to build some intuition / wondering where else this method could be applied. Probably, I am stretching my analogy, but I couldnt help notice a strong connection to life. We all want to find something that we are good at, a job/lifestyle that is well oriented ( Now, thats more like it :-) ) with our skills and interests. How do we find it ?
You start doing something random, see if that suits you, and based on how you feel, you update what you are doing. If you persevere (iterate) enough, your lifestyle will converge to what you truly want!

If you cant do it right, do it random! And hope that the dots will connect! :-)

Saturday, March 14, 2009

Thursday, February 26, 2009

Yeah right !

A linguistics professor was lecturing to his class one day. “In English,” he said, “A double negative forms a positive. In some languages, though, such as Russian, a double negative is still a negative. However, there is no language wherein a double positive can form a negative.”

A voice from the back of the room piped up, “Yeah, right.”

Saturday, February 14, 2009

Friday, January 30, 2009

machine learning alphabet :)

a for adaboost
b for bayes
c for cramer-rao
d for dirichlet
e for EM
f for fisher information
g for gaussian
h for HMM
i for ICA
j for jensen's inequality
k for kernel
l for linear
m for monica geller monte carlo
n for neural network
o for occam's razor
p for pca
q for Q-learning
r for random :)
s for SVM
t for tensor
u for UMP test
v for VC dimension
w for weka
x,y - {x,y : x \in ML alphabet, y \in ML alphabet }
z for zipf's law

:-)