ideas, research resources

A good learning is multi-scale learning

Humans with intelligence are always learning in multi-scale:
to learn a new concept, start with a holistic picture of it. Then dive into details, gradually.

It works like first applying a coarse Gaussian blurring filter onto the knowledge domain, then refine it and learn more specifics.

Standard
ideas, research resources, tech

Levels of Machine Learning R&D Engineer. By Victor Fang

Levels of Machine Learning R&D Engineer. By Victor Fang

Level 1, entry, ML consumer.
Def. He/she knows to use the proper ML toolboxes, e.g. SVM, Decision Tree, Bayesian, RandomForest etc to solve a supervised/unsupervised/semi-supervised learning problem. Knows how to analyze the result and apply the model. Can deal with median scale ML problem (can be finished on a single PC in days).

Level 2, intermediate, ML practitioner.
Def. He/she knows how to formulate a problem at hand, and properly tunes the parameters e.g. SVM alpha, RandomForest #trees/#samples. Can polish up a simple model to handle complicated real world dataset. Can handle large-scale ML problem that needs to be parallelized using mapred, mpi, etc.

Level 3, advanced, ML researcher.
Def. He/she can define the challenging point in the problem, and comes up with a new theory to solve it. Lots of new fields in ML world are opened up e.g.: active learning, semi-supervised learning, multi-instance, multi-view, multi-xxx, etc. Guru like this seeks scalable algorithms only.

Standard
ideas, research resources

Dissertation Quotes

About life

Where liberty dwells, there is my country.

~Benjamin Franklin

Being the richest man in the cemetery doesn’t matter to me… Going to bed at night saying we’ve done something wonderful…that’s what matters to me.

– Steve Jobs, on Gates and Microsoft, Wall Street Journal, summer 1993

Far and away the best prize that life offers is the chance to work hard at work worth doing.

-Theodore Roosevelt, Labor Day address, 1903

I could be bounded in a nutshell and count myself king of infinite space.

— Hamlet, Act 2, Scene 2

Your time is limited, so don’t waste it living someone else’s life.
Don’t be trapped by dogma — which is living with the results of other people’s thinking.
Don”t let the noise of others” opinions drown out your own inner voice.
And most important, have the courage to follow your heart and intuition.
They some how already know what you truly want to become. Everything else is secondary.

– Steve Jobs, “Stay hungry , Stay foolish”, Graduation Ceremony of Stanford University, 2005

It is not knowledge, but the act of learning, not possession but the act of getting there, which grants the greatest enjoyment. When I have clarified and exhausted a subject, then I turn away from it, in order to go into darkness again; the never-satisfied man is so strange if he has completed a structure, then it is not in order to dwell in it peacefully, but in order to begin another.

— Gauss, Letter to Bolyai, 1808

The true sign of intelligence is not knowledge but imagination.

— Albert Einstein

As long as I have the opportunity I will reside in a country ruled by political
freedom, tolerance and equality of all citizens before the law. Political
freedom consists of the freedom to articulate one’s political opinion, in
speech as well as writing. Tolerance means respect towards all forms of opinion of the individual. At present these conditions are not met in
Germany.

–A.Einstein 1933.3.10

About Research

True knowledge exists in knowing that you know nothing. And in knowing that you know nothing, that makes you the smartest of all.

– Socrates, ancient Greek philosopher

Eine neue wissenschaftliche Wahrheit pflegt sich nicht in der Weise durchzusetzen, daß ihre Gegner überzeugt werden und sich als belehrt erklären, sondern vielmehr dadurch, daß ihre Gegner allmählich aussterben und daß die heranwachsende Generation von vornherein mit der Wahrheit vertraut geworden ist.

* A new scientific truth does not triumph by convincing its opponents and making them see the light, but rather because its opponents eventually die, and a new generation grows up that is familiar with it.

— Max Planck

If we knew what it was we were doing, it would not be called research, would it?

– Albert Einstein

Space, the final frontier. These are the voyages of the starship Enterprise. Its five-year mission: To explore strange new worlds. To seek out new life and new civilizations. To boldly go where no man has gone before.

–Captain Kirk, Star Trek

About Computer Science and Electrical Engineering

Computer Science is not more about computers than astronomy is about telescopes.

— Dijkstra

Science is what we understand well enough to explain to a computer. Anything else is art.

–D. E. Knuth

Standard
ideas, research resources, tech

data is queen?

data is queen?
does it hold in our human being learning process?

not necessary.

the human learning is powerful because it can effectively INFERENCE more knowledge from the limited amount of data. A baby doesn’t need to be fed with all various of clothes to learn the concept with high accuracy of correctly classifying a “cloth”!

the current machine learning obviously runs into a “data over-dependent” era. Data is queen?

A learning machine structure, e.g. a much more sophisticated linkage model than neural network, a high VC dimension classifier with huge capacity to infer from partially-labeled data, etc.

We need a better theory to quantify the learning machine structure.

Standard
ideas, tech

大脑的未来

现代信息技术飞速发展,开始从根本上改变人类的思维方式。

互联网技术普及以前,信息和知识基本都依赖于纸质媒介,信息检索效率及其低下,查询检索的时候,需要翻阅大量的书本;人类的学习速度也比较缓慢,因为汲取信息的手段极其有限,纸质媒介是极大的瓶颈。

然而在现代,人类的思维方式已经开始从根本上改变了。比如,提问问题的技巧发生了本质的变化。理解一个概念的内涵,比如,什么是hadoop,美国有哪些州,人类哪一年登上月球等等,如果一个受过现代教育的成年人提问此种问题,会让人对其智商有怀疑;因为获取此等问题的答案是如此的简单,基本就是几秒钟的事情:将这些问题转化为合适的关键字,输入搜索引擎,答案立刻显现。

千万不要小看这个改变。这种思维方式的改变,将对人类心智的发展有着极其深远的影响,比如考试应试将随之发生改变,遴选人才的方式将改变,工作行业和性质将改变,人类从事的创造新事业将发生改变,等等。

随着当此种“what is this?”的问题可以被计算机快速的检索和回答, 未来的人脑将和计算机有更密切的交互。我在这里做一个大胆而合理的预测,在未来的30年内,就是在2040年以前,将会普及某种和人脑直接互动的嵌入式技术。我不做具体技术的预测,但是我敢肯定,此种技术,必然不是像现在的键盘鼠标触摸屏的操作来获得检索答案,而必然是神经末梢的直接延伸。举一个例子,有可能是在身体某处的神经末梢嵌入一块极小芯片,可以直接利用生物能,内置无线网络访问,可以直接连到某个搜索引擎而作快速的海量数据库检索;也有可能是在身体内部注入某种基因技术改良过的蛋白质(蛋白质也可以用作数据存储和具有计算功能),可以实现高速的检索。此种技术现在还存在伦理方面的争议,但是一旦有某个社会阶级开始从中收益,必然会引起整个社会的普及–因为这个技术,就如同电视遥控器一般,将给人类带来极大的便利。

人类的科技发展史,是一部越来越高效,也让每个个体人越来越懒惰的发展史。现代的信息技术,将是改变人类大脑时代的开始。

Standard