"What is the best way to start learning machine learning and deep learning without taking any online courses? originally appeared on Quora: the place to gain and share knowledge, empowering people to learn from others and better understand the world." Quora, Contributor.
Answer by Eric Jang, Research engineer at Google Brain, on Quora:
Let me first start off by saying that there is no single “best way” to learn machine learning, and you should find a system that works well for you. Some people prefer the structure of courses, others like reading books at their own pace, and some want to dive right into code.
I started with Andrew Ng’s Machine Learning Coursera course in 2012, knowing almost zero linear algebra and nothing about statistics or machine learning. Note that although the class covered neural networks, it was not a course on Deep Learning. I really enjoyed how the course formulated “machine learning” as nothing more than numerical optimization.
|Deep Learning book|
|Murphy’s Probabilistic |
Machine Learning textbook
After you finish the DL book, you can “specialize” into one of the subfields/sub-subfields of Deep Learning, by implementing some of the papers yourself. Some example topics:
- Bayesian Deep Learning (combining neural nets with graphical models)
- Deep Reinforcement Learning (AlphaGo, Atari-playing AI, Robotics)
- Generative Models (GANs, PixelCNN, VAEs)
- Adversarial Methods (GANs, Actor-Critic)
- Theory of Deep Learning
- Computer Vision
- NLP/Speech (translation, captioning, seq2seq models)
- Symbolic reasoning (e.g. proof-solving)
- Recurrent Neural Networks (e.g. LSTMs, external memory, attention)
- Applications (solving domain-specific problems like classifying cancer, protein folding, lip reading from video)
- Meta-learning / learning-to-learn (Synthetic Gradients, Pathnet)