Egor Howell thumbnail

📝 Egor Howell Blog

Your Ultimate Guide to Learning AI: Resources, Books, and Courses That Made a Difference

After spending over four years working in AI and machine learning, I've accumulated a wealth of knowledge and discovered some invaluable resources that truly helped shape my journey. Whether you’re just starting out or looking to deepen your expertise, this guide breaks down the best materials across key areas of AI: programming and software engineering, mathematics and statistics, machine learning, deep learning and large language models (LLMs), and AI engineering.


Programming and Software Engineering: The Foundation of AI

Strong programming and software engineering skills are essential for a career in AI. Greg Brockman, OpenAI’s CTO, emphasizes this as well. While AI is still a relatively new field with no single dominant programming language, Python is currently the clear frontrunner.

Python’s extensive ecosystem of AI and machine learning libraries makes it indispensable, especially since many AI roles today lean more towards software engineering than pure machine learning research. That said, learning backend languages like Java, Go, or Rust can also be valuable, as AI engineering roles increasingly demand robust software engineering skills.

Recommended resources to learn Python and software engineering fundamentals:

  • Learn Python Course by freeCodeCamp: A beginner-friendly, 4-hour course covering Python basics.
  • Python for Everybody Specialization (Coursera): One of the most popular Python courses, widely praised by learners.
  • HackerRank and LeetCode: Platforms for hands-on coding practice and interview preparation.
  • NeetCode: Great for mastering data structures, algorithms, and system design — critical skills for landing AI jobs.
  • Harvard CS50 Introduction to Computer Science: The ultimate beginner’s computer science course that covers fundamentals and multiple languages.

Tip: Practice is the best teacher. Use these resources to build a solid foundation, then dive into coding projects to reinforce your knowledge.


Mathematics and Statistics: The Backbone of AI

There’s a debate about whether deep mathematical understanding is necessary in AI, especially with the rise of large pretrained models. I believe that to become a top AI practitioner, having a firm grasp of the underlying math is crucial — it helps you understand how models work beneath the surface and innovate effectively.

Focus on three main areas: Statistics, Linear Algebra, and Calculus.

Top math resources tailored for AI:

  • Practical Statistics for Data Scientists: A highly recommended textbook that teaches statistics specifically applied to data science and AI, complete with Python examples.
  • Mathematics for Machine Learning: Focuses on linear algebra and calculus, essential for understanding AI algorithms.
  • Mathematics for Machine Learning and Deep Learning Specialization (DeepLearning.AI): A course designed to teach math concepts directly applicable to machine learning and deep learning.

These resources collectively cover everything you need to confidently tackle the mathematical side of AI.


Machine Learning: Mastering the Fundamentals

AI is much broader than just generative models like ChatGPT. It has a rich history dating back to the 1950s and beyond. To truly excel, you need a solid foundation in machine learning theory and practice.

Must-have machine learning resources:

  • Hands-On Machine Learning with Scikit-Learn, TensorFlow, and Keras (by AurĂ©lien GĂ©ron): The ultimate textbook covering practical machine learning with Python, including fundamentals and advanced topics like reinforcement learning and autoencoders.
  • Machine Learning Specialization by Andrew Ng (Coursera): A legendary course that thoroughly covers machine learning theory and practical applications, recently updated to use Python.
  • The 100-Page Machine Learning Book by Andriy Burkov: A concise, high-level overview perfect for quick reference and to solidify your understanding.
  • The Elements of Statistical Learning: A dense, theory-heavy book great for deep dives into traditional machine learning algorithms.

For a comprehensive learning experience, consider the Zero to Mastery Complete AI, Machine Learning, and Data Science Bootcamp — a project-focused course that teaches you how to build real-world AI applications, backed by an active community of over 500,000 learners.


Deep Learning and Large Language Models: Understanding the Cutting Edge

Deep learning powers today’s generative AI models like LLMs and diffusion models. To work effectively with these technologies, you need to master deep learning frameworks and concepts.

Deep learning learning path:

  • PyTorch: The most widely used deep learning library in research and industry. It’s surpassing TensorFlow in popularity and is the best choice for new learners.
  • Deep Learning Specialization by Andrew Ng: Builds on the machine learning specialization, covering CNNs, RNNs, and even touching on LLMs.
  • Introduction to LLMs by Andrej Karpathy: A one-hour video providing a high-level overview of the current generative AI and LLM landscape.
  • Neural Networks Zero to Hero by Andrej Karpathy: An advanced course that takes you through building neural networks — and even a GPT model — from scratch using only numpy.
  • Hands-On Large Language Models by Jay Alammar: The go-to textbook for understanding transformers and LLMs, authored by the creator of the famous "Illustrated Transformer" blog post.

AI Engineering: Productionizing AI for Real-World Impact

Understanding AI models is just the start. The real skill lies in deploying and scaling AI solutions to create business value. Most AI roles today are AI Engineering roles — closer to software engineering than research — focusing on building infrastructure and integrating existing models into products.

Recommended AI engineering resources:

  • Practical MLOps: Focuses on deploying traditional machine learning models, covering essential topics like Docker, containerization, and cloud infrastructure.
  • AI Engineering Textbook by Chip Huyen: Authored by a leading expert in AI/ML deployment, this book is a comprehensive guide to productionizing AI systems.

Final Thoughts: How to Approach Your AI Learning Journey

The sheer volume of resources can feel overwhelming, but remember:

  • You don’t need to read every book or complete every course end-to-end.
  • Pick one resource per topic and start learning.
  • Most importantly, apply what you learn by building projects.
  • Learn iteratively and on demand — focus on concrete projects and deepen your knowledge as you go.
  • Teach or summarize concepts in your own words to reinforce understanding.
  • Compare your progress only with your past self, not others.

As Andrej Karpathy wisely puts it:

  1. Iteratively take on concrete projects and accomplish them depthwise. Learning on demand. Don’t learn bottom-up breadthwise.
  2. Teach and summarize everything you learn in your own words.
  3. Only compare yourself to younger you, never to others.

Need Personalized Guidance?

If you want tailored advice, CV reviews, roadmap planning, or one-on-one coaching to accelerate your data science or machine learning career, I offer personalized coaching packages. Feel free to check out the links below for more information.


Embark on your AI learning adventure with confidence, armed with the right resources and mindset. Happy learning!