Egor Howell thumbnail

Egor Howell

STOP Taking Random AI Courses - Read These Books Instead

The Ultimate Guide to Learning AI: Resources and Pathways for Aspiring Practitioners

After working in AI and machine learning for over four years, I’ve gathered a wealth of knowledge about the best resources—books, courses, and tools—that have truly helped me on my learning journey. Whether you’re a complete beginner or looking to deepen your expertise, this guide breaks down essential materials across key areas: programming and software engineering, mathematics and statistics, machine learning, deep learning and large language models (LLMs), and AI engineering. Let’s dive into how you can build a strong foundation and advance your career in AI.


1. Programming and Software Engineering: The Bedrock of AI

Strong programming and software engineering skills are crucial for anyone aiming to work in AI. Greg Brockman, the CTO of OpenAI, also emphasizes this point. Although AI is an evolving field and programming language preferences can shift, Python remains the dominant language today for AI projects due to its extensive libraries and ecosystem.

Why Python?

  • Most AI and machine learning libraries are Python-based.
  • The majority of AI jobs originate from machine learning roles where Python is the lingua franca.
  • Learning Python first allows you to grasp essential concepts and tools efficiently.

Beyond Python

AI engineering roles often require backend development skills, so learning languages like Java, Go, or Rust can be beneficial. I personally use Rust in my day job and see its increasing relevance.

Recommended Resources for Programming:

  • Learn Python Course by freeCodeCamp: A fantastic 4-hour introduction covering Python basics.
  • Python for Everybody Specialization (Coursera): Highly popular and well-reviewed course.
  • HackerRank and LeetCode: Practice coding problems to improve skills and prepare for interviews.
  • NeetCode: Great for learning data structures, algorithms, and system design fundamentals.
  • Harvard’s CS50 Introduction to Computer Science: Ideal for complete beginners seeking a thorough foundation.

Key tip: Practice is your best teacher. Use these resources to learn fundamentals, then build projects to reinforce your skills.


2. Mathematics and Statistics: Understanding the Foundations

While some argue that you don’t need deep math knowledge to use AI models today, I strongly believe that grasping the underlying mathematics is essential to become a top AI practitioner. Knowing the math helps you understand how large language models (LLMs) and generative AI really work under the hood.

Core Areas to Study:

  • Statistics
  • Linear Algebra
  • Calculus

Essential Resources:

  • Practical Statistics for Data Science: A hands-on textbook tailored for data science, machine learning, and AI with Python examples.
  • Mathematics for Machine Learning: Covers linear algebra and calculus, fundamental for understanding ML algorithms.
  • Mathematics for Machine Learning and Deep Learning Specialization (DeepLearning.AI): A course focused specifically on math needed for AI and ML, not general math.

With just these three resources, you can build a solid mathematical foundation to support a lifelong career in AI.


3. Machine Learning: Building and Understanding Models

AI is broader than just generative AI like ChatGPT. To excel, you need a strong grounding in machine learning—the discipline underlying most AI technologies.

Recommended Machine Learning Resources:

  • Hands-On Machine Learning with Scikit-Learn, TensorFlow, and Keras by Aurélien Géron
    Considered the definitive book for AI and ML practitioners, it covers fundamentals, coding implementations, and advanced topics like reinforcement learning and autoencoders.

  • Machine Learning Specialization by Andrew Ng (Coursera)
    One of the most respected and oldest ML courses, recently updated to use Python. It’s perfect for theory and practical understanding.

  • The 100-Page Machine Learning Book by Andriy Burkov
    A concise reference book ideal for quick concept reviews and broad understanding.

  • The Elements of Statistical Learning
    A more traditional, theory-intensive book great for deep dives into classical algorithms.

For a comprehensive, project-focused experience:

  • Zero to Mastery’s Complete AI, Machine Learning, and Data Science Bootcamp
    This course emphasizes hands-on projects like heart disease detection apps and image classifiers. It also boasts a supportive community of over 500,000 students and instructors.

4. Deep Learning and Large Language Models (LLMs)

Deep learning is the backbone of modern generative AI. To understand LLMs, diffusion models, and transformers, you need a deep learning toolkit.

Why PyTorch?

  • Preferred in research (used in 77% of research papers in 2021).
  • Dominates the Hugging Face model ecosystem.
  • Increasingly becoming the industry standard over TensorFlow.

Learning Path:

  • Learn PyTorch: Start with this to grasp deep learning frameworks.
  • Deep Learning Specialization by Andrew Ng: Covers CNNs, RNNs, and touches on LLMs.
  • Introduction to LLMs by Andrej Karpathy (1-hour video): Provides a high-level overview of the current generative AI and LLM landscape.
  • Neural Networks from Scratch by Andrej Karpathy: Build neural networks and even GPT from raw numpy arrays, gaining deep understanding of how these models work internally.
  • Hands-On Large Language Models by Jay Alammar: A textbook from the author of the famous “Illustrated Transformer” blog, perfect for intuitive understanding of transformers and LLMs.

5. AI Engineering: Deploying AI in Production

Understanding AI theory and building models is one part of the journey. The real impact comes from deploying these models to production, where they generate business and customer value.

What is AI Engineering?

  • Focuses on deploying and scaling AI solutions rather than building models from scratch.
  • Involves working with existing foundational models (like LLaMA, Claude, ChatGPT) and integrating them into products.
  • Requires knowledge of cloud infrastructure, containerization, and MLOps.

Recommended AI Engineering Resources:

  • Practical MLOps: Covers containerization, cloud systems, and the theory behind shipping machine learning models.
  • AI Engineering Textbook by Chip Huyen: Written by a leading practitioner, this book is the definitive guide to deploying AI and ML systems.

Final Thoughts and Advice for Your AI Journey

The journey into AI can seem overwhelming given the breadth of resources and knowledge areas. But remember:

  • Don’t try to learn everything at once. Pick one resource per topic, focus on it, and apply what you learn.
  • Practice by building projects. Hands-on experience is the best way to internalize concepts.
  • Iterative learning is key. Learn on-demand by tackling concrete projects, summarize concepts in your own words, and track your personal progress.

As Andrej Karpathy wisely puts it:

  1. Iteratively take on concrete projects and accomplish them depthwise—learning on demand, not breadthwise.
  2. Teach and summarize everything you learn in your own words.
  3. Only compare yourself to your past self, never to others.

If you want tailored advice or personalized coaching on your data science or machine learning journey, I offer one-on-one coaching, CV reviews, and roadmap planning. Feel free to check out the links below for more information.


Summary: Your AI Learning Roadmap

Area Recommended Resources
Programming & Software freeCodeCamp Python, Python for Everybody (Coursera), HackerRank, LeetCode, NeetCode, Harvard CS50
Math & Statistics Practical Statistics for Data Science, Mathematics for Machine Learning (book & DeepLearning.AI course)
Machine Learning Hands-On ML with Scikit-Learn/TensorFlow/Keras, Andrew Ng’s ML Specialization, 100-Page ML Book, Zero to Mastery Bootcamp
Deep Learning & LLMs PyTorch, Andrew Ng’s Deep Learning Specialization, Andrej Karpathy’s LLM intro & Neural Networks from Scratch, Hands-On LLMs textbook by Jay Alammar
AI Engineering Practical MLOps, AI Engineering textbook by Chip Huyen

Embark on your AI journey with confidence and curiosity! With the right resources and mindset, you can master these exciting technologies and shape the future of AI.

Happy learning!

← Back to Egor Howell Blog