YouTube Deep SummaryYouTube Deep Summary

Star Extract content that makes a tangible impact on your life

Video thumbnail

Meta Hiring Lead: Avoid Downleveling, Liars, Passing OpenAI And Anthropic Interviews

Ryan Peterman • 2026-03-16 • 102:40 minutes • YouTube

🤖 AI-Generated Summary:

Cracking Senior Engineering Interviews: Insider Tips from Meta’s Austin McDonald

Landing a senior engineering role at top tech companies like Meta, OpenAI, or Anthropic is an intense process that goes far beyond coding skills. Austin McDonald, a former Meta hiring committee member who led mobile recruiting across the company, offers invaluable insights into what really happens behind the scenes during hiring and leveling decisions. Drawing from his extensive experience conducting hundreds of interviews, Austin sheds light on how to avoid common pitfalls, the critical role of behavioral interviews, and how to tailor your approach for today’s most competitive companies.


Understanding the Hiring Process: Who’s Who?

When you apply for a senior engineering role, several key players influence your journey:

  • Sourcer: The initial recruiter who identifies and contacts candidates based on resumes, years of experience, and previous titles. They often make a gut-level call to decide if you’re worth pursuing.

  • Recruiter: Takes over after initial screening, organizing interview loops, advocating for you in hiring committees, and guiding you through the process.

  • Interviewers: Engineers and managers who evaluate your technical and behavioral skills through various interviews.

  • Hiring Committee: Composed of senior engineers and managers who review your interview feedback, assess your level, and decide whether to move forward.

  • Engineering Directors: Make the final hiring and leveling decisions, often based on recommendations from the hiring committee.


The Critical Role of Behavioral Interviews in Senior Hiring

While coding interviews are important, Austin emphasizes that behavioral interviews often play the most significant role in determining your level and hireability—especially at senior levels. Hiring committees look closely at behavioral interviews to assess:

  • Your scope of impact: What size problems have you solved? How many teams or people have you influenced?

  • Your level of ambiguity handled: Can you navigate complex, undefined problems?

  • Your communication and leadership skills: How effectively do you collaborate, mentor, and resolve conflicts?

  • Your organizational insight: How well do you understand and contribute to the broader company mission?

Austin notes that at Meta, for example, a staff-level hire must pass two system design interviews and behavioral interviews carry substantial weight in showing your organizational impact.


Avoiding Downleveling: How to Demonstrate the Right Seniority

One common challenge candidates face is being downleveled, where your experience is considered less senior than you expect. This often happens when:

  • Recruiters rely heavily on years of experience and previous titles, which can vary widely in meaning across companies.

  • Candidates come from smaller companies or non-FAANG firms where titles may be inflated.

Austin advises:

  • Clearly communicate the scope and complexity of your work from the very first conversation with a recruiter.

  • Use quantifiable impact metrics and describe projects that involve cross-team leadership, ambiguity, and organizational influence.

  • Choose behavioral stories that highlight large-scale impact, leadership, and mentorship, not just technical accomplishments.

  • Prepare to “anchor” every conversation at your desired level, emphasizing senior-level responsibilities consistently.


Behavioral Interview Best Practices: Choose, Structure, and Deliver Your Stories

1. Choose Stories with the Right Scope

  • Prioritize stories that demonstrate broad organizational impact over small or narrowly focused tasks.

  • Examples:

  • Senior Engineer: Leading a project with multiple features involving several engineers.
  • Staff Engineer: Owning multiple projects that affect entire teams or departments.
  • Principal Engineer: Influencing company-wide strategies or industry-level initiatives.

2. Structure Your Stories Effectively

  • Use frameworks like STAR (Situation, Task, Action, Result) or Austin’s preferred CALR (Context, Actions, Results, Learnings).

  • Include:

  • Context: Why the project was important.
  • Actions: What you specifically did.
  • Results: The measurable impact of your work.
  • Learnings: What you took away and how you improved.

3. Deliver with Clarity and Engagement

  • Keep your stories concise but rich in relevant detail.

  • Avoid excessive technical jargon or unrelated context.

  • Manage your time by reading interviewer cues—some may interrupt frequently, others may prefer longer explanations.

  • Practice pivoting stories to better fit the interviewer's questions and highlight your strengths.


Tailoring Your Approach to Company Values: OpenAI & Anthropic Case Study

Understanding a company's unique values is essential for behavioral interviews:

  • OpenAI values humility and optimism about AI's potential. Candidates should emphasize growth mindset and enthusiasm for AI’s positive impact.

  • Anthropic focuses on “holding light and shade”, meaning recognizing both positive and negative implications of AI. Candidates should discuss ethical considerations and responsible AI development.

Austin recommends researching company values thoroughly and shaping your stories to demonstrate alignment with those values, especially for cutting-edge AI companies.


Common Behavioral Interview Mistakes for Senior Engineers

  • Choosing stories with insufficient scope or impact.

  • Over-talking or providing too much irrelevant detail.

  • Failing to anticipate negative interpretations of your stories (e.g., owning technical debt without context).

  • Neglecting non-technical leadership aspects such as mentoring, cross-team collaboration, and conflict resolution.

  • Poor story organization, leading to long, unfocused answers.


The Power of Referrals

Referrals can make a significant difference, especially when you’re on the hiring "bubble." A strong referral from a senior leader who knows your work well can:

  • Advocate for follow-up interviews if your initial performance was lukewarm.

  • Help tip the hiring committee’s decision in your favor.

Austin stresses providing your referrer with detailed information to craft a powerful recommendation.


Interview Preparation: Balancing Coding, System Design, and Behavioral

  • Junior engineers should prioritize technical skills but still prepare for behavioral questions.

  • Mid-level engineers need a balanced focus, as behavioral skills increasingly matter.

  • For senior engineers and above, behavioral interviews often determine the final hiring and leveling decisions.

Austin advises starting behavioral preparation early, practicing storytelling, and seeking feedback—ideally from calibrated insiders.


Handling Interview Subjectivity and Making a Strong Impression

  • Interviewers assess both substance and presence at senior levels.

  • Confidence, clarity, and cultural fit matter.

  • Adjust your energy and style to match your interviewer, whether they prefer a formal or conversational tone.

  • First impressions are crucial; decisions are often made within the first 10–15 minutes.

  • Ending strong with thoughtful, relevant questions shows engagement and leaves a lasting positive impression.


Final Words of Wisdom from Austin McDonald

  • Create scope proactively in your work to advance your career—don’t wait for opportunities; build them.

  • Be honest with yourself about your values and priorities; career growth often involves trade-offs.

  • Don’t let fear or impostor syndrome hold you back from pursuing your goals.

  • Prepare thoroughly for behavioral interviews—they showcase your potential impact and leadership in ways technical tests cannot.


Resources to Help You Prepare

Austin highlights resources like Hello Interview, which offers free materials for system design and behavioral interview prep, especially useful for candidates targeting top AI labs.


Conclusion

Mastering senior engineering interviews requires more than coding prowess—it demands strategic storytelling, deep understanding of organizational impact, and cultural alignment. By learning how hiring committees evaluate candidates behind the scenes and preparing accordingly, you can avoid common pitfalls like downleveling and position yourself as the senior engineer companies are eager to hire.

For anyone aspiring to land roles at companies like Meta, OpenAI, or Anthropic, Austin McDonald’s insights provide a clear roadmap to not only survive but thrive in one of the most challenging hiring landscapes.


If you found this guide helpful, share it with your network and check out additional interview prep resources mentioned above. Good luck on your journey to your next senior engineering role!


📝 Transcript (3293 entries):

Sometimes we would downlevel them significantly. >> This is Austin McDonald. [music] He was a meta hiring committee member and led mobile hiring across the company. And I asked them to share what happens behind the scenes. >> But I have seen cases where referrals [music] play, you know, a huge role. >> What does that rubric look like? >> We would not be able to hire someone at a staff level [music] unless we had provided two system designs. >> We covered how to avoid down leveling at senior levels. [music] You mentioned there's an initial leveling determination. There are certain conversations you should be very careful about >> and how to prep for specific companies [music] like OpenAI and Enthropic. I'd be curious to hear what you see in their values to help people who are looking to get hired at these companies. >> At Anthropic, they're known for assessing [music] whether or not you are >> What if you had some really unethical candidate? >> You know, we can talk about lying right now. If you can do that successfully, >> here's the full episode. Behavioral interviews are kind of one of the most common signals in hiring committees that down levels candidates. And so, and I think this is especially important for senior engineers and hire. And so, today I want to cover all of the common mistakes people make, how to prevent from getting down, and also I'd like to go over some company specific tips for people who want to work at hot companies like OpenAI and Anthropic. So, you know, I'm hoping that with your experience working on recruiting, leading iOS and Android recruiting um across Meta and after having conducted hundreds of interviews, I'm hoping you can kind of give us some of the behind the scenes in these hiring committees so we can learn about how to do better in our behavioral interviews. >> Oh, yeah. And behavioral interviews is my favorite thing to talk about. So, I'm excited to be here. >> What actually goes on in the hiring committees? Uh the first thing I would say is like when I would get a packet in front of the hiring committee and it was a senior packet the first thing I would do is go to the behavioral interview I would want to understand what is the scope that this engineer has operated at in the past what's their level of influence what's their level of insight what's their level of communication what's the level of organization that they've operated in that would be the first thing I did and these committees are built of other engineers they're built of other engineering managers who are influential in the company they're recruited by someone like me the the hiring committee chair and their job is to partner with recruiting to understand whether or not this engineer should be hired, hire an OIR decision, but also a leveling decision. And then they send that that up to a sort of companywide uh committee of people who honestly most of the time what they do is just sort of a gut check on on a sort of a cross uh you know cross company hiring bar. >> So I'd love to learn more about the the back end of the recruiting. So, let's say I'm a staff candidate and I'm going to go get hired at Meta. Who are all the people involved? What do they care about and how do they contribute to the hiring process? Yeah, great question. So, the first person you typically engage with is somebody called a sorcerer. This is someone who is responsible for finding potential candidates. Oftentimes, they're more a junior on the recruiting side, more this is an entry- level um job for a recruiter. Their job is to co- contact you or maybe to process uh referrals. this sort of first touch point. They're looking at some kind of job description. They're looking at your years of experience. That's probably the biggest thing. They're assessing your past companies, your past uh whatever they can find about your past experience, looking through the referral that they look at and seeing whether or not they want to pass you through to some kind of phone screen process. Right? So, this is the part where you see it as a as an engineer. Some sometimes this phone screen is is a technical one where they're going to be giving you some kind of uh you know coding interview, right? That's really common. It could even be a sort of a pre uh you know pre uh phone screen conversation where they're asking you sometimes we would give out multiple choice questions for engineers like oh tell me about this part of iOS or tell this part of Android and then you'd have to be able to answer those questions just as a sort of a like a a pre-f filter right to make sure that we're doing phone screens in an efficient way. Of course once your phone screen happens it goes to a uh to back to the hiring committee actually unless it's a very solid hire. If it's a very solid hire on the phone screen side, you get passed directly onto the scheduling for an on-site interview. But if it's kind of on the border, then we would review it as a hiring committee. We would look for signals, all the signals that that people talk about in coding interviews, communication and problem solving and all those things. And we would see uh whether or not it would be worth to to to a follow-up interview or we should just pass on this person on through to the uh to the to the rest of the of the hiring process to on-site or if we should maybe uh you know pass on that person overall and just maybe come back to them uh some other time. So that would be the first time the hiring committee is involved in in a hiring decision. After that um sometimes the hiring committee would be consulted when there is a certain kind of candidate has specialized experience. So for for example, if you were like a very low-level u mobile engineer doing uh like C++ work for example on the mobile side, we would want to make sure that you were giving you an appropriate system design interview that really assesses you for your specific skills. So then we would also uh typically be consulted at times when there's a a a choice of whether or not this person is a is a staff level engineer or a senior engineer. Often times that's the place in companies where the hiring process starts to change. So for example at meta specifically staff level engineers would have two system design interviews and so they we would not be able to hire someone at a staff level unless we had provided two system designs. So that sort of decision about how to structure the loop starts uh starts starts there at that that onscreen on-site um scheduling um point in the in the hiring process. Um and then of course if you as you go up as you go up to principal or as you go up to distinguish engineer those hiring um processes are very different and they add additional behavioral interviews. That's what they add. So we can talk about that at some point. That's how they assessing whether or not someone is a principal engineer or distinguished engineer. Um, and then after you go through the on-site experience, then it comes back to us as a hiring committee and we make a decision. Do we hire you at what level do we uh do we add any additional uh follow-up interviews? Maybe when the interview didn't go very well, maybe an interviewer, maybe you flubbed it and we want to give you another chance. Maybe we uh maybe the interviewer didn't do a very good job acquiring signal. Um, and that happens a lot actually in the behavioral interview. So, the behavior interview is one of the hardest ones to to give and one of the hardest ones to interpret. So oftentimes we would do follow-ups on on behavioral interviews if we didn't get the right signal and then after that it it at least at Meta it would go to a committee of engineering directors and they would make the final hiring and leveling uh decision. Sometimes u members of the hiring committee would accompany the recruiter to that conversation with u the engineering directors and advocate for our decision as a as a hiring committee. So possibly we're deciding to take a chance on somebody. Maybe this aspect of their packet is weak but we're really excited about that. We think that the company would really benefit from having engineers who have whatever that specific trait is, this problem solving piece or this technical skill or this um organizational influence skill that they've demonstrated in the in the in their onsites and we would need to go and advocate for that before the engineering director. So that would be um that would be the the process for a uh you know for an engineer from start to finish. At the beginning, you said there's that low-level recruiter that makes some gut reaction. And just to understand, because the leveling decision is the thing I'm most curious about, the way that they would judge the level of the person to kind of enter the funnel is mostly based off years of experience. Is that right? >> Years of experience and previous uh title. So, if you were a staff engineer at Google, then they'll probably try to bring you in staff engineer here at at Meta. Now a lot of companies like Meta uh don't have public levels. So it can be difficult to see um just from someone's LinkedIn what level they are. So that's why they rely so much on years of experience. >> A lot of people their their companies um let's say it might be someone outside of Fang who has many years of experience and their title is um extremely high. Let's say they're >> principal. They work in finance and they're vice president. [laughter] >> Yes. Yes. Exactly. Vice president vice president like four years. Um yeah yeah yeah [laughter] but like let's say it's it's someone you know principal architect at some uh non-Fang company for instance what's that recruiter going to set them at and how do they get leveled when you're not in fang coming into fang >> so sourcers understand this and recruiters understand that there is level inflation in different parts of the industry and so we would take somebody um you know at who worked at um even sometimes big tech companies but non uh non-fang companies like maybe companies that are that are more oriented towards business, we would take them and and and download them significantly. So, they would be they would even be supporting maybe um 10 or 15 20 people as a manager, maybe even more, maybe 50 or 50 or 75 people as a manager. And sometimes we would downlevel them and just give them a team of eight or 10 fang engineers right at at Meta. And likewise for for for IC's. So, um it's not just that if you put on LinkedIn, I'm a principal engineer, you can suddenly get principal engineering sorcerers reaching out to you. uh they understand that that um different companies have different expectations for for their levels and maybe there's some world which we would like to live in that this is all consistent but um it's not that's not the world that we live in. Just out of curiosity, what if you had some really unethical candidate who they were they worked at Google, but let's say they uh in reality they were only a senior engineer or something wherever they were, but they had the years of experience where it'd be believable that they could be maybe a senior staff engineer or something like that and that was listed on their resume. What would happen if someone did that? And I imagine that first hop would go to senior staff. What what then happens that prevents that from working? >> Yeah. So the for example the um first phone screen with an engineer that you have for a staff level engineer or above is usually some kind of uh not just a simple coding exercise like you would for a mid-level or a senior engineer, but it is also sort of scope check. there's a a mixture of coding, system design, oftentimes a conversation with you about your past experience where you walk yourself where you they walk you where the candidate needs to walk the interviewer through some large project that they shipped. Now, um so that's the first the first sort of check. Can you pass a sort of system design conversation at a high level such that we would pass you through for the the on-site the real system design interview and then can you tell me a story which is of sufficient scope of what you've executed. Now, you know, we can talk about lying, right? There are some really famous liars in the world. We call them actors. So, but I will tell you that that Los Angeles's restaurants are filled with uh people who are trying to get into the lying business, right? And they can tell you how difficult it is to be an actor. So, yes, I do think you can maybe you could come up with a story, right? And you maybe you can use AI to tell you, oh, let me tell you about this like companywide project that I shipped at at Google. It is pretty challenging to lie in a convincing way. We as as you know, people, we have this sense of of is this person really telling me the truth? And then there's always the follow-up questions. And I've I've experienced this in my coaching coaching job where I can tell someone's telling me a story that they have gotten from an AI because I start to ask them these follow-up questions, especially about technology and then they start to give me these kind of vague answers or they really don't the answers don't sort of don't fit together and then I get the sense of like this person's just not telling me the truth. I am I am I foolable? Like yes, everybody's foolable. If you're a good enough liar, yeah, you can you can make this happen for sure. But I think it's actually much harder to lie than most people expect it to be. And so that's the first that's the first step. And then um after that you have this this barrage of on-site interviewers interviews with highly calibrated people. So when we put interviewers for staff level or for or principal level engineers, we send very senior people to those people who have been in the industry for very long time who have interviewed a very lot a lot of people. they are highly calibrated and yes you will have to like lie repeatedly to these people and in a convincing way in order to get all the way through. Now if you can do that successfully I don't know maybe you are good enough to be a staff engineer or principal engineer you know maybe you'll be fine [laughter] um and and then we'll hire you right and then uh then the question is can you meet expectations at that level um I I do not have stories about people that we hire that we just we thought was totally lying to us. Um even though I've hired thousands of people I I have not heard that story. Um, I think it's much more difficult than people expect it to be. >> In theory, if someone was a a generational liar, they they could they could do this. It's just a lot harder than people think. Okay. Cuz yeah, I think that's that's on a high level when maybe it's just an engineering mindset. When I'm coming in and I'm thinking about interview prep, my my first thought is, okay, I got to be good at the technical, but the behavioral, I can kind of I can kind of wing it. You know, I can tell some stories. It's a little bit of a softer thing. >> It's about me, right? Just be yourself. >> Yeah, [laughter] I think that's a a a thing that a lot of people get wrong that gets them down. So that's why I'm kind of so curious to go through what what is it in the behavioral interviews that leads to the leveling determination. So um you mentioned there's an initial leveling determination um kind of a a gut call by the first hop in the in the layer and then at some point you're placed into sounds like a range you you mentioned in one case >> exactly >> there's a they're trying to figure it out and so then you're maybe staff maybe senior and they give you another loop. What do you need to do? um such that you are placed in staff if that were your goal. >> The most one of the most important things when you're choosing any kind of story to tell in a behavioral interview or when you're having a conversation with a recruiter, which is also kind of like a behavioral interview, is to ensure that you're establishing yourself as a certain scope and that scope is about what size business problems have I solved with technology and what level of ambiguity and what level of organizations have I have I operated within and what have I been able to accomplish in in that operation. So when you're having a conversation with a recruiter and you're talking about your past experience, you have got to land in that first tell them about yourself kind of thing like oh hey who are you tell what you've been up to. That conversation is super critical and people think about it from an interviewing perspective but it starts there in that conversation with the recruiter. And so you have to come in and say I have demonstrated and delivered large business value with with technology. And it's kind of like the greatest hits from your resume, right? People always tell you have uh you know measurable impact and and and and results that's that's present on your resume. that's that's u using some kind of metrics, right? That's super important. It's also to convey a sense of depth, right? A sense of complexity. You could say something like, well, you know, I improved performance in the Facebook app. And then people say like, okay, that doesn't sound super hard. But if you said something like, well, you know, I organized across 100 engineers, this entire organization to spend a 12-month performance improvement project that ran into multiple very difficult uh, you know, technical issues that required multiple staff level engineers in order to solve many months of investigation and experimentation and then we came out with these like three core principles and then we then we you know we we ship this to performance improvement. So I think when you start talking about the complexity of the work, you need to communicate the technical depth, you need to communicate the organizational depth, you need to communicate the business value and the business impact that you delivered and those are the things that the recruiter is listening for and and and likewise everybody in the process is listening for that. All the interviewers are listening for the same thing. So getting really crisp and practicing that that tell me about yourself piece is is is the first place where you can ensure that you're getting into the right leveling bucket. I I noticed there's a lot of um correlation between what you're talking about and also promotions as well. For instance, when you're talking about promotional behaviors for staff, your projects don't just want to be, hey, I shipped this thing and is good for my team. You want to be doing things that are across the org and larger and complicated and challenging. So, are you saying that those are pretty similar? And >> Oh, yeah. Oh, yeah. In fact, preparing for behavioral interviews will actually make you a better engineer. And I think being a great engineer is how being a great communicator especially about your impact is the thing that you need to do is to be a great behavioral interview. So yes, for sure you need to be able to um quantify your impact, communicate it efficiently, communicate effectively and honestly we're talking about lying earlier and and trying to keep people from lying. But most of my my clients, most of the people I talk to in my coaching business, they they have a problem not telling enough of the truth. like not telling in they're not not boosting themselves enough, not telling talking to me enough about the accomplish accomplishments that they that they've done. So to me, that's the thing that most people need help with. They need to they need help showcasing how difficult the problem was. They need to show help showcasing what kind of impact they made, not just on whatever topline business metric it was, but also what kind of impact did it have on the team, what kind of impact did it have on on code quality, what kind of impact did it have, you know, long term in the organization that they were they were operating within. So for me, think about if you're, you know, I'm coaching engineers to do this. I spend a lot of time thinking about um, you know, what are all the implications of the work that you've done and then how can you be really crisp about having that conversation because the the flip side of that is like, well, if I want to talk about all the things I've done, then it takes a really long time. So that's why it takes some some some preparation, but certainly getting really good at behavioral interviews, communicating, telling stories, for example, telling stories about what you've done. You do that all the time. You do that to your manager every week in a one-on-one. You do that to the executive whenever you're presenting your results. And that's a super important skill to learn as a senior engineer >> in the interview process. It sounds like at every point whether you think you are or not, you're actually being assessed. What I mean is usually that first call, at least from my recollection, it was pitched to me as, hey, this is a little chat you don't need to prepare for. Just go ahead and, you know, come and talk to me. I'm just the recruiter. But actually, that call is, hey, talk to me. I'm trying to figure out what level you are so I can place you in the right loop and even see if you're worth talking to for follow-up. So, am I understanding that people should just sell themselves at every single minute of this recruiting process? [laughter] >> Yeah, always be closing for sure. Definitely this first call is an evaluating call. I They are interested in you, right? Usually they they've they may have contacted you or they have you applied and they're contacting you. So, it is a softer kind of evaluation. You shouldn't be super nervous about it. They are your they are your your buddy. They are your partner. Let's remember that especially at a big company. These sourcers and recruiters are incentivized by how many hires they can deliver. So no, they're not your friend, right? There are certain certain conversations you should be careful about, especially about compensation with these folks, but they are advocating for you. It it is actually benefits them to find some a great candidate and be able to get them all the way through the process. That is in their best interest. So um it is a uh you know it is not a confrontational experience you need to prepare for but yes it is evaluative like you should not just show up to that phone call um dis emotionally disconnected or unprepared to talk about your past experience you and if you're if you are like that then I would delay the call so reschedule the call spend a little bit of time uh preparing what you will say to the recruiter so that they get an accurate sense of the kind of impact that you've delivered and that's going to be your best bet at getting that that higher level offer. I've had experiences where I got through everything and at some point they said, "Congrats, you've got the offer. It's verbal, but you have an offer now. So, you know, congrats. We just want you to talk to the hiring manager just one last time just and this is for you. They want to tell you about the company this and that usually." >> Right. Right. Right. >> Is that also a case where the hiring manager is trying to get signal on you? >> Oh, of course. Of course. I mean, the same exact things apply. So, yes, it's a little bit lower pressure than say the behavioral interview or the coding interview in the middle of the process, but definitely when you're having this hiring manager chat or at a place like Meta or Google, they have a team matching phase, right? Where where you're having conversations with multiple managers and they're trying to find a fit. For sure, you know, that conversation is super important for you to have a buttoned up introduction of yourself, a tell me about yourself. I do think that that one is a little bit more social. So in a in an interview setting, the interviewer has a set of questions. They want to go through the questions, right? So the longer you spend introducing yourself, the you're actually hurting your time management there. You're you're you're preventing them from collecting other signal about you. However, I think this this this hiring manager conversation, uh it is more of a like, do I want to work with this person, right? Do I do I want to hang out with this person? So you do need a little bit more of a of a loose social engagement, especially in those early that kind of early phase of the of the of the conversation. and hey you know how's it going weather you know sports tell me something right I think that that connecting with the manager on whatever is important to them is really is really key for that that uh interview but certainly it is not just a a formality or it is not purely for you it is certainly the case that the hiring manager wants to see do I want this person on my team and they need to come out of that conversation with a couple things you know one is do I like this person do I think they'll be successful in the team will they fit the team culture um will I you know will I as a manager benefit from bringing this person onto my team and then they need to come out with the sense that you can deliver and solve problems that are similar to the problems that they have. So, it's so important for you to do as much research with the recruiter and sourcer uh in advance if you're going to have this conversation. Understand what this manager values, understand what their team is working on, and then be able to tell your stories in a way that that showcases that yes, you can solve the problems that this manager has. >> You mentioned briefly there, you said the recruiter, the compensation conversations with the recruiter and how you need to be extremely careful in those conversations. What's the most common mistake people are making when it comes to those compensation conversations? >> Yeah, look, I'm not a negotiation expert. I won't I won't present myself as one. You can even hire people who are who are really good at helping you negotiate with these big tech companies and I recommend that you go get some advice from them. But I will say that um you know early anchoring in any negotiation is dangerous. So if if if early conversations where they're asking you about your uh compensation expectations, um you should be very careful about what you tell them because that will uh that will anchor you into the expectation to the conversation that you that you talk about. You should definitely get some advice and and understand the laws in your local um uh uh jurisdiction. So for example, in California and New York, uh you're required the recruiter is required to to tell you about the bands and salary bands and total comp bandants for for each each of the the jobs that you're being applying for. So you can leverage that to understand where you are in the comp bands um at that point. But I would not say I'm an expert at at negotiation. I think probably the probably the biggest mistake most people make is they don't have multiple offers. So if you are negotiating from a position of weakness like I don't have any other offers. I'm just talking to you and you're the only company I'm going to be very difficult for you to get to extract anything from that that company. And which is why it's it's so important for you to to orchestrate your offers to land at a somewhat similar time. I know that's more stressful. I understand it takes more work, you know, to go through the the interview process at the same time. Um, but if you have multiple offers in hand, that's your best your best bet for being able to improve your compensation position. >> So, I guess going back to the the leveling side of things, let's say let's say I'm staff engineer and I I will only take an interview if it's staff and I make a mistake early in the process, like I'm talking to the recruiter, >> like on the phone screen, for example. >> Yeah. Yeah. Can I be direct with the recruiter and say, "Hey, I'm I see that I'm getting a lot of coding interviews. I think maybe I I got the wrong I might have sent the wrong signal." In which case, it's fine. Let's just end the process or can I get leveled at a higher? Can you negotiate at that level in mid-process? >> Yeah, that's a really good question. I'm sure it depends on the company and the process. I would say that's a good conversation to have with your recruiter if if you know that you're being placed in uh to consideration for a level that you don't want to be. Um what I will say is that there are many times when we would uplevel people as well as down level people and um so the recruiter will is their interest. They'll try to keep you in the process. They will say let me stick around you know maybe we'll evaluate you and and and maybe we'll you know we'll offer you this second thing. And I would push for um to go ahead and try to get as much of that evaluation process done for the level that you would like to to um be hired for as much as possible. That way you don't have to go through follow-up interviews or they don't have to, you know, change something about the process late in the game. Try to collect as much information for the hiring committee um at as as possible at once as possible. So yes, I think that's a good conversation to have. Um but uh you know if it was a job you were really interested in and they were offering they were considering you for one level below uh and they were not willing to change anything I I would it depends on the job obviously depends on the total comp opportunity and where you're at. But I would say try to rock the interviews as much as possible and then get that consideration for the higher level. And you can do that in a couple of key ways. So the first way is to make sure that you're anchoring every conversation you have with all of your interviewers at that higher level which again comes back down to that tell me about yourself when when they especially behavioral and the system design interview when you're having those conversations and you are talking about very large scope projects talking about impact which is commensurate with that higher level the behavioral interviewer especially will notice that and uh then they will want to dive into that and they will want to ask you questions and they will then you're re resetting their mind about what what to expect from the interview and that's super important. And then the second place is in that uh is in the story choice that you have for your behavioral interviews. So remember that um this whenever someone's asking you a behavioral interview question, there's always a question behind the question. Like why they ask me this? They don't actually really care about my favorite project or like they really don't actually care that much about some time I had a conflict with my manager. They're probably going to forget a bunch bunch of those that that that detail right after the interview. What they want to see is are you operating at the level that they're expecting you to operate. So make sure and I talk about this in the book. There's four different considerations for whenever you choose a story and the number one choice is scope. You want to make sure that you have come out of that behavioral interview telling the stories that that are the highest scope and the ones that represent you the most, the ones that you would love to tell to a hiring manager. So that's your job as a behavioral interview candidate. I want to leave that interview having told the most important stories from my career. And sometimes that can be kind of challenging because they they you are not driving, right? The interviewer is driving. But your task as a candidate is to guide the interviewer towards that signal towards that place in your career where they're going to collect the signal that uh you think best represents you and and you do that by choosing stories that are the highest scope and the highest impact that you've delivered. So around a year ago a buddy of mine he was applying for a senior role at all of the top AI labs and he actually got an offer at Anthropic. when he was going through the process, I remember him telling me that the single most impactful tool for him in preparing for system design was the free resources that Hello Interview has on their website. If you are preparing for technical interviews, I highly recommend you check out Hello Interview. I would have said that even before they sponsored this episode. I think they're providing something that's great for the community. Also, if you're preparing for behavioral interviews, they're actually partnering with Austin to provide more behavioral interview resources on their website. So, I'll put a link in the show notes so you can check it out. This is the absolute first ad I've ever done for this podcast after over a year. Right now, the podcast is running net negative. Hopefully, it can sustain itself soon. This is a step in that direction. And I just want to say thank you so much for supporting the podcast. With that, let's get back into the episode. Austin's about to tell us how to avoid being downleveled accidentally. The big question then is how how do you do it concretely? Maybe we can go over some concrete examples. What would a senior scope project look like? What would a staff project look like? Senior staff, principal. Maybe we can take the same example and kind of evolve it so people can hear what are the keywords people are looking for. >> Right? I'll give you a sense of where um big tech companies like fang oriented companies are at with their levels now. But for the specific company that you're applying to, you should go do some research and figure out what is expected of a mid-level engineer, what is expected of a staff level engineer. Oftentimes you can find this information on the internet but I'll tell you a very simple rubric is something like a you know a new grad engineer is doing tasks you know they do a task uh come back to the team go to the manager Jira whatever whatever has given them the task they go do another task right that's their job a mid-level engineer is doing a feature a feature has many tasks and and the feature is something that might take you know a couple of weeks or something and that's what they're that's what they're working on and the senior engineer is uh doing projects projects have many features which have many tasks often times projects are ones that working through others perhaps um other uh mid-level engineers or other junior engineers who are working underneath them. So there's some kind of leadership and delegation and organization and communication expectation for this level five person or or the senior person staff person um level six at at meta for example would be uh somebody who is responsible for some kind of goal right so uh this is the goal the in order to accomplish this engagement goal or this uh you know revenue goal we have need to have multiple projects which have multiple features multiple tasks right so there's this natural cascading hierarchy of of what's expected based on ambiguity right that's how we that's how that's what levels really mean is how much ambiguity can you handle. The ambiguity of an intern is very different than the ambiguity of the CEO. Uh and that's what what uh what differentiates the levels and differentiate compensation. And then this like level seven or this principle or distinct whatever you want to call it. This next level is more about uh organization. So I'm responsible for an entire organization which has many goals which just many projects which just many features many tasks and then maybe whatever the next level is it's sometimes it's distinguished or or different people have different names for this thing but that's uh responsible for for like industry I'm responsible for this industry right which has or this entire uh you know business which has many organizations which has many uh goals etc. So I think that when you're when you're choosing stories to tell about landing a certain job, you need to understand what those level expectations are at the company that you're that you're targeting and then making sure that you're telling stories that hit those hit those notes. So let's take for example staff um staff level engineer is a big difference between that and a and a senior engineer and really it comes down to how the the breadth of impact that you're making. So you're you are uh making impact more than just your small project and your small area. oftentimes it's an entire team or maybe multiple teams you're working with. Oftentimes you're telling stories that involve a lot of of working across an organization, a very large organization. So this is why it's so difficult for for startup engineers unless you were the founder for example to get a job at staff or hire is because those those experiences are oftentimes u limited by the number of people that you've worked with. So if you didn't have to, you know, if there was only one stakeholder CEO and like two or three engineers, it's pretty difficult for you to demonstrate the kind of depth of organizational leadership that is required for that that staff level position. Um then there's like a technology uh complexity. So here you can uh and this really difficult in a behavioral interview. How do I communicate the difficulty of this technology problem, this this bug or this this this architecture decision? And you have to quantify that. So you have to talk about the the amount of time it has. You have to quantify the risk. you have to talk about the number of people you had to talk to to get advice or you have to somehow give me a sense of um how risky it was right in order to make this choice how difficult it was for you to back out of this choice for example so you can you can uh talk around the complexity of this technical problem and give me a sense of of what what is there um and then there's oftentimes leadership pieces this is something that's people forget about uh they talk maybe they maybe they talk about tech oft almost always they talk about technology right engineers oh I love talk about tech you know probably if anybody they talk too much about tech Uh then there's this organizational thing which I talked about before but sometimes people forget to even talk about the leadership parts. A lot of projects involve um some kind of influence and mentorship for example over others. So now you're convincing people to do things maybe they don't want to do. That's a big part of of of a staff engineer motivating people or getting concessions out of other teams aligning on road maps that sort of thing. And then there's also mentoring. So how did I mentor and help the people who worked underneath me and made them better? How did I make the team better? How I make the org better? So those things are oftenimes forgotten about when people are trying to to anchor this the the listener uh and make them think yes this is a this is a staff level engineer. So really and and we go back to what you said earlier if you can reflect on your own career and understand what makes you successful and you can identify those pieces which um differentiate you from other engineers. Those are the things that you need to talk about in the in the behavioral interview. Uh and and vice versa. So if you reflect back on your career as a behavioral interview behavioral candidate and you think about what made me successful, then you can start to repeat those things in your day job, right? And and you'll be more successful in what you do. >> If you know the rubric, then you can you can do the rubric and you can also talk the rubric as well, >> right? So know the rubric, right? That's the most important thing. [laughter] I think one of the biggest ways that you talked about scope was kind of in the organizational complexity or how many what's the leadership position you are in the org but what about specialists? So I've worked with engineers who they're solving problems that no one else can solve. They're their own snowflake and we need that person cuz they're pushing the industry forward and it's having a lot of impact. How is someone like that supposed to talk about their work? >> Yeah. So the first thing is to understand business impact of what you're doing and um I think this is really hard for some engineers right who are focused more on the technology. Um but there is some reason why this technology was required and some kind of context which around which it's it it it uh it lives and I always encourage people to think about what would Steve Jobs say about this like technological advancement that you that you've brought about. Why is it that that this project was so important or so uh critical to the company? What's the business context? So, make sure that you're delivering that. >> One framing I know that's common in promo committees is this person solved problems that those people couldn't and well those people are staff. So then if he's solving problem staff people then he or she must be uh greater than staff. So when your manager is saying that on your behalf in a promo committee it makes sense. If you say that on your own stories, say, "Yeah, I I landed this project and actually there's a team of five staff engineers that failed for a year before I got there." Sounds a little bit uh a little bit like too much. >> I don't think actually I don't think so. I totally disagree. So I think this is one of the the methods that I that I hear and is very successful is again you're talking around this complexity to give people a sense and to pattern match in their mind. So behavioral interviewers are pattern matchers. They are looking to see if you match the patterns that they expect for this level. And one of those things is going to be whether or not you have solved problems other people haven't. So I don't think it is necessarily bad to say something like when I took on this project I was the third owner and this is where they had failed. And this is where I'm looking for there is not just like haha I'm better than all these other people. I'm looking for the insight that made their efforts unsuccessful. So, oh, these people attempted, you know, this product market fit and that didn't work. Or these people attempted, you know, this technical approach and that didn't work for these reasons. And that kind of judgment and reflection is a big part of of uh of uh of assessing someone at a senior level and something that people often forget. They just tell the story, had a problem, I solved the problem, I'm done. And not giving me some sense of um what they learned or what the deeper insight is. And to me, that's the sign of somebody who's u you know, above staff level. the analoges between promotion conversations and recruitment conversations. It makes a lot of sense to me. And one thing that I see actually because when I was looking through the the YouTube comments of a previous interview done, there were some people were saying people can just oversell themselves and the person was a little bit salty that someone could manage the optics and kind of get a good recruitment outcome. But and I see very similar stuff on the promo the promo content that I've made is some people usually a vocal minority saying, "Oh, this person just really knows how to sell themselves." And I think um it's I think that's true and unfortunate that uh it can just be not necessarily your your achievements by themselves just objectively being true. you kind of have to you we're it's a very human process. So how you sell it is going to have a big impact on how it's perceived in both of these. So I I guess it's one of those things where it's just how it is and you need to learn how to play that game if you want to have good results in the game. >> Yeah. Welcome to the world, right? And this this works for uh this works this is the case in our careers. This is the case in our personal relationships. Don't you know that I love you? Can't you can't you just feel that I love you? That doesn't work, right? You have to do the behaviors. You have to demonstrate the things that in your relationships. You have to demonstrate the things in your career. And you you have to to to tell people, right? You have to communicate those things. And uh that may be unpleasant for some some folks. And it's can be difficult, but this is part of um of of us maturing as as people and us maturing in our careers is understanding that there are certain things that are worth doing that maybe um is a tax like on our on our progress. Um you don't have to do them, but you also will not get promoted or you also will not get the uh like staff level engineer um uh job, right? I I I tell people, look, on the other side of this principal engineering job is a million dollars a year compensation. So, you better eat your waties before you go into that interview, right? You better be ready. And and you can say what you want about like how difficult it is to assess people or whatever, but they're going to give you a million dollars a year. They're going to put you through the ringer, so you need to be ready for that. >> So, going back to the um the the promo committees, I I wanted to understand I'm just kind of like recollecting all the people you mentioned. So there's the sorcerer, there seems to be a hiring committee, there's the people >> recruiter. >> Okay. Yeah, the recruiter, there's the people in the hiring committee, there's the people who conduct interviews, and I guess they draft up notes that the hiring committee reviews, but who's the actual decision maker in these processes, >> right? Right. So, we should talk there's a sourcer. There's also a different person called a recruiter. I forgot to mention them, but usually the sourcer is someone who finds you. they typically will hand you off to someone called a recruiter once you get into the process once you get through the phone screen. And uh this person is the person that you're going to be doing the negotiation with, the person who's going to be organizing your loop, the person who's going to be advocating for you in front of the hiring committee. So there are obviously many decision makers. There's a sourcer who's just looking at your LinkedIn and deciding whether they should contact you. There's that that decision. There's also the decision of uh the um you know the initial phone screener, whoever's talking to you at different levels. That could be again that that sorcerer doing a a multiple choice question or it could be an engineer who's giving you a phone like a a coding phone screen. Then um there's uh the hiring committee. So the committee makes a decision based on um and usually it's driven by consensus. So uh but sometimes we would have to fall back into voting. Um but the uh consensus uh would be established of whether or not this person should be hired at this level or whether we should do a a uh you know follow-up or whether we should drop the person from the process and then again like I said there's this decision being made generally as a consensus among two or three engineering directors who are uh you know who are above us making that final call and those folks would would operate mostly in consensus but sometimes they would vote. >> [snorts] >> in the hiring committee. Have you ever seen cases where there was some obvious bias? Maybe someone's son happens to land in the hiring committee of uh the father or something like that. [laughter] >> I've never seen an experience where there's any kind of overt nepotism or bribery or anything that's really exciting like that. But I have seen cases where um referrals play a huge a huge um you know a huge role whether or not the referral comes from somebody who's very senior or whether or not um someone has actually showed up to in the room in the hiring committee. So sometimes there's a a friend or there's uh someone who's worked with this person before and they will show up and advocate for you in the room um and to the hiring committee and that does make a big difference. So if you can find a referral, I know this is not news or to anybody, but if you can find a referral, if you can find somebody who knows you and who will be willing to to go and spend their time in a meeting, that will make a big difference. >> When I worked at Meta, I mean, referrals and as a low-level engineer, they just kind of felt like this thing where I just fired it off and forgot about it. But are you saying that at a higher level like the the level of the person matters and to the point where they can even hop into the hiring committee? Is that right? >> For sure. So um uh well yes for sure the level the person who's who's providing this advice is is very much matters. So if it's a VP or a director who is referring this person, they understand that their their reputation is on the line. They are not just passing through someone they found on LinkedIn [laughter] to this to this process. they are they I've directly worked with this person most likely and are willing to put their personal reputation on the line to to hire this person that's a big deal um I will say that referrals of course have varying quality so we talked about level also the content of the referral so if it's like hey I knew this person in school like maybe consider them is very different than I work with this person they have this quality this quality this quality this quality and that's why you should hire them and so for certainly when you asking for a referral especially if the person has worked directly with you you should provide information to them you should like write the referral for them provide them information about that they could pass on to the to the hiring committee and we would certainly look at that. So we would we would read through those referrals and understand whether or not this is just somebody who happened to come across one of our employees and that's how I got referred or someone who worked directly with them and if they worked directly with them and they say re relevant things that makes a big difference and I would say the the biggest difference it makes is when you're on the border when you're on the bubble. So if you are you know maybe you you flubbed a couple of interviews um I actually think this was my my situation. And so when I applied, I I flubbed a couple of the interviews, especially in the phone screen stage, and I got an I got a follow-up, and I'm pretty sure I got the follow-up because I had a referral from somebody that I was in in school with who worked directly with me. And so, thank you. Thank you. Um, Nathan, I appreciate it. >> Let's say I I did um relatively bad. Like, I probably would not have passed. Not not terrible, but it's pretty lukewarm from everyone in the room uh at best in the hiring committee. But my my referral is the strongest referral you've ever seen from a VP. Let's say at their previous startup, I was their chief of staff and I was really organized and I did an excellent job and then now they're VP at Facebook or something like that and then that person comes in guns ablazing. Would that type of referral make me pass in that case? >> So typically referrals are going to be helping you on that bubble. This is what I was saying earlier. So, the it's really about whether or not you're going to get a follow-up interview. I have never seen a case where where there's a general consensus that we should not hire this person, but yet the referral results in them getting a hire. I think that may happen more at leadership levels where the kind of people that you bring from your previous jobs that that could be very sensitive to that and leadership hiring is a different whole different ball of wax. But on the engineering side, I've never seen a case where there's almost a um you know unanimous consensus that we should not hire this person. and they don't meet the bar and suddenly a like VP comes in and then is able to push the the committee to to hiring them. I haven't seen that case but I have seen the case where the VP will be able to or whoever it is will be able to push the committee into giving a follow-up or maybe multiple follow-ups, right? And so I think that you there is you still have to perform in the interviews as an engineer. Um but if you have reached like a senior manager or director level, I think that it is um a little bit more about who you know sometimes than than your raw performance. I will say that a good hiring process is not like that. So good hiring process is one where you have identified what success what makes people successful inside the organization and then the hiring process is evaluating that and people are making a non-biased decision. But I think the level the number of decision makers is smaller as you move up and more influencable by uh you know by those around them. One thing that I think you can only really see with experience and you worked at Meta for for quite some time is I'm always curious what is the the correlation between someone's performance on interviews and their downstream performance at the company and I'm I know that you've been involved in hundreds of interviews and you've seen people go and enter the company. what what what would be that correlation like how often do you see that that person smashed interviews and they're doing excellent at the company or maybe they're off. >> So what we have looked at is um not so much in the terms of the number of interviews that they they succeeded or or or failed but rather the confidence level. So the confidence level we all oftentimes people would assess the interviewer's confidence level. You would put in a hiring decision a level decision and like how confident you are that confident decision does correlate with someone's future performance. And I think what that goes to show is that people there is some sense that that the interviewers are sort of applying to their even there's a rubric and they try to structure it as much as possible. There is this kind of kind of sense that they get from from whether or not someone will be successful and that is predictive of of um future success and it makes sense right we you know if you've done hundreds of interviews as a calibrated person you you kind of know what good looks like. It may be hard to define and you try to define as much as possible. it reduces bias when you do that but ultimately sometimes it comes down to these kind of you know u feel things I will say that um certainly there have been people who rock the interview and don't do well and certainly people who are kind of rocky on the interviews and they do great and I I think that what that shows you is is what we're talking about earlier interviewing is a skill so it is not the same skill as doing the job and unfortunately in the world we live in you do need to spend some time getting good at the interviewing skill >> we talked earlier about the rubric that those interviewers are trying to fill out And I'm curious for the the behavioral side of things, what does that rubric look like? >> So, every company's a little different. A a well-run company, especially big companies, often times they hire PhDs in industrial psychology. They're called selection scientists. And what they have done is they've assessed, they've gone around your company, they've talked to different people, they've tried to understand what makes an engineer or whatever the role is very successful. And they've codified those things into a set of signal areas that they look for in the behavioral interview. So, at at Meta, there's five of them. They are driving results, embracing ambiguity, resolving conflicts, growing continuously, and communicating effectively. Every company's going to have different ones. They might purely just be the company values, and we can talk about that. But, for example, at Meta, those are not the five company values at at at Meta. So, you you should certainly talk to the recruiter and uh as you're having as you're preparing for the interview and get this rubric in advance. It's very important if you can get it or go on the internet, look for it. Um so these you know whatever five to eight things um generally they fit into uh a broader set of categories that I talk about in the book that I call signal areas and there's eight of them and so when you're uh when you're working on your um stories and your preparation you need to have um this rubric in front of you as you're thinking about your stories and then you're you're categorizing your stories based on these signal areas and then what you're doing inside the interview is this decode select deliver loop. This is your core operating system when you're inside of a a behavioral interview. When you're listening to a story, you're understanding decoding what this what is it why are they asking me this question? What is what is it they're interested in? And it's probably one of these eight areas or something related to their um to their uh company values. And so if you can identify that, then you can select a story which is appropriate and fits that you know delivers the kind of signal that the interviewer is looking for and then you can deliver that in some kind of engaging way. And that's your core loop. Decode, select, deliver. So it is really important that you understand what these rubrics are. Oftentimes a recruiter will give it to you. Um and at a smaller company it's a lot harder. They they may not have thought about this at all. They may not have structured their uh their uh you know their behavioral interview process with any kind of rubric. So there I think you rely on company values. You also rely on conversations with the recruiter. Usually at smaller places you may have even talked to somebody on the team before you get to the behavioral interview. And I think you should ask them questions like what makes engineers successful in your company? what do you look for in the hiring process? And then take that and build your own little sense of of what's valuable for that company and then use that as you're as you're going through your decode, select, deliver loop. >> That that decode part is so important because um I mean I've also been an interviewer for hundreds of interviews. Uh I did a bunch of engineering management interviews as well. And it's interesting is a lot of candidates I feel they would tell me something and I I would I'm looking for a signal and I ask a very targeted question. I say can you tell me about this and then they don't they don't get and they they talk past it or they continue on their their spiel and you're you're missing opportunity. I help me please help me fill this out. I'm I got a blank spot here I'm trying to fill out. I asked you the specific thing, >> but you're continuing on some rehearsed thing. It's it's actually like a a mutual exercise in helping fill out this rubric. >> Um, so yeah, I think that's that's so important to interview to what they're actually >> and your job as the candidate is to sort of tell the story from a perspective like like you would build a trailer out of a movie, different trailers. Robert Hamilton the PM behavioral coach talks about this and he says like well this this movie this movie may have some action parts may have some romance parts right and you can sort of remix the trailer in different ways to see what this movie is right and it's the same way with these stories so when you have a story uh it may have a part about ambiguity it may have a part about communication it may have a part about conflict resolution and so you can take the same story and in fact you probably should take the same story like I said earlier you should identify what are those core stories the stories you really want to get out and be able to build a a movie trailer which sort of fits the question uh that they're asking about and you need to do that early right to your point. So it can't be that in 3 five minutes in that then we're starting to get to the ambiguity part that the person asked about ambiguity. It needs to come up up upfront in that initial context setting and this is this is the way that um you know that you are internalizing you being a partner with the interviewer. I think people forget about that that like you said the interviewer is trying to accomplish a task trying to evaluate you. You need to be a partner in that and you need to help the interviewer get to the signal that they are looking for. You mentioned tailoring your stories and your experience to the specific values of the company and I was thinking what might be interesting we could go over uh some concrete examples maybe with some hot companies right now like OpenAI and Enthropic and yeah I'd be curious to hear what you see in their values and how you might mold stories to help people who are looking to get hired at these companies. >> Yeah. So the first thing I would say encourage people to do is first understand your stories from the perspective of these eight core areas that I talk about because most company values come it can be boiled down into these eight different areas. We could talk about them at some point but inevitably especially for newer companies like these AI companies there's some part of their company values that don't fit within that. So for example OpenAI has this one that's called act with humility. Really what that means is growth. That's my one of the eight areas. Do you respond well to feedback? you know, do you do you you know, are you are you seeking to improve yourself proving the people around you? That's sort of the same thing, but they do have one called feel the AGI, which is not really one of my eight areas. So, you'll need to understand what that means for them. And so, what that means to them is that you are very optimistic and positive about what AGI and what AI could do for the world. Now, uh uh Anthropic has one called hold, light, and shade. And really what they're trying to assess there is that you can understand both the positive and the negative implications of AI in the future. And so for me, you need to understand what the cultural zeitgeist is of this company that you can assess via their company values and by researching them before you go in. So how might you do that? Right? If you are telling a story about how you leveraged AI in the past to anthropic, you would really want to to to mention how you thought about the potential negative implications of of this of this project from an AI perspective. How did you go about mitigating those? how did you go about assessing those? And if they don't hear those things, they're not going to to feel comfortable about hiring you, hiring you. And likewise on OpenAI, if you are not somebody who's very AI forward and very much excited about about new domains that we can apply AI to, they're they're not going to be as interested in hiring you. So when you're reviewing your stories, you need to understand what every behavioral interviewer looks for. Those are those different those eight different areas. things like ownership, handling ambiguity, conflict resolution, the things that we do on a daily daily basis, but also mixing in um what are those specific things that are that are unique to their company. >> We covered how to avoid getting down and um but I'm I'm also curious before we kind of leave that kind of topic, what are the most common mistakes that people make in behavioral interviews that lead to worse results than they should have? Yeah, let's stay focused on senior engineers for a second because I think that that they are slightly different. Um, so the number one we talked about before which is inappropriate choice of stories. So you didn't choose stories that fit the appropriate scope that you're targeting. So that's number one. I would say another one is um usually as you're more senior you're a better communicator and so you might talk a lot. So this especially for manager loops oh yeah like let's be talking about this project and you would talk talk talk. This sense of giving around too much context u is really common and the and the key there is something like uh you should only give the kind of context which is required for me to understand the behaviors again that's what I'm assessing you on is the behaviors that you've done in the past and if you give me too much context isn't relevant for this then um then I you're just you're just using your own air time you're wasting your time and uh another guideline there is uh when you're when you even if you are talking about the the middle part of the project and what you did if it's been like 30 seconds since you uh told me something that you did like some kind of action, you know, some kind of verb is coming into this conversation. If it's been that long, then you should rethink that like maybe I'm providing too much content, too much technical detail, too much backstory, too much aides, whatever it is, you need to keep the, you know, keep the keep the action coming, keep the work stories are just not that exciting. Okay, let's just be honest. Like Stranger Things versus like me listening to a behavioral interview, like I'd rather watch Stranger Things, right? So, I I think people want to want to be they want to see action and movement in the story. So keep it keep it moving. Another one that's really common for um senior engineers is opening themselves up to uncharitable interpretations and I call this one the opposite is thinking defensively. You need to think defensively. So in this in this kind of senior role it's very risky to bring people on bring leaders on. They have a huge impact on the team and so interviewers are very riskaverse. So if you start presenting and telling stories like well you know the codebase had a lot of technical debt so we decided to do X. Sounds like a great story right? Hey, you're you're somebody who solves technical debt, but if you're the senior engineer in the room, then like how did we get this technical debt, right? It's your fault, right? So, I think this kind of uh how can my stories be interpreted as uh unfavorable is really important for you to consider. And the the way around that um is to make sure that you are uh compensating when you're telling the the context in the story. So it could be that like we were a startup. We needed to to close you know our next round of funding. Therefore we decided to to take on this technical debt and then it was our role to solve it and I decided to prioritize it because XYZ. So here we are giving some kind of thinking or backstory or judgment piece to how you ended up in this situation. We touched on it briefly before but another one is is not talking enough about the non-technical parts of the work that you do. Obviously technical parts super important. You need to establish yourself as somebody who can solve hard technical problems. But if you're a senior engineer or staff engineer, principal engineer, a lot of what you do is working with people. How you mentored, how you organized, how you delegated, how you influenced the road map, how you resolved conflicts, how you worked across teams, how you managed up, right? So those parts of the story are super important. Other thing is that oftentimes you're telling stories that are very long. Okay? So you're talking about especially a principal engineer, they're telling stories that are often multiple years or two, three years worth of refactors or or some um you know large product build in a new product space. Um, so you need to have your stories well organized and you need to understand what's really important for the listener out of that story. So I recommend people have some kind of table of contents at the very top which requires you to understand what's important. So you could say something like well some business context this is why I'm doing this thing da d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d and then you say oh yeah there are like five interesting parts of the story you know how I initiated the the the idea with with management how I u aligned the stakeholders on the technical approach how I solved some difficult technical problems and like how we did this very complex roll out over you know multiple multiple years something like that so now set the stage for the conversation and then I can tell a longer story keeping it organized in these different verticals um and it also gives me a way to come back to them so if I'm a a candidate and the interviewer is peppering me with follow-up questions and they're interrupting me, which is super common for these senior engineers, senior uh senior interviews, then I can always come back to, oh, you know, remember that part I was telling you about the hard technical problems like let me go back to that. I can then you can then you can bring the the listener back to the most important parts. So, um that story organization piece is is super um you super important for senior senior candidates. We didn't talk very much about choosing those stories and I did say that the most important thing is scope which I don't think is is is immediately apparent to most people who've thought about behavioral interviews. Oftentimes you would think well relevance is the number one thing. I have to tell a story which fits the the the question that they're asking and that that's very logical right but like I said earlier the most important thing is that you get out of the behavioral interview having told the stories that showcase your impact the most. So scope is the number one thing when you're choosing a story. How can you fit a big scope story into the question that that is asked? Number two is relevance. Obviously, you can't tell a story about um you know some time when that wasn't very ambiguous if you're being asked about ambiguity. Um the third thing is is is recency. So of course uh you know newer stories are more important than older stories. But I would rather hear a large scope relevant story from a senior engineer versus someone that's very new. So relevant recency is not the most important thing. And the guideline there is something like two to three years for sure uh is okay. Beyond 3 four years now you have to have a really good reason for telling that story. And of course this scale increases as you get more senior. So if you have a 30-year career then telling and you're you're applying for a principal role then telling a story from 10 years ago probably isn't that bad. Uh and the last one is uniqueness which is some some people don't often think about but how can I um tell a story that I haven't told already? And this becomes super important for uh interviews where there are multiple behavioral rounds where you're likely to tell multiple answer multiple tell me about a time kind of questions. So maybe the the question in the like project deep dive might not be the same story that you use when you're just asked about an ambiguous project in the general behavioral interview. So thinking about how you can balance uniqueness across the the portfolio of behavioral interviews that you're being given as this loop is important. >> And you said that scope is more important than relevance. Um, is it like let's say I'm in a behavioral interview, I'm I'm giving my stories and it's almost reminds me of a politician where they ask a question and I I have my rehearsed thing that's not exactly what they asked, but it's filling in the rubric. Is that you're saying that's best as opposed to saying answering exactly what they say. So be like a politician I guess is is unfortunately what I'm advocating that you do be because I think that again you want to to uh leave the interview having showcased the ways that you have delivered business value solved problems done the things you do as an engineer the best right and if if you just stay focused on answering their specific question for example like a question like tell me about the time you had a conflict with a product manager maybe you do have a story that you had a conflict with a product manager but maybe the bigger story is a conflict with uh with the director of engineering or a conflict with your direct manager. So what I would do is I would try to pivot that that story into the one that is is larger and um they may they may constrain you, you know, they may come back to it uh and then you're stuck selling the smaller story. But what I would do is I would showcase that you have this other story. So you can say something like I did have a conflict with a product manager. It involved this and this and I I was able to overcome that conflict by compromising on this. You know, I could tell that story, but there is this other story that I could tell about how I had to go through a longer conflict resolution experience where I had to collect data and I had to u you know, collect other people and we had to have multiple meetings about it. That might be a more interesting story. Can I tell that one? So, you can pivot the the the conversation focused on conflict resolution into a story that might fit fit better uh for what the interviewer is actually looking for. Um they may or may not really care about when you had a conflict with a product manager. They might just be collecting conflict resolution signal. Let's say you're in the middle of the interview and you're trying to figure out am I talking for too long or is this person still with me or should I am I saying the right things? How often should the interviewer be talking? How often should you be talking? >> So there are different style of interviewers. So some interviewers really are listening. I tend to be that that kind of person where I would uh interested in what I think interested in what you think is interesting. So, and I'm assessing you based on what you think is interesting and where you're taking me. And I'm getting a lot of communication signal out of that. Um, but some interviewers are not like that. They are they interrupt you frequently. They look at they want to look at pick out some part that you mentioned and like turn it over a couple times in their hand and then get back to you. So, they they may uh have a lot more follow-up questions. They may interrupt you a lot more or they may switch questions. They may collect a little bit of signal on this question and then like move rapidly to the other one. So, I think you'll figure out which kind of interviewer you have pretty pretty quickly in the in the interview and you should be emotionally prepared, especially for the second one. This person who interrupts you frequently can be uh kind of jarring for you and you can think, "Oh, I'm failing. I'm not doing the right thing." But no, you're just getting an interviewer who likes to interrupt people and likes to to to bounce around. Um, but to answer more specifically your question, I think you can look for signs. So, this is where you need to use your human part of your brain, not just your your sort of structured and organized part of your brain, but you need to assess like, are they looking at me? Are they taking notes? Are they do any kind of indication that they're that they're engaged? And if you notice some lack of engagement, then I would pause and ask them, is this what you're looking for? This is what I was about to say. Like, is that still relevant? And give them this opportunity. Can a good interviewer is willing to interrupt you? A good interviewer, a calibrated interviewer, someone who is is confident in what they're doing. They will be a little rude to you because they are look again, they are looking to acquire that signal and they are willing to go through a little bit of social awkwardness in order to acquire it. But some interviewers aren't that good. And so you need to make that easy for them to be able to stop you. Which is why I recommend not talking for more than um you know 2 to 4 minutes. If you're over if you're talking for more than four minutes, 5 minutes, you got to be really good at at giving a monologue like that. It better be really interesting for the for the listener and you probably you probably should know what you're doing if you're talking for that level of time. >> When it comes to interview prep, I mean, a lot of what you said sounds like there's a difference between the levels. [snorts] Senior engineers make different mistakes than junior engineers. Um, and I imagine the the weight of the behavioral interviews importance differs across the level. Sounds like as you get higher up and higher up there's they add extra behavioral interviews. Um, so I'm thinking if if someone was preparing for interviews across those highlevel buckets, how would you recommend they they split up their interview prep time across coding, system design, and behavioral? >> Most people are spending way too much time on coding and not enough time on system design and behavioral interviews because those are the more murky ones to prepare for. However, I will say that junior engineers, your the most important signal is going to be technical. So, making sure that you that you nail those coding interviews, nailing the system design interview is going to be the most important. And then the behavioral interview, the the key to focus on is um your your thinking, your motivations, your because you may not have a ton of of accomplishments to to lean on there, but you can lean on what you thought about or like why kind of ideas you had or things that you tried, maybe they didn't work. So, those kinds of um like signals of what my future performance could be or my future impact is going to be be super important for for junior engineers. For uh mid-level engineers, I think you need a balance. I I would say that um AI is changing this game. In the past, I think you could still have focused even as a mid-level engineer only on the technical parts and just make sure that you didn't flub the behavioral. I don't think that world is exists anymore. Number one, there are so many candidates in the market with so many layoffs recently that you need to shine across all different interview types. And the second thing I would say is more and more of that technical work is being done, you know, by an agentic coding experience. And so we are looking for mid-level engineers who can own problems end to end. And how do you see that kind of ownership? You're going to see that in the behavioral. We need mid-level engineers who are excited about growing and learning new things because the technology and the approach to engineering is changing so rapidly. And how are you going to assess that? It's going to be assessed in the in the behavioral interview. So I would I would balance more balance your time. Right? The beginning part of the interview process like we talked about before is often some kind of coding assessment. So you need to get your coding interviewing practice in early. But um you know once you get that on-site schedule or ideally even before that some weeks before that you have spent some time thinking about your behavioral questions. You've spent some time identifying the core uh stories from your past that you'd like to tell. You've looked at their their values. You've looked at the rubric that you find for the behavioral interview. You've made sure that you have some stories that fit each one of those uh key areas that they're going to be asking you about. And then once you get to senior and above, a lot of it's going to come down to the behavioral interview. So, like I said before, first thing I would do when I would look at at a at a staff level packet is I would go to the behavioral interview. There just aren't that many different ways to design like a web crawler in a system design interview or aren't that many ways to solve twosome in a coding interview such that I could see whether or not someone is a staff level or just a senior level. And I would go directly to the behavioral interview to see what the uh organizational impact is, what their level of influence is on others, how they resolve conflict. I would look to see uh what scope of projects they've they've been able to to accomplish and what what level of business impact they've been able to deliver and that would be my how I would determine whether or not they're really truly a staff engineer and like you mentioned at that that um you know super senior like staff plus kind of principal distinguished level they're adding additional behavioral interviews and oftentimes they're looking at specific things things like uh how you work crossf functionally with uh with partners they may give you a PM for example or another person from a a cross functional partner that will interview you and see how you work with others. Or they're going to be wanting to to get more information about one of your bigger stories, one of your bigger projects. So, they're going to give you some kind of project deep dive interview where you walk them through some technical and organizational challenge that you've solved in the past. And so, those become the differentiators and the the technical ones become kind of like uh check marks like you have to pass, you have to get over the bar, but really what's going to get you hired is going to be shining on those behavioral sides. So, certainly a slide I would say that most people underinvest in behavioral interview. So, uh, it's probably going to take you at least a few weeks to to, um, to perform well. And if you are at that staff or above, I would say, you know, start start when you start doing your leak code, [laughter] right? Start thinking about those past stories, start working on how you position them, get some feedback. Um, go do some mock interviews at least with a friend, if not with a professional. Um, and especially if you're going to be uh applying for a fang or or uh you know, open eye or anthropic, one of these big companies that's very in demand, I would try to find somebody who is calibrated uh at that company who can give you a mock interview and give you that that squishy cultural sense that we were talking about earlier and and reflect back to you whether or not you're hitting the right cultural notes. when you were in uh hiring committees in the past for maybe more senior candidates, when you have a candidate who does okay on the technical sides but really kills it on behavioral, is that the type of packet that could go through at the highest levels? um for certainly at the highest levels definitely if there's a place where you're going to flub a coding interview and be okay I think that staff or or principal level or manager level those places where we just don't expect you to be doing as much day-to-day coding and so we would would discount poor performances in those in those interviews for sure I think it's much harder to do that um uh at the junior levels I will say that I had I had a candidate that I did the behavioral for and uh this candidate was uh had not accomplished a ton in their career um the the the technical things were just okay. But I kept seeing glimpses of uh you know ideas that this candidate had had that maybe they weren't able to execute on or the manager didn't agree or they couldn't get it done in their organization but they kept thinking about things and I said now this person is just has so much like potential in this person's career that I I pushed for that person to be hired and that person ended up um being a staff person eventually and I think that that was a good indication that um you know there is a there is like a there's a slope that we're trying to assess and the slope is often assessed there in that behavioral interview even for junior folks. >> We talked about some of the subjectivity in in this type of interview and talking about how you talk about the the scope of your work and all of those things that kind of help you with leveling conversation. But also another part of subjectivity is just how much does this person like you and their their bias towards you based off of a lot of the soft influence you might have as you speak to them. And so I'm curious how much influence do you think that has on the outcome of the interview? >> It scales exactly with with uh with level. So with a more junior candidate, I think that um at least at a big company where they've spent some time structuring these behavioral interviews and they're trying to reduce this kind of do I just want to have a beer, you know, with this person kind of vibe that that they're that they're collecting. They're trying to reduce that by structuring it and making uh giving the the interviewer some sort of form to fill out or some clarifying what's what's important in the hiring decision. But as you get more senior um now they're expecting you to influence other people on the job and that so they'll how you come across in the meeting. Are you confident? Are you comfortable? Are you able to uh hold on to this kind of like casual casual excellence? Right? Which I think is a very much a a quality a cultural quality that that u that Silicon Valley has in particular. this idea that I can kind of show up and I look cool and I look not look cool but I look calm but yet I'm still very competent and can sharply discuss things and deliver things. I think they are looking for that kind of signal and um it's it's definitely subjective and so I think your your ability to connect with the interviewer in the first few minutes. If you come in and you're disheveled or you come in and you're nervous and you're not able to be present in the meeting, well, that's part of the signal they're acquiring because you're going to have to show up in meetings and and and be, you know, put together and be confident and and be able to stand in front of the CEO and deliver um you know, deliver good news or bad news or ask some questions or whatever. they are looking for somebody who will do a good job with that and they're you know this is a high pressure situation an interview you're going to be in a high pressure situation at work and they're assessing you there as well so um I think this is where you need to understand the cultural expectations of your companies that you're that you're uh that you're applying for different countries have different expectations around leadership and and hierarchy and how they approach things um I think we're talking mostly about like a US- centered kind of Silicon Valley centered or you know associated places Seattle New those kinds of culture and that place is one of u we need to be able to start the meeting with some kind of playful banter you know and then we continue with like hard-hitting pieces but sometimes I I'm I'm self-deprecating and I kind of pow of that and we laugh about a few things but then we're back in it and we're doing this like intense thing so that's super common for uh for for those environments other countries other companies they may have different expectations I think you need to understand what those are before you go in >> let's say someone is maybe a staff engineer they're not necessarily the most they wouldn't describe themselves as a people person, but they want to come off strong in that interview. How would you reverse engineer how to represent yourself strongly in terms of all those soft influence type of things? >> So the first thing I say is that the inside always comes out on the outside. Okay, I know you don't want to hear that, but the reality is what you believe about yourself, what you believe about others really changes how you present yourself. So the first thing I would say is it is not just some like list of things that we need to do or a checkbox stuff that you kind of put on. It's not a mask that you put on. You need to change your your internal beliefs. And um uh Sam Lesson has this this book he just released about Silicon Valley etiquette and he did this podcast recently where he talks about the importance of lowering your own heart rate before you go into the conversation. So yes, this might be your like one and only shot at this job. It's possible. oftentimes that's less the case than than most than most candidates believe. So sometimes we think like, "Oh, this is my one shot at getting this company." Well, if the company's going to be around for a while, you probably have other shots. So don't put so much pressure on yourself. I know it's hard, but it that is the reality. You need to tell yourself, give yourself an internal belief structure that makes it okay for you to make mistakes in this environment. You will come across a lot more calm. The second thing I say is try to um try to understand what and be empathetic of the other person. So again, this is an internal thing. believe that the other person is looking for a great engineer, a great manager, whatever it is, whatever the role that you're applying for, they're looking for somebody who's going to do really awesome. They really want they want to find that person. They're spending their time interviewing you. They really want to find somebody who's great. And um they're not just looking to nitpick you and like throw you out and and judge you, right? So, I think this kind of internal belief where you believe, you know, this person is is is not my enemy. This person is is is is a human doing their job. I would love to do my job alongside this person. let's have this great conversation. So that's the first thing you have to start start on the inside. Um if we are looking for other things then I would say how you show up physically. So what you're wearing you know go that like one notch above that's classic interview advice. Uh what's in your background so you know how how does your room appear when you're doing a video call especially um how are you uh how are you expressing care and interest in the person in the first few minutes of the meeting. So, if you're just if you come in and you're just waiting for the other person to say something, uh this is a very taking a very passive role and you're showcasing that um you know, maybe you're not ready for these kinds of of more active uh roles where I need you to build relationships with other people. Show me that you can be you may not be like the most extroverted person, but you probably do value people in some way. Like people are probably important to you. You know, your mom is important to you, maybe your significant other is important this there. People are important to you. And so, let that come across in that first few minutes. Hi, how are you? I'm doing good. you know, or I you know, I'm I'm interested in in I'm really excited to be here. Right? You can express enthusiasm even if you're uh you know, not the most extroverted person. So, those first few moments, the the brain is really looking at that like kind of just figuring out is this the kind of person I want to be with? And you're making a lot of they're making a lot of split split-second decisions. And so, how you show up in those first few minutes um are important. Practice that. Practice that with your mock interviewers. Don't just jump right into the questions. practice that kind of you know uh early early part make the other person feel comfortable sometimes the interviewer is is nervous too actually giving a behavioral interview is quite complicated quite difficult I would say it is hard to engage the person in some meaningful way ask relevant follow-up questions but making sure that you're collecting the information that you want to collect also making them feel comfortable so that they give you the best signal also you the behavioral interviewer sometimes the hiring manager or the or some kind of leader in the organization and so how they are coming across in the meeting is is is affecting the candidates uh perception of the company and a perception of the team. So, you know, have some empathy for that for that person who's given this behavioral interview. Make them feel comfortable. Make them feel like you're you're you're at ease. Um how you do that is by changing first what you believe about the about the situation. >> Who do you think would perform better on average in a behavioral interview? Someone who is extremely curt. They everything you ask them, they give you the right words really concisely, great stories, but they're they're very they're not there to be your friend. They're they're kind of cold and they're silent and they wait till you ask a question. Follow-up questions. They say no follow-up questions. Okay. Um, thank you for your time. Or someone who's very warm and bubbly and, oh, how's your day? Okay, let's get into this. Oh, I hope I do well. and they kind of build some rapport with you and then they they do so so on the the actual stories themselves across the body of people who conduct behavioral interviews. Which one do you think would do better on average? >> Well, that's the key. Who conducts the interview? So, if I'm conducting the interview, the second person will probably be doing better because I I like to engage. You might have might have noticed that, right? I want to to get those more people sides. So this is where when you say building rapport, building rapport doesn't mean that you're bubbly. Building rapport means that you are connected to the other person. So um you need to understand in that first few minutes like what kind of person is this? Is this a person who wants to be more business-like and wants to assess uh things in a more you know cold and calculating way? Fine. That's okay. Or is this person you know somebody who will kind of chop it up with me in the first in the first few minutes? So um I think you can you should start on a positive note. I think you should start energetic. you should start um uh you know uh believing that with some excite showing excitement to be there but respond to the other person and how they uh you know how they present themselves. They may um for example if this is someone who doesn't even ask you for an introduction doesn't even ask you for tell me about yourself. They may jump into tell me about a time when you had an ambiguous problem. Well, you know exactly who you're getting now and somebody who just wants to go down the list and and and and bang out the signal and and be very efficient. And so you need to to match that and be very efficient with what you what you say. But if the person starts two or three minutes of weather, sports, you know, uh how you feeling, how's the rest of the interviews going? Like, you know, you have a different kind of person that you're talking to. And so, you need to match their energy. [snorts] >> When it comes to these subjective parts of the the interview experience, what do you think is more important, the first impression or the last impression? [laughter] >> Do we have to choose? Like, why do we have to choose? So, let's let's do let's knock it out on the beginning and the end. But if I'm forced to choose, I would say the beginning. I think most of the time I am making a decision within the first 101 15 minutes of the interview about whether I'm going to hire the person. And it's because I have been asking usually my biggest scope questions. Tell me about your favorite project. Tell me about your most ambiguous project. Tell me about something that you're really proud of. And then I'm seeing what they're saying. And if I would like to have that kind of performance replicated in my organization, then the rest of the interview is more like let me check the other things. Let me check conflict resolution. Let me check growth. Let me make sure that this person's going to be successful. But ultimately, I would love for them to replicate their past success in my organization. So, if I had to pick one, I would pick the beginning. But you can rock the end. Like, why not? And the most important way to rock the end is to have relevant questions for the interviewer. And people often times forget about this in their behavioral interview prep. They spend all the time talking about their their stories and they're get really excited about telling answering questions. But then when it comes to uh you know a question that uh questions they have for the interviewer they come up with something like tell me about a day in the life of engineer like the day of the life of the engineer is pretty much the same across the company okay you know it's like hey we go get up we do some work go to meetings it's just not that interesting of a question so I think if you've thought deeply about the team about the organization about the product about the company and then you have some question which is helping you decide whether or not you want to work there the interviewer is assessing you on that even and so you can leave the impression that you are engaged in the process you're excited about the role, you're really evaluating whether it's right for you. That's a great way to leave the conversation. >> What percent of these interviews because you mentioned um the first impressions more important if you had to uh make the call. What percent of interviews do you think the result is decided within the first 20% of the interview? >> Yeah. So, lots of social science has been applied here. I have not seen any social science applied directly to tech interviews and sometimes you cannot apply um like cross apply you know interviewing at a fast food company to interviewing uh at a tech tech company. Um but the the the research says something like in the first u 15% right the first like 10 minutes of the interview most maybe like 40% of of the decisions has already been made and I would say that that happens for sure in in our experience as well as as uh you know in engineering again I I'm it's rare that I don't want to hire you in the first 10 15 minutes and then suddenly you say something at like minute 38 that's making me I changed my mind. I think it is common for me not to know right. So me for me to kind of feel like I'm not sure. Let me think about it. And then when I go back and I I would write the the the the notes down, I would consider it consider them according to the rubric, which is the goal of the rubric, right? It's to is to is to to shift our decision-m out of this this initial gut response and into something which is more cerebral leftrained. And um there would be times when I was not sure and then I would make a decision later. Uh but if I've made a decision in the first 10 minutes, it's pretty hard for you to to to overcome that. And most of the time it's because you're choosing the wrong stories or I can clearly tell that you just you have not done work at the level that we're expecting for this company. Um or you can't communicate very well. So like you can't tell stories very well and that's giving me um for for one thing usually means I can't collect enough relevant signal to to on the other axes to hire you. But also I know that uh if I hire you into my organization like you're not going to be a very good communicator. I I guess a lot of people I I've experienced this as well too where you're in the interview and it's not going so hot and then halfway you realize they're they're zoning out because they've already decided that you're not getting hired. So that that first half is so important. Another interesting thing I want to follow up on is it sounds like that last few minutes of the interview where they say, "Hey, do you have any questions for me?" This sounds like a note evaluative part of the interview, but it actually is. And you should continue to sell yourself by saying, "Hey, I ask questions that matter that are important. I am aware of the things that are important and I'm asking about those." So, um, what are good follow-up questions to ask to make sure that you get the most out of that section? >> Yeah. So, one of the themes here in our conversation is everything is evaluative, right? So the early conversation with the recruiter is evaluative. The end of the behavioral interview is evaluative. The like hangout chat with the hiring manager is evaluative. Everything is evaluative. And I think that makes sense. That's just part of life. But yes, definitely. So I think first of first off you should understand what's important to you. So what do are you concerned about the like long-term product uh prospects of this company? If that's concerning to you, why don't you ask about that? If it's if what's important to you is career growth and a manager that's going to be uh supportive of of your promotion and and you're talking to the hiring manager that's key. Then I would ask about that. Tell me about a time when you um uh tell me a story about how you help somebody grow from my level to the next level. Right? So if that's the story that you want to hear, understand what's important to you and uh it could be about the uh the technology. Although I think that those tend to be a little bit um more in the junior side. But if somebody's asking me about like what kind of stack we use or how we overcome this particular technical problem to me that feels a little bit more junior although if you know maybe in an AI context that might not be so like you could ask a question about you know model construction or evaluation or something like that that could be really important for for you to join the company. Um, you can ask about the role. So, um, oftentimes the one that I really liked would be something like, "Tell me about what makes this role really successful, like someone in this role really successful." And you can get us a lot of signal on how to be successful in the in the in the company once you get there. And showcase to the interviewer that you're interested in in being successful by asking a question like that. I mentioned company ones um, and and manager ones. So like I think those are the your your categories for choosing one some kind of insightful question. But it I wouldn't I wouldn't approach it as in like how can I impress this person with a deep question. I would approach it more like what's important to me and then that will come across in as a deep question to the person that you're you're talking to. But I would avoid certain things that might be important to you. So questions like um tell me about the conversation of this role. Right? That's not a conversation that you have with the behavioral interviewer. Or like how is the free food? Right? these things might be important to you but like this is not the time to talk about those things. I think it needs to be more related to uh you know something that the hiring manager also or the interviewer also cares about. One last thing I think on behavioral interviews we did we did a lot of a lot of stuff on on behavioral here is there's this idea of storytelling that kind of unifies everything. If you can storyt tell well you're going to do well in your behavioral. you're going to do well when you're advocating for yourself actually on the job. So, I want to get your your thoughts on how to tell stories. Well, um what are the most common ways to get the most benefit with the least amount of time? >> Yeah. So, a story has to have an arc, has to have some of beginning, middle, end. It needs to give the person whatever the the the story listener is looking for. you know, maybe in some kind of novel, we're looking for entertainment and we're looking for something like deeper meaning about life. In a behavioral interview, I'm looking to to uh see if you are demonstrating past behaviors which uh are repeatable in the organization I'm hiring you into which align with the signal areas, right? So, that's the goal. So, let's just remind ourselves that is have sort of arc and it needs to deliver this uh you know this signal area. There's a couple of different frameworks people have have talked about in the past for shortcuts for how we can get to this and the most common one is star, right? situation, task, action, result. If you've looked up anything about behavioral interviews, you've definitely seen the STAR method. If you I will begin by saying I don't love the STAR method. However, if you have an interview tomorrow and you have a bunch of star stories that you prepared, go for it. That's great. It'll give you that arc. It'll it'll showcase those actions. It will bookend the actions you have with some kind of context to understand them and then some kind of impact or results so that they can understand why you did the things that you did. I prefer one called CALR, which is context, actions, results, learnings. I don't think the difference between a situation and a task is like super relevant when you're telling a story. Often times story stories just have context like what's going on in the business, what's happening on the team, why I got this project in the first place. So I think trying to you as a preparer trying to figure out like what's the situation here and then I'm going to move into the task and what is the task on like a two year project, right? Like there's like many many many tasks really which are attached to the actions, right? So I think that that thinking in terms of just context and jumping into the actions uh is is super relevant and then I think for senior engineers star doesn't provide any kind of space for reflection or any kind of space for uh you know judgment or learnings right and that's that's why I like adding learnings to the end of every story especially for senior engineers I'm looking to see whether or not you can u look at your past experience understand what made you successful or unsuccessful and then apply that going forward so this gives you a nice uh and easy pneumonic right to remember to add those things to your stories. Um, but I also think that when you're telling stories, you need to be con cognizant of where you are in the interview. And I think this is another differentiator between junior interview and junior candidates and senior candidates. A senior candidate is managing the time. So they understand that hey when I ask some kind of big I call it a trunk question trunk branch leaf trunk question which is like tell about uh you know a project that was really ambiguous then you're giving you're being given a cart blanch by the the interviewer to tell a longer story so you tell a longer story but then if I ask something about like well you know how who did you talk to in order to get this you know piece of information then uh to you know to to do some action as part of the story then now I'm asking some kind of like middle round maybe I probably have some thought about who I talk to and how I talk to them. It's a communication signal, right? So, I should give them something, but I shouldn't give them like a complete star or Carl story at that at that level. And sometimes they just want like some very specific information like, oh, like tell me about the framework that you used for this particular project. Okay. They just kind of like checking off a box, right? Just want to understand little bit of context I didn't have before. And so, that's a leaf question. Just give them the answer and then move on. So I think your ability to detect what kind of question how long the the interviewer wants to to listen to a response is going to be an indicator of of seniority and also like an important skill for you managing the the interview. For storytelling what do you think's more important what you say or how you say it? So for instance, is it the actual words that are coming out of my mouth that makes the biggest difference or is it my presence, how confident I am? And is there one versus the other that you'd say people should really focus on to really nail their stories? >> Engineers tend to be pretty structured people and engineering interviews tend to be very structured. Um even in smaller places, someone will at least perceive that they they are structuring the interview in some kind of rational way. And so I think it is less about how you say it and is more about what you say. Um so if I even if you came across confident and positive and encouraging and like somebody I would love to work with but if somehow I did not hear that you uh were handling ambiguity in some kind of structured way or that you were applying um some kind of conflict resolution framework to the conflicts that you had then I'm I'm I'm that interview is not going to go well and uh I'm not going to be able to support hiring you. So I do think that that it really does come down to substance. I think that's the most important thing. Um uh you know form follows function as in most engineering environments and I think that it in it it uh it it's the case here as well. However, I [snorts] would say at more senior levels then how you come across and how you tell the story does make a lot more does make more impact because we are expecting you to be telling stories like this one. For example, when the VP says, "How's that project going?" in the in the in the status meeting, you need to be able to tell like a an engaging and entertaining well, as much as entertaining as any work thing is, entertaining story about how the project is going. And so I I am looking to see if you are uh providing interesting details, for example, like a detail that might be showcase something that uh some thinking that you did or some unique situation that you were in. um often times uh you know whether to include details is a big part of of what you're going through as a behavioral interviewer. So you should only include details which which help to accomplish some tasks. So maybe the task is that I want to showcase I'm deeply technical. I want to include a few details like that. Maybe the the task right now for me is the candidate is to showcase that I am somebody who can work across teams. So, I want to include the the the part about how the the other tech lead had an had a bad, you know, had a mean look on his face when I went to to to talk about this thing. Maybe that detail is relevant, right? Because it showcases how I push through difficulty and push back on on other teams. So, um yes, I think those things are relevant. I think most candidates probably need to spend more of their time on basic uh story structure, basic identification of what actions they did that are repeatable. You know, I wanted to ask you about your senior your your promotion to M2 at Meta. Actually, you've you've told me so much about how to speak about scope at this point. Maybe you could you could tell me or tell the audience how you got promoted to M2, why you got promoted to M2, and speak about it in a way that illustrates the scope of a senior manager. >> In order to get to M2, I had to solve some difficult problems in the recruiting space. And uh the probably the most important one was around diversity. So I I left uh a team which was focused on building things for teenagers which is another hard problem that I got myself involved in. Very difficult time for for Facebook during that time. Um but I left that team to uh lead a couple teams within their internal recruiting products organization which is all about um supporting candidates, supporting um recruiters and sourcers and their goals. And uh but the thing that really drew me over there was working on supporting a team that was um hiring more diverse engineers. That meant a lot to me. So how can I help make the world a better place as my position as a manager would be to make uh what is the most uh the largest wealth opportunity in the world today which was technology and is technology. How can I make that available to more people in the world? That's really motivated me. So I that is not an easy problem to solve. uh is not definitely not an easy problem to solve from a perspective of a a product team right I'm not an education institution right I I I don't get to make all hiring decisions for example um I don't get to pick uh you know what people learn in school so uh but we were able to move the needle there by improving um preparation of all things like interview preparation and that's how we were able to um help improve the diversity hiring for for uh for meta and that as well as supporting a number of other teams helping to establish uh high quality of candidate data that would be established uh for for Facebook's applicant tracking system and being able to um uh you know clarify like what's important in in terms of candidate data and being able to improve the quality that we have significantly over time. I think that's those are the reasons why I was promoted to M2. So when I when I think I that story I just heard as if I was an interview were I heard that you were supporting multiple teams. I heard that you were taking on a an ambiguous problem like how do you solve diversity? It's not immediately obvious and it sounds like you had a significant self motivation to go towards this problem space and solve for the company. So um am I hearing that those are the the signals that you hope that uh an interviewer would have got if you were interviewing for a behavioral interview? >> Yeah, for sure. Um I I would say I would add a few other ones. So one thing that that I didn't mention is impact across the company. So I think leading leading the iOS and Android uh recruiting pipelines is an important way that you're scaling yourself and and applying yourself across more than than just the teams that you're directly responsible for. So that was also a big part. I should have included that. I understand you left big tech at this point and you know looking back on your experience in big tech is there anything that you regret or anything that you wish you could have changed? >> I don't regret leaving. I think um I had a really great time. I work with a lot of wonderful people. I think that I regret uh the anxiety that I put into the teams and the anxiety that I put into myself. I think we can all look back on parts of our life, whether it's school or early career or even now, and we think, "Wow, I really wish I hadn't worried about that at the end of our lives, we don't say things like,"I wish I had just gotten a few more percent out of that engagement number and that project XYZ." Like, nobody thinks that way, right? People value relationships. They value um they value connection. Um and I I think that I added a lot of anxiety to my life in various parts of my career. And I I regret that part. I think that um like I told you earlier, I made conscious choices to optimize for my life experience versus my career. I think there were times when when I was not honest with myself about that when uh I was not honest about what that that trade-off would mean in terms of compensation or in terms of career progression or in terms of status for myself. And I think being honest with yourself about what you really value and being okay with the trade-offs in advance. And um since I've left big tech and supporting my wife as she's building her her her business um certainly that has come with like a decrease in pay. And one of the things one of the ways that I have um been able to apply the learning that I'm telling you is before I left I knew okay I'm pay is going cash flow is going to be low. I'm going to be okay with that because I'm making decisions to spend more time with my kids because I'm making decisions to support more community uh organizations here and volunteering and I'm going to be okay with that that choice. And that's been really helpful. I've been able to go back to that choice a number of times when the cash flow situation has uh you know maybe wanted to improve that [laughter] maybe we missed that that that kind of paycheck u and maybe you'll experience this I don't know you know having just having just left uh big tech uh but I think having that honest conversation with myself has really helped in the last couple of years. uh and I wish I had had done that earlier and said you know what I I really value these things and that means I'm not going to have those other things in life and that's that's okay that's okay if that's what you want right um so making that kind of conscious and valuesdriven decision and then coming back to it maybe sometimes revisiting it maybe you want to change it but that kind of intentionality is something I wish I had um was more honest with myself about >> so when you're saying you were you were not honest you still thought you wanted that cash flow and those things >> I think I was frustrated I think I was frustrated frustrated at various points about about not being able to progress. And I think that there was I would even say bitterness at times when I would say I'm frustrated that so- and so got this job, so and so got promoted, you know, so and so was able to do XYZ right here. Look at me, you know, I'm doing this, I'm doing that. But not being honest with myself of of you know what, you you didn't do the things that they did. You did not move teams as rapidly as they did. You did not work as hard as that person. You prioritized other things in your life. You prioritized your family. you prioritize in making an impact in um in uh in the community around you outside of work and um and that has consequences, right? So I I think we we can live in this world where we think um you can have it all, right? Like you can you can be a whatever level seven IC and go home at 5:00, right? And have a wonderful and engaging family life. And maybe some people can do that, right? I think that that that could be a skill that people have, but that depends a lot on on your your talent level and what kind of skills you've built up over time. Um but the reality for most people is that um if you want to accomplish something extraordinary in your life, you have to have ext you have to take extraordinary steps. And I don't think I was honest with myself. And I think that that resulted in some frustration and bitterness along the way. But I think that once I decided uh kind of in the middle what's important to me, where I really want to be um what I want my kids to say about me in 10 years, that was what really what guided me. Um what what I want what I want them to remember about me 101 15 years from now. Um, that was very clarifying and very helpful. >> That intentionality got rid of those feelings for you. >> Well, I think that it comes back sometimes. So, especially living in a place like this where uh people are are are stacking wealth in in in as fast as they possibly can and um you're going to see people like that around you all the time living in Silicon Valley. And so, you have to to to ask yourself like, is that what I want? No, maybe it is. That's fine. Maybe it's not. uh and then so it's going to come up and it comes up in my life you know on a on a semi-regular basis but it's really helpful to be aligned uh with your own values and have that kind of mission statement or vision that you have for your life and what's important to you in the future and if you live like that you'll be satisfied >> you you worked a long time at Meta across uh other companies as well and I'm curious what was the best advice that you ever received in your career >> I would say that the best advice that I ever received was um the importance of creating scope. So, uh, if you would like to get promoted or if you would like to, um, to, you know, to to advance in your career, often times we were waiting, like we were waiting for somebody to give us that opportunity. And, um, I remember one of my managers said like, if you want this, you know, M2 role, you have to create an M2 scope uh, scope team, right? You have to to accomplish and solve problems that are uh, you know, that are that are of this scope. And I so I think that this this kind of um honest reflection on like what it really takes to get to the next level that you have to change uh not just how what you do right that's often advice that you hear not just doing the same thing that you're doing as your level better you have to do something different but what is that difference and really that difference is about creating additional scope and um creating space for the the organization to succeed. That was another key part of that advice was um you know what is your VP saying about your project and if your VP is not going to be talking to anybody of their peers or their manager about what you're doing then the question is am I doing the right thing um so what can what kind of kind of how can I work backwards right and we do this a lot we work backwards in the behavioral interview what do I want to present what kind of signal area do I want to present you work backwards in a promotional experience what do I want the packet to be like and I think you can work um backwards in terms of um creating scope which is what do I want the you know the VP or the organization's leadership to say about what we've accomplished and then go and figure out a way to do that thing. >> Yeah, that's that's great advice. I mean, there's there's always situation and luck when it comes to career growth and promos, but I feel like the most satisfying promotions are the ones where you take initiative and you create the scope and no one can stop you in that case. So, it's it's uh you don't need anyone's permission. Um, and then the last question I'd ask is if you look back on your entire career and right when you graduated college and you could give yourself some advice now that you've learned what you've learned, what would you say? >> I had a lot of imposter syndrome. So I avoided, for example, I got a I got a PhD out of um in computer science out of out of undergraduate school. But during the summers, I would work uh just in in in the research in the university when a lot of my peers would go and work uh in in industry. they would go get a like a internship, right, at Google or Facebook or wherever and work there. And um really what held me back was insecurity. I didn't want to go through the interview process. I I didn't want to be rejected. And so I I think that kind of fear and allowing um the imposttor syndrome that I felt to hold me back from those choices. I I I do think that that had a my my career was great. I love my career. It's great. I'm not sure I would change a ton, but I think it did hold me back. I think I I was slower to understand how u big organizations operate. I was slower to understand how large code bases operate. Um certainly coming from from academia. So I think that that kind of insecurity and fear um really held me back. I know that's super common kind of advice to give oneself in the past is like don't give into fear. Um but that's the biggest advice I would tell myself is don't give into fear. >> Awesome. Well, thank you so much Austin for your time. I really appreciate it and I hope it's helpful for people. >> Yeah, thanks Ryan. Great to be here. >> Thank you for listening to the podcast. It's a passion project of mine that I've really enjoyed building. Another passion project that I've been working on kind of in secret is building an ergonomic keyboard that I wish existed and I finally have a prototype. So, I'd love to show you what we've built. It's ultra low profile and ergonomic and I couldn't find anything like it on the market. So, that's why we built it. I'll put a link to the keyboard in the description. You can take a look and learn more about the project there. We could definitely use your support. Also, if you have any feedback for me about the show, I'd love to hear it. Comments on YouTube have led to guests coming on like Ilia Gregoric and David Fowler. I wasn't aware of them until someone dropped a comment. Also, feedback in the comments helped me learn to reduce the number of cliffhers in the intros. So, your comments definitely make a difference. Please keep letting me know what you'd like to see more of in the show, and I'll see you in the next episode.