Why you want to join IBM
Lead Data Engineer Interview Questions
237 lead data engineer interview questions shared by candidates
on the call, difficult situation faced and how you handled it.
Find the maximum value in all possible subarrays of size K (sliding window maximum problem). Given an array of integers and a window size K, return the maximum values as the window slides through the array. This is a LeetCode hard-level algorithm question that's rarely relevant for data engineering roles, which typically focus on SQL optimization, ETL pipelines, and data architecture rather than complex algorithmic problems.
In SQL, what is the difference between GROUP BY and PARTITION BY?
Context Given a night with X ride requests and Y available drivers in a fictional city, you have to develop a batch processing application that would aggregate and expose data coming from the matching engine. Every Z seconds, the matching engine tries to match every pair of request and driver that are available in the city. Some are matched, some are not. The results of each matching tick are stored in a set of files. Given this data we want to be able to get a overview of the marketplace health and multiple applications could follow such as heat maps. The metrics that we want to use for heat mapping are driver match rate and request match rate. Exercice Develop a microservice that will: Aggregate matching data by fetching new matching data and exploiting this data in order to aggregate driver match rates and request match rates by geo-spatial units of your choice. Expose an endpoint which return the adjusted values of request and driver match rate, following this formula.. Bonus Plot the driver and request match rate for one night
Generic questions about previous roles, motivations etc
Q: How to measure the satisfaction of team members? Q: What is GIL in Python? Q: How to optimise SQL query?
- How to ensure idempotency? - What is an integration test? - How to define vision, mission, values and goals of a team - How to manage underperformance of a team member?
Experience based questions, handle different challenges, what solution did I provide, different ETL approaches , various AWS services
What is the difference between Agile and Dev ops
Viewing 141 - 150 interview questions