Which types of query optimization do I know in Spark, and how do they work internally? How to make a join with two big datasets, if the joining condition is not strict (expected to hear about product join and keep only relevant rows) Other in-depth questions about spark-streaming internals, and big data techs like kafka, zookeeper, etc.
Senior Data Engineer Interview Questions
2,563 senior data engineer interview questions shared by candidates
What would be your ideal tech stack for small / mid / big data projects?
Hackerrank questions with sql and coding exercise
design a realtime data pipeline.
Which union statement eliminates the duplicates?
A question about the live coding session
Tell me about your most interesting project
Asked simple 5-6 SQL queries which I was able to answer. Asked python, AWS based questions too which were at average level.
Most of the questions were personal type questions - "tell me about your background," and about how I would handle different scenarios.
Tell me about a time you had to go against the status quo
Viewing 1081 - 1090 interview questions