SQL join and window function, spark, adf
Senior Data Engineer Interview Questions
2,563 senior data engineer interview questions shared by candidates
1 What are the challenges faced by distributed system and how to resolve them in most efficient way
How do create a server for 100 gb of data?
Based on pyspark dataframe manipulations (withColumn, conditions, explode, etc) Be interactive.
What are some things you would like to change within your team?
spark cluster confuguration to process 1 TB of file 2. quetions on data modelling 3.GCP related quetions 4 How do you implement logging 5.SMB join in hive along with this few scenario based quetions and some architecture related quetions on cloud and kubernetes
Basics on spark coding and its architecture
Asking Sql and python script questions.
Data models , Schema, Sql, Cloud
Coding test on SQL & Dataframes Internal of spark.
Viewing 1611 - 1620 interview questions