1) Spark questions 2) Scala and Python question 3) AWS questions 4) Coding round
Senior Big Data Engineer Interview Questions
102 senior big data engineer interview questions shared by candidates
Dataframe and json question limited to interviewer's knowledge
Spark
1. How do you dedupe the data? 2. What is SCD? 3. What is big data in your world?
Some big Data related questions involving working knowledge of spark
Is working from home sometimes necessary for you?
Write code/pseudo-code for given scenarios, design solution for given scenario and answer questions that evaluated leadership capabilities.
Times X{open, close} , Y{open, close} rec_type, status, time x1, open, 930 x1, close 1030 x2, open, 1035 y1, open, 1040 y2, open, 1041 x2, close, 1100 x3, open, 1110 x3, close, 1115 y1, close, 1120 y2, close, 1121 |---x1, open, 930 |---x1, close 1030 |-----x2, open, 1035 | y1, open, 1040----| | y2, open, 1041 ---+---| |-----x2, close, 1100 | | |---x3, open, 1110 | | |---x3, close, 1115 | | y1, close, 1120---| | y2, close, 1121-------| Find the pairs of x-type and y-type where they have any time overlap between them.
Design big Data solution for 2 streaming dataset using any Cloud or open source tech
Craft demo mostly demonstrating spark working knowledge, distributed systems.
Viewing 71 - 80 interview questions