Interviewer asked very conceptual and project based questions. 2 SQL queries, questions of spark based on day to day use and debugging skills. some questions were bit unusual and need very in-depth understanding.
Interview questions [1]
Question 1
1. When does the driver is performing as executor.
2. How to ensure broadcast join without writing a single code.
3. Daily Petabyte of code then how to ensure that back date calculations you can do easily without delay.
4. How do you debug the spark app.
5. What does your driver do ? any instance where driver did something?
6. What all is there in driver and executor logs?
7. Was OCI Data Flow server or cluster based?