Explain Hbase minor and major compaction
Senior Big Data Engineer Interview Questions
102 senior big data engineer interview questions shared by candidates
Discussion around current project and challenges around it. How would you scale the current infrastructure? System design related questions. Write a program to find x number of max elements from m number of sorted arrays. General discussion around your project. Write spark code to find the unique routes from a given flight routes table where there could be individual entry for MumBai --> Kolkata/Kolkata--> Mumbai Write a spark scala code to get the employee who earns highest among employess whose salary is more than avg salary and age is less than the avg age. What is master in Spark? What does appName do in Spark? How the local scheduler work in Apache Airflow? How it differs from Kubernetes? Questions around airflow architecture. Given two programs for word count tell the difference between reduceBykey and groupbyKey?
Tell me the toughest challenges you faced in your current project
Most memorable instance in current job
What do you expect from your manager
No questions ! just said we are looking for 6+ years of experience
Different mode of running spark cluster.
What problems you faced while writting spark job and how you optimized it.
Standard CS questions
Design LRU cache
Viewing 31 - 40 interview questions
See Interview Questions for Similar Jobs
Big Data EngineerSr Data EngineerData EngineeringSenior Data EngineerBig Data ConsultantSenior Data ConsultantBig Data DeveloperBig Data Hadoop ConsultantBig Data AnalystLead Data EngineerHadoop Spark DeveloperBigdata EngineerData EngineerSenior Data Stage DeveloperEtl Informatica DeveloperBig Data ManagerData ScientistsPrincipal Data Engineer