Sr Data Engineer Interview Questions

2,552 sr data engineer interview questions shared by candidates

Tech Round (Python Coding for API Integration): Write Python code to fetch data from an API endpoint and process it. How would you handle pagination when fetching data from an API? System Design (Data Warehouse - DWH): Design a Data Warehouse (DWH) architecture for a large-scale dataset. What are the key components you would include in a DWH design and why? How would you ensure data quality and integrity in a DWH? SQL Question (5-part question): Write complex SQL queries for data manipulation or retrieval. Hiring Manager Interview (Experience-focused): Can you describe your experience with [specific technology or project]? How did you handle challenges in your previous roles? How do you prioritize tasks and manage time when working on complex projects? Director of Analytics (Behavioral Interview): Tell me about a time you worked under pressure and how you managed the situation. How do you handle conflict in a team? Can you describe a situation where you had to make a tough decision at work?
avatar

Senior Data Engineer

Interviewed at Marshmallow

2.7
Feb 19, 2025

Tech Round (Python Coding for API Integration): Write Python code to fetch data from an API endpoint and process it. How would you handle pagination when fetching data from an API? System Design (Data Warehouse - DWH): Design a Data Warehouse (DWH) architecture for a large-scale dataset. What are the key components you would include in a DWH design and why? How would you ensure data quality and integrity in a DWH? SQL Question (5-part question): Write complex SQL queries for data manipulation or retrieval. Hiring Manager Interview (Experience-focused): Can you describe your experience with [specific technology or project]? How did you handle challenges in your previous roles? How do you prioritize tasks and manage time when working on complex projects? Director of Analytics (Behavioral Interview): Tell me about a time you worked under pressure and how you managed the situation. How do you handle conflict in a team? Can you describe a situation where you had to make a tough decision at work?

1)Storm and kafka 2)Spark streaming and structured streaming 3)Spark rdd dataframe and dataset 4)Partitioning and bucketing scenarios 5)Sql functions practice 6)Test cases 7)Spark hive context and sql context and spark session difference 8)Data modeling for bigdata 9)Dimension table and fact tables 10)Data crunching 11)Webservices and microservices applications 12)1000 files with particular set of id store id columns and final outcome should be like 13)count of stores for repeating id 14)So id and stores are repeating g 15)How to deal with 1000 files 16)How sql query steps works 17)Algorithm with spark program 18)How will it check job dependency first completes then only completes second one 19)Oozie scheduler 20)Lookinto titan glm code and spark functions
avatar

Senior Data Engineer

Interviewed at Verizon

3.6
Aug 27, 2020

1)Storm and kafka 2)Spark streaming and structured streaming 3)Spark rdd dataframe and dataset 4)Partitioning and bucketing scenarios 5)Sql functions practice 6)Test cases 7)Spark hive context and sql context and spark session difference 8)Data modeling for bigdata 9)Dimension table and fact tables 10)Data crunching 11)Webservices and microservices applications 12)1000 files with particular set of id store id columns and final outcome should be like 13)count of stores for repeating id 14)So id and stores are repeating g 15)How to deal with 1000 files 16)How sql query steps works 17)Algorithm with spark program 18)How will it check job dependency first completes then only completes second one 19)Oozie scheduler 20)Lookinto titan glm code and spark functions

Viewing 2091 - 2100 interview questions

Glassdoor has 2,552 interview questions and reports from Sr data engineer interviews. Prepare for your interview. Get hired. Love your job.