First Round Q1 Delete duplicates from a table. Q2 Find duplicate rows from the table. Q3 Repartition vs Coalesce Q4 How stages are created in Spark ? Q5 Word count program with Spark Q6 Fibonnaci Sequence using Python Q7 What are generators ? Q8 Spark Architecture Q9 Questions related to project Techno managerial Round Q1 Discussion about the project and experience. Q2 Query to create a table and partition the table in HIVE ? Q3 Directory structure for partitioned table Q4 If you add a new directory with correct schema to hdfs will data be shown in HQL ? Q5 Find the max temperature for a given date range ?
Data Engineer Interview Questions
Data Engineer Interview Questions
Data engineers are IT professionals who are needed in almost every industry. Data engineers monitor data trends to determine best next steps for companies. A critical part of a data engineer job is to process raw data into usable data by creating data pipelines and building data systems.
Top Data Engineer Interview Questions & How To Answer
Question #1: Can you describe in detail your level of expertise with programming languages?
Question #2: Explain data engineering in your own words.
Question #3: Can you describe your experience working with Apache Hadoop and cloud data management environments?
20,235 data engineer interview questions shared by candidates
Scenario Based Questions for both Coding and system design
No living coding or such. Best security practices while building the data ingestion pipeline?
What is a failure you’ve learned from?
How does elasticsearch work internally?
Asked me about Machine Learning?
How do you double the revenue of a restaurant?
nda
Why are you looking for a new opportunity?
Get rows where price decreased compared to the previous date petrol_details (pump, products, price, date)? [ (PUMP-1, Petrol, 100.05, 2025-01-01), (PUMP-1, Petrol, 98.00, 2025-01-02 ), (PUMP-1, Diesel, 90.00. 2025-01-01 ), (PUMP-1, Diesel, 95.00, 2025-01-02 ), (PUMP-2, Petrol, 101.05, 2025-01-01), (PUMP-2, Petrol, 97.99, 2025-01-02 ), (PUMP-2, Diesel, 90.05. 2025-01-01 ), (PUMP-2, Diesel, 86.00, 2025-01-02 )]
Viewing 1771 - 1780 interview questions