What are basic skills of etl
Senior Data Engineer Interview Questions
2,562 senior data engineer interview questions shared by candidates
The HR interview was just a relaxed chat based around values and general compatibility for the role. They ensured that you have done your reading around the company and role. The tech challenge was python based, using a provided API to gather/filter/resubmit data. You had to upload the solution along with appropriate tests to Git. The engineer interview didn’t cover the tech challenge solution at all (surprisingly). It was a general discussion on past experience and projects. Later it switched gears to some more general questions like ‘what is etl?’ or ‘tell us about data streaming products?’ or ‘what problems have you had using semi-structured or unstructured data?’. AWS experience and services used was also covered. The whiteboard session I found the hardest part and was again scenario based where you had to diagnose problems in a process and work with the other engineers to come up with a solution. Later (once the main problem had been covered) more requirements/problems were added to see how you thought on your feed and you were questioned on which products you would use (and why)
Data Engineering questions: Explain data solution Toughest tasks you had a a a data engineer
Spark Coding skill based question.
Moving average in sql and pyspark. One python coding in string i think
1> Technical questions related to job role 2> Current project work flows 3> Some programming and Infra related questions 4> English test including speaking, writing and others
Implementing data processing job in with spark and postgresql.
Create a simple ETL pipeline in Airflow.
Why do you want to work here?
3 task 1) Python coding for array or math problem 2) Application on python with simple logic 3) Spark ingestion task from json and database into database
Viewing 721 - 730 interview questions