Python- 1. WAP to eliminate vowels in input string. 2. WAP to print "aaabbbbcccc". input - 'a3b4c4' SQL- 1. rank/dense_rank/row_num - state difference and explain with a real life example. 2. Input Table C1 | c2 1 | India 2 | Aus 3 | Pak 4 | SL OutPut India | Aus India | Pak India | SL Aus | Pak Aus | SL Pak | SL Big Data :- 1. Diff between Parquet/Avro/ORC/CSV 2. Hive partitioning vs bucketing 3. How data is stored in AWS S3 ? 4. Types of Spark modes (cluster/client) 5. Types of cluster managers (YARN/Mesos/ Kubernetes/Local/Standalone)
Data Engineer Interview Questions
Data Engineer Interview Questions
Data engineers are IT professionals who are needed in almost every industry. Data engineers monitor data trends to determine best next steps for companies. A critical part of a data engineer job is to process raw data into usable data by creating data pipelines and building data systems.
Top Data Engineer Interview Questions & How To Answer
Question #1: Can you describe in detail your level of expertise with programming languages?
Question #2: Explain data engineering in your own words.
Question #3: Can you describe your experience working with Apache Hadoop and cloud data management environments?
20,192 data engineer interview questions shared by candidates
Behavior questions plus technical assessment
Was asked to build a data pipeline that starts by making a request to an api that contains time series data, parse the response and save to a file. The API provides energy trading data.
For the Data Engineering portion, I worked with a data set and Python Pandas to do various manipulations of that data.
The most involved part was in deciding how to rate top restaurants with a given data table of yelp reviews. This was not terribly difficult, but did take a small bit of thought and a fair bit of know how for manipulating the dataframe
Able to work off hours
None! Recruiter didn't show up to the 2 scheduled calls.
Just follow the briefings and you can ask questions when I am through, also let me know when you are done reading and understanding every line. Clear? Q1: What type of job(s) have you had? How did you get your previous job(s)? Q2: What were your main Responsibilities and Achievements in your previous jobs? Q3: Can you work under stress and pressure? Q4: Are you currently employed? Q5: How would you like to be Paid? Direct deposit or Check? Q6: How would you describe yourself? I was asked what bank I use as well....
Mostly from CV and outline and they expect to answer more to the story.
Why are you interested in this role?
Viewing 901 - 910 interview questions