Given a timeseries dataset with the following columns: device_type, timestamp, number_of_requests. Find a the minute in which the next 60 minutes sum up to the greatest total for each type of device.
Data Engineer Interview Questions
Data Engineer Interview Questions
Data engineers are IT professionals who are needed in almost every industry. Data engineers monitor data trends to determine best next steps for companies. A critical part of a data engineer job is to process raw data into usable data by creating data pipelines and building data systems.
Top Data Engineer Interview Questions & How To Answer
Question 1
Question #1: Can you describe in detail your level of expertise with programming languages?
How to answer
How to answer: Before the interview, review your resume and/or portfolio and make a list of the programs you are most proficient with. If you find that you are lacking the expertise in a program that the company predominately uses, describe yourself as a highly motivated self-starter who will work tirelessly to learn the program(s).
Question 2
Question #2: Explain data engineering in your own words.
How to answer
How to answer: Highlight your role in relation to the larger organization and other roles like data scientists to clearly define your contribution to the overall system of business. Clarify the difference between a database-centric engineer and a pipeline-centric engineer.
Question 3
Question #3: Can you describe your experience working with Apache Hadoop and cloud data management environments?
How to answer
How to answer: Research the company's software, data cloud products, and use of Apache Hadoop to be prepared for this inquiry. Data Engineers must be fluent in programming languages and data management systems used throughout the industry such as Apache Hadoop.
20,235 data engineer interview questions shared by candidates
what is the most complex thing you faced in your recent project?how did you resolve that?what was your approach?what did you learn from that
Q: The USA and Russia has the Largest natural gas resources in the world. Qater is 4th although 849 times smaller than USA. Which Country ranks 3rd?
Mostly CV based Questions were asked.
SQL (follow up) Now imagine that you have a user that is "always" accessing table A, but you need to move the changes (in 10000 rows) from the temp table into table A without the user being affected. How would you do that ?
SQL Imagine you want to make some changes to table A, without actually changing table A. How do you do it ?
Python: Have you ever used a context manager ?
Are you willing to relocate?
Tell me about the main differences between transient clusters and permanent (& shared) clusters?
Tech Questions related to Data Engineering. Python, SQL, PySpark and in general CS questions
Viewing 1991 - 2000 interview questions
See Interview Questions for Similar Jobs
Analytics EngineerPerl DeveloperModeling EngineerOracle Data IntegratorEtl TesterEtl DeveloperDatastage DeveloperData ModelerDatabase AdministratorData Warehouse DeveloperData MinerBusiness Intelligence SpecialistData ScientistData Warehouse ArchitectDatawarehouse DeveloperData AnalystBusiness Objects DeveloperData Warehouse ManagerMachine Learning Scientist