1. Tell me about yourself 2. Few basic question from Spark and Data Ware house 3. Change Data Capture CDC Implementation question (As i implemented CDC in my current Company) Scenario Question : I have a use case where if I stream the data from Mongodb oplog to Kafka and then write to s3 buckets as it is, how do I ingest data and handle multi level nesting from mongodb and updates to the tables. (Ask Solution)
It was a Python project
1st technical round: Spark related basic question. Hive queries. Linux command File format 2nd technical round: output of inner, left, right, full outer join with 2 tables. End to end code in spark to join 2 table.
Why forward? See body for more questions ^
architecture, culture, software principals, etc.
Endless grilling on a variety of topics. Most interviewers were either disinterested or waiting for me to trip up.
Previous roles related to database administration
Write DF on Databricks Cost Optimization of queries ETL / ELT on AWS
Questions were related to Spark, Hadoop, Hive, SQL and Python
Tell i know about Spark
Viewing 1681 - 1690 interview questions