Data Engineer

Roles & Responsibilities: 

• Experience in understanding and translating data, analytic requirements and functional needs into technical requirements while working with global customers
• Build and maintain data pipelines to support large scale data management in alignment with data strategy and data processing standards
• Experience in Database programming using multiple flavor of SQL
• Deploy scalable data pipelines for analytical needs
• Experience in Big Data ecosystem – on-prem (Hortonworks/MapR) or Cloud (Dataproc/EMR/HDInsight)
• Worked on query languages/tools such as Hadoop, Pig, SQL, Hive, Sqoop and SparkSQL.
• Experience in any orchestration tool such as Airflow/Oozie for scheduling pipelines
• Exposure to latest cloud ETL tools such as Glue/ADF/Dataflow
• Understand and execute IN memory distributed computing frameworks like Spark (and/or DataBricks) and its parameter tuning, writing optimized queries in Spark
• Hands-on experience in using Spark Streaming, Kafka and Hbase
• Experience in any orchestration tool such as Airflow/Oozie
• Experience working in an Agile/Scrum development process

Academic Credentials : BE/BS/MTech/MS in computer science or equivalent work experience.

Experience :  Associate-DE(2-4 YEARS ), Senior Associate-DE(4-6 YEARS ), TC-DE (6-8 YEARS )

Key Skills : Bigdata, Cloud, Python, SQL

Contact : CHAITHRA

Contact Number: 6362229035

Email ID: chaitra@novotreeminds.com