Opening For BIG FOUR For Big Data Engineer

4 - 9 Years

Job Description

Big data Engineer with 4 to 8 years of IT experience including 4 to 7 years in
Big Data and Analytics field, developing E2E Data pipelines to perform batch
and Real - Time/Stream analytics on structured and unstructured data.
Developing, constructing, testing and maintaining architectures for data lakes,
data pipeline, data warehouses and large-scale data processing systems .
Expertise in building Data Lake,Data Pipeline on Cloudera or Hortonworks.
Experience in Big Data Analytics and design in Hadoop ecosystem using
Spark/Spark Streaming, Kafka
Solid understanding of data processing patterns, distributed computing and in
building applications for real-time and batch analytics.
Strong programming skills in design and implementation using Python, Scala
and Java
Hands on Data Ingress, Egress, Processing using Kafka or DataBricks
Good knowledge on NoSQL Data bases such as HBase, Cassandra, Redis and
using Spark streaming for real time stream processing of data into the cluster.
Experience with multiple Hadoop file formats like Avro, Parquet, ORC, and
JSON etc.
We are looking for the candidates with the following:
BE/BTech/MCA with a sound industry experience of 6 to 10 years
Mandatory skills:

o Spark, Scala,Spark Streaming,Pyspark
o Kafka, Hbase, Cassandra, Mongodb,
o Cloudera/Hortonworks Hadoop Distribution
Preferred skills:
o Data Warehousing, ETL, Hive, Flink, AWS/Azure
o Experience working on CMMI / Agile / SAFE methodologies


Desired Candidate Profile

Please refer to the Job description above

Company Profile


Clarity Consulting is a boutique recruitment firm, specializing in recruiting for Consulting , Outsourcing and Research & analytics firms. We are headquartered in New Delhi and service our clients PAN India from this office. . Our clients are the leading BPO companies , Big4 consulting firms, ITES companies and Research and Analytics firms.
This is our 8th year of operation and we have been growing at a rapid pace, while maintaining our position as the top 5 Vendor at most clients.
View Contact Details+



Not Disclosed by Recruiter

Role Category

Programming & Design


Software Developer

Employment Type

Full Time, Permanent