Position Details: ETL Architect

Description:

Role: ETL Architect
Client: Techmahindra
Location: Denver (Onsite)

Experience: 12+

Duration: Long Term 

Role & Responsibilities

• 12+ years of IT experience in Data Engineering, Data Quality, Data Migrations, Data Architecture, Data Lake formation and Data Analytics.
• 5+ Years hands on solid Experience on AWS services like S3, EMR, VPC, EC2, IAM, EBS, RDS, Glue, Lambda, Lake Formation etc.
• Must have worked in producing architecture document for small to large solution implementations.  
• In depth understanding of Spark Architecture including Spark Code, Spark SQL, Data frames, Spark Streaming, Spark MLiB, etc. Experience on handing very high-volume streaming data in various format like JSON, XML, AVRO, Snappy etc. 
• Good Exposure to Kafka to design future capacity planning, partition Planning, Read and write 
• Must have worked with Big Data and should have good knowledge Mar reduce and Spark.
• Must have very good working exposure on different kind of databases like RDBMS, No SQL Columnar, Document, distributed databases, Could Databases, in memory databases etc.
• Python Exposure is an added advantage

Perform an action: