Required Skills

Design, create, build & maintain data pipelines. Aggregate & transform raw data coming from a variety of data sources to fulfill the functional & non-functional business needs. Performance optimization: Automating processes, optimizing data delivery & re-designing the complete architecture to improve performance. Handling, transforming & managing Big Data using Big Data Frameworks & NoSQL databases. Building complete infrastructure to ingest, transform & store data for further analysis & business requirement. Performs resource management by allocating resources to different applications and scheduling jobs using YARN. Process the data parallelly on top of Distributed Hadoop Storage i.e. HDFS using MapReduce. Apache Spark to be easily integrated with Hadoop leveraging HDFS as real-time processing framework to deduct Fraud system. Closely work with the relational databases, they need to have a strong command on SQL. PL/SQL is also prominently used in the industry used to structure, manipulate & manage data stored in databases. NoSQL technologies like Cassandra and MongoDB as the requirements of organizations to grown beyond structured data. UNIX, Linux, Solaris or MS Windows – Industry-wide various operating systems. Position will utilize the following BigData Tools: HDFS, YARN, MapReduce, PID&HIVE, Flume & Sqoop, Zookeeper, Oozie etc.

Position requires

up to 30% domestic travel.

Qualification

Requires a Bachelor's degree or foreign equivalent in Computer Science, Computer Engineering, or related field and five (5) years of experience in cloud-based applications. Also requires knowledge in BigData Tools.