Data Engineer (2-3 YEARS)- 5 POSITIONS
R
Rightpath Computer Technologies Pvt Ltd
📍 Hyderabad, Andhra Pradesh, India
Job Description
Role: Data Engineer (2-3 YEARS)- 5 POSITIONS
Responsibilities: Data Engineer will work on collecting, storing, processing, and analyzing huge sets of data The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. You will also be responsible for integrating them with the architecture used across the company in various products.
Key Skills:
1. Proficient understanding of distributed computing principles
2. Ability to build, run and manage large clusters
3. Hadoop v2, MapReduce, HDFS
4. Java, Python
5. Large Scale crawling : Scrapy, Nutch and custom crawling solutions
6. Experience with Apache Solr Lucene
7. NoSQL databases, such as MongoDB, HBase, Cassandra
8. Knowledge of various ETL techniques and frameworks, such as Flume