Big-data (Scala, Hadoop, Spark - Streaming and Machine Learning, Kafka, ElasticSearch, Logstat, Kibana, Cassandra, Hive, HBase,Pig,Tableau,Sqoop)
And
Java professional, Shell/Perl/Python with MySQL/Oracle/Db2/Mongo/Postgres/Vertica
Have good knowledge in analysis, programming, technical
methodologies and Team performance.
Hands on experience in Hadoop ecosystems like Hive, HBase, Sqoop,
Spark, Storm, MapReduce, Pig in Hortonworks Distribution.
Having good experience in working with Agile Methodology.
Ability to learn and comprehend and implement new technologies.
Good interpersonal and communication skills.
Role & Responsibility
Upgraded the Storm cluster from 0.9.3 to 1.0.3
Load data from s3 into Hive, Hbase using spark
Load and transform large sets of structured, semi structured data and
unstructured data
Import the data from mysql/SQL SERVER to Hive,HBase table
web scraping data analysis
HIVE with PHP integration