Senior Engineer, Big Data - Payment Integrity/Databricks - Remote

About this role

Job Summary 
Responsible for all the aspects of architecture, design and implementation of Data Management solution using Big Data platform on Cloudera or Hortonworks and other areas of enterprise application platforms.

Reporting and analytics are very important for this position.  Payment integrity is also important.  Please update your resume with any relevant previous experience.  

  Knowledge/Skills/Abilities 
• Convert concepts to technical architecture, design and implementation 
• Provide guidance on choosing ideal Architecture, Evaluating tools and Frameworks, define Standards & Best Practices for implementing scalable business solutions 
• Implement Batch and Real-time data ingestion/extraction processes through ETL, Streaming, API, etc., between diverse source and target systems with structured and unstructured datasets 
• Design and build data solutions with an emphasis on performance, scalability, and high-reliability 
• Code, test, and document new or modified data systems to create robust and scalable applications for data analytics 
• Build data model for analytics and application layers 
• Contribute to leading and building a team of top-performing data technology professionals 
• Help with project planning and scheduling 
• Expert level experience on Hadoop cluster components and services (like HDFS, YARN, ZOOKEEPER, AMBARI/CLOUDERA MANAGER, SENTRY/RANGER, KERBEROS, etc.) 
• Ability to participate and lead, in solving technical issues while engaged with infrastructure and vendor support teams. 
  Job Qualifications

Required Education
Bachelor's Degree
Required Experience
• 5-7 years of data management experience.
• Experience in building stream-processing systems, using solutions such as Kafka, Storm or Spark-Streaming.
• Proven experience on Big Data tools such as, Spark, Hive, Impala, Polybase, Phoenix, Presto, Kylin, etc.
• Experience with integration of data from multiple data sources (u...