Big Data Developers LT Contract
SUMMARY
We are seeking a Bid Data Developer to design, develop, and implement web-based Java applications to support business requirements and develop data platforms and associated tools in a cloud infrastructure.
This is a SME level who can design, code and provide Big Data Warehouse solutions across multiple environments. This platform and tools will be used across the organization and are critical to the deployment and release of new products, features and devices.
RESPONSIBILITIES
• Development of end-to-end Big Data analytics platform, web applications and services
• Design, code and provide data flow and ingestion processes
• Solve for complex data integrations across multiple systems
• Design and execute strategies for real-time data analysis and decisioning
• Deal with large quantity of metrics, and batch and real time data that needs to be processed
• Monitoring and Administration of cloud-based infrastructure and services
• Solve for complex data integrations across multiple systems
REQUIREMENTS
• 5+ years’ experience in application development using Big Data based technologies
• Mastery level of Apache Spark, Scala and SQL
• Expertise in AWS deploying, managing and performance tuning Spark applications in AWS EMR
• Knowledge of Databricks/Notebooks (Jupyter/Zeppelin), S3, Athena/Presto, Kafka/Kinesis
• Familiarity with Visualization Tools: Looker/Tableau/Quicksight/Qlik/etc.
• Expertise in SQL based databases like MySQL, SQL, and Oracle etc.
Desired Skills
• Experience with Open stack and/or Amazon Cloud services