• Share this Job

Sr Spark Developer

Location : Phila
Job Type : Temp/Contract
Reference Code : 27770
Hours : Full Time
Required Years of Experience : 3+
Required Education : BS
Travel : No
Relocation : No

Job Description :

SUMMARY


Utilize your programming skills in large, fast-paced development environment working in multiple cloud applications. Your primary responsibility will be to design, develop and monitor applications, and coordinate with the team working on different layers of the infrastructure to move and migrate data between cloud platforms. Serve as Spark SME for application team. Insure integrity and QA between networks. Develop, collect and monitor performance metrics for processing performance. Commitment to collaborative problem solving and product quality is essential.


RESPONSIBILITIES


· Hands-on knowledge of Big Data querying tools, such as SQL, Pig, Python, etc.


· Identify bottlenecks and bugs, and devise solutions to these problems


· Build real time data pipelines and streaming apps


· Integrate applications by designing database architecture and server scripting


· Define site objectives, analyze user requirements; establish system features and functionality


· Designs and develops user interfaces to internet/intranet applications


· Establish connectivity with and between network systems and information servers


· Troubleshoot development and production problems across multiple environments and operating platforms


Required Qualifications :

REQUIREMENTS


·        Experience with Business Intelligence principles and processes in a Big Data environment


·        Extensive hands-on experience in Spark application


·        5+ years’ combined programming experience in Java and Scala


·        2+ years’ experience with Spark / Spark Streaming / Spark SQL


·        Extensive expertise in data management using SQL and data management/QC tools


·        Functional and object oriented programming experience using Python or Scala


·        Proficiency in code versioning tools, such as GIT


·        AWS and/or Hadoop Experience


·        Experience with both external and embedded databases and database schemas


·        Maven/Scala/SBT Experience (Preferred)


·        Working Knowledge Kafka/ Docker / Kubernetes (Preferred)


·        Strong analytical and problem solving skills and ability to troubleshoot issues


Powered by AkkenCloud