StLouisRecruiter Since 2001
the smart solution for St. Louis jobs

Remote - Big Data processing Engineer - Spark or Flink

Company: Intelliswift Software, Inc.
Location: Saint Louis
Posted on: November 22, 2021

Job Description:

Required Skills: Java/Scala/Python, AWS, Hadoop, Spark/Flink, Stream Processing (Spark or Flink)
Duration: 12 months
Location: Seattle, WA / Remote

Title : SW ( big data processing )
Location : Seattle/Remote, WA, United States
Description :
You will be responsible for the stream processing platform used for analytics and machine learning of worldwide Siri and Search events. We process a triple digit billion events per day. To run our environment efficiently, we drive for proper monitoring, alerting and automation. The team's goal is to ensure the reliability and performance at the highest level.

Manage one of the largest infrastructure supporting hundreds of millions of Siri and customers
Diagnose, fix, improve, and automate complex issues across the entire stack to ensure maximum uptime and performance
Take part in designing and building out our next generation realtime data processing infrastructure and push our services to the next level
Harden and launch new data models and data pipelines in production
Establish SLA's for all data sets and applications running in production
Advise other teams (within and outside of Siri) on proper integration of our platform
Build relationships with Data Scientists, Product Managers and Software Engineers to understand data needs
Manage the infrastructure which powers ETL, Analytics, and Privacy Efforts within AIML
Skills
.
Passionate about Data Processing Technologies
Extensive programming experience in Java, Python or Go
Extensive experience using data processing frameworks such as Apache Flink or Apache Spark Streaming
Experience configuring and troubleshooting data processing frameworks (e.g. Flink, Spark Streaming, Samza, Kafka Streams or Storm)
Experience with alerting, monitoring and remediation automation in a large scale distributed environment
Experience setting up and managing public cloud infrastructure on AWS (EKS, S3, IAM, etc)
Education
.
BS, MS, or PhD degree in Computer Science or equivalent and 5+ years experience in data technologies

Keywords: Intelliswift Software, Inc., St. Louis , Remote - Big Data processing Engineer - Spark or Flink, Engineering , Saint Louis, Missouri

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category
within


Log In or Create An Account

Get the latest Missouri jobs by following @recnetMO on Twitter!

St. Louis RSS job feeds