Big Data Devops Engineer - St. Louis
Company: Technology Partners
Location: Saint Louis
Posted on: March 17, 2019
Are you looking for a new and challenging opportunity? Do you have experience with data lineage and impact analyses? Employer can help you make your next big career move a reality.Employer is currently seeking a talented person for a Big Data DevOps Engineer position.What You Will Be Doing:You will develop optimal extraction, transformation, and loading of data from a wide variety of data sources using Hadoop and GCP 'big data' technologies. You will also develop a technical and functional understanding of enterprise data specific to our environment, as well as how it is consumed/delivered, whether via web service, file system, database object, or in real-time streaming applications (Kafka). You will collaborate with subject matter experts, users, and other team members to define and execute cross-functional data movements for all aspects of our business. You will also create data tools for analytics and data scientist team members that assist them in building and optimizing data models and queries. You will adopt a data transformation code to accommodate changes in source data and new business requirements. You will develop and deploy code with reliable error/exception handling and rollback framework. You will also ensure data quality throughout the entire process. You will implement, refine and evangelize DevOps practices using GIT, Jenkins, Artifactory, and Spinnaker. You will also perform unit testing, system integration testing, and assist with user acceptance testing. You will be proactive in clarifying requirements when needed in order to ensure accurate results.What We Are Looking For:Bachelor's Degree in computer science or equivalent experience required5 years experience in managing data lineage and performing impact analyses5 years hands on SQL and relational database experience required3 years hands on experience with Spark and Python3 years hands on experience using big data in cloud environment (GCP preferred)Experience setting clear standards for design, documentation, testing, and code qualityProficient understanding of distributed computing principlesGood knowledge of Big Data querying tools, such as BigQuery, and HiveExperience with various messaging systems, such as Kafka and PubSubAbility to conduct code reviews and provide constructive feedback to peer team membersExcellent Communication SkillsIf this position sounds like you, WE SHOULD TALK! We realize our people are our most valuable asset, that is why we offer the following benefits:Health, Dental, and Vision insurance401(k) retirement planLong and Short-Term disabilityLife insuranceDirect depositReferral programYour better future is ready, and we want to put the right tools in your hands to get you there. Let's go!Looking for more opportunities with Employer?Check out jobs.technologypartners.net.Employer is an Equal Opportunity Employer. Employer does not discriminate on the basis of race, color, religion, sex, national origin, age, disability or any other characteristic protected by applicable state or federal civil rights laws.
Keywords: Technology Partners, St. Louis , Big Data Devops Engineer - St. Louis, Engineering , Saint Louis, Missouri
Didn't find what you're looking for? Search again!