Loading...
Share this Job
Apply now »

Senior Data Engineer

1585

We are Farmers!

Job Summary

We are seeking a highly skilled and energetic Senior Data Engineer to build enterprise cloud data lakes and build enterprise, reusable data sources for Machine Learning and Artificial Intelligence (ML/AI) development on AWS Infrastructure.  The selected candidate will initially focus on application builds, building out CI/CD practices, including those that provision data end points to data scientists for data model development while working across leadership, data engineering, architecture, security, and the broader data scientist community. 

 

Exceptional Cloud Software Technical Lead

 

  • Leads independently, working across Cloud Infrastructure, Architecture, Security, Monitoring, etc. teams to build data capabilities for data scientists to use in model development.
  • Designs and builds data lakes in AWS to ingest, process, store and visualize data for analytics. 
  • Design and build cleansed data sources for data scientists to include their data models.
  • Work across IT and  AI/MI partners to solve complex problems and create unique solutions.
  • Support translation of business requirements to architecture designs.
  • Create documentation and best practices to share with the data science community.
  • Responsible for ensuring compliance with SDLC, Application Development, EA, CCRM, DBA, Data, and Security standards and procedures.
  • Designs, codes, tests, debugs, and maintains complex solutions.
  • Applies/implements DevOps, MLOps and Agile best practices.

Essential Job Functions

 

Proactive, Timely, Concise and Audience Appropriate Communication

 

  • Creative and resourceful when it comes to problem-solving.
  • A passionate can-do attitude. You are not afraid to try, learn, and improve.
  • Ability to work with internal stakeholders to collect feedback, prioritize tasks, and manage the engineering backlog.
  • Self-motivated, self-directed, and the ability to thrive in a fast-paced environment in an industry that constantly changes.
  • Communicates information in line with the target audience experience, background, and expectations; uses terms, examples, and analogies that are meaningful to the audience.

 

Physical Actions

Physical Environment

Education Requirements

  • High school diploma or equivalent required.
  • Bachelor’s degree preferred or equivalent, relevant experience.
  • Computer Science or Engineering background - Master's degree in Computer Science or related technical field, preferred. 

Experience Requirements

  • At least 4 years of total IT experience including demonstrated success as a lead software developer working in cloud platforms for at least 4 years.
  • Solid understanding of effective AWS cloud computing principles.
  • Experience designing, developing and maintaining standardized and sanitized data sources.
  • Broad, strong technical knowledge which encompasses application operations including deployment, automation, platform architecture, database, network, load-balancing / clustering and security.

Special Skill Requirement

  • Must have experience working with:
    • Tools in Hadoop echo system (PySpark, HDFS, Hive, Parquet Sqoop), Python, BotoS3, R or Java.
    • Snowflake or any other SQL database, Unix shell scripting.
    • Tools in AWS ecosystem such as S3, Athena, Glue, Step Functions, CloudFormation, CloudTrail, Lambda (experience with similar tools on Azure Cloud platform will also be considered).
    • Containerization, Docker and Kubernetes.
    • ML pipeline support.
  • AWS Cloud certifications.
  • Good exposure to Agile software development and DevOps practices such as Infrastructure as Code (IaC), Continuous Integration and automated deployment.
  • Continuous Integration (CI) tools (e.g. Jenkins).
  • Strong practical application development experience on Linux and Windows-based systems.
  • Experience working directly with customers, partners and third-party developers.
  • Experience in insurance or financial services industry.
  • Experience supporting Customer Journey Analytics.
  • Exposure to data science and AI tools such as Sagemaker and Algorithmia.

Job Location(s): US - RW - Remote Work - Farmers

 

Want to learn more about our culture & opportunities? Check out farmers.com/careers and be sure to follow us on Instagram and LinkedIn!

 

 

 

Farmers offers a competitive salary to commensurate with experience, qualifications and location.

Colorado Only: The pay range for this job being performed in Colorado would be $90,800 - $121,000

Bonus Opportunity (based on Company and Individual Performance)

401(k)

Medical

Dental

Vision

Health Savings and Flexible Spending Accounts

Life Insurance

Paid Time Off

Paid Parental Leave

Tuition Assistance

For more information, review “What we offer” on https://www.farmers.com/careers/

Apply now »