Senior Engineer (Spark)
Job Type
Full-time
Description

eSimplicity is modern digital services company that delivers innovative federal and commercial IT solutions designed to improve the health and lives of millions of Americans while defending our national interests. Our solutions and services improve healthcare for 100+ million Americans, protect our borders, and defend our country by supporting and innovating with the Air Force, Space Force, and Navy. Our team of 200+ engineers, designers and strategists relentlessly challenge the status quos, build consensus and collaborate to deliver new solutions with an unwavering focus on the user experience from start to finish. 


Position Objective: 

You will work collaboratively with Product Managers, Designers, and Engineers to set up, develop, and maintain critical back-end integrations for the data and analytics platform that allows users to, access data catalogs, request compute resources, and manage data access controls for an enterprise data and analytics platform 


Responsibilities: 

  • Building, iterating, and testing scalable, resilient back-end capabilities for a cloud-based developer platform that supports data analytics capabilities at scale 
  • Support the self-service provisioning capabilities of a large, bring-your-own-data platform that provides high-end data analytics capabilities to a wide variety of technical users (developers, analysts) 
  • Participating in Agile processes including daily standups, demos, retrospectives, and sprint planning  
  • Working closely with leadership to gather and implement business requirements   
  • Working closely with designers and engineers to gather and implement product, front-end, and back-end requirements  
  • Providing support, maintenance, and enhancements to the existing application   
  • Provide Subject Matter expertise to the user community in best-practices for configuring clusters, designing jobs and controlling costs of data pipelines 
  • Guide customer in pricing feature sets based on the user community’s usage patterns and data processing requirements 
  • Collaborating with product managers, engineers, and QA on the team to communicate and clarify designs and requirements 
Requirements

Education and Experience: 

  • Bachelor's Degree or equivalent in experience in Engineering, Computer Science, or related field  
  • 7+ years of experience in software application development, particularly in an agile development environment including but not limited to daily scrum, iteration reviews, Kanban/Lean, continuous integration and test-driven development  
  • 3+ years of experience in AWS cloud data architecture 

Qualifications: 

  • 7+ years of software engineering experience  
  • 5+ years of experience with Spark processing large datasets and optimizing data pipelines 
  • Experience with Node.js, Rust, and Python  
  • Experience optimizing cloud costs 
  • Deep understanding of APIs, and familiarity with JSON, Web APIs, REST APIs, JSON-RPC, XML-RPC, RESTful practices, and GraphQL  
  • Experience with Docker containerization and deployments  
  • Experience in relational and non-relational databases like SQL, MySQL, NoSQL, PostgreSQL, MongoDB or similar  
  • Experience with benchmarking, monitoring, and performance engineering applications with tools such as Grafana, Sentry, New Relic and Prometheus  
  • Knowledge of AuthN and AuthZ systems, including Active Directory, Okta, and AWS IAM Policies/Roles using attribute-based access controls  
  • Knowledge of automated end-to-end and unit tests and testing platforms  
  • Experience with Git and DevOps    
  • Experience with Kubernetes 
  • Some experience with DevOps tools Terraform desired  
  • Experience with implementing Observability solutions with platforms such a NewRelic/Dynatrace to implement JVM metrics tracking and python application tracking for microservice applications 
  • Experience implementing complex pipelines and solving challenging problems in Github Actions Pipelines, Github Runner provisioning, execution, configuration and upgrade 
  • Experience with implementing, managing and streamlining a release process with focus on code quality and code coverage 
  • Strong verbal and nonverbal communication skills 
  • Strong documentation and problem-solving skills   

Preferred Qualifications: 

  • Databricks Experience preferred 
  • Team leadership or product owner experience a plus 

eSimplicity supports a remote work environment operating within the Eastern time zone so we can work with and respond to our government clients. Expected hours are 9:00 AM to 5:00 PM Eastern unless otherwise directed by your manager. 


Benefits: 

We offer a highly competitive salary, full healthcare benefits, performance bonus, and a flexible leave policy. 


Equal Employment Opportunity: 

eSimplicity is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, religion, color, national origin, gender, age, status as a protected veteran, sexual orientation, gender identity, or status as a qualified individual with a disability.