ABOUT US: At Nexus Cognitive, we are at the forefront of technological innovation, driving transformative solutions in the world of data and analytics. Our mission is to enable your business to harness the power of big data, transforming complex data sets into actionable insights that disrupt industries and deliver a competitive advantage for our clients. We are a trusted advisor that handles the heavy lifting of big data management and governance, so our clients can focus on making informed, strategic decisions that drive growth and innovation. Nexus Cognitive firmly grasps the transformative power of data and artificial intelligence. We have a spirited team of employees across the globe dedicated to redefining the boundaries of technology and cognitive solutions.
THE OPPORTUNITY: As we continue our journey, we are building a team of sharp, intelligent innovators who can move fast with great agility and passion. We are currently searching for a Hands-on Senior Manager Data Platform Engineer Lead to join our India team in Pune for high-performing product and fulfillment center of excellence. You will contribute to implementing new product features and rapidly on-boarding new enterprise customers. The ideal candidate will be a proactive problem solver with strong technical skills and meticulous attention to detail. This person will be intellectually curious with relentless desire to learn the latest modern data architecture platforms and patterns.
WHAT YOU’LL DO:
- Lead the Platform Engineering team to design, enhance, and automate the infrastructure and services that operate NX1
- Work closely with NX1 Product team to define product roadmap, plan/test/execute new releases, and identify new features/capabilities
- Enthusiastic mentor, guiding NX1 Support and Test Engineering teams for on-premises and cloud-based technologies using open-source Linux-based data technologies.
- Configure/Customize Datadog and develop new integrations to monitoring, alerting, and performance profiling
- Implement new tools, test and automate patches, and upgrade existing Data products. Recommend best practices to ensure minimal downtime while adhering to Nexus Cyber Security.
- Evaluate new products, setup policies and optimize complex distributed production deployments, identify bottlenecks and recommend performance enhancements.
- Develop and maintain technical documentation, including administration, plan rollout of new capability and knowledge base articles, to support operational excellence and knowledge sharing.
- Work in an agile team and Participate in an on-call rotation, providing expert-level support and troubleshooting for critical issues.
- Passionate about open-source and emerging technologies and industry trends.
WHO YOU ARE:
- In-depth understanding of managing both on-premises and cloud Modern Data architectures, ensuring seamless integration and efficient data flow.
- Minimum of 5 years of experience managing and leading platform engineering teams.
- Minimum 8 years hands-on experience with open-source Linux-based data technologies, including Datadog, Impala, Iceberg, Spark, Airflow, Nifi, Jupyter Notebooks, Cloudera, Databricks, Kubeflow, MLFlow, Kafka and Build/Manage Kubernetes containers
- Proven ability to build and support solutions across major cloud platforms (AWS, Azure, GCP), leveraging cloud-native tools and open source for optimal performance.
- Experience integrating Azure Active Directory with FreeIPA and other directory services such as LDAP, enhancing security and user management.
- Up-to-date knowledge Cloudera Data Platform (Public or Private Cloud), with a proven track record of managing large-scale deployments.
- Excellent verbal and written communication to articulate ideas and provide clear instructions.
- Proven experience implementing and maintaining Data Federation, ETL, and Modern Data Lakehouse architectures. This includes capacity planning, identifying bottlenecks, and optimizing memory utilization, CPU usage, OS performance, storage, and network configurations.
- Strong analytical and problem-solving abilities, capable of efficiently diagnosing and resolving complex technical issues.
- Demonstrated ability to mentor staff on the latest industry trends and technologies
WHY NEXUS COGNITIVE: At Nexus Cognitive, you’ll be stepping into a youthful, and vibrant work culture. Our work environment thrives on teamwork, creativity, and the shared ambition to redefine what’s possible. Our team is our greatest asset, and we are deeply committed to fostering a collaborative, supportive and dynamic atmosphere where every voice is valued, and every team member can flourish. We understand that our success hinges not just on the quality of our work but also on the well-being of our team members.