Big Data Administrator / Custom Software Engineer (Data …, Chennai

• Design, develop, and maintain end-to-end big data pipelines for enterprise applications • Work on Apache Hadoop and Apache Spark-based data processing frameworks • Manage and optimize data pipelines, scripts, and production systems for performance and stability • Perform unit testing ofdata pipelines and support UAT (User Acceptance Testing) activities• Debug and resolve issues in existing data pipelines, scripts, and production workflows • Modify and enhance existing data processing systems based on business requirements • Review design, code, and deliverables to ensure high-quality output • Build and maintain scalable and secure bigdata solutions using cloud platforms• Ensure implementation of data governance, security, and compliance standards • Mentor junior team members and contribute to knowledge sharing initiatives • Participate in Agile development practices and cross-team collaboration • Handle Proof of Concepts (PoCs) and deliver solutions within timelines