Big Data Software Engineer - Manufacturing Systems&Infrastru …, Bengaluru

Job description As a BigData Engineer, you will lead the development and implementation of our cloud-based data infrastructure. You will work closely with cross-functional teams to understand data requirements, design scalable solutions, and ensure the integrity and availability of our data. The ideal candidate will have a deep understanding of cloud technologies, data engineering best practices, and a proven track record of successfully delivering complex data projects.- Lead the design and implementation of cloud-based data architectures.- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements.- Implement data security and privacy best practices.- Optimize data storage, retrieval, and processing for performance and cost efficiency.- Lead efforts to ensure data quality, consistency, and accuracy.- Mentor and provide technical guidance to junior data engineers.- Stay current with industry trends and emerging technologies in cloud data engineering.Minimum Qualifications Bachelor s or Masters degree in Computer Science or a related field Proven experience as a Big Data developer, with a focus on cloud platforms Strong proficiency in cloud services such as AWS, Azure, or Google Cloud Expertise in data modelling and data integration Experience with big data technologies (Hadoop, Spark, etc.)Proficient in programming languages such as Python, Java, Scala, GoLang Knowledge of data warehouse solutions (Redshift, BigQuery, Snowflake, Druid) Experience with streaming data technologies (Kafka, Kinesis) Preferred Qualifications Certification in cloud platforms (AWS Certified Big Data - Specialty, Microsoft Certified: Azure Data Engineer, etc.)Experience building data streaming solutions using Apache Spark, Storm, Link, Flume Experience using ETL tools and technologies like Reltio, Stibo, Informatics, Apache Atlas Knowledge of machine learning and data science concepts Contributions to the open source community Familiarity with data governance and complianceStrong problem-solving and analytical skills Excellent communication and leadership skills