Senior Data Engineer (Bellandur)

Position: Senior Data Engineer Location: Bangalore (Hybrid) Experience: 4 – 7 years Employment Type: Full-time Notice Period: Not more than 30 Days Role Overview We are looking for an experienced AI Data Engineer to design, build and manage scalable data pipelines and AI-ready data platforms. The ideal candidate will work closely with data scientists, AI engineers, product teams and business stakeholders to ensure clean, reliable, secure and well-structured data is available for AI, machine learning, analytics and agentic AI applications. This role requires strong expertise in data engineering, cloud platforms, ETL/ELT pipelines, data modeling and modern AI data workflows including vector databases, embeddings, RAG pipelines and real-time data processing. Key Responsibilities Design, develop, and maintain scalable data pipelines for structured, semi-structured and unstructured data. Build AI-ready data infrastructure to support machine learning models, LLM applications, RAG systems and agentic AI workflows. Work with large datasets from multiple sources including databases, APIs, logs, documents, cloud storage and enterprise applications. Develop and optimize ETL/ELT workflows using tools such as Apache Spark, Airflow, dbt, Kafka, AWS Glue, Azure Data Factory or similar platforms. Implement data ingestion, transformation, validation and quality checks to ensure high data accuracy and reliability. Design and manage data lakes, data warehouses, lakehouses and feature stores. Support AI/ML teams by preparing high-quality datasets for model training, fine-tuning, evaluation and inference. Build and maintain vector databases and embedding pipelines for semantic search and Retrieval-Augmented Generation applications. Integrate enterprise data sources with AI systems, chatbots, analytics platforms and automation agents. Implement secure data access, governance, lineage, monitoring and compliance best practices. Optimize pipeline performance, cost, scalability and reliability across cloud and on-premise environments. Collaborate with cross-functional teams to translate business requirements into data architecture and engineering solutions. Required Skills Solid experience in Python, SQL and data engineering frameworks. Hands-on experience with ETL/ELT pipeline development and workflow orchestration. Experience with cloud platforms such as AWS, Azure or Google Cloud. Knowledge of data lake, data warehouse, and lakehouse architectures. Experience with tools such as Apache Spark, Kafka, Airflow, dbt, Snowflake, Databricks, BigQuery, Redshift, Synapse or similar technologies. Understanding of AI/ML data preparation, feature engineering, model lifecycle and production data requirements. Experience working with APIs, JSON, Parquet, Avro, CSV, relational databases, NoSQL databases and cloud storage. Familiarity with vector databases such as Pinecone, Weaviate, Milvus, ChromaDB, FAISS or similar tools. Knowledge of embeddings, semantic search, RAG pipelines and LLM-based application data flows. Strong debugging, performance tuning and problem-solving skills. Good understanding of data security, access control, encryption, privacy and governance. Preferred Skills Experience building data pipelines for Generative AI, LLM or agentic AI applications. Knowledge of MLOps, LLMOps, model monitoring and production AI deployment workflows. Experience with Kubernetes, Docker, CI/CD and Infrastructure as Code. Familiarity with data cataloging, lineage, metadata management and observability tools. Experience with real-time streaming data pipelines. Exposure to enterprise systems such as SAP, Salesforce, ERP, CRM or healthcare/financial data platforms. Knowledge of compliance frameworks such as GDPR, HIPAA, SOC 2, DPDP or industry-specific standards. Qualifications Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Technology, Engineering, Statistics or a related field. 4+ years of experience in data engineering, data platform development or AI/ML data infrastructure. Strong communication skills and ability to work with technical and business teams. Ideal Candidate Profile The ideal candidate is a hands-on engineer who can convert raw enterprise data into trusted, AI-ready intelligence. They should understand both traditional data engineering and modern AI data requirements, including embeddings, vector search, RAG and scalable data pipelines for intelligent applications. Interested candidates may apply by sharing their CV at with the subject line "Application for the position of Senior Data Engineer". Pay: ₹1,800,000.00
- ₹2,400,000.00 per year Application Question(s)
- Do you have experience Developing and Deploying Multi-Agent Workflows? Work Location: Hybrid remote in Bellandur, Bengaluru, Karnataka Apply on Kit Job: kitjob.in/job/4m4ckg