India

Senior Data Engineer Bangalore Urban

Senior Data Engineer Bangalore Urban
Description
Senior Data Engineer

Role : Senior Data Engineer Location: Bangalore

Years of experience : 7+ Years

Shift : General Shift (3 days WFO)

Responsibilities : Design and implement GCP-native data pipelines using services such as

BigQuery, Dataflow, and Pub/Sub. Leverage Cloud Composer for orchestration and automate workflows across GCP services.


• Understanding of the data architecture
- from data ingestion at the source, through transformation and storage, to final consumption by analytics, reporting, or machine learning systems.


• Design and implement data pipelines and ETL/ELT pipelines to move and transform data from various sources (APIs, databases, logs, IoT, files)


• Ensure ETL processes are effective, scalable, and optimized for performance


• Implement measures to ensure accuracy, integrity, and consistency of data throughout the ETL process


• Design and optimize data models for structured and unstructured data


• Implement and manage scalable cloud data lakes and warehouses


• Collaborate with cross-functional teams to understand data requirements and deliver solutions


• Troubleshoot and resolve performance and reliability issues across the data platform


• Involved in automating workflows using CI/CD (e.g., GitHub Actions, Jenkins)

Mandatory Skills:

Extensive experience with Google Cloud Platform (GCP) /Azure/AWS including BigQuery, Dataflow, Pub/Sub, Cloud Composer, Vertex AI, Cloud Storage, Cloud Functions. Ability to design and implement GCP-native data engineering solutions.


• 7+ years for Data Modeling and ETL Development Experience


• Experience with cloud data warehouse such as BigQuery


• Robust SQL skills experience and experience with one or more programming languages (Python, Java, Scala)


• Experience with big data technologies (Hadoop, Spark, Kafka)


• Hands-on knowledge of GCP cloud platform


• Experience with CI/CD pipelines and DevOps practices


• Familiarity with data modeling, warehousing, and governance principles Preferred Skills: Hands-on experience with GCP-native tools and services for data engineering and orchestration.


• Certifications in GCP or cloud data engineering


• Familiarity with tools like Looker and dbt Apply on Kit Job: kitjob.in/job/4m90qa
Highlights
Safety Tips
Be careful with multilevel marketing programs, and their income projections.
1 / 10
More info about this ad

Senior Data Engineer Bangalore Urban has been posted in the Vasanth Nagar Information Technology category on Locanto.

In this category, there are no other ads right now posted in Vasanth Nagar.

Interested in more? Widen your search to view ads in nearby areas of Vasanth Nagar. This includes Information Technology in Mahatma Gandhi Rd, Bangalore and Cox Town. There are more ads within a 15 km radius for this category. If you want to view those ads, click here.