Senior Software Engineer, BigQuery Multimodal Storage and Lakehouse

Responsibilities

The engineer will develop and optimize core transactional features for BigQuery, including data mutation platforms and high-performance data loaders for AI/ML frameworks. They will also lead design reviews, perform code reviews, and implement advanced table features for streaming and efficient updates.

Requirements

Candidates must have a bachelor's degree and at least 5 years of experience in C++ or Rust development. Additionally, 3 years of experience in large-scale infrastructure, distributed systems, or database internals is required.

Skills

• C++
• Rust
• Distributed systems
• Database internals
• Query processing
• Query optimization
• BigQuery
• Data warehousing
• Cloud computing
• AI/ML data pipelines
• PyTorch
• JAX
• Vector search
• GPU programming
• Data mutation
• Change Data Capture

Benefits

• Bonus
• Equity
• Health Insurance

About this role

MINIMUM QUALIFICATIONS:

* Bachelor’s degree or equivalent practical experience.
* 5 years of experience with software development in C++/Rust.
* 3 years of experience with developing large-scale infrastructure, distributed
systems or networks, or experience with compute technologies, storage or
hardware architecture.
* Experience with distributed computing, distributed databases, and distributed
systems.
* Experience in designing and developing relational databases, database
internals, query processing and query optimization.

PREFERRED QUALIFICATIONS:

* Master's degree or PhD in Computer Science or related technical field.
* Experience working with BigQuery, database, or storage systems.
* Familiarity with AI/ML data pipelines, PyTorch/JAX data loaders, vector
search, or GPU programming.

ABOUT THE JOB:

Google's software engineers develop the next-generation technologies that change
how billions of users connect, explore, and interact with information and one
another. Our products need to handle information at massive scale, and extend
well beyond web search. We're looking for engineers who bring fresh ideas from
all areas, including information retrieval, distributed computing, large-scale
system design, networking and data storage, security, artificial intelligence,
natural language processing, UI design and mobile; the list goes on and is
growing every day. As a software engineer, you will work on a specific project
critical to Google’s needs with opportunities to switch teams and projects as
you and our fast-paced business grow and evolve. We need our engineers to be
versatile, display leadership qualities and be enthusiastic to take on new
problems across the full-stack as we continue to push technology forward.

BigQuery is an exabyte scale cloud-based data warehouse. It is a multi-tenant
system storing exabytes of user data. BigQuery storage is the component
responsible for getting user data in and out of BigQuery, and how to
automatically optimize its physical shape for scale, speed, and ease of use.
Drive the Metamorphosis of BigQuery into a high-throughput transactional
platform. You will transform how users interact with and manage their data, by
implementing core transactional features, change history, fine-grained Data
Manipulation Language (DML), and Change Data Capture (CDC) upserts for both
Iceberg and native managed tables, amplified by Vortex.

In this role, you will help us build and deliver a data mutation platform for
BigQuery and have a huge impact on BigQuery, Data Analytics, and
Google Cloud Platform (GCP).
Google Cloud accelerates every organization’s ability to digitally transform its
business and industry. We deliver enterprise-grade solutions that leverage
Google’s technology, and tools that help developers build more sustainably.
Customers in more than 200 countries and territories turn to Google Cloud as
their trusted partner to enable growth and solve their most critical business
problems.Individual pay is determined by factors including job-related skills,
experience, and relevant education or training.

US: $174000 - $252000 (USD) + 15% bonus target + equity + benefits

Learn more about benefits at Google
[https://www.google.com/about/careers/applications/benefits/].

RESPONSIBILITIES:

* Write and test product or system development code.
* Participate in, or lead design reviews with peers and stakeholders to decide
amongst available technologies.
* Review code developed by other developers and provide feedback to ensure best
practices (e.g., style guidelines, checking code in, accuracy, testability,
and efficiency).
* Develop advanced data table features supporting streaming, efficient updates,
and open-source engine integration and engineer high-performance data loaders
for AI/ML frameworks to accelerate and optimize GPU training pipelines.
* Build and optimize Vortex read/write paths in BigQuery (C++/Rust), pushing
filters and projections directly onto compressed encodings.

About Google

Software Development · 10,001+ employees · headquartered in Mountain View, CA