mozilla/bigquery-etl

View on GitHub

Bigquery ETL

Stars: 338
Forks: 155
Open beginner issues: 2
Indexed issues: 126
Avg merge: 1d 15h
Merged PRs (30d): 68

Dominant language: Python
License: MPL-2.0
Last GitHub push: Sep 18, 2026
Latest indexed: Sep 19, 2026
Contributing guide: Contributing guide
Code of conduct: Code of conduct
Beginner labels: No beginner labels indexed

Beginner friendly Everything

Open All

126 open issues indexed

Rolling cohorts undercounts new profiles that don't send `main` ping on their first day Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

mozilla/bigquery-etl#9732 · Opened Jul 27, 2026
Stage deploys don't support pseudo column in ingestion-time partitioned tables Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

mozilla/bigquery-etl#9704 · Opened Jul 17, 2026
Don't default bqetl writes to moz-fx-data-shared-prod; require explicit project Open

Difficulty 4/5 3-5 days Newbie friendliness 52/100

mozilla/bigquery-etl#9605 · Opened Jun 18, 2026
Resolved Date in UTC Open

Difficulty 2/5 1-3 hours Newbie friendliness 75/100

mozilla/bigquery-etl#9587 · Opened Jun 16, 2026
Fix Bigeye config validation Open

Difficulty 2/5 1-3 hours Newbie friendliness 68/100

mozilla/bigquery-etl#9188 · Opened Apr 9, 2026
Deploy materialized views as part of `./bqetl deploy` Open

Difficulty 4/5 3-5 days Newbie friendliness 52/100

mozilla/bigquery-etl#9126 · Opened Mar 31, 2026
Stage deploys: deploy and dryrun immediate downstream dependencies Open

Difficulty 5/5 Over a week Newbie friendliness 30/100

mozilla/bigquery-etl#8884 · Opened Feb 19, 2026
Bug in `file_exists_for_dependency` stage deploy logic Open

Difficulty 3/5 1-2 days Newbie friendliness 38/100

mozilla/bigquery-etl#8545 · Opened Dec 3, 2025
Stage deploy failing when view references connected sheet Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

mozilla/bigquery-etl#8495 · Opened Nov 24, 2025
Bigeye metadata flip flopping in generate-sql Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

mozilla/bigquery-etl#8402 · Opened Nov 6, 2025
Delete removed tables from public facing datasets Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

mozilla/bigquery-etl#8111 · Opened Sep 17, 2025
Explicitly enumerate columns in clients_daily derived tables Open

Difficulty 4/5 3-5 days Newbie friendliness 30/100

mozilla/bigquery-etl#7955 · Opened Aug 14, 2025
Tooling to estimate cost of backfills Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

mozilla/bigquery-etl#7913 · Opened Aug 5, 2025
Improve copy-deduplicate efficiency and speed Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

mozilla/bigquery-etl#7912 · Opened Aug 5, 2025
Split up glean_usage Airflow DAG Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

mozilla/bigquery-etl#7911 · Opened Aug 5, 2025
Support backfilling non-daily ETLs Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

mozilla/bigquery-etl#7908 · 1 comment · Opened Aug 5, 2025
Improve local development and testing experience of bigquery-etl Open

Difficulty 5/5 Over a week Newbie friendliness 30/100

mozilla/bigquery-etl#7907 · Opened Aug 5, 2025
Additional CI Checks for private-bigquery-etl / bigquery-etl Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

mozilla/bigquery-etl#7901 · Opened Aug 1, 2025
CI check for mozilla-confidential datasets in private-bigquery-etl Open

Difficulty 3/5 1-2 days Newbie friendliness 48/100

mozilla/bigquery-etl#7899 · 4 comments · Opened Aug 1, 2025
MozFun.Glean alias for MozFun.GLAM Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

mozilla/bigquery-etl#7894 · Opened Jul 31, 2025
Adding references to the Glean book to MozFun Open

Difficulty 3/5 1-2 days Newbie friendliness 45/100

mozilla/bigquery-etl#7893 · Opened Jul 31, 2025
Test for making sure Bigeye is working as expected Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

mozilla/bigquery-etl#7608 · Opened Jun 10, 2025
Support or check for bqetl airflow sensors with different cadences Open

Difficulty 4/5 3-5 days Newbie friendliness 42/100

mozilla/bigquery-etl#7587 · 5 comments · Opened Jun 5, 2025
CI checks to validate suffixes and with `user_facing` setting Open

Difficulty 3/5 1-2 days Newbie friendliness 48/100

mozilla/bigquery-etl#7495 · 1 comment · Opened May 22, 2025
Some ETLs and views may be silently unioning data incorrectly Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

mozilla/bigquery-etl#7461 · 4 comments · Opened May 16, 2025
Metadata validation running on files in stage environment causing failures Open

mozilla/bigquery-etl#7412 · 1 assignee · Opened May 8, 2025
bigquery-etl docs about incremental queries are outdated Open

docs

Difficulty 2/5 1-3 hours Newbie friendliness 30/100

mozilla/bigquery-etl#7366 · Opened Apr 29, 2025
Spikes in the duration of bqetl_merino_newtab_extract_to_gcs Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

mozilla/bigquery-etl#6202 · Opened Sep 13, 2024
materialized views don't get updated after deploy Open

Difficulty 4/5 3-5 days Newbie friendliness 38/100

mozilla/bigquery-etl#5804 · 4 comments · Opened Jun 18, 2024
Python 3.12 bootstrap - ModuleNotFoundError: No module named 'distutils' Open

Difficulty 4/5 3-5 days Newbie friendliness 30/100

mozilla/bigquery-etl#5711 · 2 comments · Opened Jun 3, 2024
Issue with first_seen_date field in fenix.new_profile_activation Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

mozilla/bigquery-etl#5192 · 1 comment · Opened Mar 10, 2024
Better checks to ensure test data files exist for tables referenced in SQL integration tests Open

Difficulty 3/5 1-2 days Newbie friendliness 45/100

mozilla/bigquery-etl#5184 · 1 comment · Opened Mar 7, 2024
Prompt GCP authentication flow Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

mozilla/bigquery-etl#5174 · 1 comment · Opened Mar 6, 2024
Remove the dryrun function and use service accounts instead Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

mozilla/bigquery-etl#5169 · Opened Mar 5, 2024
Views incorrectly removed in CI Open

Difficulty 4/5 3-5 days Newbie friendliness 38/100

mozilla/bigquery-etl#5111 · Opened Feb 26, 2024
Reduce noise in PR diffs Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

mozilla/bigquery-etl#4974 · 2 comments · Opened Feb 6, 2024
bqetl tooling check for updates automatically Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

mozilla/bigquery-etl#4973 · Opened Feb 6, 2024
Separate SQL tests and bigquery-etl tooling tests Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

mozilla/bigquery-etl#4918 · Opened Jan 30, 2024
Replace use of `gke_command` with `GKEPodOperator` in DAG jinja templates Open

mozilla/bigquery-etl#4895 · 1 assignee · Opened Jan 26, 2024
Bug in generated DAGs using depends_on with tasks that have the same name Open

bug dag_generation

Difficulty 4/5 3-5 days Newbie friendliness 35/100

mozilla/bigquery-etl#4814 · Opened Jan 11, 2024
Support rebuilding a rolling window of multiple table partitions via Airflow Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

mozilla/bigquery-etl#4783 · 1 comment · Opened Jan 5, 2024
Make sure generated references metadata isn't overriden by static metadata Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

mozilla/bigquery-etl#4618 · Opened Nov 28, 2023
Consider creating test to validate that each dataset has a `dataset_metadata.yaml` Open

Difficulty 3/5 1-2 days Newbie friendliness 38/100

mozilla/bigquery-etl#4601 · Opened Nov 23, 2023
`bqetl stage deploy` uses ever-increasing memory Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

mozilla/bigquery-etl#4340 · 4 comments · Opened Sep 22, 2023
Write generated artifacts to a separate directory Open

Difficulty 5/5 Over a week Newbie friendliness 28/100

mozilla/bigquery-etl#4068 · Opened Jul 12, 2023
Use data-aware scheduling for generated Airflow DAGs Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

mozilla/bigquery-etl#3987 · 3 comments · Opened Jun 26, 2023
Improve logging for bqetl cli Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

mozilla/bigquery-etl#3917 · 1 comment · Opened Jun 8, 2023
Add ability to generate DAG by table name Open

dag_generation usability

Difficulty 3/5 1-2 days Newbie friendliness 45/100

mozilla/bigquery-etl#3913 · Opened Jun 7, 2023
mozfun docs break table of content when reading from README Open

Difficulty 2/5 1-3 hours Newbie friendliness 55/100

mozilla/bigquery-etl#3846 · Opened May 23, 2023
Schemas and yaml filenames in tests have to match dependencies exactly Open

Difficulty 4/5 3-5 days Newbie friendliness 30/100

mozilla/bigquery-etl#3803 · 2 comments · Opened May 18, 2023

mozilla/bigquery-etl

Get new issues in your inbox