[Question][GitHub] PR records remain duplicated and stale after a repository is moved between GitHub connections
还没有人认领这个 Issue。
评估
- 难度
- 5/5
- 预计耗时
- 一周以上
- 新手友好度
- 35/100
- Issue 类型
- 缺陷
- 描述清晰度
- 需要澄清
- 活跃度
- 冷清
- 技术栈
- github, graphql
调研方向
该 issue 指出了 pull_requests 表、github_graphql 插件、project blueprints 和 reporting queries。首先跟踪如何收集和映射 connection 作用域内的 repository 和 pull request 身份。完成的标准是记录是否支持 reconciliation 和 cleanup,以及安全的 migration 或 reporting 流程。
由索引模型根据 Issue 内容生成。
描述
Question
We are investigating how Apache DevLake handles repositories that are moved from one GitHub connection to another.
Our DevLake instance contains the same GitHub repository and pull request under multiple connection-scoped identities. For example, GitHub PR #137 from an example repo
is present in the pull_requests table as follows:
github:GithubPullRequest:1:3375195798 OPEN
github:GithubPullRequest:35:3375195798 MERGED
github:GithubPullRequest:36:3375195798 MERGED
github:GithubPullRequest:37:3375195798 MERGED
GitHub confirms that PR #137 was merged:
created_at: 2026-03-09T20:00:14Z
updated_at: 2026-03-10T03:38:33Z
closed_at: 2026-03-10T03:38:31Z
merged_at: 2026-03-10T03:38:31Z
The most recent pipeline for the project collected the repository through connection 35:
{
"plugin": "github_graphql",
"options": {
"connectionId": 35,
"fullName": "",
"githubId":
}
}
That pipeline correctly created or updated the connection-35 record to MERGED. However, the older connection-1 record remains OPEN and is not updated by subsequent pipeline runs.
Our reporting queries join pull requests to repositories by repository name and therefore include both the active connection-35 record and the stale connection-1 record. This results in incorrect open-PR counts unless we explicitly filter by the currently active connection-specific repository ID.
Is this behavior expected by design, or should DevLake reconcile records across GitHub connections when the same GitHub repository and pull request are collected through a different connection?
In particular:
- Is the connection ID intentionally part of the identity of a GitHub repository and pull request?
- When a repository is removed from connection
1and added to connection35, should historical records under connection1remain permanently queryable? - Should a future full-sync or backfill pipeline update the old connection-
1record, even though connection1is no longer present in the project blueprint? - Is there a supported procedure for migrating repository data between connections without creating duplicate tool-layer and domain-layer entities?
- Is there a recommended way to mark or remove obsolete connection-scoped records?
- What is the recommended query or dashboard strategy for counting PRs and identifying stale open PRs when the same repository exists under multiple connection IDs?
- Is there a supported cleanup or deduplication task that preserves related PR comments, reviews, commits, deployments, and DORA metrics?
Additional context
The project uses the GitHub GraphQL plugin and has skipOnFail enabled. The affected pipeline also experienced a separate network timeout while preparing a GitHub GraphQL task:
unable to get github API client instance
Failed to connect
dial tcp 20.26.156.210:443: i/o timeout
However, for PR #137, the active connection-35 record was successfully updated to MERGED. The issue appears specifically related to the older connection-1 record remaining stale and being included in cross-connection reporting.
The project’s sync policy is currently:
Data time range: 2026-05-07 01:00 to Now
Sync frequency: Custom
Skip failed tasks: Enabled
We would appreciate clarification on whether this is:
- expected connection-scoped identity behavior,
- a limitation of connection migration,
- a data cleanup/configuration issue,
- or a defect in the GitHub GraphQL collector, extractor, converter, or project mapping logic.
Expected outcome
We would like to understand the supported DevLake behavior and obtain guidance for:
- migrating repositories between GitHub connections,
- preventing duplicate records,
- excluding obsolete connection data from project metrics,
- and safely cleaning up stale records without corrupting related DevLake data.
- 主要语言
- Go
- 星标
- 3.1k
- 派生
- 812
- 平均合并
- 1 天 23 小时
- 30 天内合并 PR
- 51
贡献指南
这个仓库没有索引到贡献指南
从这里开始
- 先读完整个 Issue,再读项目的贡献指南。
- 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
- Fork 仓库,在一个分支上完成修改。
- 提交 Pull Request,并在描述里引用这个 Issue 编号。
apache/devlake 的其他 Issue
-
type/bug
难度 2/5 1-3 小时 新手友好度 82/100
-
难度 4/5 3-5 天 新手友好度 45/100
-
难度 5/5 一周以上 新手友好度 35/100
-
type/bug
难度 4/5 3-5 天 新手友好度 52/100
-
难度 5/5 一周以上 新手友好度 35/100
相似的 Issue
-
bug github_actions
难度 2/5 1-3 小时 新手友好度 75/100
registrystack/registry-stack#1393 ·
-
难度 2/5 1-3 小时 新手友好度 75/100
JakeChampion/lang#10213 ·
-
难度 2/5 1-3 小时 新手友好度 70/100
oasisprotocol/oasis-sdk#2523 ·
-
难度 2/5 1-3 小时 新手友好度 75/100
-
难度 2/5 1-3 小时 新手友好度 70/100