Hacktoberfest 2026:维护者为十月标记出来的 issue,仍然开放、适合新手。 浏览 Hacktoberfest issue

Refactor profiles scraper to use API

未关闭
#111 4 条评论 0 个 reaction 已指派 1 人 在 GitHub 查看

@AJayaV06 已经在做这个了。

开始于 2026年5月10日。

  • #168 来自 @AJayaV06 —— 未关闭

评估

这个 Issue 还没有评估数据。

描述

Help Wanted L2

Overview

Refactor the profile scraper in scrapers/profiles.go to just pull data from the below API and create a parser/profiles.go file to parse that data into our preexisting format, maybe with more fields for more information if there is any.

Information from the Office of Research and Innovation that maintains UT Profiles:

Here's the documentation I created for the profiles.utdallas.edu API: https://documenter.getpostman.com/view/8354395/TzCHApzg . It's a public API. The one thing I would strongly suggest is to try to limit the scope of your calls so as to not overload our server. (Some faculty have thousands of publications, so grabbing all that data is quite intensive.) You might, for example, start by grabbing the list of profiles at https://profiles.utdallas.edu/api/v1, then loop through in chunks and pull something like

https://profiles.utdallas.edu/api/v1?person=herve.abdi;nimali.abeykoon;robert.ackerman&with_data=1&data_type=information;areas

Alternatively, just loop through each of the schools (AHT, BBS, ECS, etc), like this:

https://profiles.utdallas.edu/api/v1?from_school=AHT&with_data=1&data_type=information;areas

Note

Recommend that 2 people working on this issue:

  • One will work on the calling the API to get the raw data.
  • Another one will work on parsing the data and setting up connection with courses and sections
主要语言
Go
星标
12
派生
54
PR 合并指标
30 天内没有已合并 PR

环境准备

  • 提供 Dockerfile 或 Docker Compose 文件
  • 有 Pull Request 模板
  • 没有贡献指南

从这里开始

  1. 先读完整个 Issue,再读项目的贡献指南。
  2. 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
  3. Fork 仓库,在一个分支上完成修改。
  4. 提交 Pull Request,并在描述里引用这个 Issue 编号。

UTDNebula/api-tools 的其他 Issue

查看 UTDNebula/api-tools 的全部 Issue

相似的 Issue

更多 Go Issue

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。