Legislator Profile - Scrape Biographies from Legislature Site
#2,161 建立於 2026年6月9日
倉庫指標
- Star
- (56 star)
- PR 合併指標
- (PR 指標待抓取)
描述
Summary
The Legislator pages on the Legislature's site actually have biographies:https://malegislature.gov/Legislators/Profile/RLR0/Biography - we should use those as a default for our Legislator Profile page's biography section. Given that this is relevant data for all members, not just members with MAPLE accounts, it makes the most sense to store this on the Member document itself.
I would guess they only update these once a session at most, so I think this is fine as a one-off script that will run and scrape this for all legislators. (We may eventually want this longer-term, but given that we also want to avoid overwriting a biography the legislator sets in MAPLE itself, that may be self-defeating).
Success Criteria
- Add
biographyfield to Members (ingeneralCourts/194/members)- (There may also eventually be an override in
profilesfor legislator who make accounts on MAPLE and want to customize them, but that is out of scope for this ticket)
- (There may also eventually be an override in
- Create a scraper script that:
- Iterates over all legislators in the current court (better yet, make
courtconfigurable by a param and just default to the current general court) - Scrapes the biography from the html of the legislature's legislator page (found at
https://malegislature.gov/Legislators/Profile/<<MEMBER_CODE>>/Biography) - Writes the biographies to the corresponding
memberin Firestore
- Iterates over all legislators in the current court (better yet, make