Skip to content

lchski/mp-downloader

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

72 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Process sketch

  1. POST a bunch of IDs. queueParliamentarianIds sends each ID to Pub/Sub.
  2. Pub/Sub triggers a background function, downloadParliamentarianData.
  3. downloadParliamentarianData loads the parliamentarian page URL and extracts the data, storing them in Cloud Storage.

API links

Get info for a specific parliamentarian:

https://lop.parl.ca/ParlinfoWebApi/Person/GetPersonWebProfile/{ID}?callback=jQuery33107266187344061623_1569968990479&_=1569968990480

About

No description or website provided.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published