Cloud-based user interactive SDE Job Application Platform
https://cs5412cloudjobboardapp.azurewebsites.net/#
Our project aims to build a Handshake-like software-engineer-oriented job board, where the users are able to view new job information more conveniently at one single place. What’s more, users can upload their own information such as their application status and timeline for each company. Users also have the choice to share their own information in exchange for the analyzed data from other users who are willing to share, such as the average time/percentage for getting/passing an OA/VO for a certain company.
Use Case Diagram:
Activity Diagram:
Our project will mainly have three parts.
- A real-time crawler (which we plan to use an existing service or a self-built tool using python libraries).
- A website page that allows user interaction, which contains multiple functions and would be the main part of our project.
- A database that serves as the storage tier and stores both the job and the user information.
The web crawler could be built using python libraries. We will search from popular job boards such as LinkedIn and Glassdoor, copying the title, description, link, etc. We plan to also use some techniques from data mining to determine whether the job supports sponsorship or not (which is an important factor for international students). The website mainly splits into several functions. First is the user login and profile page, which displays all the information users already entered. The user would be able to visualize their timeline for the job application via the user profile. Second is the information for all the companies including the posted date and detailed statistics. For the database, we plan to use a database like CosmosDB to implement, and we would also add multiple layers of cache before the final database for higher-performance retrieving.
Customize microservices for various logic or data extraction operations, such as getting the related job positions from the input filters and search keywords; also need some logic to control the number of instances used to ensure elasticity.
We want to have multiple layers of cache, including browser cache, edge cache, and possibly another cache in front of the databases so that we can optimize the data transfer speed.
Implement or use message queue / bus to relay the requests to micro services from the front-end webpage.
Use a distributed hash tables to record:
- the job position information (title, description, requirement …)
- User information (profile, user entered data including comments, interview experiences, time period)
Yihan Zhang | Programmer
Shuyan Huang | Programmer
Yuchen Qiu | Programmer