Skip to content

Latest commit

 

History

History
36 lines (25 loc) · 1010 Bytes

README.md

File metadata and controls

36 lines (25 loc) · 1010 Bytes

STOCK DATA STREAMING AND ANALYSIS

DESCRIPTION

  • This project is basically for collecting enormous data and analysing it.
  • It includes live streaming of data from FOREX trading API and Electric Vehicle stocks API.
  • The data is fetched and processed using Kafka Streaming and Spark streaming.
  • Throughout this project stocks of Forex data and Electric Vehicle parts making companies data were analyzed and business use case is implemented.
  • The analyzed data is then visualized by plotting different graphs using python libraries.

STREAMING TOOLS

  • Websocket,
  • Requests library,
  • Pandas datareader library,
  • Netcat,
  • API : Tiingo API,Alpha Vantage API.
  • data visualization tool: matplotlib,Seaborn

TECHNOLOGIES USED:

  • Spark
  • Kafka
  • Pyspark

alt text

ROLES AND RESPONSIBILITIES

  • DATA STREAMING AND SPARK submit job
  • Use cases
  • Visualization
  • EV stock use case
  • Deployment