Streaming Engine

Things to figure out before starting stream:

• Fixture ID.
• Hashtag(s) for the above particular fixture id.
• URL for sky sports streaming

Streaming blackbox documentation

1. sudo service zookeeper start

2. sudo service zookeeper status - Blocking terminal. Count terminal: 1

3. Running Kafka:

   • cd /home/aviral and cd inside kafka folder.
   • Run bin/kafka-server-start.sh config/server.properties
   • Blocking terminal. Count terminal: 2

4. Running streaming blackbox. cd /home/aviral/dev/bubble-process-watson/

5. Stream tweets.

   • Command: python stream_tweets.py
   • Inputs:
     • Fixture ID:
     • Hashtags:
   • Blocking terminal. Count terminal: 3

6. Process tweets:

   • Command: python stream_tweets.py
     • Inputs:
       • Fixture ID:
   • Blocking terminal. Count terminal: 4

7. Live trending calculation:

   • Command: python live_trending.py
     • Inputs:
       • Fixture ID:
   • Blocking terminal. Count terminal: 5

8. Fetching events from skypsport -> store them inside db:

   • Command: python live_match_event_scraper.py

     • Inputs:
       • Fixture ID:
       • URL: skysports live commentary url.

   • Blocking terminal. Count terminal: 6