my-asu-archive/real-time-traffic-analysis-clickhouse
1
0
Fork 0
mirror of https://github.com/20kaushik02/real-time-traffic-analysis-clickhouse.git synced 2025-12-06 09:44:06 +00:00
Code Issues Packages Projects Releases Wiki Activity

Update README.md

Browse Source
This commit is contained in:
Akash Sivakumar 2024-11-03 18:47:05 -07:00 committed by GitHub
parent d8631a5cfc
commit 6d29dcf343
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 16 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

17
preprocessing/README.md
View File

@ -15,7 +15,22 @@
- Packet size - in bytes
- `sample_output.csv` contains a partial subset of `202310081400.pcap`, ~600K packets
# Setting up Kafka
- Download and install kafka [from here](https://kafka.apache.org/downloads)
- Run all commands in separate terminals from installation location
- Zookeeper:
- Windows: `.\bin\windows\zookeeper-server-start.bat .\config\zookeeper.properties`
- Mac: `bin/zookeeper-server-start.sh config/zookeeper.properties`
- Kafka Broker:
- Windows: `.\bin\windows\kafka-server-start.bat .\config\server.properties`
- Mac: `bin/kafka-server-start.sh config/server.properties`
- Creating a Kafka topic:
- Windows: `.\bin\windows\kafka-topics.bat --create --topic %topicname% --bootstrap-server localhost:9092 --partitions 1 --replication-factor 1`
- Mac: `bin/kafka-topics.sh --create --topic %topicname% --bootstrap-server localhost:9092 --partitions 1 --replication-factor 1`
# Streaming from pcap file using Kafka
- Start zookeeper and Kafka broker whenever python code is run after machine reboot
- Run pcap_processor.py file
- Arguments
- -f or --pcap_file: pcap file path, mandatory argument
@ -26,4 +41,4 @@
- -d or --debug: boolean value indicating if program is run in debug mode
python pcap_processor.py -f C:/Users/akash/storage/Asu/sem3/dds/project/202310081400.pcap -s --sample-size 1000
python pcap_processor.py -f C:/Users/akash/storage/Asu/sem3/dds/project/202310081400.pcap -s --sample-size 1000