my-asu-archive/real-time-traffic-analysis-clickhouse
1
0
Fork 0
mirror of https://github.com/20kaushik02/real-time-traffic-analysis-clickhouse.git synced 2026-01-25 08:04:04 +00:00
Code Issues Packages Projects Releases Wiki Activity

added kafka streaming part

Browse Source
This commit is contained in:
Akash Sivakumar
2024-11-03 18:33:11 -07:00
parent 599741326e
commit d8631a5cfc
2 changed files with 58 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

13
preprocessing/README.md
View File

@@ -14,3 +14,16 @@
- TCP/UDP - ports - sport, dport
- Packet size - in bytes
- `sample_output.csv` contains a partial subset of `202310081400.pcap`, ~600K packets
# Streaming from pcap file using Kafka
- Run pcap_processor.py file
- Arguments
- -f or --pcap_file: pcap file path, mandatory argument
- -o or --out_file: output csv file path
- -x or --sample: boolean value indicating if data has to be sampled
- -s or --stream: boolean value indicating if kafka streaming should happen
- --stream_size: integer indicating number of sampled packets
- -d or --debug: boolean value indicating if program is run in debug mode
python pcap_processor.py -f C:/Users/akash/storage/Asu/sem3/dds/project/202310081400.pcap -s --sample-size 1000