50 Commits

Author SHA1 Message Date
ea2017b251 Merge branch 'main' into preprocessing 2024-11-26 21:48:56 -07:00
fc35cc8ec1 Merge branch 'integration_temp' 2024-11-26 21:45:24 -07:00
Akash Sivakumar
b1fc1dbc49 Fixed integration issue with csv streaming 2024-11-26 21:41:17 -07:00
b8d36d0907 Merge branch 'clickhouse' 2024-11-25 23:22:27 -07:00
887b04a04e
Merge pull request #4 from 20kaushik02/integration_temp
Start integration
2024-11-25 22:39:09 -07:00
5d20e14dbf added option for streaming from csv 2024-11-25 22:33:32 -07:00
Akash Sivakumar
3710362d2a Merge branch 'integration_temp' of https://github.com/20kaushik02/real-time-traffic-analysis-clickhouse into integration_temp 2024-11-25 16:53:18 -07:00
Akash Sivakumar
35d48a2cf4 pcap check 2024-11-25 16:53:13 -07:00
6884fc681d Merge branch 'main' into preprocessing 2024-11-25 13:21:52 -07:00
Lalit Arvind
13dc2b4089 updated some errors while testing 2024-11-25 10:59:05 -07:00
Lalit Arvind
351a6473a4 added volume template and modified update_compose accordingly. updated service template 2024-11-25 01:11:09 -07:00
Lalit Arvind
ee03026d47 Changed some bind volumes to named volumes 2024-11-25 00:44:27 -07:00
Lalit Arvind
cf50af1a9e Corrected storage policy errors 2024-11-25 00:30:05 -07:00
Lalit Arvind
34b9ae609e table creation queries 2024-11-24 17:14:56 -07:00
Lalit Arvind
745870bb9c Added storage policy for TTL in each server's config files and jinja templates. Testing needed 2024-11-24 15:21:35 -07:00
Lalit Arvind
52fc788eee Added resources, created a prototype trigger and its corresponding dockerfile for update configurations, Testing required 2024-11-23 15:50:38 -07:00
Akash Sivakumar
30e90013d7
Rename README to README.md 2024-11-22 20:49:07 -07:00
Akash Sivakumar
98601a1078
Update README 2024-11-22 20:48:29 -07:00
Akash Sivakumar
5b1add9241 integration working in akash's system 2024-11-22 20:26:57 -07:00
Lalit Arvind
4d9526ae60 added weight tag to remote servers config files 2024-11-22 17:32:57 -07:00
Akash Sivakumar
e65cf00d34 branch test commit 2024-11-20 20:10:15 -07:00
Akash Sivakumar
bab6e8cf4d
Merge pull request #3 from 20kaushik02/clickhouse
Clickhouse
2024-11-20 20:06:18 -07:00
AnirudhPI
4c04f4f0ef docker-compose.yml fix 2024-11-20 18:21:53 -07:00
Akash Sivakumar
1df759f6a6 Merge branch 'main' of https://github.com/20kaushik02/real-time-traffic-analysis-clickhouse 2024-11-20 16:30:13 -07:00
Akash Sivakumar
d4fc9382ed temp push 2024-11-20 16:30:09 -07:00
Lalit Arvind
8e03c62f72 Added jinja template for each of node config files and created an preliminary update script 2024-11-17 00:15:19 -07:00
Lalit Arvind
078ef06279 Jinja file and update script to add service in docker compose file 2024-11-16 15:55:19 -07:00
ac5f50a480 added some data 2024-11-15 23:00:18 -07:00
6150cc6679 corrections 2024-11-15 18:17:41 -07:00
e6c0182724 aggregating data 2024-11-15 13:12:04 -07:00
Lalit Arvind
20453ae388 small updates in docker-compose to execute swarm. clickhouse client connection through published port prob. 2024-11-15 09:57:53 -07:00
afdddbaf54 reorg back into master 2024-11-14 22:41:18 -07:00
b9f5e37eff Merge branch 'master'
reorganization of clickhouse stuff
2024-11-14 22:38:23 -07:00
90a7a2415d reorg 2024-11-14 22:33:10 -07:00
Akash Sivakumar
35881893f6 Incomplete - dockerizing kafka streaming 2024-11-14 18:32:17 -07:00
Akash Sivakumar
5ade3d90fc Merge branch 'main' of https://github.com/20kaushik02/real-time-traffic-analysis-clickhouse 2024-11-14 17:13:33 -07:00
Akash Sivakumar
c223d11fd5 remove intermdiate json 2024-11-14 17:13:29 -07:00
Lalit Arvind
2936f6c0db README 2024-11-09 11:05:48 -07:00
Lalit Arvind
eb17e06605 modify paths for common use 2024-11-09 10:40:46 -07:00
Lalit Arvind
2265c3023f Local docker containers demo config 2024-11-09 09:43:15 -07:00
98c76353cb
Merge pull request #2 from 20kaushik02/preprocessing
ip2location data
2024-11-04 18:03:12 -07:00
38afa8d9fd ip2location data 2024-11-04 18:02:12 -07:00
Akash Sivakumar
b4a777c368
Update README.md 2024-11-03 18:47:39 -07:00
Akash Sivakumar
6d29dcf343
Update README.md 2024-11-03 18:47:05 -07:00
Akash Sivakumar
d8631a5cfc added kafka streaming part 2024-11-03 18:33:11 -07:00
599741326e
Merge pull request #1 from 20kaushik02/preprocessing
Preprocessing part completed
2024-11-02 22:28:24 -07:00
3bf8565a16 update readme 2024-11-02 22:25:05 -07:00
59ea030790 pcap to csv pipeline 2024-11-02 22:15:39 -07:00
957202d86f preprocessing data 2024-10-31 00:29:26 -07:00
a96c4320b0 Initial commit 2024-10-30 11:08:09 -07:00