64 Commits

Author SHA1 Message Date
84e501cf4b attempting swarm mode with linux host 2024-11-28 17:51:53 -07:00
6a4cdd6b50 some more dashboard stuff 2024-11-28 01:22:59 -07:00
d5bacff369 dashboard WiP 2024-11-27 23:26:51 -07:00
0a6f0bb6f4 added bash script, integrating ui 2024-11-27 17:40:20 -07:00
75bca2d704 kafka ch integration done 2024-11-27 16:24:14 -07:00
6fb0ff4b4c ch entrypoint sql, fixes 2024-11-27 11:08:16 -07:00
e9752758e1 ch config fixes 2024-11-27 10:22:46 -07:00
4caeda48c2 integrating data streamer stack and clickhouse stack 2024-11-27 10:07:30 -07:00
b701e239d2 added deployment script for data streamer part of the stack 2024-11-27 00:25:59 -07:00
d07d94cc1e Merge branch 'preprocessing' into integration_2 2024-11-26 22:48:44 -07:00
989b2adbe6 geoip csv 2024-11-26 22:19:11 -07:00
ea2017b251 Merge branch 'main' into preprocessing 2024-11-26 21:48:56 -07:00
fc35cc8ec1 Merge branch 'integration_temp' 2024-11-26 21:45:24 -07:00
Akash Sivakumar
b1fc1dbc49 Fixed integration issue with csv streaming 2024-11-26 21:41:17 -07:00
a17c8c3cb4 Merge branch 'ui' into integration_2 2024-11-26 17:43:28 -07:00
75a75a08d6 Merge branch 'preprocessing' into integration_2 2024-11-26 17:33:24 -07:00
1335ca617e grafana-clickhouse connection works 2024-11-26 10:49:02 -07:00
b8d36d0907 Merge branch 'clickhouse' 2024-11-25 23:22:27 -07:00
887b04a04e
Merge pull request #4 from 20kaushik02/integration_temp
Start integration
2024-11-25 22:39:09 -07:00
5d20e14dbf added option for streaming from csv 2024-11-25 22:33:32 -07:00
Akash Sivakumar
3710362d2a Merge branch 'integration_temp' of https://github.com/20kaushik02/real-time-traffic-analysis-clickhouse into integration_temp 2024-11-25 16:53:18 -07:00
Akash Sivakumar
35d48a2cf4 pcap check 2024-11-25 16:53:13 -07:00
6884fc681d Merge branch 'main' into preprocessing 2024-11-25 13:21:52 -07:00
Lalit Arvind
13dc2b4089 updated some errors while testing 2024-11-25 10:59:05 -07:00
Lalit Arvind
351a6473a4 added volume template and modified update_compose accordingly. updated service template 2024-11-25 01:11:09 -07:00
Lalit Arvind
ee03026d47 Changed some bind volumes to named volumes 2024-11-25 00:44:27 -07:00
Lalit Arvind
cf50af1a9e Corrected storage policy errors 2024-11-25 00:30:05 -07:00
Lalit Arvind
34b9ae609e table creation queries 2024-11-24 17:14:56 -07:00
Lalit Arvind
745870bb9c Added storage policy for TTL in each server's config files and jinja templates. Testing needed 2024-11-24 15:21:35 -07:00
Lalit Arvind
52fc788eee Added resources, created a prototype trigger and its corresponding dockerfile for update configurations, Testing required 2024-11-23 15:50:38 -07:00
Akash Sivakumar
30e90013d7
Rename README to README.md 2024-11-22 20:49:07 -07:00
Akash Sivakumar
98601a1078
Update README 2024-11-22 20:48:29 -07:00
Akash Sivakumar
5b1add9241 integration working in akash's system 2024-11-22 20:26:57 -07:00
Lalit Arvind
4d9526ae60 added weight tag to remote servers config files 2024-11-22 17:32:57 -07:00
Akash Sivakumar
e65cf00d34 branch test commit 2024-11-20 20:10:15 -07:00
Akash Sivakumar
bab6e8cf4d
Merge pull request #3 from 20kaushik02/clickhouse
Clickhouse
2024-11-20 20:06:18 -07:00
AnirudhPI
4c04f4f0ef docker-compose.yml fix 2024-11-20 18:21:53 -07:00
Akash Sivakumar
1df759f6a6 Merge branch 'main' of https://github.com/20kaushik02/real-time-traffic-analysis-clickhouse 2024-11-20 16:30:13 -07:00
Akash Sivakumar
d4fc9382ed temp push 2024-11-20 16:30:09 -07:00
Lalit Arvind
8e03c62f72 Added jinja template for each of node config files and created an preliminary update script 2024-11-17 00:15:19 -07:00
Lalit Arvind
078ef06279 Jinja file and update script to add service in docker compose file 2024-11-16 15:55:19 -07:00
ac5f50a480 added some data 2024-11-15 23:00:18 -07:00
6150cc6679 corrections 2024-11-15 18:17:41 -07:00
e6c0182724 aggregating data 2024-11-15 13:12:04 -07:00
Lalit Arvind
20453ae388 small updates in docker-compose to execute swarm. clickhouse client connection through published port prob. 2024-11-15 09:57:53 -07:00
afdddbaf54 reorg back into master 2024-11-14 22:41:18 -07:00
b9f5e37eff Merge branch 'master'
reorganization of clickhouse stuff
2024-11-14 22:38:23 -07:00
90a7a2415d reorg 2024-11-14 22:33:10 -07:00
Akash Sivakumar
35881893f6 Incomplete - dockerizing kafka streaming 2024-11-14 18:32:17 -07:00
Akash Sivakumar
5ade3d90fc Merge branch 'main' of https://github.com/20kaushik02/real-time-traffic-analysis-clickhouse 2024-11-14 17:13:33 -07:00