82 Commits

Author SHA1 Message Date
ede2a760d6
Merge pull request #8 from 20kaushik02/integration_2
fin.
2024-12-03 00:33:25 -07:00
63c0ceba60 final submission 2024-12-03 00:28:17 -07:00
Lalit Arvind
1549c39325 added sleep after creating additional shard 2024-12-01 10:36:21 -07:00
Lalit Arvind
56df05ef93 bugfix 2024-11-30 23:15:21 -07:00
Lalit Arvind
7a79530633 error correction wrt autonomous sharding script 2024-11-30 21:12:38 -07:00
fd1ad9b641 added cc data 2024-11-30 18:20:36 -07:00
374c7f1aa1
Merge pull request #7 from 20kaushik02/integration_2
final stretch, tentatively done?
2024-11-29 20:46:45 -07:00
a5887f30f5 cc map, full scale data testing 2024-11-29 20:11:36 -07:00
11abeb5337 working with region and time data 2024-11-29 17:30:53 -07:00
ece4ca4508 dict on all nodes 2024-11-29 17:30:12 -07:00
6afaa613b2 ttl tested 2024-11-29 13:18:24 -07:00
c013d9cc67 geoip WiP 2024-11-29 01:59:51 -07:00
5de749c09a
Merge pull request #6 from 20kaushik02/integration_2
ocean of little drops
2024-11-28 22:23:07 -07:00
fe7f2e570d stream slow option 2024-11-28 22:19:05 -07:00
030659c3e1 check chkeeper health manually because swarm doesn't support depends_on-healthy_condition 2024-11-28 22:15:27 -07:00
3f15f225f4 load geoip data from csv 2024-11-28 22:11:32 -07:00
8b04cbdadb back to ui, WiP 2024-11-28 18:39:04 -07:00
84e501cf4b attempting swarm mode with linux host 2024-11-28 17:51:53 -07:00
2f96ef5641
Merge pull request #5 from 20kaushik02/integration_2
Integration 2
2024-11-28 01:23:41 -07:00
6a4cdd6b50 some more dashboard stuff 2024-11-28 01:22:59 -07:00
d5bacff369 dashboard WiP 2024-11-27 23:26:51 -07:00
0a6f0bb6f4 added bash script, integrating ui 2024-11-27 17:40:20 -07:00
75bca2d704 kafka ch integration done 2024-11-27 16:24:14 -07:00
6fb0ff4b4c ch entrypoint sql, fixes 2024-11-27 11:08:16 -07:00
e9752758e1 ch config fixes 2024-11-27 10:22:46 -07:00
4caeda48c2 integrating data streamer stack and clickhouse stack 2024-11-27 10:07:30 -07:00
b701e239d2 added deployment script for data streamer part of the stack 2024-11-27 00:25:59 -07:00
d07d94cc1e Merge branch 'preprocessing' into integration_2 2024-11-26 22:48:44 -07:00
989b2adbe6 geoip csv 2024-11-26 22:19:11 -07:00
ea2017b251 Merge branch 'main' into preprocessing 2024-11-26 21:48:56 -07:00
fc35cc8ec1 Merge branch 'integration_temp' 2024-11-26 21:45:24 -07:00
Akash Sivakumar
b1fc1dbc49 Fixed integration issue with csv streaming 2024-11-26 21:41:17 -07:00
a17c8c3cb4 Merge branch 'ui' into integration_2 2024-11-26 17:43:28 -07:00
75a75a08d6 Merge branch 'preprocessing' into integration_2 2024-11-26 17:33:24 -07:00
1335ca617e grafana-clickhouse connection works 2024-11-26 10:49:02 -07:00
b8d36d0907 Merge branch 'clickhouse' 2024-11-25 23:22:27 -07:00
887b04a04e
Merge pull request #4 from 20kaushik02/integration_temp
Start integration
2024-11-25 22:39:09 -07:00
5d20e14dbf added option for streaming from csv 2024-11-25 22:33:32 -07:00
Akash Sivakumar
3710362d2a Merge branch 'integration_temp' of https://github.com/20kaushik02/real-time-traffic-analysis-clickhouse into integration_temp 2024-11-25 16:53:18 -07:00
Akash Sivakumar
35d48a2cf4 pcap check 2024-11-25 16:53:13 -07:00
6884fc681d Merge branch 'main' into preprocessing 2024-11-25 13:21:52 -07:00
Lalit Arvind
13dc2b4089 updated some errors while testing 2024-11-25 10:59:05 -07:00
Lalit Arvind
351a6473a4 added volume template and modified update_compose accordingly. updated service template 2024-11-25 01:11:09 -07:00
Lalit Arvind
ee03026d47 Changed some bind volumes to named volumes 2024-11-25 00:44:27 -07:00
Lalit Arvind
cf50af1a9e Corrected storage policy errors 2024-11-25 00:30:05 -07:00
Lalit Arvind
34b9ae609e table creation queries 2024-11-24 17:14:56 -07:00
Lalit Arvind
745870bb9c Added storage policy for TTL in each server's config files and jinja templates. Testing needed 2024-11-24 15:21:35 -07:00
Lalit Arvind
52fc788eee Added resources, created a prototype trigger and its corresponding dockerfile for update configurations, Testing required 2024-11-23 15:50:38 -07:00
Akash Sivakumar
30e90013d7
Rename README to README.md 2024-11-22 20:49:07 -07:00
Akash Sivakumar
98601a1078
Update README 2024-11-22 20:48:29 -07:00