dmitry_medvedev/homework
1
0
Fork 0
Code Issues Pull Requests 1 Actions Packages Projects Releases Wiki Activity

Этап 2. Загрузка данных (эмуляция Airflow). Пет проект: DWH

Browse Source
This commit is contained in:
mnoskov
2026-04-21 21:44:45 +03:00
parent 8913ccb25e
commit c456045950
5 changed files with 151 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
mnoskov/greenplum/Пет проект: DWH/Step 2: Loading Data/courses_202604212117.csv
+6
View File
@@ -0,0 +1,6 @@
"id","title","category","created_at"
1,SQL для начинающих,data,2023-01-01 00:00:00.000 +0300
2,Python для анализа данных,programming,2023-01-15 00:00:00.000 +0300
3,BI с нуля,business,2023-03-01 00:00:00.000 +0300
4,Excel для аналитиков,business,2023-02-01 00:00:00.000 +0300
5,Основы машинного обучения,data,2023-03-15 00:00:00.000 +0300
1 id title category created_at
2 1 SQL для начинающих data 2023-01-01 00:00:00.000 +0300
3 2 Python для анализа данных programming 2023-01-15 00:00:00.000 +0300
4 3 BI с нуля business 2023-03-01 00:00:00.000 +0300
5 4 Excel для аналитиков business 2023-02-01 00:00:00.000 +0300
6 5 Основы машинного обучения data 2023-03-15 00:00:00.000 +0300
mnoskov/greenplum/Пет проект: DWH/Step 2: Loading Data/enrollments_202604212130.csv
+46
View File
@@ -0,0 +1,46 @@
"id","user_id","course_id","enrolled_at"
1,1,1,2023-01-15 00:00:00.000 +0300
2,1,2,2023-02-01 00:00:00.000 +0300
3,2,1,2023-01-20 00:00:00.000 +0300
4,3,2,2023-03-05 00:00:00.000 +0300
5,4,3,2023-04-01 00:00:00.000 +0300
6,6,1,2023-01-06 00:00:00.000 +0300
7,6,2,2023-01-10 00:00:00.000 +0300
8,6,4,2023-02-05 00:00:00.000 +0300
9,7,1,2023-01-13 00:00:00.000 +0300
10,7,3,2023-03-10 00:00:00.000 +0300
11,8,1,2023-01-22 00:00:00.000 +0300
12,8,2,2023-01-22 00:00:00.000 +0300
13,8,3,2023-01-22 00:00:00.000 +0300
14,9,4,2023-02-12 00:00:00.000 +0300
15,10,1,2023-04-16 00:00:00.000 +0300
16,11,2,2023-04-21 00:00:00.000 +0300
17,12,1,2023-01-16 00:00:00.000 +0300
18,13,2,2023-01-19 00:00:00.000 +0300
19,13,4,2023-02-20 00:00:00.000 +0300
20,14,1,2023-01-09 00:00:00.000 +0300
21,14,2,2023-01-09 00:00:00.000 +0300
22,14,3,2023-01-09 00:00:00.000 +0300
23,14,4,2023-02-01 00:00:00.000 +0300
24,14,5,2023-03-20 00:00:00.000 +0300
25,15,1,2023-01-11 00:00:00.000 +0300
26,15,3,2023-03-05 00:00:00.000 +0300
27,16,2,2023-02-16 00:00:00.000 +0300
28,16,4,2023-02-16 00:00:00.000 +0300
29,17,3,2023-03-22 00:00:00.000 +0300
30,17,5,2023-03-25 00:00:00.000 +0300
31,18,1,2023-04-02 00:00:00.000 +0300
32,19,1,2023-04-11 00:00:00.000 +0300
33,19,2,2023-04-11 00:00:00.000 +0300
34,20,2,2023-04-19 00:00:00.000 +0300
35,5,5,2023-03-20 00:00:00.000 +0300
36,1,4,2023-02-10 00:00:00.000 +0300
37,2,3,2023-03-15 00:00:00.000 +0300
38,3,1,2023-02-25 00:00:00.000 +0300
39,4,2,2023-03-10 00:00:00.000 +0300
40,6,3,2023-03-08 00:00:00.000 +0300
41,7,2,2023-02-01 00:00:00.000 +0300
42,9,1,2023-02-15 00:00:00.000 +0300
43,12,3,2023-03-10 00:00:00.000 +0300
44,15,2,2023-02-01 00:00:00.000 +0300
45,18,4,2023-04-05 00:00:00.000 +0300
1 id user_id course_id enrolled_at
2 1 1 1 2023-01-15 00:00:00.000 +0300
3 2 1 2 2023-02-01 00:00:00.000 +0300
4 3 2 1 2023-01-20 00:00:00.000 +0300
5 4 3 2 2023-03-05 00:00:00.000 +0300
6 5 4 3 2023-04-01 00:00:00.000 +0300
7 6 6 1 2023-01-06 00:00:00.000 +0300
8 7 6 2 2023-01-10 00:00:00.000 +0300
9 8 6 4 2023-02-05 00:00:00.000 +0300
10 9 7 1 2023-01-13 00:00:00.000 +0300
11 10 7 3 2023-03-10 00:00:00.000 +0300
12 11 8 1 2023-01-22 00:00:00.000 +0300
13 12 8 2 2023-01-22 00:00:00.000 +0300
14 13 8 3 2023-01-22 00:00:00.000 +0300
15 14 9 4 2023-02-12 00:00:00.000 +0300
16 15 10 1 2023-04-16 00:00:00.000 +0300
17 16 11 2 2023-04-21 00:00:00.000 +0300
18 17 12 1 2023-01-16 00:00:00.000 +0300
19 18 13 2 2023-01-19 00:00:00.000 +0300
20 19 13 4 2023-02-20 00:00:00.000 +0300
21 20 14 1 2023-01-09 00:00:00.000 +0300
22 21 14 2 2023-01-09 00:00:00.000 +0300
23 22 14 3 2023-01-09 00:00:00.000 +0300
24 23 14 4 2023-02-01 00:00:00.000 +0300
25 24 14 5 2023-03-20 00:00:00.000 +0300
26 25 15 1 2023-01-11 00:00:00.000 +0300
27 26 15 3 2023-03-05 00:00:00.000 +0300
28 27 16 2 2023-02-16 00:00:00.000 +0300
29 28 16 4 2023-02-16 00:00:00.000 +0300
30 29 17 3 2023-03-22 00:00:00.000 +0300
31 30 17 5 2023-03-25 00:00:00.000 +0300
32 31 18 1 2023-04-02 00:00:00.000 +0300
33 32 19 1 2023-04-11 00:00:00.000 +0300
34 33 19 2 2023-04-11 00:00:00.000 +0300
35 34 20 2 2023-04-19 00:00:00.000 +0300
36 35 5 5 2023-03-20 00:00:00.000 +0300
37 36 1 4 2023-02-10 00:00:00.000 +0300
38 37 2 3 2023-03-15 00:00:00.000 +0300
39 38 3 1 2023-02-25 00:00:00.000 +0300
40 39 4 2 2023-03-10 00:00:00.000 +0300
41 40 6 3 2023-03-08 00:00:00.000 +0300
42 41 7 2 2023-02-01 00:00:00.000 +0300
43 42 9 1 2023-02-15 00:00:00.000 +0300
44 43 12 3 2023-03-10 00:00:00.000 +0300
45 44 15 2 2023-02-01 00:00:00.000 +0300
46 45 18 4 2023-04-05 00:00:00.000 +0300
mnoskov/greenplum/Пет проект: DWH/Step 2: Loading Data/lesson_views_202604212133.csv
+59
View File
@@ -0,0 +1,59 @@
"id","user_id","lesson_id","viewed_at"
1,1,1,2023-01-16 10:00:00.000 +0300
2,1,2,2023-01-16 10:15:00.000 +0300
3,1,3,2023-01-17 09:00:00.000 +0300
4,1,4,2023-01-17 09:30:00.000 +0300
5,1,4,2023-01-17 11:00:00.000 +0300
6,1,4,2023-01-18 10:00:00.000 +0300
7,1,6,2023-02-02 14:00:00.000 +0300
8,1,12,2023-02-15 10:00:00.000 +0300
9,1,13,2023-02-15 10:30:00.000 +0300
10,2,1,2023-01-21 09:00:00.000 +0300
11,2,9,2023-03-16 10:00:00.000 +0300
12,2,10,2023-03-16 10:30:00.000 +0300
13,3,6,2023-03-06 12:00:00.000 +0300
14,3,1,2023-02-26 11:00:00.000 +0300
15,3,2,2023-02-26 11:20:00.000 +0300
16,4,9,2023-04-02 10:00:00.000 +0300
17,4,10,2023-04-03 10:00:00.000 +0300
18,4,6,2023-03-12 14:00:00.000 +0300
19,4,7,2023-03-13 09:00:00.000 +0300
20,5,15,2023-03-21 10:00:00.000 +0300
21,5,16,2023-03-22 11:00:00.000 +0300
22,6,1,2023-01-07 10:00:00.000 +0300
23,6,2,2023-01-07 10:15:00.000 +0300
24,6,3,2023-01-08 09:00:00.000 +0300
25,6,4,2023-01-08 09:30:00.000 +0300
26,6,5,2023-01-09 10:00:00.000 +0300
27,6,6,2023-01-11 14:00:00.000 +0300
28,6,7,2023-01-12 10:00:00.000 +0300
29,6,8,2023-01-13 11:00:00.000 +0300
30,6,12,2023-02-06 09:00:00.000 +0300
31,6,13,2023-02-06 09:30:00.000 +0300
32,6,14,2023-02-07 10:00:00.000 +0300
33,6,9,2023-03-09 11:00:00.000 +0300
34,7,1,2023-01-14 10:00:00.000 +0300
35,7,2,2023-01-14 10:20:00.000 +0300
36,7,3,2023-01-15 09:00:00.000 +0300
37,7,9,2023-03-11 14:00:00.000 +0300
38,7,10,2023-03-11 14:30:00.000 +0300
39,9,12,2023-02-13 10:00:00.000 +0300
40,9,13,2023-02-13 10:30:00.000 +0300
41,9,1,2023-02-16 11:00:00.000 +0300
42,12,1,2023-01-17 10:00:00.000 +0300
43,12,2,2023-01-17 10:20:00.000 +0300
44,12,1,2023-04-10 11:00:00.000 +0300
45,12,3,2023-04-10 11:30:00.000 +0300
46,12,9,2023-03-12 10:00:00.000 +0300
47,13,6,2023-01-20 14:00:00.000 +0300
48,13,7,2023-01-21 10:00:00.000 +0300
49,13,12,2023-02-21 09:00:00.000 +0300
50,14,1,2023-01-09 08:00:00.000 +0300
51,14,2,2023-01-09 08:15:00.000 +0300
52,14,3,2023-01-10 10:00:00.000 +0300
53,14,4,2023-01-10 10:30:00.000 +0300
54,14,5,2023-01-11 09:00:00.000 +0300
55,14,6,2023-01-10 14:00:00.000 +0300
56,14,7,2023-01-11 10:00:00.000 +0300
57,14,8,2023-01-12 11:00:00.000 +0300
58,14,9,2023-01-10 08:00:00.000 +0300
1 id user_id lesson_id viewed_at
2 1 1 1 2023-01-16 10:00:00.000 +0300
3 2 1 2 2023-01-16 10:15:00.000 +0300
4 3 1 3 2023-01-17 09:00:00.000 +0300
5 4 1 4 2023-01-17 09:30:00.000 +0300
6 5 1 4 2023-01-17 11:00:00.000 +0300
7 6 1 4 2023-01-18 10:00:00.000 +0300
8 7 1 6 2023-02-02 14:00:00.000 +0300
9 8 1 12 2023-02-15 10:00:00.000 +0300
10 9 1 13 2023-02-15 10:30:00.000 +0300
11 10 2 1 2023-01-21 09:00:00.000 +0300
12 11 2 9 2023-03-16 10:00:00.000 +0300
13 12 2 10 2023-03-16 10:30:00.000 +0300
14 13 3 6 2023-03-06 12:00:00.000 +0300
15 14 3 1 2023-02-26 11:00:00.000 +0300
16 15 3 2 2023-02-26 11:20:00.000 +0300
17 16 4 9 2023-04-02 10:00:00.000 +0300
18 17 4 10 2023-04-03 10:00:00.000 +0300
19 18 4 6 2023-03-12 14:00:00.000 +0300
20 19 4 7 2023-03-13 09:00:00.000 +0300
21 20 5 15 2023-03-21 10:00:00.000 +0300
22 21 5 16 2023-03-22 11:00:00.000 +0300
23 22 6 1 2023-01-07 10:00:00.000 +0300
24 23 6 2 2023-01-07 10:15:00.000 +0300
25 24 6 3 2023-01-08 09:00:00.000 +0300
26 25 6 4 2023-01-08 09:30:00.000 +0300
27 26 6 5 2023-01-09 10:00:00.000 +0300
28 27 6 6 2023-01-11 14:00:00.000 +0300
29 28 6 7 2023-01-12 10:00:00.000 +0300
30 29 6 8 2023-01-13 11:00:00.000 +0300
31 30 6 12 2023-02-06 09:00:00.000 +0300
32 31 6 13 2023-02-06 09:30:00.000 +0300
33 32 6 14 2023-02-07 10:00:00.000 +0300
34 33 6 9 2023-03-09 11:00:00.000 +0300
35 34 7 1 2023-01-14 10:00:00.000 +0300
36 35 7 2 2023-01-14 10:20:00.000 +0300
37 36 7 3 2023-01-15 09:00:00.000 +0300
38 37 7 9 2023-03-11 14:00:00.000 +0300
39 38 7 10 2023-03-11 14:30:00.000 +0300
40 39 9 12 2023-02-13 10:00:00.000 +0300
41 40 9 13 2023-02-13 10:30:00.000 +0300
42 41 9 1 2023-02-16 11:00:00.000 +0300
43 42 12 1 2023-01-17 10:00:00.000 +0300
44 43 12 2 2023-01-17 10:20:00.000 +0300
45 44 12 1 2023-04-10 11:00:00.000 +0300
46 45 12 3 2023-04-10 11:30:00.000 +0300
47 46 12 9 2023-03-12 10:00:00.000 +0300
48 47 13 6 2023-01-20 14:00:00.000 +0300
49 48 13 7 2023-01-21 10:00:00.000 +0300
50 49 13 12 2023-02-21 09:00:00.000 +0300
51 50 14 1 2023-01-09 08:00:00.000 +0300
52 51 14 2 2023-01-09 08:15:00.000 +0300
53 52 14 3 2023-01-10 10:00:00.000 +0300
54 53 14 4 2023-01-10 10:30:00.000 +0300
55 54 14 5 2023-01-11 09:00:00.000 +0300
56 55 14 6 2023-01-10 14:00:00.000 +0300
57 56 14 7 2023-01-11 10:00:00.000 +0300
58 57 14 8 2023-01-12 11:00:00.000 +0300
59 58 14 9 2023-01-10 08:00:00.000 +0300
mnoskov/greenplum/Пет проект: DWH/Step 2: Loading Data/lessons_202604212131.csv
+19
View File
@@ -0,0 +1,19 @@
"id","course_id","title","duration_min"
1,1,SELECT и FROM,10
2,1,JOIN,15
3,1,WHERE и фильтрация,12
4,1,Агрегации и GROUP BY,18
5,1,Подзапросы,25
6,2,Pandas основы,20
7,2,NumPy,15
8,2,Визуализация данных,22
9,3,Основы BI,12
10,3,Метрики и дашборды,18
11,3,Power BI введение,20
12,4,Формулы в Excel,15
13,4,Сводные таблицы,18
14,4,Графики и диаграммы,14
15,5,Введение в ML,20
16,5,Линейная регрессия,30
17,5,Классификация,28
18,5,Кластеризация,25
1 id course_id title duration_min
2 1 1 SELECT и FROM 10
3 2 1 JOIN 15
4 3 1 WHERE и фильтрация 12
5 4 1 Агрегации и GROUP BY 18
6 5 1 Подзапросы 25
7 6 2 Pandas основы 20
8 7 2 NumPy 15
9 8 2 Визуализация данных 22
10 9 3 Основы BI 12
11 10 3 Метрики и дашборды 18
12 11 3 Power BI введение 20
13 12 4 Формулы в Excel 15
14 13 4 Сводные таблицы 18
15 14 4 Графики и диаграммы 14
16 15 5 Введение в ML 20
17 16 5 Линейная регрессия 30
18 17 5 Классификация 28
19 18 5 Кластеризация 25
mnoskov/greenplum/Пет проект: DWH/Step 2: Loading Data/users_202604212132.csv
+21
View File
@@ -0,0 +1,21 @@
"id","name","age","email","registration_date"
1,Alice,25,alice@mail.com,2023-01-10 00:00:00.000 +0300
2,Bob,30,bob@gmail.com,2023-02-05 00:00:00.000 +0300
3,Charlie,22,charlie@mail.com,2023-02-20 00:00:00.000 +0300
4,Diana,28,diana@mail.com,2023-03-01 00:00:00.000 +0300
5,Ethan,35,ethan@gmail.com,2023-03-10 00:00:00.000 +0300
6,Frank,29,frank@mail.com,2023-01-05 00:00:00.000 +0300
7,Grace,26,grace@gmail.com,2023-01-12 00:00:00.000 +0300
8,Henry,32,henry@mail.com,2023-01-20 00:00:00.000 +0300
9,Iris,24,iris@gmail.com,2023-02-10 00:00:00.000 +0300
10,Jack,27,jack@mail.com,2023-04-15 00:00:00.000 +0300
11,Kelly,23,kelly@gmail.com,2023-04-20 00:00:00.000 +0300
12,Leo,31,leo@mail.com,2023-01-15 00:00:00.000 +0300
13,Mia,26,mia@gmail.com,2023-01-18 00:00:00.000 +0300
14,Nina,28,nina@mail.com,2023-01-08 00:00:00.000 +0300
15,Oscar,33,oscar@gmail.com,2023-01-10 00:00:00.000 +0300
16,Paul,29,paul@mail.com,2023-02-15 00:00:00.000 +0300
17,Quinn,24,quinn@gmail.com,2023-03-20 00:00:00.000 +0300
18,Rita,27,rita@mail.com,2023-04-01 00:00:00.000 +0300
19,Sam,30,sam@gmail.com,2023-04-10 00:00:00.000 +0300
20,Tina,25,tina@mail.com,2023-04-18 00:00:00.000 +0300
1 id name age email registration_date
2 1 Alice 25 alice@mail.com 2023-01-10 00:00:00.000 +0300
3 2 Bob 30 bob@gmail.com 2023-02-05 00:00:00.000 +0300
4 3 Charlie 22 charlie@mail.com 2023-02-20 00:00:00.000 +0300
5 4 Diana 28 diana@mail.com 2023-03-01 00:00:00.000 +0300
6 5 Ethan 35 ethan@gmail.com 2023-03-10 00:00:00.000 +0300
7 6 Frank 29 frank@mail.com 2023-01-05 00:00:00.000 +0300
8 7 Grace 26 grace@gmail.com 2023-01-12 00:00:00.000 +0300
9 8 Henry 32 henry@mail.com 2023-01-20 00:00:00.000 +0300
10 9 Iris 24 iris@gmail.com 2023-02-10 00:00:00.000 +0300
11 10 Jack 27 jack@mail.com 2023-04-15 00:00:00.000 +0300
12 11 Kelly 23 kelly@gmail.com 2023-04-20 00:00:00.000 +0300
13 12 Leo 31 leo@mail.com 2023-01-15 00:00:00.000 +0300
14 13 Mia 26 mia@gmail.com 2023-01-18 00:00:00.000 +0300
15 14 Nina 28 nina@mail.com 2023-01-08 00:00:00.000 +0300
16 15 Oscar 33 oscar@gmail.com 2023-01-10 00:00:00.000 +0300
17 16 Paul 29 paul@mail.com 2023-02-15 00:00:00.000 +0300
18 17 Quinn 24 quinn@gmail.com 2023-03-20 00:00:00.000 +0300
19 18 Rita 27 rita@mail.com 2023-04-01 00:00:00.000 +0300
20 19 Sam 30 sam@gmail.com 2023-04-10 00:00:00.000 +0300
21 20 Tina 25 tina@mail.com 2023-04-18 00:00:00.000 +0300