rilla
/
dayrize-usecase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Commit Graph

  • e9446f42f3 feat: added a few more plots to notebooks main Ricard Illa 2023-06-26 13:03:06 +0200
  • 39d279f089 refactor: some cleanup on etl's code structure Ricard Illa 2023-06-26 12:36:19 +0200
  • b28ddc350d doc: added readme to etl Ricard Illa 2023-06-26 12:09:50 +0200
  • 4ba29e7e1d feat: postgresql port doesn't need to be exposed Ricard Illa 2023-06-26 11:57:50 +0200
  • 0dd81715d4 feat: ignore dbt/.user.yaml Ricard Illa 2023-06-26 11:54:17 +0200
  • 543004b51c feat: added pylint and pytest for etl Ricard Illa 2023-06-26 11:53:40 +0200
  • ac1101ae96 fix: fix dbt writeable directories permissions Ricard Illa 2023-06-26 10:04:53 +0200
  • 7d898c6297 fix: airflow's BashOperator's cwd cannot be templated Ricard Illa 2023-06-26 10:04:28 +0200
  • 06c76f0b65
         docs: added dbt readme Ricard Illa 2023-06-26 08:51:54 +0200
  • 743c57a0d1
         feat: minor changes Ricard Illa 2023-06-26 08:49:16 +0200
  • 5ed10fb179
         feat: added DAG readme.md Ricard Illa 2023-06-26 08:48:37 +0200
  • 3d230263e2
         feat: added reame Ricard Illa 2023-06-26 08:42:26 +0200
  • d97fb6456a
         feat: added some plots Ricard Illa 2023-06-25 23:52:23 +0200
  • 15178b0b3c
         feat: added analysis notebook Ricard Illa 2023-06-25 23:24:54 +0200
  • 900955d92d
         feat: some cleanup on exploration notebook Ricard Illa 2023-06-25 23:24:43 +0200
  • c479a66405
         feat: implemented incremental model for scored products Ricard Illa 2023-06-25 23:21:40 +0200
  • 73df832a6c
         feat: implemented incremental model for scored products Ricard Illa 2023-06-25 22:41:58 +0200
  • 1268537695
         feat: moved transformations to dbt Ricard Illa 2023-06-25 20:53:51 +0200
  • 1bc5daa29e
         feat: removed dimensions from schema Ricard Illa 2023-06-25 13:19:51 +0200
  • 6d7f4909cc
         feat: upsert products Ricard Illa 2023-06-25 13:18:44 +0200
  • 2cf2007434
         feat: added score calculation Ricard Illa 2023-06-25 12:46:53 +0200
  • 6bb944c114
         feat: minor renaming Ricard Illa 2023-06-25 12:22:38 +0200
  • 4a3d43bcc5
         feat: autocommit session Ricard Illa 2023-06-25 12:22:06 +0200
  • 915f3c2a4c
         feat: tcin is the primary key now Ricard Illa 2023-06-25 11:33:06 +0200
  • 9f3a4865ce
         refactor: some refactoring of file placements Ricard Illa 2023-06-24 19:08:14 +0200
  • 02ad9fab8d
         refactor: some refactoring of file placements Ricard Illa 2023-06-24 19:07:02 +0200
  • 55b20bb897 feat: update table if there's a primary key conflict Ricard Illa 2023-06-23 18:25:11 +0200
  • 8e89404b76 feat: import elements into database using beam Ricard Illa 2023-06-23 18:02:01 +0200
  • 66782ec2ef feat: added query to create table to airflow Ricard Illa 2023-06-23 16:23:21 +0200
  • cbfbf42d53 feat: added gtin13 column Ricard Illa 2023-06-23 15:29:57 +0200
  • 3e42d55e7c feat: added postgres and terraform Ricard Illa 2023-06-23 15:20:40 +0200
  • 63e961e9a2 feat: added module for reading and writing data Ricard Illa 2023-06-23 11:20:42 +0200
  • 7a86988bd1 misc changes Ricard Illa 2023-06-23 11:11:32 +0200
  • a0c868f2f0 refactor: generalize unit conversion function Ricard Illa 2023-06-23 10:30:07 +0200
  • 9e3936fdc0 fix: typo Ricard Illa 2023-06-23 10:20:08 +0200
  • e716fc1cd3 feat: added parsing dimensions Ricard Illa 2023-06-23 10:05:24 +0200
  • 9c19835746 doc: small doc added Ricard Illa 2023-06-22 17:36:49 +0200
  • 050323d583 feat: added clean_origin_name Ricard Illa 2023-06-22 17:32:08 +0200
  • b018abe00e feat: remove older file Ricard Illa 2023-06-22 17:11:49 +0200
  • f2a996d42e feat: tests for materials Ricard Illa 2023-06-22 17:11:31 +0200
  • 691b8898a0 docs: added docstring to parse_xml module Ricard Illa 2023-06-22 15:51:47 +0200
  • b3069d4ca2 refactor: put helpers in a separate folder Ricard Illa 2023-06-22 15:43:26 +0200
  • 0b58d47acc feat: handle malformed xml file Ricard Illa 2023-06-22 15:34:38 +0200
  • 9b5ce6d36f feat: more tests for parse_raw_specs Ricard Illa 2023-06-22 15:34:11 +0200
  • 725114805a feat: added parse_raw_specification Ricard Illa 2023-06-22 09:40:26 +0200
  • 5a4bca756e added skeleton for airflow DAG Ricard Illa 2023-06-21 19:12:03 +0200
  • 02eaa4b7ff added skeleton for beam etl pipeline Ricard Illa 2023-06-21 19:11:17 +0200
  • b5ab3ca687 feat: added files for containerized airflow Ricard Illa 2023-06-21 16:02:12 +0200
  • 0a3323170f data exploration Ricard Illa 2023-06-21 15:46:28 +0200
  • 1e7c1eac1c feat: added docker-compose for containerized notebook Ricard Illa 2023-06-21 15:45:49 +0200
  • 9ce86c12a7 added sample data Ricard Illa 2023-06-21 15:45:01 +0200
  • 5458fc0335 initial commit Ricard Illa 2023-06-21 15:43:58 +0200