david hace 7 años
padre
commit
136ed7740e
Se han modificado 3 ficheros con 22 adiciones y 3 borrados
  1. 8 3
      README.md
  2. 14 0
      docs/services.dot
  3. BIN
      docs/services.png

+ 8 - 3
README.md

@@ -2,7 +2,7 @@
 
 * S3 (minio can be used for a local instance).
 * Redis
-* Postgresql
+* sqlite
 * Python3.6
 
 # Batch process
@@ -20,11 +20,16 @@ I executed:
 @Xon-new
 ```
 
-Then fetched all of the files, unarchived and concatenated them together.
-On the resulting file I ran `parse.py` which inserts it into postgres.
+Then fetched all of the files, unarchived, concatenated them together and
+deduped them.
+On the resulting file I ran `parse.py` which inserts it into the database.
 
 # Services
 
+## Diagram
+
+![](docs/services.png)
+
 ## Installation
 
 ```

+ 14 - 0
docs/services.dot

@@ -0,0 +1,14 @@
+digraph Services {
+   node [shape=rect];
+   rankdir=LR;
+   IRCClient
+   FileFetcher
+   Unpacker
+   WebAPI
+   BulkInserter
+   S3
+   DB
+
+   WebAPI -> IRCClient -> FileFetcher -> Unpacker -> S3
+   Unpacker -> BulkInserter -> DB
+}

BIN
docs/services.png