|
|
c6204be8e1
|
Added more comments and thoughts
|
2024-03-23 15:31:15 -04:00 |
|
|
|
20ee3fcb0f
|
Added a comment about the methodology of determining the zone the data is from.
|
2024-03-23 14:48:45 -04:00 |
|
|
|
e74741c0ad
|
Updated example record comment under source to reflect on the new record structure
|
2024-03-23 14:46:44 -04:00 |
|
|
|
6983b8ebec
|
AXFR detection in zone file input, to determine if the data is form ICANN or an AXFR against a dns (for source tracking)
|
2024-03-23 14:42:51 -04:00 |
|
|
|
a53541c328
|
Added zone field too better querying on specific tlds/zones
|
2024-03-23 14:31:39 -04:00 |
|
|
|
78d7556f09
|
Records stored as a nested type for better querying, added source field so we can identify where the zone data derived (icann, axfr, breach, etc)
|
2024-03-23 13:46:38 -04:00 |
|
|
|
87f2cf27ea
|
Code cleanup
|
2024-03-11 22:33:18 -04:00 |
|
|
|
d34aa105f1
|
Overall code cleanup
|
2024-03-08 00:07:26 -05:00 |
|
|
|
45f878285c
|
Testing function added to every ingestor to debug directly. No more --dry-run needed.
|
2024-03-07 23:31:30 -05:00 |
|
|
|
b15b3d8241
|
OCD about formatting again
|
2024-03-06 15:07:52 -05:00 |
|
|
|
cba51ca2dd
|
Added a note about NSEC3 hash cracking for zone file data
|
2024-03-06 14:16:05 -05:00 |
|
|
|
654e4a8667
|
Zone file ingestion script now uses the same sentinal value as masscans ingestion, set document id as the domain name to allow updating records if they exist
|
2024-03-06 14:12:27 -05:00 |
|
|
|
a4b89e6e5a
|
Asyncronous refactorization pushed as main version 💯
|
2024-03-05 22:19:11 -05:00 |
|
|
|
1ee71868ec
|
Ingestion agents are now modular, FIFO live ingestion added
|
2024-02-02 00:11:18 -05:00 |
|
|
|
c105db705d
|
Updated README, copied over consistencies across the ingestors, docstring updates to reflect on new arguments
|
2024-01-27 04:28:30 -05:00 |
|
|
|
c481edc883
|
Added parallel bulk uploading, error handling, sniffing nodes for discovery, dynamic batch sizes, and more
|
2024-01-27 01:13:11 -05:00 |
|
|
|
3ff233a991
|
Updated README, fixed issue using the wrong domain in records for zone file ingestion (woops)
|
2024-01-20 10:53:55 -05:00 |
|
|
|
14b6d1c88a
|
Initial commit
|
2024-01-20 02:04:50 -05:00 |
|
