acidvegas/eris
acidvegas
/
eris
1
Fork 0
Code Issues Pull Requests Activity

Commit Graph

  • 124e4b0cf3
         ECS formatting added to eris, certstream ingestor now caches to prevent duplication, elastic connections properly closed now main Dionysus 2024-03-23 22:47:30 -0400
  • 510f7db07e
         Fixed _doc to doc in record Dionysus 2024-03-23 17:26:55 -0400
  • c6204be8e1
         Added more comments and thoughts Dionysus 2024-03-23 15:31:15 -0400
  • 20ee3fcb0f
         Added a comment about the methodology of determining the zone the data is from. Dionysus 2024-03-23 14:48:45 -0400
  • e74741c0ad
         Updated example record comment under source to reflect on the new record structure Dionysus 2024-03-23 14:46:44 -0400
  • 6983b8ebec
         AXFR detection in zone file input, to determine if the data is form ICANN or an AXFR against a dns (for source tracking) Dionysus 2024-03-23 14:42:51 -0400
  • a53541c328
         Added zone field too better querying on specific tlds/zones Dionysus 2024-03-23 14:31:39 -0400
  • 78d7556f09
         Records stored as a nested type for better querying, added source field so we can identify where the zone data derived (icann, axfr, breach, etc) Dionysus 2024-03-23 13:46:38 -0400
  • 603d005a47
         Added IXP ingestor, updated all other ingestors Dionysus 2024-03-19 19:00:12 -0400
  • 24850ea976
         Typo in pypi title Dionysus 2024-03-15 01:26:55 -0400
  • fe49255f69
         Added elastic common schema (ecs) logging to file for ingesting eris logs straight into ES Dionysus 2024-03-15 01:25:09 -0400
  • 1ab7199f7d
         Certstream ingestor now only logs sub-domains since we already ingested zone files. Ignores www. and wildcard domains. Dionysus 2024-03-13 22:34:20 -0400
  • 7f93a4d8de
         add ingest_rir_transfers.py Dionysus 2024-03-13 20:54:36 -0400
  • 4dc31a5090
         RIR Transfers ingestor added Dionysus 2024-03-13 20:51:53 -0400
  • bd735ea8a7
         Thats how you fucking do it. Delegations stored in ranges now for querying. Dionysus 2024-03-12 21:20:34 -0400
  • 1864f08e4b
         Fixed import error saying aiofiles instead of aiohttp Dionysus 2024-03-12 18:23:52 -0400
  • b1fa34f3aa
         Added anomaly detection to RIR delegations ingestor Dionysus 2024-03-12 18:19:47 -0400
  • 00711fe856
         Created an ingestor for RIR delegations Dionysus 2024-03-12 17:04:14 -0400
  • 6bb0d4eeef
         Lowered reconnect time on certstream timeout Dionysus 2024-03-12 00:44:17 -0400
  • 67c7e639a9
         Renamed default_index to eris-certstream Dionysus 2024-03-11 23:32:37 -0400
  • 1ad7d8a1d3
         Fixed logger again Dionysus 2024-03-11 23:30:48 -0400
  • 32d5c773e8
         Fixed missing logging.handlers import Dionysus 2024-03-11 23:07:35 -0400
  • c3b9cb9e08
         Fixed logger level Dionysus 2024-03-11 23:06:25 -0400
  • de3878ef6b
         Removed _id from certstream yield and renamed ingest_certs.py to ingest_certstream.py Dionysus 2024-03-11 22:46:48 -0400
  • 87f2cf27ea
         Code cleanup Dionysus 2024-03-11 22:33:18 -0400
  • b018da4e4d
         Full source commenting, uniformity in testing function, records stored as a list by default incase an IP address yields multiple PTR records Dionysus 2024-03-11 19:18:03 -0400
  • 6c4ae3e988
         Many bugs fixed in sniffer and async model. Dionysus 2024-03-08 12:13:57 -0500
  • d34aa105f1
         Overall code cleanup Dionysus 2024-03-08 00:07:26 -0500
  • 681e3bd788
         Fixed issue with ingest_certs and the ingestion function signature. Simple placeholder argument (un-used) added to maintain function uniformity Dionysus 2024-03-07 23:33:20 -0500
  • 45f878285c
         Testing function added to every ingestor to debug directly. No more --dry-run needed. Dionysus 2024-03-07 23:31:30 -0500
  • b78b99e060
         Changed yield to return when sentinal value is recieved through the FIFO Dionysus 2024-03-07 22:57:59 -0500
  • da065c6889
         Added a testing function for calling the ingest_massdns.py file directly for debugging Dionysus 2024-03-07 22:55:48 -0500
  • 3c98f8f1f1
         MassDNS ingestion script now caches the previous record to support IP addresses that yield more than one PTR record (field turned into a list when +1). Records will now upsert so MassDNS can be streaming into ES 24/7= Dionysus 2024-03-07 21:57:44 -0500
  • 9c6beb71ce
         MassDNS ingestion script now caches the previous record to support IP addresses that yield more than one PTR record (field turned into a list when +1). Records will now upsert so MassDNS can be streaming into ES 24/7= Dionysus 2024-03-07 21:57:10 -0500
  • b15b3d8241
         OCD about formatting again Dionysus 2024-03-06 15:07:52 -0500
  • fd617e3c9d
         Certstream ingestion improved, still need to test stripping nulls and refactor the index mapping so we only store whats needed Dionysus 2024-03-06 14:38:34 -0500
  • 90d6260b99
         Updated massdns ingestion script with sentinal value checking and using the ip address as the document id Dionysus 2024-03-06 14:33:21 -0500
  • cba51ca2dd
         Added a note about NSEC3 hash cracking for zone file data Dionysus 2024-03-06 14:16:05 -0500
  • 654e4a8667
         Zone file ingestion script now uses the same sentinal value as masscans ingestion, set document id as the domain name to allow updating records if they exist Dionysus 2024-03-06 14:12:27 -0500
  • 84f124b23d
         Masscan ingestion script updated to use ip:port as the document id to allow updating records that already exist. Added a sentinal value to trigger an EOF when using --watch with FIFO's Dionysus 2024-03-06 13:26:45 -0500
  • 5a45be5c60
         Updated cause I am OCD about spaces and formatting Dionysus 2024-03-05 22:29:31 -0500
  • 598552d34f
         Introduction paragraph descriving the project overview added, updated roadmap Dionysus 2024-03-05 22:26:42 -0500
  • a4b89e6e5a
         Asyncronous refactorization pushed as main version 💯 Dionysus 2024-03-05 22:19:11 -0500
  • ed547a27f4
         Added a recursive JSON explorer to remove empty or nulled keys from a dictionary Dionysus 2024-03-05 22:15:55 -0500
  • 4cf976aada
         Asyncronous refactorization of the codebase is complete, testing & metrics and then it will be production ready Dionysus 2024-03-05 21:40:34 -0500
  • b6fb68ba3a
         Asyncronous developed mon ERIS is complete, need to refactor ingestion helpers before pushing this as the main version Dionysus 2024-03-05 16:47:11 -0500
  • 31287a99d2
         Added certificate transparency monitoring via websockets for ingestion Dionysus 2024-03-05 11:52:06 -0500
  • be4938ee6e
         Added certificate transparency monitoring via websockets for ingestion Dionysus 2024-03-05 11:48:53 -0500
  • c05c48f3fe
         Started asyncronous implementation of bulk streaming data, altered ERIS defaults, etc Dionysus 2024-03-04 17:44:09 -0500
  • 2ff7ddc869
         Added an asyncronous sniffer patch in helpers Dionysus 2024-02-02 13:21:59 -0500
  • 1ee71868ec
         Ingestion agents are now modular, FIFO live ingestion added Dionysus 2024-02-02 00:11:18 -0500
  • c105db705d
         Updated README, copied over consistencies across the ingestors, docstring updates to reflect on new arguments Dionysus 2024-01-27 04:28:30 -0500
  • 88e0dbfea8
         Added parallel bulk uploading, error handling, sniffing nodes for discovery, dynamic batch sizes, and more Dionysus 2024-01-27 01:13:27 -0500
  • c481edc883
         Added parallel bulk uploading, error handling, sniffing nodes for discovery, dynamic batch sizes, and more Dionysus 2024-01-27 01:13:11 -0500
  • b14038a335
         Updated mirrors Dionysus 2024-01-20 21:37:27 -0500
  • 3ff233a991
         Updated README, fixed issue using the wrong domain in records for zone file ingestion (woops) Dionysus 2024-01-20 10:53:55 -0500
  • 14b6d1c88a
         Initial commit Dionysus 2024-01-20 02:04:50 -0500